-- Logs begin at Sun 2022-09-11 00:10:41 UTC, end at Sun 2022-09-11 03:15:05 UTC. -- Sep 11 00:46:04.026910 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Sep 11 00:46:04.034070 n-d-master-1 devstack@keystone.service[81845]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 11 00:46:04.036049 n-d-master-1 devstack@keystone.service[81845]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 00:46:04 2022] *** Sep 11 00:46:04.036049 n-d-master-1 devstack@keystone.service[81845]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 00:46:04.036049 n-d-master-1 devstack@keystone.service[81845]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 00:46:04.036049 n-d-master-1 devstack@keystone.service[81845]: nodename: n-d-master-1 Sep 11 00:46:04.036049 n-d-master-1 devstack@keystone.service[81845]: machine: x86_64 Sep 11 00:46:04.036049 n-d-master-1 devstack@keystone.service[81845]: clock source: unix Sep 11 00:46:04.036049 n-d-master-1 devstack@keystone.service[81845]: pcre jit disabled Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: detected number of CPU cores: 4 Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: current working directory: / Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: detected binary path: /usr/bin/uwsgi-core Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: your processes number limit is 47680 Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: your memory page size is 4096 bytes Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: detected max file descriptor number: 2048 Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: lock engine: pthread robust mutexes Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: thunder lock: enabled Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 11 00:46:04.036507 n-d-master-1 devstack@keystone.service[81845]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 00:46:04.078442 n-d-master-1 devstack@keystone.service[81845]: Python main interpreter initialized at 0x559246f7b9c0 Sep 11 00:46:04.078442 n-d-master-1 devstack@keystone.service[81845]: python threads support enabled Sep 11 00:46:04.078442 n-d-master-1 devstack@keystone.service[81845]: your server socket listen backlog is limited to 100 connections Sep 11 00:46:04.078442 n-d-master-1 devstack@keystone.service[81845]: your mercy for graceful operations on workers is 90 seconds Sep 11 00:46:04.078854 n-d-master-1 devstack@keystone.service[81845]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 00:46:04.078938 n-d-master-1 devstack@keystone.service[81845]: *** Operational MODE: preforking *** Sep 11 00:46:04.079166 n-d-master-1 devstack@keystone.service[81845]: *** uWSGI is running in multiple interpreter mode *** Sep 11 00:46:04.079166 n-d-master-1 devstack@keystone.service[81845]: spawned uWSGI master process (pid: 81845) Sep 11 00:46:04.079432 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Sep 11 00:46:04.081015 n-d-master-1 devstack@keystone.service[81845]: spawned uWSGI worker 1 (pid: 81859, cores: 1) Sep 11 00:46:04.081015 n-d-master-1 devstack@keystone.service[81845]: spawned uWSGI worker 2 (pid: 81860, cores: 1) Sep 11 00:46:04.081015 n-d-master-1 devstack@keystone.service[81845]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 00:46:08.390490 n-d-master-1 devstack@keystone.service[81859]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:08.390490 n-d-master-1 devstack@keystone.service[81859]: from cryptography.utils import int_from_bytes Sep 11 00:46:08.391297 n-d-master-1 devstack@keystone.service[81859]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:08.391297 n-d-master-1 devstack@keystone.service[81859]: from cryptography.utils import int_from_bytes Sep 11 00:46:08.391975 n-d-master-1 devstack@keystone.service[81860]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:08.391975 n-d-master-1 devstack@keystone.service[81860]: from cryptography.utils import int_from_bytes Sep 11 00:46:08.392532 n-d-master-1 devstack@keystone.service[81860]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:46:08.392532 n-d-master-1 devstack@keystone.service[81860]: from cryptography.utils import int_from_bytes Sep 11 00:46:08.440492 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:46:08.440659 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:46:08.440852 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] command line args: [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:46:08.441140 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:46:08.441315 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ================================================================================ {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:46:08.441565 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] admin_token = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.441806 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] config_dir = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.441987 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.442161 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] config_source = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.442334 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] debug = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.442416 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:46:08.442526 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.443789 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:46:08.443789 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] command line args: [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:46:08.443912 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.443974 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:46:08.444037 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444100 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ================================================================================ {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:46:08.444163 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444225 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] admin_token = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444282 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444343 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] config_dir = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444400 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] list_limit = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444473 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444537 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] log_config_append = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444599 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] config_source = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444660 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444723 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] debug = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444785 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] log_dir = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444851 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.444935 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] log_file = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445002 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445084 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445146 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445218 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445282 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445340 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445395 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445450 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445513 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] list_limit = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445577 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445641 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] log_config_append = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445697 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445754 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445814 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.445881 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] log_dir = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446173 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446249 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] log_file = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446308 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446414 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446497 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446623 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446702 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446815 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446912 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.446994 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.447129 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.447216 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.447293 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.447364 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.447538 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.447635 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.447784 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448018 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448132 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448244 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448386 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] publish_errors = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448509 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448626 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448743 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448853 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.448853 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449099 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449229 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449348 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449467 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449583 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449701 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] standard_threads = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449817 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.449936 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450049 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450176 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] publish_errors = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450299 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450299 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] use_journal = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450509 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450625 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] use_json = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450742 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450850 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] use_stderr = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.450965 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.451076 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] use_syslog = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.451191 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.451303 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.451413 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.451586 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.451701 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] standard_threads = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.451812 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.451928 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.452044 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.452156 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.452274 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.452385 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.452385 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] use_journal = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.452605 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.452722 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] use_json = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.452833 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.452951 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] use_stderr = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.453098 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.453219 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] use_syslog = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.453330 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.453440 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:46:08.453599 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.453729 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.453844 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.453961 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.454072 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.454188 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.454306 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.454429 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.454556 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.455249 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.455412 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.455548 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.455676 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.455828 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.455977 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.456125 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.456125 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.456436 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.456436 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.456667 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.456788 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.456906 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457017 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457161 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457161 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457380 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457492 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457608 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457725 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457725 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.457941 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458131 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458131 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458344 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458455 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458565 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458694 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458694 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.458912 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459023 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459133 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459249 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459249 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459479 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459590 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459706 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459818 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.459818 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460037 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460149 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460260 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460370 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460507 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460622 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460744 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.460945 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.461099 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.461225 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.461371 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.461488 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.461687 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.461802 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.461919 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.462105 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.462222 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.462379 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.462502 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.462614 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.462827 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.462943 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.463061 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.463171 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.463289 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.463491 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.463606 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.463717 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.463892 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.464014 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.464203 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.464317 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.464427 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.464627 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.464742 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.464859 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.465127 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.465258 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.465371 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.465528 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.465645 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.465800 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.465984 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.466101 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.466263 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.466378 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.466489 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.466726 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.466849 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.466962 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.467182 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.467297 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.467434 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.467589 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.467713 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.467895 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.468009 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.468153 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.468373 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.468490 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.468610 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.468830 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.468945 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.469069 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.469320 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.469476 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.469663 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.469849 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.470026 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.470200 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.470381 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.470570 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.470745 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.470926 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.471085 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.471262 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.471442 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.471615 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.471793 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.471981 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.472156 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.472335 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.472515 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.472690 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.472872 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.473106 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.473301 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.473477 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.473656 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.473851 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.474036 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.474222 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.474404 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.474542 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.474657 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.474771 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.474883 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475003 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475124 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475244 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475356 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475500 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475662 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475818 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.475918 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476011 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476104 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476197 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476291 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476291 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476511 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476623 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476623 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476806 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.476902 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477003 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477162 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477239 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477340 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477340 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477531 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477655 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477655 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477864 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477974 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.477974 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.478161 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.478348 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.478468 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.478468 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.478676 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.478777 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.478894 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479014 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479124 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479234 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479344 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479453 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479563 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479673 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479790 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] auth.external = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.479899 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480009 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480119 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480228 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480340 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480459 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480570 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480682 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] auth.password = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480791 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.480901 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] auth.token = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481002 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481149 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481265 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481377 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481489 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481600 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481747 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481869 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.481985 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482104 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482218 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482337 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482337 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482549 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482660 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] credential.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482780 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.482901 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483015 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483133 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483253 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483365 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483484 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483603 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483716 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483828 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.483939 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484051 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484171 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] auth.external = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484285 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484397 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484508 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484620 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484732 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484851 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.484965 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.485128 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] auth.password = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.485243 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.485366 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] auth.token = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.485480 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.485601 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.485715 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.486341 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.486464 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.486567 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.486687 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.486794 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.486890 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.486985 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487080 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487180 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487180 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487368 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487464 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] credential.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487559 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487654 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487749 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487843 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.487945 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488041 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488144 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488241 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488336 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488431 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488533 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488630 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488730 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488835 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.488930 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489024 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489160 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489267 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489363 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489457 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489551 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489551 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489733 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489835 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.489928 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490045 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490159 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490280 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490396 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490509 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490629 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490743 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490855 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.490975 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491090 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491209 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491323 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491436 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491548 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491729 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491844 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.491956 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492069 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492183 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492296 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492416 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492531 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492644 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492756 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492869 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.492981 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493146 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493263 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493376 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493489 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493602 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493602 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493819 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.493933 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494052 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494166 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494166 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494377 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494499 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494613 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494735 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494850 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.494991 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.495108 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.495229 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.495441 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.495560 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.495672 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.495829 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.495947 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.496139 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.496255 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.496388 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.496603 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.496721 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.496837 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.496998 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.497157 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.497307 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.497423 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.497535 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.497735 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.497865 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.497980 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.498091 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.498356 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.498473 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.498614 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.498823 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.498942 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.499088 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.499203 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.499316 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.499569 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.499692 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.499809 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.499947 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.500065 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.500266 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.500382 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.500503 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.500714 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.500832 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.500945 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.501102 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.501235 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.501474 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.502281 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.502449 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.502674 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.502855 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.502997 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503113 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503113 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503325 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503439 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503439 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503662 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503777 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.503890 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504003 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504115 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504226 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504347 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504461 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504580 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504761 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.504887 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.505003 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.505236 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.505357 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.505470 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.505581 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.505723 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.505961 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.506089 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.506204 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.506346 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.506463 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.506640 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.506755 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.506877 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.507057 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.507176 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.507346 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.507462 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.507603 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.507766 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.507885 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508068 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508190 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508304 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508482 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508608 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508751 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508867 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.508981 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.509270 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.509411 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.509539 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.509726 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.509843 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.509956 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.510139 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.510259 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.510437 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.510554 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.510668 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.510841 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.510947 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.511192 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.511320 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.511419 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.511847 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.511956 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.512103 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.512206 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.512345 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.512561 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.512665 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] role.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.512817 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] role.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.512920 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.513050 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.513299 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.513407 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.513559 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.513663 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.513809 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.514061 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.514174 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.514308 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.514413 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.514555 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.514788 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.514892 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.515040 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.515170 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.515274 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.515510 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.515614 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.515760 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.515882 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.516009 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.516228 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.516346 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.516590 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.516719 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.516901 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.517017 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.517221 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.517393 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.517515 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.517694 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.517814 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.517927 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.518073 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.518192 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.518403 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.518528 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.518644 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.518813 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.518930 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.519102 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.519218 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.519414 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.519554 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.519673 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.519786 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.519898 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.520046 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.520279 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.520398 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.520515 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.520627 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.520741 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.520961 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.521108 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.521227 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.521373 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.521491 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.521683 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.521800 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.521970 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.522090 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.522204 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.522397 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.522513 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.522626 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.522795 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.522916 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.523101 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.523217 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.523350 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.523526 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.523645 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.523817 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.523933 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.524047 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.524258 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.524376 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.524545 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.524662 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.524775 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.524968 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.525149 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.525289 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.525400 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.525551 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.connection = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.525746 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.525851 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.526033 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.526153 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.526278 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.526450 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.526555 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.526719 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.526869 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527002 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527134 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527281 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527418 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527558 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527688 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527828 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.527967 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528107 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528205 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528299 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528299 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528475 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528569 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528742 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528847 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.528984 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.529130 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.529235 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.529471 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.530124 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.530257 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.530257 n-d-master-1 devstack@keystone.service[81860]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:46:08.530547 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] role.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.530547 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] role.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.530547 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.530991 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.530991 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.531300 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.531590 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.531972 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.532350 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.532755 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.533207 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.533582 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.533836 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.534132 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.534384 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.534756 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.535401 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.535767 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.536172 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.536608 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.536890 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.537202 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.537443 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.537771 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.538159 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.538526 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.538879 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.539245 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.539635 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.540019 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.540382 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.540635 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.540871 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.541129 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.541364 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.541599 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.541834 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.542081 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.542314 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.542568 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.542814 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.543048 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.543289 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.543529 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.543773 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.544009 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.544245 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.544477 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.544720 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.544994 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.545246 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.545485 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.545748 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.546004 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.connection = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.546243 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.546487 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.546721 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.546957 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.547188 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.547422 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.547654 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.547888 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.548130 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.548895 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.549165 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.549399 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.549643 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.549874 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.550118 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.550342 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.550578 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.550809 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:46:08.550974 n-d-master-1 devstack@keystone.service[81859]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:46:08.559590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.559823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.560048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.569175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.576049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.576828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.576828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.584987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.600414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.600680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.603335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.603648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.657282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.657443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.706329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.706554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.707705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.707943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.863649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.863867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.863958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.864949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.887496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.887726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.887946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.888869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.889011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.889254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.899607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.900535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.912684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.912858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.913998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81859) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.914137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.914354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.914569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.914785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81860) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:46:08.930777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.930879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.930987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:46:08.931083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:46:08.931335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.931426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.931536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:46:08.931618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:46:08.931814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.931894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.932070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.932151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.932328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.932409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.932580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.932658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.942737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.942838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.943015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.943097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.943289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.943384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.943567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.943648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.950460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.950550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.953361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.953524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.953648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.953729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.953906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.953987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.954183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.954265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.954462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.954543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.955284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.955462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.955540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.955614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.955840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.955921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.956113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.956196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.956383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.956462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.956648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.956728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.979221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.979358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.980667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.980842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.980949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.981161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.985452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.985732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.985945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.986084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.986232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.986636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.992421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.992704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.993081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.993377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.996616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.996903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.997212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.997497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.997772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.998964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:08.999262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.999556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.999674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.999845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:08.999958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.000124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.000236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.000401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.000675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.000948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.016468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.016745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.017155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.017938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.021128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.021757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.024126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.024416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.024937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.025267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.028631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.029432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.031689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.032532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.034870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.035167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.035451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.035733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.035813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.036098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.036186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.036380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.036461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.036670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.036956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.037295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.051857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.052140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.052409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.052671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.053071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.053369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.053641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.053905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.059366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.060733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.061002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.062318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.062547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.062822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.063840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.064631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.065971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.066250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.066528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.066807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.067093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.067402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.067695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.067978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.068262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.068650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.078211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.078490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.078767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.079044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.079320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.079611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.079951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.080034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.080303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.080598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.080884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.081296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.081583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.081873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.097308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.097921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.100288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.100837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.103140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.103765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.104571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.105238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.106026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.106304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.106592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.106693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.106977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.107379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.113284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.113849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.114746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.115291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.117597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.117886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.118171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.118250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.118447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.118579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.118867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.119143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.126281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.127095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.127533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.127645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.127826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.128109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.134365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81859) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.134647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.134930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.135010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81860) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:46:09.135203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.135292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.135481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.135570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.135746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.135828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.136015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.136097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.136288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.136379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.136552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.136892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.137984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.138188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.138267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81859) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.138456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.138741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81860) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:46:09.172058 n-d-master-1 devstack@keystone.service[81859]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559246f7b9c0 pid: 81859 (default app) Sep 11 00:46:09.173194 n-d-master-1 devstack@keystone.service[81860]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559246f7b9c0 pid: 81860 (default app) Sep 11 00:46:09.175949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe87e-81d1-4d22-8d6d-460c3a5f59d1 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:09.176232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe87e-81d1-4d22-8d6d-460c3a5f59d1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:09.176500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe87e-81d1-4d22-8d6d-460c3a5f59d1 None None] PATH_INFO: `/v3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:09.180563 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sun Sep 11 00:46:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:15.989023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f61d-5de0-45b9-8261-96c002f738eb None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:15.989534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f61d-5de0-45b9-8261-96c002f738eb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:15.989654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f61d-5de0-45b9-8261-96c002f738eb None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:15.993864 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:15.999223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:15.999669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:15.999806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:16.070999 n-d-master-1 devstack@keystone.service[81859]: INFO dbcounter [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] Registered counter for database keystone Sep 11 00:46:16.090494 n-d-master-1 devstack@keystone.service[81859]: DEBUG oslo_db.sqlalchemy.engines [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:46:16.097397 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writer thread running {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:46:16.274381 n-d-master-1 devstack@keystone.service[81859]: DEBUG passlib.handlers.bcrypt [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81859) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 00:46:16.274692 n-d-master-1 devstack@keystone.service[81859]: DEBUG passlib.handlers.bcrypt [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81859) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 00:46:16.332344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:16.333943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:16.458656 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 00:46:16.915486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f61d-5de0-45b9-8261-96c002f738eb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:16.983507 n-d-master-1 devstack@keystone.service[81860]: INFO dbcounter [None req-f216f61d-5de0-45b9-8261-96c002f738eb None None] Registered counter for database keystone Sep 11 00:46:17.004627 n-d-master-1 devstack@keystone.service[81860]: DEBUG oslo_db.sqlalchemy.engines [None req-f216f61d-5de0-45b9-8261-96c002f738eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:46:17.010817 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writer thread running {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:46:17.128439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f61d-5de0-45b9-8261-96c002f738eb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:17.132694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c82c15-fa9b-49f9-90ed-62dd32012b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:17.133327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82c15-fa9b-49f9-90ed-62dd32012b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:17.133605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82c15-fa9b-49f9-90ed-62dd32012b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:17.133872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82c15-fa9b-49f9-90ed-62dd32012b41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:17.142226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c82c15-fa9b-49f9-90ed-62dd32012b41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:17.195260 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.common.rbac_enforcer.enforcer [None req-01c82c15-fa9b-49f9-90ed-62dd32012b41 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 00:46:17.195542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c82c15-fa9b-49f9-90ed-62dd32012b41 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:17.204724 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 11 00:46:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:46:17.211042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:17.228006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd163e5a-85c2-40c6-ab23-db3759859a25 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:17.232399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83658773-d731-430e-859b-73a44ca27837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:17.233516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83658773-d731-430e-859b-73a44ca27837 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:17.233796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83658773-d731-430e-859b-73a44ca27837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:17.234071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83658773-d731-430e-859b-73a44ca27837 admin admin] PATH_INFO: `/v3/projects/677f08d32cea40f083b85bb0df613dd0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:17.235611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83658773-d731-430e-859b-73a44ca27837 admin admin] RBAC: Authorizing `identity:get_project(project_id=677f08d32cea40f083b85bb0df613dd0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:17.289001 n-d-master-1 devstack@keystone.service[81859]: WARNING keystone.common.rbac_enforcer.enforcer [None req-83658773-d731-430e-859b-73a44ca27837 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 00:46:17.289363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83658773-d731-430e-859b-73a44ca27837 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:17.293796 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sun Sep 11 00:46:17 2022] GET /identity/v3/projects/677f08d32cea40f083b85bb0df613dd0 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:19.411422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199456-db99-4b85-aea2-15ae0e075c0a None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:19.412042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199456-db99-4b85-aea2-15ae0e075c0a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:19.412042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199456-db99-4b85-aea2-15ae0e075c0a None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:19.415995 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:19.421400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d757c6-4294-480d-9215-1492fce10d63 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:19.421822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d757c6-4294-480d-9215-1492fce10d63 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:19.421981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d757c6-4294-480d-9215-1492fce10d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:19.446764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-52d757c6-4294-480d-9215-1492fce10d63 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:19.448273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-52d757c6-4294-480d-9215-1492fce10d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:19.456208 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 11 00:46:19.749957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199456-db99-4b85-aea2-15ae0e075c0a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:19.762055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199456-db99-4b85-aea2-15ae0e075c0a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:19.766471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0f230-cffa-4692-aa0e-e24a01029586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:19.767057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0f230-cffa-4692-aa0e-e24a01029586 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:19.767331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0f230-cffa-4692-aa0e-e24a01029586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:19.767599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0f230-cffa-4692-aa0e-e24a01029586 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:19.775613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0f230-cffa-4692-aa0e-e24a01029586 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:19.777395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0f230-cffa-4692-aa0e-e24a01029586 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:19.786488 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 11 00:46:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:46:19.791735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d757c6-4294-480d-9215-1492fce10d63 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:19.800993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d757c6-4294-480d-9215-1492fce10d63 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:19.805477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac8920-e2b4-4c8e-9abe-f631efd0dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:19.806103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8920-e2b4-4c8e-9abe-f631efd0dd76 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:19.806384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8920-e2b4-4c8e-9abe-f631efd0dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:19.806658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac8920-e2b4-4c8e-9abe-f631efd0dd76 admin admin] PATH_INFO: `/v3/users/f315e7427b614b24bed4c1fa5addb708` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:19.808342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8920-e2b4-4c8e-9abe-f631efd0dd76 admin admin] RBAC: Authorizing `identity:get_user(user_id=f315e7427b614b24bed4c1fa5addb708)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:19.810196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac8920-e2b4-4c8e-9abe-f631efd0dd76 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:19.811693 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sun Sep 11 00:46:19 2022] GET /identity/v3/users/f315e7427b614b24bed4c1fa5addb708 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:22.032800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409bc8-6424-4d5a-aabd-8082bc9abd8a None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.033358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409bc8-6424-4d5a-aabd-8082bc9abd8a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.033358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409bc8-6424-4d5a-aabd-8082bc9abd8a None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.034871 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:22.039910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.040089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e510a-8d04-4030-b822-24695e12e7e5 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.040489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.040584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e510a-8d04-4030-b822-24695e12e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.040681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.040762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e510a-8d04-4030-b822-24695e12e7e5 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.041956 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:22.046798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992bb9-5b46-4cd5-a265-e8c829a13d80 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.047080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992bb9-5b46-4cd5-a265-e8c829a13d80 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.047349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992bb9-5b46-4cd5-a265-e8c829a13d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.065540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b0992bb9-5b46-4cd5-a265-e8c829a13d80 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:22.066704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b0992bb9-5b46-4cd5-a265-e8c829a13d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:22.083881 n-d-master-1 devstack@keystone.service[81860]: DEBUG passlib.handlers.bcrypt [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81860) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 00:46:22.084264 n-d-master-1 devstack@keystone.service[81860]: DEBUG passlib.handlers.bcrypt [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81860) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 00:46:22.133430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:22.135119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:22.146144 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:22.233960 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:22.412394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992bb9-5b46-4cd5-a265-e8c829a13d80 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:22.437224 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:22.503638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:22.518526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992bb9-5b46-4cd5-a265-e8c829a13d80 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:22.553115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:22.553755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.554030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.554298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.605428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67cfc4-672b-46a2-a89e-31c921312991 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:22.607834 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:22.620708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:22.622257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:22.643699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:22.644792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.645085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.645370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.645904 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:22.657591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:22.666779 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:22.667874 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:22.668915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:22.673706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:22.720868 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:22.726804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:22.773627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dc05c-e02e-4ae7-8225-563d804e457f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:22.806849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:22.807440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.807718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.807988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.808637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:22.808941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:22.810379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:22.822128 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:22.822902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381fe0f-40b9-48db-97be-5c2e53ff8d30 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:22.827758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:22.845750 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:22.855750 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:22.858292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:22.858924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.859202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.859472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.869722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:22.871186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:22.889813 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:22.890726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:22.891554 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:22.891554 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:22.891554 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:22.891554 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:22.897229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:22.928522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5732a9-d98d-464f-ad7a-3a5ebff336c5 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:22.962621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:22.963244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:22.963528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:22.963799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] PATH_INFO: `/v3/users/f315e7427b614b24bed4c1fa5addb708` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:22.965313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] RBAC: Authorizing `identity:get_user(user_id=f315e7427b614b24bed4c1fa5addb708)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:22.966759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:22.968334 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:22 2022] GET /identity/v3/users/f315e7427b614b24bed4c1fa5addb708 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:22.974317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:22.996070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7c350-a8b2-4241-a259-3ae284a32c66 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:23.034161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:23.034768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:23.035046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:23.035344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:23.035982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:23.036286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:23.037704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:23.054337 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:23.072913 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:23.081495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc79b1-a8b3-49fd-bb91-0f55e4b10a57 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:23.117756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd688976-aa9b-471d-830d-016c800695df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:23.118403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd688976-aa9b-471d-830d-016c800695df None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:23.118682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd688976-aa9b-471d-830d-016c800695df None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:23.118958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd688976-aa9b-471d-830d-016c800695df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:23.120116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd688976-aa9b-471d-830d-016c800695df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:23.121635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd688976-aa9b-471d-830d-016c800695df None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:23.123257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:23.130064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:23.165936 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:23.238605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a9042-9833-488e-96fb-dc6748dd5892 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:23.273583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4f868-a936-4eb3-b349-502a5c058f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:23.274192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f868-a936-4eb3-b349-502a5c058f40 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:23.274471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f868-a936-4eb3-b349-502a5c058f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:23.274746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4f868-a936-4eb3-b349-502a5c058f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:23.275479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f868-a936-4eb3-b349-502a5c058f40 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.domain.id=default, user.id=f315e7427b614b24bed4c1fa5addb708) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:23.275795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f868-a936-4eb3-b349-502a5c058f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:23.277250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4f868-a936-4eb3-b349-502a5c058f40 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:23.284425 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 11 00:46:23 2022] GET /identity/v3/role_assignments?user.id=f315e7427b614b24bed4c1fa5addb708&scope.domain.id=default&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:25.939448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6c567-d52c-428e-85a1-9f2b81813776 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:25.939959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6c567-d52c-428e-85a1-9f2b81813776 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:25.940076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6c567-d52c-428e-85a1-9f2b81813776 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:25.941384 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:25.946682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95e90e-888d-4407-9321-4a902143cd15 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:25.947109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95e90e-888d-4407-9321-4a902143cd15 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:25.947281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95e90e-888d-4407-9321-4a902143cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:25.974033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8a95e90e-888d-4407-9321-4a902143cd15 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:25.975229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8a95e90e-888d-4407-9321-4a902143cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:25.979889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349df0c-fce8-4632-a5c4-dbcf2a44c504 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:25.980195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349df0c-fce8-4632-a5c4-dbcf2a44c504 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:25.980429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349df0c-fce8-4632-a5c4-dbcf2a44c504 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:25.981762 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 12/23] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:25.987755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9ac7b-a4ed-4c36-b7db-f3ec42f43303 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:25.988037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9ac7b-a4ed-4c36-b7db-f3ec42f43303 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:25.988493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9ac7b-a4ed-4c36-b7db-f3ec42f43303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:26.028780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d8b9ac7b-a4ed-4c36-b7db-f3ec42f43303 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:26.030542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d8b9ac7b-a4ed-4c36-b7db-f3ec42f43303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:26.119411 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:26.123264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ee48d-1e3a-43b7-91cc-99c3274005df None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:26.124462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ee48d-1e3a-43b7-91cc-99c3274005df None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:26.125136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ee48d-1e3a-43b7-91cc-99c3274005df None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:26.128654 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:26.135737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb10a17-f05e-4485-aeef-b9b4552e3d2c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:26.136152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb10a17-f05e-4485-aeef-b9b4552e3d2c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:26.136556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb10a17-f05e-4485-aeef-b9b4552e3d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:26.162113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7bb10a17-f05e-4485-aeef-b9b4552e3d2c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:26.163302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7bb10a17-f05e-4485-aeef-b9b4552e3d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:26.172913 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:26.195043 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:26.259458 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:26.469672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9ac7b-a4ed-4c36-b7db-f3ec42f43303 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:26.542484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168db07b-70d1-4efc-8364-9c2d50cc50f8 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:26.542761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168db07b-70d1-4efc-8364-9c2d50cc50f8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:26.543041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168db07b-70d1-4efc-8364-9c2d50cc50f8 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:26.544367 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:26.563152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4687da-648c-49c6-ac27-7bd5fba49e15 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:26.563443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4687da-648c-49c6-ac27-7bd5fba49e15 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:26.563720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4687da-648c-49c6-ac27-7bd5fba49e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:26.589859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0d4687da-648c-49c6-ac27-7bd5fba49e15 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:26.591058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d4687da-648c-49c6-ac27-7bd5fba49e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:26.600402 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:26.617053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9ac7b-a4ed-4c36-b7db-f3ec42f43303 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:26.657263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:26.657868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:26.658143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:26.658620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:26.659790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:26.661177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:26.754375 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:26.755192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4687da-648c-49c6-ac27-7bd5fba49e15 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:26.842350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 14/30] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 00:46:26 2022] POST /identity/v3/roles => generated 225 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:26.843367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:26.882195 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:26.903984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4687da-648c-49c6-ac27-7bd5fba49e15 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:26.997975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:26.998618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:26.998841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:26.999112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:26.999773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:27.001175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:27.098728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe93d4-7daf-4b3b-88bd-1994f57fb369 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:27.178548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:27.179195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.179473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.179743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.193939 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 17/31] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 00:46:26 2022] POST /identity/v3/roles => generated 219 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:27.194808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.214120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:27.215849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:27.247989 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:27.249526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:27.250339 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:27.250339 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:27.250339 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:27.252589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 15/32] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:27.257278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.270451 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:27.371510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65ccb-ab39-484b-8787-19e534bdfd68 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:27.422606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c229d-0973-4287-848a-b9d1ef281b08 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:27.423084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f5d8b-02ba-4e1d-aec1-942a5cba77aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:27.423728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d8b-02ba-4e1d-aec1-942a5cba77aa None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.424014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d8b-02ba-4e1d-aec1-942a5cba77aa None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.424791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d8b-02ba-4e1d-aec1-942a5cba77aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.439213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f5d8b-02ba-4e1d-aec1-942a5cba77aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-616f5d8b-02ba-4e1d-aec1-942a5cba77aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:27.445408 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:27.446268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:27.447014 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 18/33] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:27.447798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd54ed-af0b-49c3-81bd-2b6f6fcc51a6 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.448080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd54ed-af0b-49c3-81bd-2b6f6fcc51a6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.448359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd54ed-af0b-49c3-81bd-2b6f6fcc51a6 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.453861 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 19/34] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:27.454939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f93001-4dcc-477c-b6c5-db74741d9776 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.455284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f93001-4dcc-477c-b6c5-db74741d9776 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.456090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f93001-4dcc-477c-b6c5-db74741d9776 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.457381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 20/35] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:27.458081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f93001-4dcc-477c-b6c5-db74741d9776 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.464003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd75a-e54d-4376-b20c-63ee5878c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:27.464639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd75a-e54d-4376-b20c-63ee5878c863 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.464927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd75a-e54d-4376-b20c-63ee5878c863 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.465244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd75a-e54d-4376-b20c-63ee5878c863 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.465906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcd75a-e54d-4376-b20c-63ee5878c863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:27.466213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcd75a-e54d-4376-b20c-63ee5878c863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:27.467601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcd75a-e54d-4376-b20c-63ee5878c863 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:27.474147 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:27.487963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 16/36] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:27.489474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49775bc8-8816-4bb5-993c-f2171cc463b3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.489758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49775bc8-8816-4bb5-993c-f2171cc463b3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.490033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49775bc8-8816-4bb5-993c-f2171cc463b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.508233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-49775bc8-8816-4bb5-993c-f2171cc463b3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:27.509778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-49775bc8-8816-4bb5-993c-f2171cc463b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:27.569691 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:27.570612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f93001-4dcc-477c-b6c5-db74741d9776 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:27.579051 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 17/37] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:27.581505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892eb1a-4f26-4599-a1ec-d29ab3ae54b6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.581801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892eb1a-4f26-4599-a1ec-d29ab3ae54b6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.582073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892eb1a-4f26-4599-a1ec-d29ab3ae54b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.605307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:27.605474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b892eb1a-4f26-4599-a1ec-d29ab3ae54b6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:27.605931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.606201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.606479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.606646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b892eb1a-4f26-4599-a1ec-d29ab3ae54b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:27.607142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:27.607449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:27.608948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:27.621606 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 21/38] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:27.626593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.678773 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 18/39] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:27.680177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892eb1a-4f26-4599-a1ec-d29ab3ae54b6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.698200 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:27.738280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8c376-7439-4042-8cb0-4f86aeef69ed None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:27.774238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:27.774757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.775143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.775481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.776212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:27.777769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:27.813374 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 22/40] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:46:27 2022] POST /identity/v3/projects => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:27.825821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892eb1a-4f26-4599-a1ec-d29ab3ae54b6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:27.855175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.856522 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:27.874059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:27.875265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.875687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.876201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] PATH_INFO: `/v3/users/f315e7427b614b24bed4c1fa5addb708` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.878331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] RBAC: Authorizing `identity:get_user(user_id=f315e7427b614b24bed4c1fa5addb708)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:27.880261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:27.882810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 19/41] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:27 2022] GET /identity/v3/users/f315e7427b614b24bed4c1fa5addb708 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:27.891764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.020342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea988c6-164a-424f-9d10-ca431e8c9180 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.061393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.062029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.062686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.062686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.063958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.066172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.072424 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 20/42] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:28.072424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.090949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c24473-b126-4017-972f-a33b9f919ade None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.113745 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.126061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.126606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.126888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.127169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.128509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.130070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.134537 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.145925 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 23/43] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 00:46:27 2022] POST /identity/v3/roles => generated 223 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:46:28.146717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.187434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d3613-6aa4-4a0e-886d-30f88784e2ce None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.233330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.234001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.234288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.234566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.235905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.238682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.245174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 21/44] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:28.247424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.266483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b56858-102d-4029-9814-0357d5f4fb23 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.308082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048226-4bc9-498f-a2f2-d7e439ed1e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.309240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048226-4bc9-498f-a2f2-d7e439ed1e82 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.309665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048226-4bc9-498f-a2f2-d7e439ed1e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.310107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048226-4bc9-498f-a2f2-d7e439ed1e82 None admin] PATH_INFO: `/v3/domains/default/users/f315e7427b614b24bed4c1fa5addb708/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.312546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048226-4bc9-498f-a2f2-d7e439ed1e82 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f315e7427b614b24bed4c1fa5addb708, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.314323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048226-4bc9-498f-a2f2-d7e439ed1e82 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.334504 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 24/45] 10.222.0.16 () {58 vars in 1361 bytes} [Sun Sep 11 00:46:28 2022] PUT /identity/v3/domains/default/users/f315e7427b614b24bed4c1fa5addb708/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:46:28.382710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa334b-f90e-47f6-a63d-15d0161d504c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.417463 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.427291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546389e-bf69-4b27-83dc-0e042f87ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.427948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546389e-bf69-4b27-83dc-0e042f87ce7f None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.428239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546389e-bf69-4b27-83dc-0e042f87ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.428515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546389e-bf69-4b27-83dc-0e042f87ce7f None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.429221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546389e-bf69-4b27-83dc-0e042f87ce7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.430694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546389e-bf69-4b27-83dc-0e042f87ce7f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.461281 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:46:28 2022] POST /identity/v3/projects => generated 312 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:30.499768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d60-d876-469c-926f-a462f4887c52 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:30.500322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d60-d876-469c-926f-a462f4887c52 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:30.500322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d60-d876-469c-926f-a462f4887c52 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:30.501678 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:30.507013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa48fc-8150-4e90-8b88-f6a0f52ade26 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:30.507428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa48fc-8150-4e90-8b88-f6a0f52ade26 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:30.507559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa48fc-8150-4e90-8b88-f6a0f52ade26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:30.526708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-41aa48fc-8150-4e90-8b88-f6a0f52ade26 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:30.527904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-41aa48fc-8150-4e90-8b88-f6a0f52ade26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:30.595810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:30.708924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea648481-ca44-4094-8868-cfba369fe34a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:30.709246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea648481-ca44-4094-8868-cfba369fe34a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:30.709528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea648481-ca44-4094-8868-cfba369fe34a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:30.710896 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 26/49] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:30.716073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba009add-17d8-4038-90b4-0ffa58fe8932 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:30.716359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba009add-17d8-4038-90b4-0ffa58fe8932 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:30.716634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba009add-17d8-4038-90b4-0ffa58fe8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:30.734389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ba009add-17d8-4038-90b4-0ffa58fe8932 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:30.735560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ba009add-17d8-4038-90b4-0ffa58fe8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:30.799324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 24/50] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:30.871617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea648481-ca44-4094-8868-cfba369fe34a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:30.915961 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:30.973299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea648481-ca44-4094-8868-cfba369fe34a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:31.005822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:31.006445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.006726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.006995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.016944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:31.022654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:31.023489 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:31.024239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:31.025421 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 27/51] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:31.029456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba009add-17d8-4038-90b4-0ffa58fe8932 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:31.068888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:31.071780 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:31.131179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba009add-17d8-4038-90b4-0ffa58fe8932 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:31.165527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:31.166132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.166411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.166684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.167350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:31.167649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:31.169032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:31.169943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83470d9f-f1b2-4534-b87b-2d37c89dd789 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:31.171448 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:31.178056 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 25/52] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:31.183737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:31.204990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:31.205647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.206415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.206683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.207952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:31.209425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:31.210982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:31.216343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:31.283314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8efacf-3adc-4473-b435-e15c9a7a2c38 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:31.285507 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:31.313872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc454e85-0f50-43bc-804d-077df0f3256e None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:31.317838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:31.318474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.318783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.319107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] PATH_INFO: `/v3/users/f315e7427b614b24bed4c1fa5addb708` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.320218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f315e7427b614b24bed4c1fa5addb708)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:31.321694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:31.323264 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:31 2022] GET /identity/v3/users/f315e7427b614b24bed4c1fa5addb708 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:31.328746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:31.347638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:31.348242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.348521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.348792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.349469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:31.350905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:31.377224 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 29/55] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 11 00:46:31 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:46:31.436540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeaede-91b8-48ff-b2e6-a6f228b090c9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:31.472379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7536678-c24d-4e45-a8c1-a657fbdcaac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:31.473031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7536678-c24d-4e45-a8c1-a657fbdcaac7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.473337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7536678-c24d-4e45-a8c1-a657fbdcaac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.473603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7536678-c24d-4e45-a8c1-a657fbdcaac7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.474775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7536678-c24d-4e45-a8c1-a657fbdcaac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:31.476224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7536678-c24d-4e45-a8c1-a657fbdcaac7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:31.477855 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 27/56] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:31.483803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:31.511047 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:31.594753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d54f0-c74e-4f20-869e-7e7d6d591566 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:31.628893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bd9e5-56d3-4709-b7fa-1951ef90f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:31.629537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd9e5-56d3-4709-b7fa-1951ef90f646 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:31.629819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd9e5-56d3-4709-b7fa-1951ef90f646 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:31.630092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd9e5-56d3-4709-b7fa-1951ef90f646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:31.630812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd9e5-56d3-4709-b7fa-1951ef90f646 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.domain.id=default, user.id=f315e7427b614b24bed4c1fa5addb708) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:31.631117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd9e5-56d3-4709-b7fa-1951ef90f646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:31.632559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd9e5-56d3-4709-b7fa-1951ef90f646 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:31.638220 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 30/57] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 11 00:46:31 2022] GET /identity/v3/role_assignments?user.id=f315e7427b614b24bed4c1fa5addb708&scope.domain.id=default&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:33.554762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e79d80-cd3d-408a-a269-333c56357bda None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.555243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e79d80-cd3d-408a-a269-333c56357bda None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.555737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e79d80-cd3d-408a-a269-333c56357bda None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.557116 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:33.562399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc526ce-0291-4dde-80e8-d1a99c63df05 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.562796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc526ce-0291-4dde-80e8-d1a99c63df05 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.562944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc526ce-0291-4dde-80e8-d1a99c63df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.582465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9cc526ce-0291-4dde-80e8-d1a99c63df05 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:33.583981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9cc526ce-0291-4dde-80e8-d1a99c63df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:33.648792 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:33.924989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e79d80-cd3d-408a-a269-333c56357bda None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:34.068760 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:34.129413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e79d80-cd3d-408a-a269-333c56357bda None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:34.164421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a94f00-e4a8-481a-8bb9-8a0a1f061e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:34.165044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a94f00-e4a8-481a-8bb9-8a0a1f061e89 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:34.165351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a94f00-e4a8-481a-8bb9-8a0a1f061e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:34.165622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a94f00-e4a8-481a-8bb9-8a0a1f061e89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:34.166717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a94f00-e4a8-481a-8bb9-8a0a1f061e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:34.168156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a94f00-e4a8-481a-8bb9-8a0a1f061e89 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:34.169744 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:34.177404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc526ce-0291-4dde-80e8-d1a99c63df05 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:34.194874 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:34.274620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc526ce-0291-4dde-80e8-d1a99c63df05 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:34.307286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffcdb9-6184-4bd9-a31e-88f46e4fe229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:34.307890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffcdb9-6184-4bd9-a31e-88f46e4fe229 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:34.308172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffcdb9-6184-4bd9-a31e-88f46e4fe229 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:34.308449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffcdb9-6184-4bd9-a31e-88f46e4fe229 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:34.309124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffcdb9-6184-4bd9-a31e-88f46e4fe229 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:34.310551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffcdb9-6184-4bd9-a31e-88f46e4fe229 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:34.336019 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:46:34 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:37.505350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e742f-f607-4fcc-9522-92392194495b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.506406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e742f-f607-4fcc-9522-92392194495b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.506887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e742f-f607-4fcc-9522-92392194495b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.508444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:37.514352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e82fe4-ea6f-4ac5-9259-bdd5452dfe0b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.515225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e82fe4-ea6f-4ac5-9259-bdd5452dfe0b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.515701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e82fe4-ea6f-4ac5-9259-bdd5452dfe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.536977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-04e82fe4-ea6f-4ac5-9259-bdd5452dfe0b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:37.538272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-04e82fe4-ea6f-4ac5-9259-bdd5452dfe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:37.636579 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:37.824535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db825ee-136b-4016-96dd-05fbefef6c46 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.824734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db825ee-136b-4016-96dd-05fbefef6c46 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.825338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db825ee-136b-4016-96dd-05fbefef6c46 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.826948 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 31/64] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:37.833018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f7ed4-e128-46e9-870e-75a00484f747 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.833323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f7ed4-e128-46e9-870e-75a00484f747 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.833599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f7ed4-e128-46e9-870e-75a00484f747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.840825 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:37.858337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9b6f7ed4-e128-46e9-870e-75a00484f747 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:37.859531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9b6f7ed4-e128-46e9-870e-75a00484f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:37.865100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a081546-37d0-4b7f-aa48-3a47242ab379 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.865100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a081546-37d0-4b7f-aa48-3a47242ab379 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.865100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a081546-37d0-4b7f-aa48-3a47242ab379 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.866812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 32/65] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:37.872190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d21d-6b36-4bb6-ae15-4a39e3cd6671 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.872708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d21d-6b36-4bb6-ae15-4a39e3cd6671 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.873232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d21d-6b36-4bb6-ae15-4a39e3cd6671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.899320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1497d21d-6b36-4bb6-ae15-4a39e3cd6671 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:37.901091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1497d21d-6b36-4bb6-ae15-4a39e3cd6671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:37.984418 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:37.987032 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:38.036427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497d21d-6b36-4bb6-ae15-4a39e3cd6671 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.073017 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.160427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497d21d-6b36-4bb6-ae15-4a39e3cd6671 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.210110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.210782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.211065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.211338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.227298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:38.237582 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:38.238595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:38.239365 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:38.245188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f7ed4-e128-46e9-870e-75a00484f747 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.292195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.385336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f7ed4-e128-46e9-870e-75a00484f747 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.402580 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.410245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bfe3-8136-48f6-b654-e02ccf18d841 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.417153 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.423143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.423761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.424039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.424305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.425602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:38.425905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.427543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.438982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:38.439888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.454453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc601-f865-4a39-b64a-5a5996fe596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.455285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc601-f865-4a39-b64a-5a5996fe596b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.455700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc601-f865-4a39-b64a-5a5996fe596b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.456198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc601-f865-4a39-b64a-5a5996fe596b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.466766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bc601-f865-4a39-b64a-5a5996fe596b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e77bc601-f865-4a39-b64a-5a5996fe596b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:38.472688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:38.473731 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:38.474606 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:38.476504 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:38.477916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145c65b-9809-4ec0-8c20-983a0d897a2f None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.478198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145c65b-9809-4ec0-8c20-983a0d897a2f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.478942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145c65b-9809-4ec0-8c20-983a0d897a2f None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.480175 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 36/71] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:38.484896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145c65b-9809-4ec0-8c20-983a0d897a2f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.566539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f51663-21d1-4958-8815-ab616dda7fe3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.602569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145c65b-9809-4ec0-8c20-983a0d897a2f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.603505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.604140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.604441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.604716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.615769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:38.621047 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:38.621996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:38.622749 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:38.623384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.647749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e241b19-cf4b-4ece-b56b-92286018fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.648379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e241b19-cf4b-4ece-b56b-92286018fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.648673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e241b19-cf4b-4ece-b56b-92286018fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.648927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e241b19-cf4b-4ece-b56b-92286018fdc2 None admin] PATH_INFO: `/v3/users/f315e7427b614b24bed4c1fa5addb708` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.650118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e241b19-cf4b-4ece-b56b-92286018fdc2 None admin] RBAC: Authorizing `identity:get_user(user_id=f315e7427b614b24bed4c1fa5addb708)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.651556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e241b19-cf4b-4ece-b56b-92286018fdc2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.653146 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/users/f315e7427b614b24bed4c1fa5addb708 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:38.654235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef0432-9064-45db-86cd-c3ad389daf2e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.654513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef0432-9064-45db-86cd-c3ad389daf2e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.654780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef0432-9064-45db-86cd-c3ad389daf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.672967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d1ef0432-9064-45db-86cd-c3ad389daf2e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:38.674145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d1ef0432-9064-45db-86cd-c3ad389daf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:38.687947 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.692528 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.734321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de9e3c-1877-4957-b977-51b70df1b571 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.743905 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 38/74] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:38.745922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef0432-9064-45db-86cd-c3ad389daf2e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.770508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a33a41-4db9-42e1-8228-ad991ffd1f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.771118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a33a41-4db9-42e1-8228-ad991ffd1f4d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.771401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a33a41-4db9-42e1-8228-ad991ffd1f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.771678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a33a41-4db9-42e1-8228-ad991ffd1f4d None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.772336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a33a41-4db9-42e1-8228-ad991ffd1f4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:38.772641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a33a41-4db9-42e1-8228-ad991ffd1f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.774067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a33a41-4db9-42e1-8228-ad991ffd1f4d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.783000 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:38.789313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110314-5be4-4d41-b664-e385e0de0d5c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.789605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110314-5be4-4d41-b664-e385e0de0d5c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.789924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72110314-5be4-4d41-b664-e385e0de0d5c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.791195 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 38/76] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:38.791925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72110314-5be4-4d41-b664-e385e0de0d5c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.854297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef0432-9064-45db-86cd-c3ad389daf2e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.890576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.891177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.891455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.891732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.892393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:38.892694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.894302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.899478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72110314-5be4-4d41-b664-e385e0de0d5c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.902688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:38.903624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.917783 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.927826 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.942504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.943140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.943421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.943700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.017424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.019553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.022604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2334-cd86-4361-b0b3-7feb149229b8 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.057073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5e3c-752d-4db4-b5a1-ea8804414fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.057727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5e3c-752d-4db4-b5a1-ea8804414fbc None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.058011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5e3c-752d-4db4-b5a1-ea8804414fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.058289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5e3c-752d-4db4-b5a1-ea8804414fbc None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.073236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5e3c-752d-4db4-b5a1-ea8804414fbc None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.074676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5e3c-752d-4db4-b5a1-ea8804414fbc None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.076310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:39.077472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d113-77a7-416e-bc81-571c0cb45772 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.077761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d113-77a7-416e-bc81-571c0cb45772 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.078039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d113-77a7-416e-bc81-571c0cb45772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.095623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c793d113-77a7-416e-bc81-571c0cb45772 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:39.097773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c793d113-77a7-416e-bc81-571c0cb45772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:39.123728 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 39/79] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:39.124743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.141891 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.165678 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:39.166685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793d113-77a7-416e-bc81-571c0cb45772 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.169795 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.240219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a87bb7-e74a-40e9-b649-c9e70e4710f8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.274769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.275393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.275669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.275935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.276191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793d113-77a7-416e-bc81-571c0cb45772 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.277068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.278499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.285710 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 40/81] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:39.285710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.329228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.330223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.330507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.330776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.332950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.334461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.336223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 42/82] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:39.336881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.397552 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.416776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fb42f-8aea-4f29-afeb-d3a66c959e15 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.418625 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.451149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a989-432e-4ee2-a23e-b220c6c66064 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.454538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.455146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.455428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.455705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.486303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.486937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.487217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.487607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.488769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.490307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.491875 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 43/83] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:39.492639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.523588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.525038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.594648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562f1cc-e275-4787-b74e-9d4960175dfe None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.608695 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.625509 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 41/84] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:39.626309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.628997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.629680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.630075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.630490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.649330 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.707910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.709388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.729214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534cf0b-a8db-4778-b15a-0a5d53dcfb99 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.763596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.764382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.764662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.764938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.765623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.767063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.788151 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 42/85] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:46:39 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:39.788974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.821671 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 44/86] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:39.823410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.847489 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.873813 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.918634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ec20-05cd-41ee-9824-e7a9c86be701 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.943988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c0e0-1b23-4bd5-abb5-f344d43d40b9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.956630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.957568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.957845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.958113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.973229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:39.978924 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:39.979894 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:39.980661 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 43/87] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:39.982509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.991523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.992141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.992418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.992694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.993457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=f315e7427b614b24bed4c1fa5addb708) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:39.994459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.995206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:40.003873 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 45/88] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/role_assignments?user.id=f315e7427b614b24bed4c1fa5addb708&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:40.004706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:40.111133 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:40.115875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635639-1ef6-406f-8dae-3580f8c6db50 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:40.138837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd8c4-4eb0-4757-ae20-6162190ee82c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:40.142598 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:40.159277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:40.160313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:40.160800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:40.161331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:40.163891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:40.165768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:40.167714 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 44/89] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:40.168788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:40.180967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:40.181662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:40.181951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:40.182230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:40.183432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:40.184916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:40.186999 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:40 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:40.188319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:40.290141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c67ce4-d743-467c-a3a7-45b419cc57c0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:40.316466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496d952-0ace-4f6e-978e-c933662016ca None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:40.324817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:40.325463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:40.325740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:40.326011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:40.326671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:40.326972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:40.328340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:40.337943 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:40.338864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:40.357549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:40.358420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:40.358703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:40.359369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:40.360112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=2459cbb42d584a5c886610385b44f84c) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:40.360421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:40.363174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:40.370018 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:40 2022] GET /identity/v3/role_assignments?user.id=2459cbb42d584a5c886610385b44f84c&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:40.370847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:40.373907 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:40.450666 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:40.494597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01076-4f24-436e-b45b-14dde59c49f4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:40.538176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:40.538783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:40.539061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:40.539397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:40.540122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] RBAC: Adding query filter params (role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=2459cbb42d584a5c886610385b44f84c) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:40.540431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:40.541894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:40.548394 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:40 2022] GET /identity/v3/role_assignments?user.id=2459cbb42d584a5c886610385b44f84c&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:40.589164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6a8c-82cb-40b2-97bf-c25384bb797d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:40.628582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:40.629147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:40.629676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:40.629676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:40.630893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:40.632369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:40.634466 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:40 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:40.640184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:40.748761 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:40.756578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a56b42-331f-476f-8aa7-0eb4dea0dcda None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:40.799533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:40.800788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:40.801342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:40.801842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:40.900472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:40.901966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:41.027836 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:41.036110 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 47/95] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:41.041979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:41.158806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead885-ea5b-49e9-b395-29c030543026 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:41.161866 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:41.197849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae20647-9947-45dc-a5f0-eee99689706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:41.198492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae20647-9947-45dc-a5f0-eee99689706d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:41.198770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae20647-9947-45dc-a5f0-eee99689706d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:41.199044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae20647-9947-45dc-a5f0-eee99689706d None admin] PATH_INFO: `/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:41.200183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae20647-9947-45dc-a5f0-eee99689706d None admin] RBAC: Authorizing `identity:get_project(project_id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:41.201706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae20647-9947-45dc-a5f0-eee99689706d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:41.203680 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:41 2022] GET /identity/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:41.210003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:41.361810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79bdd-7bbf-4708-a1ca-b6dabb8b714b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:41.415720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819092e-7eaa-4a9e-a2d5-0a0662f1c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:41.416257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819092e-7eaa-4a9e-a2d5-0a0662f1c947 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:41.416531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819092e-7eaa-4a9e-a2d5-0a0662f1c947 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:41.416797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819092e-7eaa-4a9e-a2d5-0a0662f1c947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:41.417540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819092e-7eaa-4a9e-a2d5-0a0662f1c947 None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8, user.id=2459cbb42d584a5c886610385b44f84c) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:41.417843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819092e-7eaa-4a9e-a2d5-0a0662f1c947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:41.419269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819092e-7eaa-4a9e-a2d5-0a0662f1c947 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:41.430010 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:41 2022] GET /identity/v3/role_assignments?user.id=2459cbb42d584a5c886610385b44f84c&scope.project.id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:42.850883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ee27-7e7a-4638-bb08-9e1dd82f8167 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.851364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ee27-7e7a-4638-bb08-9e1dd82f8167 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.851364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54ee27-7e7a-4638-bb08-9e1dd82f8167 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.852817 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:42.858490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41483c0b-ce24-4d3f-97e1-ec46b88968d3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.858903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41483c0b-ce24-4d3f-97e1-ec46b88968d3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.859071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41483c0b-ce24-4d3f-97e1-ec46b88968d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.881053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-41483c0b-ce24-4d3f-97e1-ec46b88968d3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:42.882267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-41483c0b-ce24-4d3f-97e1-ec46b88968d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:42.951990 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:42.966573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:43.302959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3951528-de78-423d-9491-06e2cde0cd53 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.303334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3951528-de78-423d-9491-06e2cde0cd53 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.303508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3951528-de78-423d-9491-06e2cde0cd53 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.304963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 51/100] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:43.310766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a60e-9ced-4831-b9a7-d108d3375521 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.311093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a60e-9ced-4831-b9a7-d108d3375521 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.311324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a60e-9ced-4831-b9a7-d108d3375521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.334354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dbe7a60e-9ced-4831-b9a7-d108d3375521 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:43.335647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dbe7a60e-9ced-4831-b9a7-d108d3375521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:43.423157 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:43.467726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231dbd-d661-4a54-af33-68e490be6107 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.468012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231dbd-d661-4a54-af33-68e490be6107 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.468296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231dbd-d661-4a54-af33-68e490be6107 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.469691 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 52/102] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:43.475575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1104-b765-4cd6-a58e-3fae7524b725 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.475920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1104-b765-4cd6-a58e-3fae7524b725 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.476200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1104-b765-4cd6-a58e-3fae7524b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.495089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c39e1104-b765-4cd6-a58e-3fae7524b725 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:43.496273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c39e1104-b765-4cd6-a58e-3fae7524b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:43.516325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63231dbd-d661-4a54-af33-68e490be6107 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:43.633302 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:43.701868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63231dbd-d661-4a54-af33-68e490be6107 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:43.743231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d008d-4221-4cd6-9062-52913711f418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:43.744257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d008d-4221-4cd6-9062-52913711f418 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.744808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d008d-4221-4cd6-9062-52913711f418 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.745319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d008d-4221-4cd6-9062-52913711f418 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.757522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d008d-4221-4cd6-9062-52913711f418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-489d008d-4221-4cd6-9062-52913711f418 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:43.763265 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:43.764123 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:46:43.765158 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:43.767769 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 53/104] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:43.773269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e1104-b765-4cd6-a58e-3fae7524b725 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:43.817634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce467a4-65dc-4367-b600-7b81b5701954 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.818255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce467a4-65dc-4367-b600-7b81b5701954 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.818723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce467a4-65dc-4367-b600-7b81b5701954 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.820814 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 54/105] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:43.828023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd557-0884-4bdf-8ef6-268177e0b69b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.828536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd557-0884-4bdf-8ef6-268177e0b69b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.829007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd557-0884-4bdf-8ef6-268177e0b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.841222 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:43.862186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f2bdd557-0884-4bdf-8ef6-268177e0b69b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:43.864008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2bdd557-0884-4bdf-8ef6-268177e0b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:43.903276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e1104-b765-4cd6-a58e-3fae7524b725 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:43.928783 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:43.942830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:43.943842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.944407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.944876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.945808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:43.946326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:43.947977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:43.959698 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 52/106] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:43.961025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.026278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:44.027142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd557-0884-4bdf-8ef6-268177e0b69b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.075312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4183a-aa9e-4ec4-82d1-724fee12f374 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.088141 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.114379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73668b7-b6c8-455b-ba52-f8680cf3eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.115324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73668b7-b6c8-455b-ba52-f8680cf3eb9c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.115723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73668b7-b6c8-455b-ba52-f8680cf3eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.116156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73668b7-b6c8-455b-ba52-f8680cf3eb9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.117562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73668b7-b6c8-455b-ba52-f8680cf3eb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.119123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73668b7-b6c8-455b-ba52-f8680cf3eb9c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.120943 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 53/108] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:44.122445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673f66-a95e-4021-b3ab-ec127bb1b9dd None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.122826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673f66-a95e-4021-b3ab-ec127bb1b9dd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.123199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673f66-a95e-4021-b3ab-ec127bb1b9dd None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.124563 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 54/109] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:44.130901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673f66-a95e-4021-b3ab-ec127bb1b9dd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.197135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd557-0884-4bdf-8ef6-268177e0b69b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.234400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf53357-b41d-41e9-b127-ad2cd31b519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.235131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53357-b41d-41e9-b127-ad2cd31b519c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.235410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53357-b41d-41e9-b127-ad2cd31b519c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.235680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf53357-b41d-41e9-b127-ad2cd31b519c None admin] PATH_INFO: `/v3/users/972ee159a09547939544ae4d8cd8a3d6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.242018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673f66-a95e-4021-b3ab-ec127bb1b9dd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.250477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf53357-b41d-41e9-b127-ad2cd31b519c None admin] RBAC: Authorizing `identity:get_user(user_id=972ee159a09547939544ae4d8cd8a3d6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.252038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf53357-b41d-41e9-b127-ad2cd31b519c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.254477 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 56/110] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/users/972ee159a09547939544ae4d8cd8a3d6 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:44.255626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d8745-d39e-4ec5-8858-3343807eb27e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.255905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d8745-d39e-4ec5-8858-3343807eb27e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.256176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d8745-d39e-4ec5-8858-3343807eb27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.275836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-195d8745-d39e-4ec5-8858-3343807eb27e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:44.277026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-195d8745-d39e-4ec5-8858-3343807eb27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:44.280755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.281448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.281732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.282066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.282730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.284389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.293044 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.317421 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 55/111] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:46:44 2022] POST /identity/v3/projects => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:44.318925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.352156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 57/112] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:44.352847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d8745-d39e-4ec5-8858-3343807eb27e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.367709 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.467412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d8745-d39e-4ec5-8858-3343807eb27e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.491290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d49a75-510d-44c0-80eb-3c9e65b0d08d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.506997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.507963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.508411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.508952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.530252 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.574853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.575496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.575836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.576113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.589406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:44.589579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.591038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:44.596524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:44.597770 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:44.598525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:44.601668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 56/113] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:44.602697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.718514 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 58/114] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:44.719837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.732508 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.745905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769bc3d-b7ac-4a2d-a9ed-b97c7c6adca7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.786048 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.795130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.795776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.796055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.796345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.810903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:44.818064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:44.818942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:44.819709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 57/115] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:44.820334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.845955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686ff2d-7235-4d80-aeed-63a2932e9059 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.883022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4e5e5-c5e2-434a-9512-dfa9de03a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.883953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4e5e5-c5e2-434a-9512-dfa9de03a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.884240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4e5e5-c5e2-434a-9512-dfa9de03a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.884652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4e5e5-c5e2-434a-9512-dfa9de03a4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.885356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4e5e5-c5e2-434a-9512-dfa9de03a4b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:44.885668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4e5e5-c5e2-434a-9512-dfa9de03a4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.887050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4e5e5-c5e2-434a-9512-dfa9de03a4b6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.899827 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 59/116] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:44.899827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814cb6-6503-4e29-8eab-4d0ed06fe373 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.899827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814cb6-6503-4e29-8eab-4d0ed06fe373 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.899827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814cb6-6503-4e29-8eab-4d0ed06fe373 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.899827 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 60/117] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:44.899827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814cb6-6503-4e29-8eab-4d0ed06fe373 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.933420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56326f-cd8c-4abf-8a48-f8ce459572e3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.967641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.968276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.968608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.968836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.970070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.971519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.973713 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:44.974489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.994770 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.019941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814cb6-6503-4e29-8eab-4d0ed06fe373 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.034286 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.058787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d7504-3e10-46f6-b048-453a95e75799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.059396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7504-3e10-46f6-b048-453a95e75799 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.059681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7504-3e10-46f6-b048-453a95e75799 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.059956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7504-3e10-46f6-b048-453a95e75799 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.060617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7504-3e10-46f6-b048-453a95e75799 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:45.060925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7504-3e10-46f6-b048-453a95e75799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.062343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7504-3e10-46f6-b048-453a95e75799 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.072133 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 61/119] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:45.073241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed549-0608-4b89-bda5-985675a893e6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.073525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed549-0608-4b89-bda5-985675a893e6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.073799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed549-0608-4b89-bda5-985675a893e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.082874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2292b54-be30-4108-8ed4-70be215348b1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.091931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-475ed549-0608-4b89-bda5-985675a893e6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:45.093127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-475ed549-0608-4b89-bda5-985675a893e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:45.119063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.119955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.120235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.120512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.132011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:45.136804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:45.137714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:45.138466 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 59/120] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:45.139087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.169303 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 62/121] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:45.178019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed549-0608-4b89-bda5-985675a893e6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.225657 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.251385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766392db-e5fb-4276-a602-f0ba4d020157 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.293175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.293816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.294158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.294438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] PATH_INFO: `/v3/users/f315e7427b614b24bed4c1fa5addb708` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.296138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] RBAC: Authorizing `identity:get_user(user_id=f315e7427b614b24bed4c1fa5addb708)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.297907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.300673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 60/122] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/users/f315e7427b614b24bed4c1fa5addb708 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:45.306979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.324646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed549-0608-4b89-bda5-985675a893e6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.328099 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.375746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.376364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.376647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.376922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.377941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] RBAC: Adding query filter params (role.id=d3bbff4f8c1e4d74bbe9cd468867d654, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=972ee159a09547939544ae4d8cd8a3d6) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:45.378376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.381196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.388679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 63/123] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/role_assignments?user.id=972ee159a09547939544ae4d8cd8a3d6&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=d3bbff4f8c1e4d74bbe9cd468867d654 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:45.394596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.448996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32682b-25f6-4f6b-b62e-09716113df30 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.486821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.488611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.489202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.489732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.491221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.493113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.495066 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 61/124] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:45.496174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.524391 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.568970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90d9e0-102f-46c8-a9ae-00a54943fd8e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.628734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.630006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.630629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.631102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.632650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:45.633202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.635192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.641890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11acff-791c-4873-8249-d5d943836304 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.645790 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:45.646975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.682868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.684677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.685357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.685830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.687443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.689121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.691806 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:45.692942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.701201 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.786538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a093ad-7b3d-44fe-8d63-364b744cac77 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.788648 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.810085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44e541-5d03-4fcf-b5c4-ee611260c3cb None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:45.825353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.826004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.826285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.826561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.839208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:45.845384 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:45.846283 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:45.848036 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 65/127] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:45.851977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.855514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:45.856558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:45.857034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:45.857577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:45.859017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:45.860648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:45.862740 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 63/128] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:45.863766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:45.970257 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:45.984083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91862f-4de7-4c7e-9949-40ff69fd4fce None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.006082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5843e-e554-43db-8723-684b985f0f9f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.024841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.025770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.026247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.026696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.028018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.029847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.032210 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 66/129] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:45 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:46.033705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:46.050953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.051896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.052291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.053049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/f315e7427b614b24bed4c1fa5addb708/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.055886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e0a0c5eaf43aea21ba643db80846e, user_id=f315e7427b614b24bed4c1fa5addb708, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.057851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.077097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 64/130] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:46:45 2022] PUT /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/f315e7427b614b24bed4c1fa5addb708/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:46:46.078011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:46.096841 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:46.168115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd41d4-6e29-4e07-8f66-6582ea99402e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.214584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.215460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.216082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.217262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.218307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:46.222453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.224830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.244926 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 67/131] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:46.247580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:46.285392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366022ef-87df-4c90-b605-695b372c7d25 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.294631 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:46.357571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.358470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.358912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.359326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/2459cbb42d584a5c886610385b44f84c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.365738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e0a0c5eaf43aea21ba643db80846e, user_id=2459cbb42d584a5c886610385b44f84c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.367474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.402759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cec363-89cf-4305-bb05-7587c2fa8dc7 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.406012 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 65/132] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:46:46 2022] PUT /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/2459cbb42d584a5c886610385b44f84c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:46:46.407039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:46.454147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.455604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.456247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.457189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.458730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.460388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.462563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 68/133] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:46 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:46.469156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:46.542509 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:46.586558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355047e1-5d02-4bc0-b1a7-5456152c2e94 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.624409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.624987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.625359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.625643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.626857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.628867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.630793 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 66/134] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:46 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:46.637805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:46.690495 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:46.709470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8d559-a965-4eff-bc9a-85df4f905fec None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.771904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.772588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.772870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.773175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/2459cbb42d584a5c886610385b44f84c/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.777780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e0a0c5eaf43aea21ba643db80846e, user_id=2459cbb42d584a5c886610385b44f84c, role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.779240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.808648 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 69/135] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:46:46 2022] PUT /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/2459cbb42d584a5c886610385b44f84c/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:46:46.842340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adc83c-dd4c-4be3-9536-2a8ad41664fe None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:46.879685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9077c-c6ee-440b-9614-b48856444dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:46.880268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9077c-c6ee-440b-9614-b48856444dae None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.880554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9077c-c6ee-440b-9614-b48856444dae None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.880836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9077c-c6ee-440b-9614-b48856444dae None admin] PATH_INFO: `/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.882047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9077c-c6ee-440b-9614-b48856444dae None admin] RBAC: Authorizing `identity:get_project(project_id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:46.883522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9077c-c6ee-440b-9614-b48856444dae None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:46.885230 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 67/136] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:46 2022] GET /identity/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8 => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:46.891612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.030146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5280984-b175-4937-a4a8-bf1d06024c95 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.072421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6beec-a93a-4e48-afc7-671f37f99efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.073133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6beec-a93a-4e48-afc7-671f37f99efe None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.073417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6beec-a93a-4e48-afc7-671f37f99efe None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.073695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6beec-a93a-4e48-afc7-671f37f99efe None admin] PATH_INFO: `/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8/users/2459cbb42d584a5c886610385b44f84c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.075803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6beec-a93a-4e48-afc7-671f37f99efe None admin] RBAC: Authorizing `identity:create_grant(project_id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8, user_id=2459cbb42d584a5c886610385b44f84c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:47.077320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6beec-a93a-4e48-afc7-671f37f99efe None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:47.119147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 70/137] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:46:46 2022] PUT /identity/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8/users/2459cbb42d584a5c886610385b44f84c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:46:47.226410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c90ff3-6bf9-41b1-9f87-8e4284f7d33b None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.226915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c90ff3-6bf9-41b1-9f87-8e4284f7d33b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.227011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c90ff3-6bf9-41b1-9f87-8e4284f7d33b None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.228319 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 68/138] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:47.233874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a64d65-29a0-40ab-b953-27749a0d56ed None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.234166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a64d65-29a0-40ab-b953-27749a0d56ed None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.234459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a64d65-29a0-40ab-b953-27749a0d56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.255732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-85a64d65-29a0-40ab-b953-27749a0d56ed None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:47.256965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-85a64d65-29a0-40ab-b953-27749a0d56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:47.259331 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.335046 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:47.648623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c90ff3-6bf9-41b1-9f87-8e4284f7d33b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.658002 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.781860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c90ff3-6bf9-41b1-9f87-8e4284f7d33b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.823194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1c2c8-113f-4d24-bb04-849f9941ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.823839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1c2c8-113f-4d24-bb04-849f9941ba87 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.824121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1c2c8-113f-4d24-bb04-849f9941ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.824401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1c2c8-113f-4d24-bb04-849f9941ba87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.825689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1c2c8-113f-4d24-bb04-849f9941ba87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:47.827150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1c2c8-113f-4d24-bb04-849f9941ba87 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:47.828730 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 69/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:47.838472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a64d65-29a0-40ab-b953-27749a0d56ed None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.860010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d8b7a-637c-43ad-8a58-5808c2dfe6e0 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.860318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d8b7a-637c-43ad-8a58-5808c2dfe6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.860563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d8b7a-637c-43ad-8a58-5808c2dfe6e0 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.862000 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 70/141] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:47.868189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d3bca-fb73-4057-83f3-60e8f1101be4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.868479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d3bca-fb73-4057-83f3-60e8f1101be4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.868832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d3bca-fb73-4057-83f3-60e8f1101be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.891259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fb8d3bca-fb73-4057-83f3-60e8f1101be4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:47.892638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fb8d3bca-fb73-4057-83f3-60e8f1101be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:48.003815 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 71/142] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:48.070909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a64d65-29a0-40ab-b953-27749a0d56ed None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.115460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.116430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.116969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.117456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.118329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.119976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.140980 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.167594 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 72/143] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:46:47 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:48.470503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d3bca-fb73-4057-83f3-60e8f1101be4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.474506 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.609363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d3bca-fb73-4057-83f3-60e8f1101be4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.659054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.660545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.661019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.661531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.673419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:48.678715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:48.679547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:46:48.680302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:48.684661 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 72/144] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:48.688286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.799834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7470f-3723-4e24-bbfb-25b50a24b25f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.843324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.844322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.844797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.845368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.846222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:48.846713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.848784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.859530 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 73/145] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:48.864770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.938511 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.984087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253014c-46bf-44ad-bca0-d3cee777f9e2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:49.027997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:49.028961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:49.029487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:49.029981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] PATH_INFO: `/v3/users/972ee159a09547939544ae4d8cd8a3d6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:49.033743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] RBAC: Authorizing `identity:get_user(user_id=972ee159a09547939544ae4d8cd8a3d6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:49.036343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:49.038544 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 73/146] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:48 2022] GET /identity/v3/users/972ee159a09547939544ae4d8cd8a3d6 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:49.043958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:49.112012 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:49.173317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3890-4b7c-4f84-a07e-656c4c33317a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:49.214689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b807ef-7073-4c11-80aa-7c66d1a1221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:49.215325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b807ef-7073-4c11-80aa-7c66d1a1221d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:49.215600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b807ef-7073-4c11-80aa-7c66d1a1221d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:49.215866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b807ef-7073-4c11-80aa-7c66d1a1221d None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:49.217738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b807ef-7073-4c11-80aa-7c66d1a1221d None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:49.219185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b807ef-7073-4c11-80aa-7c66d1a1221d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:49.220827 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 74/147] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:49 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:49.226586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:49.418719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfe2c1-adf3-4ef8-bbc8-57d5a0581aef None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:49.458985 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:49.465592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eda43-218f-4350-934a-05e27092b334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:49.466266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eda43-218f-4350-934a-05e27092b334 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:49.467491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eda43-218f-4350-934a-05e27092b334 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:49.467791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eda43-218f-4350-934a-05e27092b334 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/972ee159a09547939544ae4d8cd8a3d6/roles/d3bbff4f8c1e4d74bbe9cd468867d654` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:49.474853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eda43-218f-4350-934a-05e27092b334 None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e0a0c5eaf43aea21ba643db80846e, user_id=972ee159a09547939544ae4d8cd8a3d6, role_id=d3bbff4f8c1e4d74bbe9cd468867d654)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:49.476325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eda43-218f-4350-934a-05e27092b334 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:49.499326 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 74/148] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:46:49 2022] PUT /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/users/972ee159a09547939544ae4d8cd8a3d6/roles/d3bbff4f8c1e4d74bbe9cd468867d654 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:46:49.858328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193e64-b132-4af7-86d8-823344c6fb77 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:49.858745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193e64-b132-4af7-86d8-823344c6fb77 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:49.858922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193e64-b132-4af7-86d8-823344c6fb77 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:49.860217 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 75/149] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:49.866397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb2e1-afc4-40e0-9012-5b7a32517010 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:49.866684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb2e1-afc4-40e0-9012-5b7a32517010 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:49.866964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb2e1-afc4-40e0-9012-5b7a32517010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:49.888095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d77bb2e1-afc4-40e0-9012-5b7a32517010 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:49.889358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d77bb2e1-afc4-40e0-9012-5b7a32517010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:49.979580 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 75/150] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:50.077337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f794a-5545-4854-92f2-f3b108a9ab67 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.077620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f794a-5545-4854-92f2-f3b108a9ab67 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.077888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f794a-5545-4854-92f2-f3b108a9ab67 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.079235 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 76/151] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:50.091024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c9f1b-37a7-4a39-92b7-0a632a1dcce4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.091381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c9f1b-37a7-4a39-92b7-0a632a1dcce4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.091662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c9f1b-37a7-4a39-92b7-0a632a1dcce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.118174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a26c9f1b-37a7-4a39-92b7-0a632a1dcce4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:50.119285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a26c9f1b-37a7-4a39-92b7-0a632a1dcce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:50.179894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b6f4-a6e6-433c-8ee7-f59c5781b09a None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.180402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b6f4-a6e6-433c-8ee7-f59c5781b09a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.180402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1b6f4-a6e6-433c-8ee7-f59c5781b09a None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.182165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 77/152] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:50.187110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688c3a-4cac-43a5-b8ec-c467ce90e43a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.187390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688c3a-4cac-43a5-b8ec-c467ce90e43a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.187659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688c3a-4cac-43a5-b8ec-c467ce90e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.219245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c7688c3a-4cac-43a5-b8ec-c467ce90e43a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:50.220670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c7688c3a-4cac-43a5-b8ec-c467ce90e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:50.230800 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:50.309705 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:50.432614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c9f1b-37a7-4a39-92b7-0a632a1dcce4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:50.501717 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:50.569690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c9f1b-37a7-4a39-92b7-0a632a1dcce4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:50.612538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e3717-ee8e-468f-8aa9-e21e63a1eb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:50.613736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e3717-ee8e-468f-8aa9-e21e63a1eb32 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.614001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e3717-ee8e-468f-8aa9-e21e63a1eb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.614325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e3717-ee8e-468f-8aa9-e21e63a1eb32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.630557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e3717-ee8e-468f-8aa9-e21e63a1eb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-956e3717-ee8e-468f-8aa9-e21e63a1eb32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:50.635557 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:50.636464 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:50.637297 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 77/155] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:50.645213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688c3a-4cac-43a5-b8ec-c467ce90e43a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:50.673307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d051-7880-4a34-88a8-4e459c1935c8 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.673634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d051-7880-4a34-88a8-4e459c1935c8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.675062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d051-7880-4a34-88a8-4e459c1935c8 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.677503 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 78/156] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:50.683122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589bc0-fa1e-4024-b7b9-ea8f2d1b3738 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.683404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589bc0-fa1e-4024-b7b9-ea8f2d1b3738 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.683571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589bc0-fa1e-4024-b7b9-ea8f2d1b3738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.715020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-99589bc0-fa1e-4024-b7b9-ea8f2d1b3738 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:50.716202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-99589bc0-fa1e-4024-b7b9-ea8f2d1b3738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:50.742941 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:50.843293 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 79/157] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:50.844575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99589bc0-fa1e-4024-b7b9-ea8f2d1b3738 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:50.844996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688c3a-4cac-43a5-b8ec-c467ce90e43a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:50.935292 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:50.938107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:50.938741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:50.939016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:50.939290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:50.939960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:50.940266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:50.941895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:50.960271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 79/158] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:50.961234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.030057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99589bc0-fa1e-4024-b7b9-ea8f2d1b3738 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.123790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.124496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.124770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.125034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.148835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2184-7308-45e4-8835-194ce8e15f4b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.162076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:51.168992 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:51.170027 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:51.170830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 80/159] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:51.172225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.196067 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.241882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.242828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.243256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.243527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.282545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:51.297347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:51.298260 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:51.299138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:51.299731 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 80/160] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:46:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:51.301091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.371462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cafe2b-859a-488a-b9b7-d6a8d14ceff4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.381418 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.422830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.423605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.423883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.424151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] PATH_INFO: `/v3/users/f315e7427b614b24bed4c1fa5addb708` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.427887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] RBAC: Authorizing `identity:get_user(user_id=f315e7427b614b24bed4c1fa5addb708)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:51.429477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:51.431599 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 81/161] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/users/f315e7427b614b24bed4c1fa5addb708 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:51.432380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.551672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ebc1-5d0c-47d9-84ad-86f55268d7a0 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.646362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.646973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.647253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.647521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.648189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:51.648487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:51.649915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:51.655455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db188bd-21ce-4e39-8be6-e8f80861e11c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.669418 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 81/162] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:51.669418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.736463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.737472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.738577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.739048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.739909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:51.740510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:51.742275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:51.763261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 82/163] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:51.764413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.770529 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.844277 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.907345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5727cab-3955-4399-8c89-685e145f2441 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.984987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.985784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.986462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.986849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.994983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d92279-34b6-4479-8a51-c6f5b3624a30 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.061623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.062518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.062941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.063370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.095324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:52.102067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:52.103002 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:52.103789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:52.114129 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 83/164] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:52.115146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.131464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.133181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.189674 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.257078 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.275825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e1f11-1e29-4973-84e0-c354c2e0a89f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.279907 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:52.282677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.349401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.352290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.352726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.353175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.356115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.363465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.365748 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 84/166] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:52.366760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.465894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bf0d2-9f08-41b4-bfdd-edcc1781c9b8 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.505434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.506351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.506791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.507216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.509273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.511034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.514228 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 83/167] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:52.516236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.538997 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.554370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d212f9-5ac7-408e-af55-7c7e0c158bbd None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.622582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.623117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.623395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.623665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.624334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:52.624638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.626031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.638365 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 85/168] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:52.640422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.689545 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.711045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b94608-9d7c-4241-ae16-953b86411248 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.756652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.757330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.757609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.757882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.760224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.761712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.763359 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 84/169] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:52.764127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.847073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dca4e-f66b-42e9-9eb4-66c2e0b60137 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.889517 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.906588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.907262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.907541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.907813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.947053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec9acd-84f6-4928-ae86-3f1ea79dd127 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.999542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.001166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.035733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.036229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.036510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.036782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.037679 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.155286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.156749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.184024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 86/170] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:53.184676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.270596 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.303771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 85/171] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:53.304621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.350908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db0e5-3ffc-4bb1-80f9-c1329f871260 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.374490 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.387844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a9c1a-22e5-4b3b-a91a-3d0c1cc0ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.388741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a9c1a-22e5-4b3b-a91a-3d0c1cc0ce9e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.389258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a9c1a-22e5-4b3b-a91a-3d0c1cc0ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.389533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a9c1a-22e5-4b3b-a91a-3d0c1cc0ce9e None admin] PATH_INFO: `/v3/users/2459cbb42d584a5c886610385b44f84c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.390930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a9c1a-22e5-4b3b-a91a-3d0c1cc0ce9e None admin] RBAC: Authorizing `identity:get_user(user_id=2459cbb42d584a5c886610385b44f84c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.392416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a9c1a-22e5-4b3b-a91a-3d0c1cc0ce9e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.394869 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 87/172] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/users/2459cbb42d584a5c886610385b44f84c => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:53.395713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db570a0-9a28-4010-b551-3de4f1870522 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.395996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db570a0-9a28-4010-b551-3de4f1870522 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.396271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db570a0-9a28-4010-b551-3de4f1870522 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.401511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 88/173] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:53.401511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db570a0-9a28-4010-b551-3de4f1870522 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.428016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530b43-0d4b-4b2e-b499-c8f4c50e3b3a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.466459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cdb13-71f4-475b-a5df-658f39d7eb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.467202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cdb13-71f4-475b-a5df-658f39d7eb10 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.467501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cdb13-71f4-475b-a5df-658f39d7eb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.467773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cdb13-71f4-475b-a5df-658f39d7eb10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.468810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cdb13-71f4-475b-a5df-658f39d7eb10 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=f315e7427b614b24bed4c1fa5addb708) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:53.469147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cdb13-71f4-475b-a5df-658f39d7eb10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.470574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cdb13-71f4-475b-a5df-658f39d7eb10 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.476981 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 86/174] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/role_assignments?user.id=f315e7427b614b24bed4c1fa5addb708&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:53.478433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f874ab-dccc-405d-bff4-c4ba710be0e3 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.478723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f874ab-dccc-405d-bff4-c4ba710be0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.478993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f874ab-dccc-405d-bff4-c4ba710be0e3 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.480343 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 87/175] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:53.493172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41cac9-0e6c-443b-9a2b-38bb428865fd None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.493172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41cac9-0e6c-443b-9a2b-38bb428865fd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.493172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41cac9-0e6c-443b-9a2b-38bb428865fd None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.493172 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 88/176] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:53.493172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41cac9-0e6c-443b-9a2b-38bb428865fd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.528244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db570a0-9a28-4010-b551-3de4f1870522 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.553927 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.575137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.575877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.576160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.576480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.577759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.579290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.581109 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:53.582083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.630459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41cac9-0e6c-443b-9a2b-38bb428865fd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.651784 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.671374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e6ece-d0ee-447f-911d-7627db79784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.672000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e6ece-d0ee-447f-911d-7627db79784a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.672275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e6ece-d0ee-447f-911d-7627db79784a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.672833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e6ece-d0ee-447f-911d-7627db79784a None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.674415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e6ece-d0ee-447f-911d-7627db79784a None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.676698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e6ece-d0ee-447f-911d-7627db79784a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.678536 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 89/178] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:53.679590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9f8b-43b8-4f91-b379-692abf1aeba6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.679864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9f8b-43b8-4f91-b379-692abf1aeba6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.680126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d9f8b-43b8-4f91-b379-692abf1aeba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.703322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e49d9f8b-43b8-4f91-b379-692abf1aeba6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:53.704535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e49d9f8b-43b8-4f91-b379-692abf1aeba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:53.708386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de0951-a4ec-484b-857a-f65d09c6ab28 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.748451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.749085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.749512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.749781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.782057 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:53.783285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206896c6-4fd4-4e64-9b9c-ef4fb986ecc2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.783564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206896c6-4fd4-4e64-9b9c-ef4fb986ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.783829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206896c6-4fd4-4e64-9b9c-ef4fb986ecc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.802013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-206896c6-4fd4-4e64-9b9c-ef4fb986ecc2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:53.803189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-206896c6-4fd4-4e64-9b9c-ef4fb986ecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:53.819247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.820894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.835802 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.878711 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 91/180] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:53.880132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694d20-7f51-4389-80c0-3f3ce14f1327 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.880486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694d20-7f51-4389-80c0-3f3ce14f1327 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.880824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694d20-7f51-4389-80c0-3f3ce14f1327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.890972 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.910307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-df694d20-7f51-4389-80c0-3f3ce14f1327 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:53.912121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-df694d20-7f51-4389-80c0-3f3ce14f1327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:53.949276 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 90/181] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:53.950361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.999364 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 92/182] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:54.001138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2ea1-8910-4a56-b79b-9650a0b901b6 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.001494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2ea1-8910-4a56-b79b-9650a0b901b6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.001839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2ea1-8910-4a56-b79b-9650a0b901b6 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.003152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 93/183] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:54.005786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2ea1-8910-4a56-b79b-9650a0b901b6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.070156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db025df4-fa82-4007-aa66-27bcc66626dd None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.122507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.123864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.124480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.124938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.126193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=2459cbb42d584a5c886610385b44f84c) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:54.127115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:54.129199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:54.136554 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 91/184] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/role_assignments?user.id=2459cbb42d584a5c886610385b44f84c&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:54.137823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.143256 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.168224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2ea1-8910-4a56-b79b-9650a0b901b6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.194848 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.221371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8937fbc-0cc2-4f6a-806a-1a99c29d4ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.223017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937fbc-0cc2-4f6a-806a-1a99c29d4ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.223558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937fbc-0cc2-4f6a-806a-1a99c29d4ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.224010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8937fbc-0cc2-4f6a-806a-1a99c29d4ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.224972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937fbc-0cc2-4f6a-806a-1a99c29d4ae7 None admin] RBAC: Adding query filter params (role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=2459cbb42d584a5c886610385b44f84c) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:54.225486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937fbc-0cc2-4f6a-806a-1a99c29d4ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:54.227337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8937fbc-0cc2-4f6a-806a-1a99c29d4ae7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:54.240797 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 94/185] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/role_assignments?user.id=2459cbb42d584a5c886610385b44f84c&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:54.242456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce1d2b-1fd8-4f31-8f5f-777995409b88 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.242780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce1d2b-1fd8-4f31-8f5f-777995409b88 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.243054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce1d2b-1fd8-4f31-8f5f-777995409b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.278818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-23ce1d2b-1fd8-4f31-8f5f-777995409b88 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:54.280035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23ce1d2b-1fd8-4f31-8f5f-777995409b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:54.293563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4c4b7-6e33-4117-a2e6-9cf7f81491bf None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.339273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.339938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.340219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.340493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] PATH_INFO: `/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.341717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] RBAC: Authorizing `identity:get_project(project_id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:54.343296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:54.349091 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 92/186] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/projects/05f2eb2c0fd14af7b6fcd2e9e93fc4c8 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:54.349091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.395933 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 95/187] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:54.396619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce1d2b-1fd8-4f31-8f5f-777995409b88 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.468498 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.484429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb86ea5-8770-40f6-9574-516715689308 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.514887 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.528194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce1d2b-1fd8-4f31-8f5f-777995409b88 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.534442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.535484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.535818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.536111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.549292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:54.555618 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:54.556518 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:54.557346 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 93/188] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:54.558096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.575089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.576012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.576475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.576880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.591507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:54.596552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:54.598154 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 96/189] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:54.599088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.678582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4622-e5ab-4610-a636-4069c361d8e0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.712667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6728d-120c-4869-876b-69767b1f7037 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.713835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.714461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.714730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.714992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.725856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:54.730591 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:54.731454 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:54.732243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 94/190] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:54.732941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.744610 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.748519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.749156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.749440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.749718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.750438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8, user.id=2459cbb42d584a5c886610385b44f84c) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:54.750744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:54.752174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:54.765228 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 97/191] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/role_assignments?user.id=2459cbb42d584a5c886610385b44f84c&scope.project.id=05f2eb2c0fd14af7b6fcd2e9e93fc4c8&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:54.765228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.788114 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:54.841553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e1b56-00c3-4c93-bbc1-870b65094c55 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.881582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.882368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.882647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.883256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.884203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:54.884509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:54.886698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:54.888959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb491fed-5e7d-4bed-85e7-041783fbd831 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:54.904649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 95/192] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:54.904649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:54.932634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:54.933635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:54.933919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:54.934186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:54.934858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:54.935165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:54.936531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:54.947651 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 98/193] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:54.948503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.005247 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.038135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7a50-5c26-4f0b-b41a-e58c1ee66703 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.040662 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.064161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86908e-7cf8-450c-bca1-ca637e0584ea None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.073741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.074379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.074649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.074919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.076038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.077510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.079108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:55.079781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.098590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.099193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.099466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.099736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.100391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:55.100687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.102078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.109984 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 99/195] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:55.110675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.184408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e212587-e4ad-4fc5-b542-9fcd4994ee4d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.208075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1587a1-fcd4-427a-b1e6-a124d174c20e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.217248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.217880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.218151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.218418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] PATH_INFO: `/v3/users/38cc1b9374d049a5aa899b6e23f9c49d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.228459 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.231967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] RBAC: Authorizing `identity:get_user(user_id=38cc1b9374d049a5aa899b6e23f9c49d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.233711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.235523 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 97/196] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/users/38cc1b9374d049a5aa899b6e23f9c49d => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:55.236335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.243839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.244466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.244760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.245028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] PATH_INFO: `/v3/users/38cc1b9374d049a5aa899b6e23f9c49d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.246178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] RBAC: Authorizing `identity:get_user(user_id=38cc1b9374d049a5aa899b6e23f9c49d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.247593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.253557 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 100/197] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/users/38cc1b9374d049a5aa899b6e23f9c49d => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:55.253557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.259460 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.349313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d3201-e490-41ab-88d8-7e734995000d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.354951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4fa17-22a6-4ef2-9306-41ce4ec886c9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.382951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.383548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.383821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.384089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.384733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.386189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.387861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.388523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.388800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.389096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] PATH_INFO: `/v3/users/972ee159a09547939544ae4d8cd8a3d6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.390492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] RBAC: Authorizing `identity:get_user(user_id=972ee159a09547939544ae4d8cd8a3d6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.391895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.393499 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 101/198] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/users/972ee159a09547939544ae4d8cd8a3d6 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:55.394400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.409246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 98/199] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:46:55 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:55.410659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.472164 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.494870 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.526910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087d741-8f8e-4168-8d17-282cea040544 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.531678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1933e5-004d-43f7-93b4-8ce94521f4cc None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.566584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.567477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.567810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.568281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.573115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.573742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.574024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.574298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.658736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.658923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.660782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.660894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.731869 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.762875 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.787948 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 99/200] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:55.789015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.798185 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 102/201] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:55.799155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.908667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d2c0-91e9-4b5f-ad76-f5603b97e157 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.921973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b94524-eff7-4cd5-8885-41a5c135caf2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:55.955084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.955955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.956367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.957371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.958325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:55.959118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.959397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.959821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.960977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:55.962657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:55.964131 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 103/202] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:55.964888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:55.992321 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:56.022956 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:56.053375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.055478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.096296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0fb79-9fe8-48b8-80c2-8dfbf721988f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.137104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.137104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.137104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.137104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.138252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.140503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.142518 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 104/203] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:56.143354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:56.184855 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 100/204] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:56.186146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:56.244822 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:56.260053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059156-fe44-4c01-8fbf-02efb6826fee None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.273850 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:56.294476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f457c66-9c14-4230-9b16-c6efc20ca6df None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.307984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.308649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.309022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.309413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.310343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] RBAC: Adding query filter params (role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=38cc1b9374d049a5aa899b6e23f9c49d) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:56.311043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.312366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.320649 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 105/205] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:56 2022] GET /identity/v3/role_assignments?user.id=38cc1b9374d049a5aa899b6e23f9c49d&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:56.321740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:56.334157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.335139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.335558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.335965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.336872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=38cc1b9374d049a5aa899b6e23f9c49d) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:56.337355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.338943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.345006 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 101/206] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:56 2022] GET /identity/v3/role_assignments?user.id=38cc1b9374d049a5aa899b6e23f9c49d&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:56.441917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6f1f9-1d34-4735-97ad-354a716e021c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.486320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c58f31-001f-4bb8-ae79-1aa930d26b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.486971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c58f31-001f-4bb8-ae79-1aa930d26b9e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.487244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c58f31-001f-4bb8-ae79-1aa930d26b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.487511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c58f31-001f-4bb8-ae79-1aa930d26b9e None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.489391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c58f31-001f-4bb8-ae79-1aa930d26b9e None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.490892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c58f31-001f-4bb8-ae79-1aa930d26b9e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.492881 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 106/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:56 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:56.498726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:56.623984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296086-7153-4a61-8740-aee3a88fbc3a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.650401 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:56.668810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6305-0f09-42cf-a50e-cb4f4c86b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.669687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6305-0f09-42cf-a50e-cb4f4c86b33b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.670152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6305-0f09-42cf-a50e-cb4f4c86b33b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.670588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6305-0f09-42cf-a50e-cb4f4c86b33b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.671479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6305-0f09-42cf-a50e-cb4f4c86b33b None admin] RBAC: Adding query filter params (role.id=d3bbff4f8c1e4d74bbe9cd468867d654, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e, user.id=972ee159a09547939544ae4d8cd8a3d6) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:56.671934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6305-0f09-42cf-a50e-cb4f4c86b33b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.673568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6305-0f09-42cf-a50e-cb4f4c86b33b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.681511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 102/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:56 2022] GET /identity/v3/role_assignments?user.id=972ee159a09547939544ae4d8cd8a3d6&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=d3bbff4f8c1e4d74bbe9cd468867d654 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:58.052825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec3b0-dff8-41a6-8d55-d229e1c1f2ba None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.053375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec3b0-dff8-41a6-8d55-d229e1c1f2ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.053375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efec3b0-dff8-41a6-8d55-d229e1c1f2ba None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.055198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 107/209] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:58.061397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f842-150b-47e7-a4be-4f88460e8b30 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.061929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f842-150b-47e7-a4be-4f88460e8b30 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.062155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f842-150b-47e7-a4be-4f88460e8b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.083246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cc83f842-150b-47e7-a4be-4f88460e8b30 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:58.084534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc83f842-150b-47e7-a4be-4f88460e8b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:58.158371 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 103/210] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:58.185095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecb912-44fe-4342-a3e8-657706c93125 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.185095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecb912-44fe-4342-a3e8-657706c93125 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.185095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecb912-44fe-4342-a3e8-657706c93125 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.185095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 108/211] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:58.190699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f13e1-8473-4e47-a9d6-79b4aa5f988d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.191223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f13e1-8473-4e47-a9d6-79b4aa5f988d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.191702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f13e1-8473-4e47-a9d6-79b4aa5f988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.210238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-912f13e1-8473-4e47-a9d6-79b4aa5f988d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:58.211682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-912f13e1-8473-4e47-a9d6-79b4aa5f988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:58.283384 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 104/212] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:58.433710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecb912-44fe-4342-a3e8-657706c93125 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:58.479812 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:58.543535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecb912-44fe-4342-a3e8-657706c93125 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:58.573806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f13e1-8473-4e47-a9d6-79b4aa5f988d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:58.578853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:58.579486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.579762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.580030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.592158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:58.596981 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:58.598395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:58.599610 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 109/213] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:58.604819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:58.625428 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:58.694336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f13e1-8473-4e47-a9d6-79b4aa5f988d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:58.732638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb4bfb-0833-4705-be64-2acbd6eb7155 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:58.734675 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:58.739142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:58.739806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.740091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.740361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.741645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:58.743200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:58.745140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 105/214] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:58.750826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:58.789581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:58.790659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.790948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.791511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.792300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:58.792613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:58.794080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:58.804028 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 110/215] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:46:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:58.818148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:58.883473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49f14-3971-485e-8929-fc50deb749aa None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:58.896241 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:58.921540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a68bf-f6ee-42de-8fce-396c69c79114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:58.922145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a68bf-f6ee-42de-8fce-396c69c79114 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.922420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a68bf-f6ee-42de-8fce-396c69c79114 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.922687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a68bf-f6ee-42de-8fce-396c69c79114 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.923330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a68bf-f6ee-42de-8fce-396c69c79114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:58.924776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a68bf-f6ee-42de-8fce-396c69c79114 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:58.937457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91340c8c-0bdb-4f32-b318-e6d19bd12084 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:58.946214 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 106/216] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:46:58 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:58.947818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0d19-6659-4ed0-a4c4-5219ba0ddb16 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.948106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0d19-6659-4ed0-a4c4-5219ba0ddb16 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.948424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0d19-6659-4ed0-a4c4-5219ba0ddb16 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.949854 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 107/217] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:58.950916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2708e-5604-48fe-bebb-4360c86dfd54 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.951199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2708e-5604-48fe-bebb-4360c86dfd54 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.951470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2708e-5604-48fe-bebb-4360c86dfd54 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.953097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 108/218] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:58.955359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2147fe-af11-42db-80ba-7279b4d4d25e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.955647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2147fe-af11-42db-80ba-7279b4d4d25e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.955909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2147fe-af11-42db-80ba-7279b4d4d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.975978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1f2147fe-af11-42db-80ba-7279b4d4d25e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:58.977258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f2147fe-af11-42db-80ba-7279b4d4d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:58.985985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ac669-f215-4231-998a-5d7b08fddf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:58.986640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac669-f215-4231-998a-5d7b08fddf55 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.986922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac669-f215-4231-998a-5d7b08fddf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.987189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac669-f215-4231-998a-5d7b08fddf55 None admin] PATH_INFO: `/v3/users/e87fd5899c944af2a12443e7c52decd1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.005872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ac669-f215-4231-998a-5d7b08fddf55 None admin] RBAC: Authorizing `identity:get_user(user_id=e87fd5899c944af2a12443e7c52decd1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:59.007526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ac669-f215-4231-998a-5d7b08fddf55 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:59.009344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 111/219] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:58 2022] GET /identity/v3/users/e87fd5899c944af2a12443e7c52decd1 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:59.010536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496630-51fb-460a-9c44-5b8ce8a42123 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.010821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496630-51fb-460a-9c44-5b8ce8a42123 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.011090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496630-51fb-460a-9c44-5b8ce8a42123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.031371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-04496630-51fb-460a-9c44-5b8ce8a42123 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:59.032612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-04496630-51fb-460a-9c44-5b8ce8a42123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:59.058796 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:59.060772 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 109/220] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:46:59.071607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2147fe-af11-42db-80ba-7279b4d4d25e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.128609 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 112/221] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:46:59.199538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2147fe-af11-42db-80ba-7279b4d4d25e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.201315 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:59.237861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:59.239015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.239293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.239563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.310603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:59.312455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:59.333407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04496630-51fb-460a-9c44-5b8ce8a42123 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.437452 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:59.443678 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 110/222] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:46:59.449529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.464731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04496630-51fb-460a-9c44-5b8ce8a42123 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.501540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:59.502184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.502464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.502736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.521117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:59.526674 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:59.527567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:46:59.528369 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 113/223] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:59.529030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.545783 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:59.572319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc16a5-ac16-43eb-875d-af711df454de None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.611208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:59.612153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.612611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.613093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.624537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:59.630098 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:59.631217 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:46:59.632238 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:46:59.639040 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:59.640162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.651861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034dadc-e810-4bb5-9d2c-519a2267cfb7 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.702023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:59.702635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.702906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.703173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.704309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:59.706077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:59.714046 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 114/225] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:59.714046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.720942 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:59.771880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ae29-dfd3-4172-bc61-d100166ef6bc None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.804495 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:59.811445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:59.813189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.813627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.814051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.814983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:59.815582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:59.817190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:59.824178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3d7b-c1fa-4fad-b13c-a1e521ee938a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.831645 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 112/226] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:59.833540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.865530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:59.866785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.867069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.867349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.868018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:59.868322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:59.869740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:59.880144 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 115/227] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:59.880945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.958996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee1289-5266-4fb3-8245-076f55ba3e2c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.978146 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:00.006062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:00.007712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.008187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.008892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.010251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=e87fd5899c944af2a12443e7c52decd1) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:00.011048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:00.013597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:00.015673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee217d4-0274-4149-8298-fe81e34b0a2d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:00.021759 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 113/228] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/role_assignments?user.id=e87fd5899c944af2a12443e7c52decd1&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:00.022807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:00.076609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:00.078326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.078812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.079937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] PATH_INFO: `/v3/users/38cc1b9374d049a5aa899b6e23f9c49d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.086729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] RBAC: Authorizing `identity:get_user(user_id=38cc1b9374d049a5aa899b6e23f9c49d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:00.088548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:00.091263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 116/229] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:46:59 2022] GET /identity/v3/users/38cc1b9374d049a5aa899b6e23f9c49d => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:00.097031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:00.116095 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:00.189580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c28c3-537d-4c35-b17d-46b2a32305b2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:00.262218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:00.262776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.263055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.263324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] PATH_INFO: `/v3/users/38cc1b9374d049a5aa899b6e23f9c49d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.264463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=38cc1b9374d049a5aa899b6e23f9c49d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:00.266183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:00.267917 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 114/230] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:00 2022] GET /identity/v3/users/38cc1b9374d049a5aa899b6e23f9c49d => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:00.275021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:00.280300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fac26b-5d1d-464e-9fe2-31aa4912fa52 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:00.324878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:00.325902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.326370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.326829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.328151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:00.330116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:00.332592 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:00 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:00.338338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:00.344820 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:00.428511 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:00.453621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ba534-addf-45ea-b2c3-7a2984da277e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:00.482824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aece662-9ea1-4b50-9f86-def71cb9f4f1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:00.491525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:00.492474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.492943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.493434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/38cc1b9374d049a5aa899b6e23f9c49d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.495564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef55a652856b48b0a04ac5a1e9cae197, user_id=38cc1b9374d049a5aa899b6e23f9c49d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:00.497679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:00.533296 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 118/232] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:00 2022] PUT /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/38cc1b9374d049a5aa899b6e23f9c49d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:47:00.549441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e836-86a0-4320-a66e-8a46167ba9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:00.550421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e836-86a0-4320-a66e-8a46167ba9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.551559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e836-86a0-4320-a66e-8a46167ba9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.552201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e836-86a0-4320-a66e-8a46167ba9b8 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.553549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e836-86a0-4320-a66e-8a46167ba9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:00.555166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e836-86a0-4320-a66e-8a46167ba9b8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:00.556987 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 115/233] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:00 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:00.566935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:00.718156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a180e-a81e-4676-b292-ba01d424f3e6 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:00.760580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa644629-206c-4f15-914d-fbe74dd1a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:00.761298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644629-206c-4f15-914d-fbe74dd1a21a None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:00.761583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644629-206c-4f15-914d-fbe74dd1a21a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:00.761863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa644629-206c-4f15-914d-fbe74dd1a21a None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/38cc1b9374d049a5aa899b6e23f9c49d/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:00.765922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa644629-206c-4f15-914d-fbe74dd1a21a None admin] RBAC: Authorizing `identity:create_grant(project_id=ef55a652856b48b0a04ac5a1e9cae197, user_id=38cc1b9374d049a5aa899b6e23f9c49d, role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:00.767361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa644629-206c-4f15-914d-fbe74dd1a21a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:00.787412 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:00.795990 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:00 2022] PUT /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/38cc1b9374d049a5aa899b6e23f9c49d/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:01.562042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5386-0284-48f7-8fc7-23e64cb60644 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.562552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5386-0284-48f7-8fc7-23e64cb60644 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.562651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f5386-0284-48f7-8fc7-23e64cb60644 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.563926 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 116/235] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:01.570197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dfe39-3116-44ee-942f-df21e5984bbb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.570700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dfe39-3116-44ee-942f-df21e5984bbb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.570927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dfe39-3116-44ee-942f-df21e5984bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.599762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b75dfe39-3116-44ee-942f-df21e5984bbb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:01.601006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b75dfe39-3116-44ee-942f-df21e5984bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:01.694735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:01.706663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d29a-f3ed-4c62-aa5d-1159ff484494 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.707543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d29a-f3ed-4c62-aa5d-1159ff484494 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.707822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d29a-f3ed-4c62-aa5d-1159ff484494 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.710485 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 117/237] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:01.715751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8773c1-ab39-4ab8-9b38-c726a535bbcf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.716276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8773c1-ab39-4ab8-9b38-c726a535bbcf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.716773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8773c1-ab39-4ab8-9b38-c726a535bbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.738834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cb8773c1-ab39-4ab8-9b38-c726a535bbcf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:01.740027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb8773c1-ab39-4ab8-9b38-c726a535bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:01.813428 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:02.073005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d29a-f3ed-4c62-aa5d-1159ff484494 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:02.211835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8773c1-ab39-4ab8-9b38-c726a535bbcf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:02.226430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d29a-f3ed-4c62-aa5d-1159ff484494 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:02.259652 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:02.290687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:02.291315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.291589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.291856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.293763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:02.295993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:02.297786 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 118/239] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:02.309586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:02.323315 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:02.382814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8773c1-ab39-4ab8-9b38-c726a535bbcf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:02.424379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:02.425014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.425310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.425670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.449732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:02.457178 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:02.458156 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:02.459826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:02.464309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:02.551583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed915677-2dff-4367-ab83-0cf6b417c5ec None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:02.591250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc796ba-20eb-47a0-9109-3224a57306c8 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:02.611097 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:02.633555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:02.634538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.635824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.636689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.637982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:02.639191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:02.641453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:02.642183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:02.643262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.643689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.645277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.646078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:02.648326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:02.664712 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 123/241] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:02.674205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:02.690097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 119/242] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:47:02 2022] POST /identity/v3/users => generated 293 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:02.805620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589e977-8af5-4c40-9cd0-bb980c5caa72 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:02.849251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c47cc-8e01-4a68-879d-04a7dd085dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:02.850136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c47cc-8e01-4a68-879d-04a7dd085dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.850574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c47cc-8e01-4a68-879d-04a7dd085dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.850985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c47cc-8e01-4a68-879d-04a7dd085dc8 None admin] PATH_INFO: `/v3/users/54a8877beced4d6d828a6c4a16b13491` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.867879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c47cc-8e01-4a68-879d-04a7dd085dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=54a8877beced4d6d828a6c4a16b13491)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:02.869610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c47cc-8e01-4a68-879d-04a7dd085dc8 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:02.871474 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 124/243] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:02 2022] GET /identity/v3/users/54a8877beced4d6d828a6c4a16b13491 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:02.877134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:02.913092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29735768-1b99-4661-bd21-5dae4a75dc2c None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.913599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29735768-1b99-4661-bd21-5dae4a75dc2c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.913985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29735768-1b99-4661-bd21-5dae4a75dc2c None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.915809 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 125/244] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:02.921570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9fc4-8645-4718-817b-cad24e1612da None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.921985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9fc4-8645-4718-817b-cad24e1612da None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.922363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9fc4-8645-4718-817b-cad24e1612da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.938131 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:02.952271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-373b9fc4-8645-4718-817b-cad24e1612da None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:02.953907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-373b9fc4-8645-4718-817b-cad24e1612da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:02.996345 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:03.022471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130faed8-25fc-4cea-b45f-421d91f80a57 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:03.049820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 126/245] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:03.067989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:03.068616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.068894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.069250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.157719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:03.159136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:03.209971 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:03.248454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12d54c-08ca-48ae-8981-c21721ab7b67 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.248791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12d54c-08ca-48ae-8981-c21721ab7b67 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.249010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12d54c-08ca-48ae-8981-c21721ab7b67 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.250391 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 127/246] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:03.256062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a80e7-5acc-45fc-8fd1-7f73f02e6aa6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.256346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a80e7-5acc-45fc-8fd1-7f73f02e6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.256625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a80e7-5acc-45fc-8fd1-7f73f02e6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.277852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-274a80e7-5acc-45fc-8fd1-7f73f02e6aa6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:03.279169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-274a80e7-5acc-45fc-8fd1-7f73f02e6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:03.284466 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 120/247] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:03.291150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:03.365894 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 128/248] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:03.370016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a80e7-5acc-45fc-8fd1-7f73f02e6aa6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:03.420785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b225344-1505-42e9-be5f-7e1f1f62736d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:03.463927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:03.465019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.465174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.465454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.466884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:03.468588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:03.471190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 121/249] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:03 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:03.477123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:03.485666 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:03.491766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a80e7-5acc-45fc-8fd1-7f73f02e6aa6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:03.492771 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:03.551921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:03.553021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.553541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.554010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.568770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:03.574511 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:03.575450 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:03.576282 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:03.578768 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 129/250] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:03.585700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:03.613980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91665a-3d92-4e25-80d1-34e9e865fb1d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:03.661798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f025c-2f53-4496-bc3e-cc217e277342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:03.663970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f025c-2f53-4496-bc3e-cc217e277342 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.665082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f025c-2f53-4496-bc3e-cc217e277342 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.665759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f025c-2f53-4496-bc3e-cc217e277342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.668963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f025c-2f53-4496-bc3e-cc217e277342 None admin] RBAC: Adding query filter params (role.id=d3bbff4f8c1e4d74bbe9cd468867d654, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=54a8877beced4d6d828a6c4a16b13491) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:03.669555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f025c-2f53-4496-bc3e-cc217e277342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:03.671552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f025c-2f53-4496-bc3e-cc217e277342 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:03.682096 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 122/251] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:03 2022] GET /identity/v3/role_assignments?user.id=54a8877beced4d6d828a6c4a16b13491&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=d3bbff4f8c1e4d74bbe9cd468867d654 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:03.698056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b202-e43a-498f-a231-1593340f07b0 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.698668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b202-e43a-498f-a231-1593340f07b0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.699142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b202-e43a-498f-a231-1593340f07b0 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.700866 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 123/252] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:03.706310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf587c-6b51-4de6-ba2c-4ca1e5833a12 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.706956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf587c-6b51-4de6-ba2c-4ca1e5833a12 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.707471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf587c-6b51-4de6-ba2c-4ca1e5833a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.736844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118bfe5-caf4-4781-b99b-78287c09526d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:03.737561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-84cf587c-6b51-4de6-ba2c-4ca1e5833a12 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:03.739747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84cf587c-6b51-4de6-ba2c-4ca1e5833a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:03.788182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:03.788807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:03.797144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:03.797144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:03.797144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:03.797144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:03.797144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:03.813862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 130/253] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:03.817204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:03.866133 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:03.887591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 124/254] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:03.888466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf587c-6b51-4de6-ba2c-4ca1e5833a12 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:03.903293 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.060226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f45db-c142-4387-bf3e-3a386cb0b4a0 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.063783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf587c-6b51-4de6-ba2c-4ca1e5833a12 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.122264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.123169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.123585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.123994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.143981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.145979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.146363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.146735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] PATH_INFO: `/v3/users/e87fd5899c944af2a12443e7c52decd1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.152844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] RBAC: Authorizing `identity:get_user(user_id=e87fd5899c944af2a12443e7c52decd1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:04.153835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:04.155517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:04.163948 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 125/255] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:03 2022] GET /identity/v3/users/e87fd5899c944af2a12443e7c52decd1 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:04.164526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:04.165607 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:04.166573 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:04.169673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.170180 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 131/256] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:04.179975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.305886 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.328406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02465cb-b55c-47c1-a737-2d113e7492cf None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.361470 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.369963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.370587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.370866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.371140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.371811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:04.372118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:04.373539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:04.397985 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 132/257] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:04.398859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.409569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0ab7-9539-482b-a8ac-3270ba30770b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.502368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.503365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.504350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.504811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.509752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:04.511926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:04.516114 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 126/258] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:04.517168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.527920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73b0b4-ea42-448e-a7b0-47b91df436c7 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.567244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.567883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.568163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.568437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.593505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:04.602059 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:04.603019 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:04.604310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 133/259] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:04.605245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.618479 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.728807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488ead6-7f51-4d63-9e6c-af95ccf35548 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.753624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7681e-164b-4ca9-bd19-07f86ef1b620 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.791995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.792658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.792945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.793250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/e87fd5899c944af2a12443e7c52decd1/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.796900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] RBAC: Authorizing `identity:create_grant(project_id=ef55a652856b48b0a04ac5a1e9cae197, user_id=e87fd5899c944af2a12443e7c52decd1, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:04.798375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:04.809485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.811611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.811611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.811611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] PATH_INFO: `/v3/users/38cc1b9374d049a5aa899b6e23f9c49d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.812067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] RBAC: Authorizing `identity:get_user(user_id=38cc1b9374d049a5aa899b6e23f9c49d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:04.813636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:04.815419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 127/260] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/users/38cc1b9374d049a5aa899b6e23f9c49d => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:04.816491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.827599 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 134/261] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:04 2022] PUT /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/e87fd5899c944af2a12443e7c52decd1/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:04.828655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.841891 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.900661 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.947793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b689cf-ac58-4853-ac5f-482a5eb41aed None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.985629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.986246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.986528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.986799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:05.039322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd69299-fd09-46e8-86df-3eacc26bcfb3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:05.062885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:05.064347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:05.133307 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:05.138738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:05.139357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:05.139633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:05.139900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:05.140822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:05.141153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:05.142522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:05.160965 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 128/262] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:05.170136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:05.178871 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 135/263] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:05.184661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:05.290847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065f188-ac11-4ef8-a36e-1f57aaea9be4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:05.327021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:05.327709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:05.327992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:05.328269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:05.329713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:05.331153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:05.333114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 136/264] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:05 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:05.338591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:05.343048 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:05.371250 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:05.411500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057eb1-7c4b-4232-a9d6-004121b5b489 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:05.448037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db040c84-08bd-449d-8cf1-c9b113bbc7a0 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:05.477764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:05.478408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:05.478688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:05.478965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] PATH_INFO: `/v3/users/38cc1b9374d049a5aa899b6e23f9c49d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:05.480145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] RBAC: Authorizing `identity:get_user(user_id=38cc1b9374d049a5aa899b6e23f9c49d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:05.481609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:05.483534 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 129/265] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:05 2022] GET /identity/v3/users/38cc1b9374d049a5aa899b6e23f9c49d => generated 283 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:05.485768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:05.486374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:05.486653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:05.486924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:05.487646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=38cc1b9374d049a5aa899b6e23f9c49d) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:05.487950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:05.490055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:05.491601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:05.496893 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 137/266] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:05 2022] GET /identity/v3/role_assignments?user.id=38cc1b9374d049a5aa899b6e23f9c49d&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:05.671966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91155bc-9577-420e-a1e2-2c9fa6a8d6b6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:05.726337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:05.726960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:05.727235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:05.727505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:05.738042 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:05.824867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:05.826775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:05.958419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 130/267] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:47:05.964390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:06.073272 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:06.080987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460bd1e-d703-48a9-8b73-4ea427677fed None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:06.124156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314eb201-b701-4247-b144-7087a427e830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:06.124802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb201-b701-4247-b144-7087a427e830 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.125116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb201-b701-4247-b144-7087a427e830 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.125399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314eb201-b701-4247-b144-7087a427e830 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.126557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314eb201-b701-4247-b144-7087a427e830 None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:06.127999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314eb201-b701-4247-b144-7087a427e830 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:06.130255 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 138/268] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:05 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:06.136315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:06.182649 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:06.263061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9ec30-f1e8-444c-9da7-8d3dba7730d2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:06.311003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7890a-8fe9-43b6-bcdc-3a90c95bd88b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.311324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7890a-8fe9-43b6-bcdc-3a90c95bd88b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.311554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7890a-8fe9-43b6-bcdc-3a90c95bd88b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.312913 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 139/269] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:06.321179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28820a0a-17bb-47b1-ba16-06c40dc55a08 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.321179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28820a0a-17bb-47b1-ba16-06c40dc55a08 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.321179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28820a0a-17bb-47b1-ba16-06c40dc55a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.324618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6a6dc-f689-40ed-baa3-2df9d6f9734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:06.325291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6a6dc-f689-40ed-baa3-2df9d6f9734c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.325573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6a6dc-f689-40ed-baa3-2df9d6f9734c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.325847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6a6dc-f689-40ed-baa3-2df9d6f9734c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.326574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6a6dc-f689-40ed-baa3-2df9d6f9734c None admin] RBAC: Adding query filter params (role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=38cc1b9374d049a5aa899b6e23f9c49d) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:06.326881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6a6dc-f689-40ed-baa3-2df9d6f9734c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:06.328321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6a6dc-f689-40ed-baa3-2df9d6f9734c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:06.342627 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 131/270] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:06 2022] GET /identity/v3/role_assignments?user.id=38cc1b9374d049a5aa899b6e23f9c49d&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:06.354405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-28820a0a-17bb-47b1-ba16-06c40dc55a08 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:06.355677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28820a0a-17bb-47b1-ba16-06c40dc55a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:06.431285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217c614-96f3-4f53-98d3-70ae6b635c5d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.431600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217c614-96f3-4f53-98d3-70ae6b635c5d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.431840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217c614-96f3-4f53-98d3-70ae6b635c5d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.433392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 132/271] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:06.438644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaff33-356d-422e-9309-be6ccc6b1091 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.438926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaff33-356d-422e-9309-be6ccc6b1091 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.439202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaff33-356d-422e-9309-be6ccc6b1091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.461714 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 140/272] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:06.474517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1ecaff33-356d-422e-9309-be6ccc6b1091 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:06.475831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ecaff33-356d-422e-9309-be6ccc6b1091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:06.580190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 133/273] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:06.630171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb452d-22f5-466a-942b-2b29af105573 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.630464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb452d-22f5-466a-942b-2b29af105573 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.630731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb452d-22f5-466a-942b-2b29af105573 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.632099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 141/274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:06.637425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52f36-e15a-40ad-8638-6d3d5f74115d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.637825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52f36-e15a-40ad-8638-6d3d5f74115d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.638189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52f36-e15a-40ad-8638-6d3d5f74115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:06.657687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c7f52f36-e15a-40ad-8638-6d3d5f74115d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:06.659150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c7f52f36-e15a-40ad-8638-6d3d5f74115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:06.692460 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:06.736346 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 134/275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:06.818511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb452d-22f5-466a-942b-2b29af105573 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:06.886758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f52f36-e15a-40ad-8638-6d3d5f74115d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:06.932941 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:06.949486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb452d-22f5-466a-942b-2b29af105573 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:06.995420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:06.996181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:06.996349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:06.996585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.009670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:07.016181 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:07.017290 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:07.018380 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:07.021115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 142/276] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:07.027811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.032341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f52f36-e15a-40ad-8638-6d3d5f74115d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.071055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.072056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.072295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.072604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.074132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.075584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.077408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 135/277] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:07.078082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.108977 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:07.142178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b190757-96f2-4f1d-8630-09d87f62e523 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.183151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae50ee-1dae-40d3-b5fa-a7bfcb2a96b9 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.184182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.184784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.185075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.185351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.186004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:07.186298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.187647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.195918 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 143/278] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:07.196515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.213527 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:07.226056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.226689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.226967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.227489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.238137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:07.243540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:07.244419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:07.245239 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 136/279] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:07.245909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.309139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9666e77-2677-44ca-b750-c8c615755745 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.338321 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:07.347688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.348851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.348990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3c950-9842-42ea-9935-c2c258e16e53 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.349244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.349417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.350050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.351516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.375123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 144/280] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:47:07 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:07.376279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.399608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.400565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.401087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.401613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] PATH_INFO: `/v3/users/973f9595ace643b9a1bb21fa6896eda6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.424304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] RBAC: Authorizing `identity:get_user(user_id=973f9595ace643b9a1bb21fa6896eda6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.427365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.432173 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 137/281] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:07 2022] GET /identity/v3/users/973f9595ace643b9a1bb21fa6896eda6 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:07.438129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.483853 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:07.536641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93803b14-76f9-4a5f-a795-02b132acb4ca None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.579297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef6b0-acc9-462b-a2be-be1326ea5d52 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.586072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.586780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.587128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.587467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.588241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:07.588598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.590412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.601949 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 145/282] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:07.607568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.623819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.624820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.625350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.625825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.626683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, user.id=973f9595ace643b9a1bb21fa6896eda6, scope.system=all) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:07.627138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.628560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.634528 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 138/283] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 00:47:07 2022] GET /identity/v3/role_assignments?user.id=973f9595ace643b9a1bb21fa6896eda6&scope.system=all&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:07.735375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4d01-0c23-470f-9ad5-8ed14e57765e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.780511 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:07.790369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.790369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.790369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.790369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] PATH_INFO: `/v3/users/54a8877beced4d6d828a6c4a16b13491` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.792696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] RBAC: Authorizing `identity:get_user(user_id=54a8877beced4d6d828a6c4a16b13491)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.794230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.796292 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 146/284] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:07 2022] GET /identity/v3/users/54a8877beced4d6d828a6c4a16b13491 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:07.806219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:07.823064 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:07.925022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462861-2bf2-40fd-9028-557e1ee37afd None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:07.968179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00219b6d-a1de-4b92-9e24-a8b64d064f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:07.968892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219b6d-a1de-4b92-9e24-a8b64d064f8b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:07.969217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219b6d-a1de-4b92-9e24-a8b64d064f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:07.969492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00219b6d-a1de-4b92-9e24-a8b64d064f8b None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:07.970649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00219b6d-a1de-4b92-9e24-a8b64d064f8b None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:07.972096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00219b6d-a1de-4b92-9e24-a8b64d064f8b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:07.974615 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 139/285] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:07 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:07.980440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:08.031150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f724cb-e7bb-4bc1-a0d2-0581d1aaef23 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:08.031479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f724cb-e7bb-4bc1-a0d2-0581d1aaef23 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:08.031712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f724cb-e7bb-4bc1-a0d2-0581d1aaef23 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:08.033054 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 140/286] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:08.041216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a93be-4318-4448-92dd-de3a6ed6a790 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:08.041509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a93be-4318-4448-92dd-de3a6ed6a790 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:08.041785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a93be-4318-4448-92dd-de3a6ed6a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:08.062920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c78a93be-4318-4448-92dd-de3a6ed6a790 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:08.064675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c78a93be-4318-4448-92dd-de3a6ed6a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:08.151256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ec0c4-917d-41b9-a5fb-b629c26b12bf None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:08.160984 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 141/287] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:08.193039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:08.193734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:08.194079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:08.194417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/54a8877beced4d6d828a6c4a16b13491/roles/d3bbff4f8c1e4d74bbe9cd468867d654` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:08.196404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef55a652856b48b0a04ac5a1e9cae197, user_id=54a8877beced4d6d828a6c4a16b13491, role_id=d3bbff4f8c1e4d74bbe9cd468867d654)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:08.197904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:08.216884 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 147/288] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:07 2022] PUT /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/users/54a8877beced4d6d828a6c4a16b13491/roles/d3bbff4f8c1e4d74bbe9cd468867d654 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:08.468165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a93be-4318-4448-92dd-de3a6ed6a790 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:08.480672 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:08.581457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a93be-4318-4448-92dd-de3a6ed6a790 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:08.619018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:08.619679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:08.619958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:08.620229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:08.632120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:08.637037 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:08.637949 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:08.639015 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 142/289] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:08.647321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:08.740954 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:08.793335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b6807-de63-4d0c-9cad-0a6c4e681ba2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:08.843207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:08.843832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:08.844111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:08.844383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:08.845081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:08.845388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:08.846768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:08.861488 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 148/290] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:08.867410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:08.977334 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:09.017818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0e8f5-45f2-467b-a09a-aacfdbde2bce None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:09.070880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:09.071589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:09.072315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:09.072315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] PATH_INFO: `/v3/users/e87fd5899c944af2a12443e7c52decd1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:09.073341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] RBAC: Authorizing `identity:get_user(user_id=e87fd5899c944af2a12443e7c52decd1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:09.074961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:09.076600 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 143/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:08 2022] GET /identity/v3/users/e87fd5899c944af2a12443e7c52decd1 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:09.082143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:09.229052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90468a8-2000-4b77-a435-5a60f171aa8d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:09.263776 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:09.281827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:09.282369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:09.282649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:09.282918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:09.381149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:09.382618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:09.514510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 149/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:09.520763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:09.667499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff820fc-aacd-4365-8ea8-0b57396982c8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:09.712506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f44cb-2f92-4352-9b40-a02743934831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:09.713166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f44cb-2f92-4352-9b40-a02743934831 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:09.713450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f44cb-2f92-4352-9b40-a02743934831 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:09.713726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f44cb-2f92-4352-9b40-a02743934831 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:09.714876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f44cb-2f92-4352-9b40-a02743934831 None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:09.716330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f44cb-2f92-4352-9b40-a02743934831 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:09.718291 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 144/293] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:09 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:09.724396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:09.767598 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:09.864783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256c4cf-9186-4ba9-9060-34ca0f8c7efd None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:09.915226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2f908-4259-4234-a80d-5e6552b7198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:09.915847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2f908-4259-4234-a80d-5e6552b7198e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:09.916127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2f908-4259-4234-a80d-5e6552b7198e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:09.916401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2f908-4259-4234-a80d-5e6552b7198e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:09.917155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2f908-4259-4234-a80d-5e6552b7198e None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=e87fd5899c944af2a12443e7c52decd1) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:09.917468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2f908-4259-4234-a80d-5e6552b7198e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:09.918909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2f908-4259-4234-a80d-5e6552b7198e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:09.925496 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 150/294] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:09 2022] GET /identity/v3/role_assignments?user.id=e87fd5899c944af2a12443e7c52decd1&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:10.250742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b5a2-fe1e-451e-a31c-0fb582839d57 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:10.251251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b5a2-fe1e-451e-a31c-0fb582839d57 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:10.251326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8b5a2-fe1e-451e-a31c-0fb582839d57 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:10.252613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 145/295] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:10.262306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6ff12-7059-44c2-ad77-055591354624 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:10.263111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6ff12-7059-44c2-ad77-055591354624 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:10.263588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6ff12-7059-44c2-ad77-055591354624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:10.286066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-09e6ff12-7059-44c2-ad77-055591354624 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:10.287660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-09e6ff12-7059-44c2-ad77-055591354624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:10.371868 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 151/296] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:10.428863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5594-6782-49f6-bf6a-00ad4250ca05 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:10.429506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5594-6782-49f6-bf6a-00ad4250ca05 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:10.429973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f5594-6782-49f6-bf6a-00ad4250ca05 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:10.431511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 146/297] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:10.437083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595e24-7b39-4522-a282-43812c6cf35d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:10.437403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595e24-7b39-4522-a282-43812c6cf35d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:10.437674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595e24-7b39-4522-a282-43812c6cf35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:10.460004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-19595e24-7b39-4522-a282-43812c6cf35d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:10.461267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-19595e24-7b39-4522-a282-43812c6cf35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:10.477145 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:10.557254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 152/298] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:10.604601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546f85e-7931-4b7b-883d-a1dc3c05bbdf None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:10.605280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546f85e-7931-4b7b-883d-a1dc3c05bbdf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:10.605777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546f85e-7931-4b7b-883d-a1dc3c05bbdf None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:10.607306 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 147/299] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:10.612699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f431-675f-4930-8644-23e2ad8f2488 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:10.613314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f431-675f-4930-8644-23e2ad8f2488 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:10.613818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86f431-675f-4930-8644-23e2ad8f2488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:10.633201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ca86f431-675f-4930-8644-23e2ad8f2488 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:10.634728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca86f431-675f-4930-8644-23e2ad8f2488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:10.680365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546f85e-7931-4b7b-883d-a1dc3c05bbdf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:10.692310 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:10.709858 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 153/300] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:10.794880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546f85e-7931-4b7b-883d-a1dc3c05bbdf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:10.830125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:10.830762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:10.831042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:10.831319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:10.831422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f431-675f-4930-8644-23e2ad8f2488 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:10.842256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:10.847525 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:10.848705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:10.849682 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 148/301] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:10.854505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:10.929647 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:10.948836 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:10.961161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86f431-675f-4930-8644-23e2ad8f2488 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:10.992592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac6fa-4967-4c62-8ad1-4b6b32fb5c91 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.005791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.006434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.006778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.007054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.018342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:11.023316 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:11.024191 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 154/302] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:11.029917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.033492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.034193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.034469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.034736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.035434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:11.035730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.037098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.045625 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 149/303] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:11.046265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.132680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65692-7c47-4f03-b852-af45498e32a8 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.145334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4b114-2c80-464b-b8ab-63319f1caabc None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.165715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559df8b-1ca9-4205-9e19-140ec0f576be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.166329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559df8b-1ca9-4205-9e19-140ec0f576be None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.166602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559df8b-1ca9-4205-9e19-140ec0f576be None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.166871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559df8b-1ca9-4205-9e19-140ec0f576be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.167973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559df8b-1ca9-4205-9e19-140ec0f576be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.169402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559df8b-1ca9-4205-9e19-140ec0f576be None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.170594 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:11.170931 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 155/304] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:11.172020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcd61-7cde-4916-bb52-6e08365be29c None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.172413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcd61-7cde-4916-bb52-6e08365be29c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.172552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcd61-7cde-4916-bb52-6e08365be29c None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.174005 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 156/305] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:11.174706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcd61-7cde-4916-bb52-6e08365be29c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.180473 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:11.180934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.181663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.181990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.182311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.183003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:11.183315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.184668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.193844 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 150/306] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:11.193844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.282531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcd61-7cde-4916-bb52-6e08365be29c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.293030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8bce6-db63-413a-8607-1046e5fd6c04 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.316152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3afdd-7509-4417-b5bf-6c1d537a73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.317259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3afdd-7509-4417-b5bf-6c1d537a73e4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.317669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3afdd-7509-4417-b5bf-6c1d537a73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.317935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3afdd-7509-4417-b5bf-6c1d537a73e4 None admin] PATH_INFO: `/v3/users/973f9595ace643b9a1bb21fa6896eda6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.319050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3afdd-7509-4417-b5bf-6c1d537a73e4 None admin] RBAC: Authorizing `identity:get_user(user_id=973f9595ace643b9a1bb21fa6896eda6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.320460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3afdd-7509-4417-b5bf-6c1d537a73e4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.326800 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 157/307] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:11 2022] GET /identity/v3/users/973f9595ace643b9a1bb21fa6896eda6 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:11.326800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbe0f-037b-44eb-ac7d-0a832282ee8d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.326800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbe0f-037b-44eb-ac7d-0a832282ee8d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.326800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbe0f-037b-44eb-ac7d-0a832282ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.327109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.327109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.327109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.327411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.327987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.329423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.342570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f87dbe0f-037b-44eb-ac7d-0a832282ee8d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:11.343767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f87dbe0f-037b-44eb-ac7d-0a832282ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:11.345548 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 151/308] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 11 00:47:11 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:11.346330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.418029 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:11.433746 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 158/309] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:11.437989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbe0f-037b-44eb-ac7d-0a832282ee8d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.440830 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:11.504878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431c58-71e8-4668-a646-2884dd820b2c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.563415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.564058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.564339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.564614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] PATH_INFO: `/v3/users/70616d7dd41447af973f16e0569610a7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.572446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbe0f-037b-44eb-ac7d-0a832282ee8d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.586232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] RBAC: Authorizing `identity:get_user(user_id=70616d7dd41447af973f16e0569610a7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.588285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.589977 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 152/310] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:11 2022] GET /identity/v3/users/70616d7dd41447af973f16e0569610a7 => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:11.596208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.621606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.622526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.622809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.623131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] PATH_INFO: `/v3/system/users/973f9595ace643b9a1bb21fa6896eda6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.625543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=973f9595ace643b9a1bb21fa6896eda6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.627561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.642034 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 159/311] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 11 00:47:11 2022] PUT /identity/v3/system/users/973f9595ace643b9a1bb21fa6896eda6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:11.730889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:11.733140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28981b-f586-4a1b-a04d-93957815caed None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.745203 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:11.775896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.777133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.777746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.778022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.778844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] RBAC: Adding query filter params (role.id=d3bbff4f8c1e4d74bbe9cd468867d654, user.id=70616d7dd41447af973f16e0569610a7, scope.system=all) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:11.779161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:11.780642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:11.793458 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 153/312] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 00:47:11 2022] GET /identity/v3/role_assignments?user.id=70616d7dd41447af973f16e0569610a7&scope.system=all&role.id=d3bbff4f8c1e4d74bbe9cd468867d654 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:11.819683 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:11.867446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d186fb5-04f9-4014-9261-f08c3ddef4b9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:11.912154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:11.913223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:11.913700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:11.914178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:11.929472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:11.933679 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:11.934587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:11.935399 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 160/313] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:11.940868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:12.050979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61913-023f-43c1-9ad7-990ecd180178 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:12.087326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:12.087936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:12.088212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:12.088483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:12.089185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:12.089490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:12.090852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:12.100311 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 154/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:12.106006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:12.229226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d03d2-da08-4792-872b-3b855fd4957e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:12.257118 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:12.266857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:12.267490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:12.267770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:12.268041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] PATH_INFO: `/v3/users/54a8877beced4d6d828a6c4a16b13491` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:12.269256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] RBAC: Authorizing `identity:get_user(user_id=54a8877beced4d6d828a6c4a16b13491)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:12.271309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:12.272893 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 161/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:12 2022] GET /identity/v3/users/54a8877beced4d6d828a6c4a16b13491 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:12.278657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:12.315319 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:12.386961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443b794-cbc9-4d90-9255-d2c838ea0253 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:12.421857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:12.422468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:12.422803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:12.423086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:12.495311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:12.496749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:12.532454 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:12.602508 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 155/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:12.608655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:12.720194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca201-36b6-41f0-b3c0-760af8cba497 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:12.756387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f9313-8f16-4570-a62e-129f31f81edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:12.757031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9313-8f16-4570-a62e-129f31f81edd None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:12.757341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9313-8f16-4570-a62e-129f31f81edd None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:12.757612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9313-8f16-4570-a62e-129f31f81edd None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:12.758731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f9313-8f16-4570-a62e-129f31f81edd None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:12.760146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f9313-8f16-4570-a62e-129f31f81edd None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:12.762083 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 162/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:12 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:12.768239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:12.872438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442897-15e9-4a70-a3aa-c30d7ec4891e None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:12.910744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b04a4-7ab0-48df-af73-9e0e1055061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:12.911607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b04a4-7ab0-48df-af73-9e0e1055061f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:12.912009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b04a4-7ab0-48df-af73-9e0e1055061f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:12.912402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b04a4-7ab0-48df-af73-9e0e1055061f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:12.913525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b04a4-7ab0-48df-af73-9e0e1055061f None admin] RBAC: Adding query filter params (role.id=d3bbff4f8c1e4d74bbe9cd468867d654, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197, user.id=54a8877beced4d6d828a6c4a16b13491) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:12.913982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b04a4-7ab0-48df-af73-9e0e1055061f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:12.916179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b04a4-7ab0-48df-af73-9e0e1055061f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:12.918758 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:12.925604 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 156/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:12 2022] GET /identity/v3/role_assignments?user.id=54a8877beced4d6d828a6c4a16b13491&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=d3bbff4f8c1e4d74bbe9cd468867d654 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:13.765438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7623-7d2d-4fa8-8adb-07c1317bdd55 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:13.765963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7623-7d2d-4fa8-8adb-07c1317bdd55 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:13.765963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7623-7d2d-4fa8-8adb-07c1317bdd55 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:13.767607 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 163/319] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:13.772925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00469-93fd-4801-9201-7355670ada31 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:13.773365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00469-93fd-4801-9201-7355670ada31 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:13.773539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00469-93fd-4801-9201-7355670ada31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:13.791631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5ff00469-93fd-4801-9201-7355670ada31 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:13.792790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5ff00469-93fd-4801-9201-7355670ada31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:13.861010 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 157/320] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:14.010070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b622e-c85f-4e1f-b36b-c21db617d593 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.010726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b622e-c85f-4e1f-b36b-c21db617d593 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.011219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b622e-c85f-4e1f-b36b-c21db617d593 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.012987 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 164/321] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:14.018337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec5bad-e263-44ae-a2bb-7ada471358ed None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.018625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec5bad-e263-44ae-a2bb-7ada471358ed None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.018898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec5bad-e263-44ae-a2bb-7ada471358ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.031565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3619-8267-4a8a-8c0a-830cd720e3b6 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.032202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3619-8267-4a8a-8c0a-830cd720e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.032202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3619-8267-4a8a-8c0a-830cd720e3b6 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.033589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 165/322] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:14.038533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-76ec5bad-e263-44ae-a2bb-7ada471358ed None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:14.039359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9c699-a1ca-4407-8d50-6c1c126b9ff3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.039644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9c699-a1ca-4407-8d50-6c1c126b9ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.039736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-76ec5bad-e263-44ae-a2bb-7ada471358ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:14.039918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9c699-a1ca-4407-8d50-6c1c126b9ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.061034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-10f9c699-a1ca-4407-8d50-6c1c126b9ff3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:14.062522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-10f9c699-a1ca-4407-8d50-6c1c126b9ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:14.112288 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 158/323] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:14.125429 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:14.137101 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 166/324] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:14.137260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec5bad-e263-44ae-a2bb-7ada471358ed None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.198363 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:14.240577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec5bad-e263-44ae-a2bb-7ada471358ed None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:14.275488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:14.276106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.276377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.276642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.277736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:14.279146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:14.280872 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 159/325] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:14.286209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9c699-a1ca-4407-8d50-6c1c126b9ff3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.384762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.386950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9c699-a1ca-4407-8d50-6c1c126b9ff3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:14.423634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:14.424250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.424525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.424793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] PATH_INFO: `/v3/groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.425460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:14.427414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:14.444935 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 167/326] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 11 00:47:14 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:47:14.445792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.499551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7020e-05f6-4aba-a3e6-1a5249828962 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:14.518523 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:14.537908 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:14.548706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:14.549573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.549858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.550133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.562037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:14.567209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:14.568154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:14.569023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 160/327] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:14.574557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.581231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d6ee9-6af6-4722-9f0f-6c76ae6a5743 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:14.621399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:14.621758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.622036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.622311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.635041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:14.640627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:14.641821 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:14.642621 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 168/328] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:14.649121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.700548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c8da-3c6f-4b2a-b988-bdda20149f51 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:14.746379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:14.747339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.747816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.748335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.749338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:14.749822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:14.751373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:14.761080 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 161/329] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:14.766909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.776417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879121a-1b68-4b4f-9c8f-17825ea6b174 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:14.794359 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:14.826012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:14.826629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.826906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.827176 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:14.827623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.827850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:14.828151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:14.830791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:14.847591 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 169/330] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:14.853765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.891028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ccd65-38ed-4514-8a7c-a529f57e0fdf None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:14.934500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:14.935299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:14.935573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:14.935842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] PATH_INFO: `/v3/users/70616d7dd41447af973f16e0569610a7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:14.936961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] RBAC: Authorizing `identity:get_user(user_id=70616d7dd41447af973f16e0569610a7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:14.938440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:14.940299 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 162/331] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:14 2022] GET /identity/v3/users/70616d7dd41447af973f16e0569610a7 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:14.946705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:14.987287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9e3b-e247-4040-a36b-57c667b64f72 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:15.032897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:15.033907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:15.034838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:15.035861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] PATH_INFO: `/v3/users/973f9595ace643b9a1bb21fa6896eda6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:15.037675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] RBAC: Authorizing `identity:get_user(user_id=973f9595ace643b9a1bb21fa6896eda6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:15.039665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:15.041897 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 170/332] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:14 2022] GET /identity/v3/users/973f9595ace643b9a1bb21fa6896eda6 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:15.047672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:15.063356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379691df-2ce4-4714-a0de-389bb9f82e8e None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:15.089485 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:15.095214 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:15.101995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d79f5d-8d5e-4ac0-a3af-01bc85b1faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:15.103297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79f5d-8d5e-4ac0-a3af-01bc85b1faae None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:15.104175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79f5d-8d5e-4ac0-a3af-01bc85b1faae None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:15.105439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79f5d-8d5e-4ac0-a3af-01bc85b1faae None admin] PATH_INFO: `/v3/system/users/70616d7dd41447af973f16e0569610a7/roles/d3bbff4f8c1e4d74bbe9cd468867d654` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:15.107628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d79f5d-8d5e-4ac0-a3af-01bc85b1faae None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=70616d7dd41447af973f16e0569610a7, role_id=d3bbff4f8c1e4d74bbe9cd468867d654)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:15.111763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d79f5d-8d5e-4ac0-a3af-01bc85b1faae None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:15.123927 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 163/333] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 11 00:47:14 2022] PUT /identity/v3/system/users/70616d7dd41447af973f16e0569610a7/roles/d3bbff4f8c1e4d74bbe9cd468867d654 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:47:15.174160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5f832-78a1-45ed-b765-d5b6fd2bdc70 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:15.216439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1799-023b-4d4b-8b68-61d216f836a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:15.217499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1799-023b-4d4b-8b68-61d216f836a1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:15.217978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1799-023b-4d4b-8b68-61d216f836a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:15.218445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1799-023b-4d4b-8b68-61d216f836a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:15.219467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1799-023b-4d4b-8b68-61d216f836a1 None admin] RBAC: Adding query filter params (role.id=275ac2aaf11e4619be3ad7f3890fb7b1, user.id=973f9595ace643b9a1bb21fa6896eda6, scope.system=all) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:15.219974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1799-023b-4d4b-8b68-61d216f836a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:15.221679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1799-023b-4d4b-8b68-61d216f836a1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:15.236377 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 171/334] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 00:47:15 2022] GET /identity/v3/role_assignments?user.id=973f9595ace643b9a1bb21fa6896eda6&scope.system=all&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:17.079943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676cfc-51e7-4738-8745-a6dd802b0a3d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:17.080449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676cfc-51e7-4738-8745-a6dd802b0a3d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:17.080524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676cfc-51e7-4738-8745-a6dd802b0a3d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:17.082705 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 164/335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:17.088158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a8ef-b080-47bb-bb87-5798db895cb3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:17.088607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a8ef-b080-47bb-bb87-5798db895cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:17.088684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a8ef-b080-47bb-bb87-5798db895cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:17.111984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4d80a8ef-b080-47bb-bb87-5798db895cb3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:17.113206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4d80a8ef-b080-47bb-bb87-5798db895cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:17.193957 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 172/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:17.222006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7070e-5fd9-4e5a-9d74-9e9d7bdfafb9 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:17.222314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7070e-5fd9-4e5a-9d74-9e9d7bdfafb9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:17.222557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7070e-5fd9-4e5a-9d74-9e9d7bdfafb9 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:17.224955 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 165/337] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:17.239202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aa694-b4fd-454c-8d22-41ee82de3ce2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:17.239530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aa694-b4fd-454c-8d22-41ee82de3ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:17.239758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aa694-b4fd-454c-8d22-41ee82de3ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:17.266107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-604aa694-b4fd-454c-8d22-41ee82de3ce2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:17.267562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-604aa694-b4fd-454c-8d22-41ee82de3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:17.296944 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:17.352854 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 173/338] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:17.803132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7070e-5fd9-4e5a-9d74-9e9d7bdfafb9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:17.933146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7070e-5fd9-4e5a-9d74-9e9d7bdfafb9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:17.976903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:17.977575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:17.977850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:17.978120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:17.995162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:17.998466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aa694-b4fd-454c-8d22-41ee82de3ce2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:18.016888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:18.017942 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:18.018753 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 166/339] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:18.024375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:18.101655 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.130637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aa694-b4fd-454c-8d22-41ee82de3ce2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:18.179751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7d35b-7054-4d09-96a2-bd812fa0970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:18.180842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7d35b-7054-4d09-96a2-bd812fa0970d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.181387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7d35b-7054-4d09-96a2-bd812fa0970d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.181862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7d35b-7054-4d09-96a2-bd812fa0970d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.207332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f7a0-eaaa-4331-b8fa-a2623abe0f82 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:18.213431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7d35b-7054-4d09-96a2-bd812fa0970d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-caf7d35b-7054-4d09-96a2-bd812fa0970d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:18.218440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:18.219394 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:18.220215 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 174/340] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:18.220869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3459e-92f5-4794-b53f-455ee0c70edf None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.221827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3459e-92f5-4794-b53f-455ee0c70edf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.221827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3459e-92f5-4794-b53f-455ee0c70edf None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.228168 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 175/341] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:18.230846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3459e-92f5-4794-b53f-455ee0c70edf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:18.270276 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.302240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37996496-ac06-468c-bf8e-c7f235cc3bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:18.302864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996496-ac06-468c-bf8e-c7f235cc3bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.303197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996496-ac06-468c-bf8e-c7f235cc3bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.303469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996496-ac06-468c-bf8e-c7f235cc3bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.304143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37996496-ac06-468c-bf8e-c7f235cc3bd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:18.304446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37996496-ac06-468c-bf8e-c7f235cc3bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:18.307976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37996496-ac06-468c-bf8e-c7f235cc3bd6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:18.325503 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 167/342] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:18.326763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb46e6-2501-48ad-92dc-9a602197f120 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.327043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb46e6-2501-48ad-92dc-9a602197f120 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.327309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb46e6-2501-48ad-92dc-9a602197f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.369575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-16eb46e6-2501-48ad-92dc-9a602197f120 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:18.370809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-16eb46e6-2501-48ad-92dc-9a602197f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:18.377996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3459e-92f5-4794-b53f-455ee0c70edf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:18.417318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:18.417938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.418216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.418490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.419700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:18.420015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:18.421444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:18.433725 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 176/343] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:18.435093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:18.455930 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 168/344] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:18.457976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52ff0-d690-42b3-a518-6daf9a676504 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.458382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52ff0-d690-42b3-a518-6daf9a676504 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.458657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52ff0-d690-42b3-a518-6daf9a676504 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.460243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 169/345] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:18.460954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52ff0-d690-42b3-a518-6daf9a676504 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:18.501104 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.599719 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.618347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52ff0-d690-42b3-a518-6daf9a676504 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:18.643480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567502a-6e50-420d-bd75-ed7a072fc976 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:18.675168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738f735-ec01-468e-b177-00b0a843133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:18.676194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738f735-ec01-468e-b177-00b0a843133b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.676601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738f735-ec01-468e-b177-00b0a843133b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.677075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738f735-ec01-468e-b177-00b0a843133b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.708926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f336a59-94e3-4f17-8520-525630f500d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:18.709810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f336a59-94e3-4f17-8520-525630f500d1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.710190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f336a59-94e3-4f17-8520-525630f500d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.710949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f336a59-94e3-4f17-8520-525630f500d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.812398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738f735-ec01-468e-b177-00b0a843133b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:18.814098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738f735-ec01-468e-b177-00b0a843133b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:18.844838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f336a59-94e3-4f17-8520-525630f500d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:18.846466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f336a59-94e3-4f17-8520-525630f500d1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:18.869052 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.956358 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:18.960054 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 170/346] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:18.961606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e54c25-fa94-4693-abaa-95975c742932 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.962003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e54c25-fa94-4693-abaa-95975c742932 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.962423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e54c25-fa94-4693-abaa-95975c742932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.982208 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 177/347] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:18.983615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51dd3-5602-4078-a64c-acf2d4fce35a None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:18.983906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51dd3-5602-4078-a64c-acf2d4fce35a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:18.984181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51dd3-5602-4078-a64c-acf2d4fce35a None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:18.985721 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 178/348] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:18.986420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51dd3-5602-4078-a64c-acf2d4fce35a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:18.991769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c4e54c25-fa94-4693-abaa-95975c742932 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:18.993086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c4e54c25-fa94-4693-abaa-95975c742932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:19.085115 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 171/349] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:19.086321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e54c25-fa94-4693-abaa-95975c742932 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.135575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51dd3-5602-4078-a64c-acf2d4fce35a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.168610 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:19.180783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.182707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.183217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.183681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.198310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:19.204825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:19.205800 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:47:19.206671 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:19.210679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 179/350] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:19.211738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.224596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e54c25-fa94-4693-abaa-95975c742932 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.267926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097786a1-12a2-41e8-9a94-92b72694a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.268567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097786a1-12a2-41e8-9a94-92b72694a7ec None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.268838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097786a1-12a2-41e8-9a94-92b72694a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.269158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097786a1-12a2-41e8-9a94-92b72694a7ec None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.271198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097786a1-12a2-41e8-9a94-92b72694a7ec None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:19.271967 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:19.273103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097786a1-12a2-41e8-9a94-92b72694a7ec None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:19.274942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 172/351] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:19.276103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db4e8-c086-4b32-99fa-421f0631214a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.276649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db4e8-c086-4b32-99fa-421f0631214a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.276995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db4e8-c086-4b32-99fa-421f0631214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.297738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2a5db4e8-c086-4b32-99fa-421f0631214a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:19.298776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a5db4e8-c086-4b32-99fa-421f0631214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:19.357553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdba4e-babe-4409-973c-bca185274013 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.381960 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 173/352] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:19.382909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db4e8-c086-4b32-99fa-421f0631214a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.404992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.405940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.406416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.406851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.408667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:19.411568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:19.414194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 180/353] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:19.415179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.458739 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:19.518914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db4e8-c086-4b32-99fa-421f0631214a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.552734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af030f-fc8a-4b94-81b4-73e267e254ab None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.569483 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:19.571696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.572324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.572601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.572875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.573730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:19.574037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:19.576308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:19.588117 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 174/354] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:19.589012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.604414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.605481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.605956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.606419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.616176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:19.617948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:19.620936 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 181/355] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:19.621911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.724493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b77fba-1bff-46b7-8027-2e8082953c26 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.747676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ab6ea-d979-4430-8fad-85dcc180b8db None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.750558 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:19.764209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.764931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.765267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.765544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.766918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:19.768348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:19.770629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 175/356] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:19.771557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.788706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.788706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.789009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.789191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.802175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:19.807579 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:19.808681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 182/357] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:19.809917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.849410 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:19.894552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361143-8366-4d27-89cc-43f0d05ff87b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.929305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa048-5283-407d-85ad-fc6821920a9f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:19.934181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d6492-bfdc-4c4a-b382-4834e0aa7ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.934822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d6492-bfdc-4c4a-b382-4834e0aa7ecd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.935104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d6492-bfdc-4c4a-b382-4834e0aa7ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.935375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d6492-bfdc-4c4a-b382-4834e0aa7ecd None admin] PATH_INFO: `/v3/users/70616d7dd41447af973f16e0569610a7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.936518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d6492-bfdc-4c4a-b382-4834e0aa7ecd None admin] RBAC: Authorizing `identity:get_user(user_id=70616d7dd41447af973f16e0569610a7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:19.938006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d6492-bfdc-4c4a-b382-4834e0aa7ecd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:19.939575 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 176/358] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/users/70616d7dd41447af973f16e0569610a7 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:19.943314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0b3a-b64c-45ae-9965-61ecf6a8a76d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.943314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0b3a-b64c-45ae-9965-61ecf6a8a76d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.943314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0b3a-b64c-45ae-9965-61ecf6a8a76d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.943314 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 177/359] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:19.944273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae0b3a-b64c-45ae-9965-61ecf6a8a76d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:19.967338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:19.967966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:19.968242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:19.968509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:19.969267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:19.969573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:19.971001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:19.977241 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 183/360] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:19.977793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:20.021015 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:20.090946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae0b3a-b64c-45ae-9965-61ecf6a8a76d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:20.124936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6972c-b12f-48c4-bbab-3e06a0636f2e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:20.128241 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:20.136885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:20.137571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.138417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.138700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.152934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:20.160877 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:20.161888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:20.162709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 178/361] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:20.163387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:20.178684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:20.179343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.179573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.179848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.180587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:20.182401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:20.184551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:20.190915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 184/362] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:19 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:20.192746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:20.301811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda41ab-dc78-43e0-a83e-2f1fe6d90de0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:20.321284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0f444-a808-490f-9a28-6ae33aa33955 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:20.334372 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:20.361131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c695c-4112-4526-b85e-706728357240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:20.361768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c695c-4112-4526-b85e-706728357240 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.362056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c695c-4112-4526-b85e-706728357240 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.362319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c695c-4112-4526-b85e-706728357240 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.363027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c695c-4112-4526-b85e-706728357240 None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:20.363304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c695c-4112-4526-b85e-706728357240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:20.364865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c695c-4112-4526-b85e-706728357240 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:20.366231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:20.367157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.367703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.368770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.369796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] RBAC: Adding query filter params (role.id=d3bbff4f8c1e4d74bbe9cd468867d654, user.id=70616d7dd41447af973f16e0569610a7, scope.system=all) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:20.370310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:20.372105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:20.380326 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 179/363] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:20.380326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ada3c-cfff-4a91-aa40-0b98326cfd64 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.380326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ada3c-cfff-4a91-aa40-0b98326cfd64 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.380326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ada3c-cfff-4a91-aa40-0b98326cfd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.394604 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 185/364] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 00:47:20 2022] GET /identity/v3/role_assignments?user.id=70616d7dd41447af973f16e0569610a7&scope.system=all&role.id=d3bbff4f8c1e4d74bbe9cd468867d654 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:20.396115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:20.404048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-808ada3c-cfff-4a91-aa40-0b98326cfd64 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:20.405514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-808ada3c-cfff-4a91-aa40-0b98326cfd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:20.426080 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:20.559551 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 180/365] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:20.560389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ada3c-cfff-4a91-aa40-0b98326cfd64 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:20.593341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0db51c-10d8-4b23-a820-edd87ec29b12 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:20.660541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:20.661565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.662065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.662554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.663490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:20.663991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:20.665704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:20.678723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 186/366] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:20.685277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:20.769039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ada3c-cfff-4a91-aa40-0b98326cfd64 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:20.786614 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:20.820919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:20.821991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.822528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.823003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.831207 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:20.857916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0797a8-8cdc-425b-9ecf-7d248b9ca919 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:20.903190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:20.903801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:20.904079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:20.904353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:20.911805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:20.913600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:20.985296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:20.986751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:21.088769 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.111672 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 187/367] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:47:21.112543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.121702 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 181/368] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:21.127165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.139334 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.231578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6aed5-361f-41ef-846b-4f41b1b0f4a2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.236870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97253291-85ce-4aa1-8072-b51d9571d73a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.270333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.271238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.271518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.271790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.276378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.277009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.277332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.277603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.278722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:21.280377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:21.282675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:21.285195 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 182/369] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:21.286627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:21.288689 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:21.289677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:21.292076 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 188/370] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:21.297933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.345500 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.384113 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.416422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930048bd-de30-4cb4-9f24-ad65105475da None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.423567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d83a2-25aa-4a69-ae7d-d20ed79e4cb8 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.458573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.459173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.459451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.459705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.461033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:21.462022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.462492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:21.462687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.462910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.463179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.464286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:21.464469 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 183/371] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:21.465266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.465726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:21.471877 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 189/372] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:21.472746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.603602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995a60d-d0b3-4391-9bea-bf5457ebce1f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.609626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e684db-4871-4cba-b483-63f65e1650d1 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.624267 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.653625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.654763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.655035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.655307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.656475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:21.656777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:21.658964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:21.661776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.662636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.663117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.663586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.664889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:21.666544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:21.667629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 184/373] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:21.668427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.670643 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 190/374] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:21.676522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.684362 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.783332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba397e-44ff-4995-a222-178dfbbce75a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.789662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f31d7-c9f6-47f5-8305-29b906d83905 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:21.826936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.827839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.828327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.828736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.829703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:21.830241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:21.832191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:21.836866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:21.837619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:21.838136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:21.838639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:21.840592 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 185/375] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:21.841672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:21.946545 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.967575 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:21.993768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:21.995509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:22.006618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985783a-fa3e-48b7-ad5b-c1d678a1eef5 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:22.083781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:22.084412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:22.084694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:22.084968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:22.085775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:22.086092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:22.087538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:22.098569 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 186/376] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:22.171346 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 191/377] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:22.177779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:22.314878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01713f4-7575-4f67-94a8-97a83c003711 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:22.360184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:22.360820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:22.361165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:22.361449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] PATH_INFO: `/v3/projects/677f08d32cea40f083b85bb0df613dd0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:22.362601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] RBAC: Authorizing `identity:get_project(project_id=677f08d32cea40f083b85bb0df613dd0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:22.364584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:22.366555 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 187/378] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:22 2022] GET /identity/v3/projects/677f08d32cea40f083b85bb0df613dd0 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:22.372022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:22.461514 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:22.487690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75745e-f60e-4240-922e-75116a4e10f3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:22.548174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc659-971f-4935-a9ca-846987a9cbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:22.548824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc659-971f-4935-a9ca-846987a9cbfb None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:22.549136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc659-971f-4935-a9ca-846987a9cbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:22.549414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc659-971f-4935-a9ca-846987a9cbfb None admin] PATH_INFO: `/v3/groups/1813abb33e3346698d7d54b198d0f1c8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:22.560797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc659-971f-4935-a9ca-846987a9cbfb None admin] RBAC: Authorizing `identity:get_group(group_id=1813abb33e3346698d7d54b198d0f1c8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:22.562508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc659-971f-4935-a9ca-846987a9cbfb None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:22.564353 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 192/379] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:22 2022] GET /identity/v3/groups/1813abb33e3346698d7d54b198d0f1c8 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:22.571097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:22.578274 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:22.581551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f445cd-9539-4b94-8a20-8cc6761d2505 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:22.582532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f445cd-9539-4b94-8a20-8cc6761d2505 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:22.582532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f445cd-9539-4b94-8a20-8cc6761d2505 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:22.583946 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 193/380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:22.593000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6bc19-16cb-4338-962e-c373618d44ce None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:22.593317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6bc19-16cb-4338-962e-c373618d44ce None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:22.593593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6bc19-16cb-4338-962e-c373618d44ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:22.625581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-33f6bc19-16cb-4338-962e-c373618d44ce None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:22.626810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-33f6bc19-16cb-4338-962e-c373618d44ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:22.747485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675b794-4840-4441-9b41-405f32a2f478 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:22.764970 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 194/381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:22.790868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114c13-4a0d-429f-94b6-1d775e0cf76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:22.791475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114c13-4a0d-429f-94b6-1d775e0cf76b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:22.791753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114c13-4a0d-429f-94b6-1d775e0cf76b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:22.792022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114c13-4a0d-429f-94b6-1d775e0cf76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:22.792752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114c13-4a0d-429f-94b6-1d775e0cf76b None admin] RBAC: Adding query filter params (group.id=1813abb33e3346698d7d54b198d0f1c8, role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=677f08d32cea40f083b85bb0df613dd0) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:22.793097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114c13-4a0d-429f-94b6-1d775e0cf76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:22.794515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114c13-4a0d-429f-94b6-1d775e0cf76b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:22.800887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 188/382] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:22 2022] GET /identity/v3/role_assignments?group.id=1813abb33e3346698d7d54b198d0f1c8&scope.project.id=677f08d32cea40f083b85bb0df613dd0&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:23.107618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6bc19-16cb-4338-962e-c373618d44ce None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:23.201468 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:23.221485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5314ea-07e3-44fe-9750-389c11a3353c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.222101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5314ea-07e3-44fe-9750-389c11a3353c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.222585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5314ea-07e3-44fe-9750-389c11a3353c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.224626 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 189/383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:23.230371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a746d6-bab3-44f7-83fe-ef7c07686873 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.231012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a746d6-bab3-44f7-83fe-ef7c07686873 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.231487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a746d6-bab3-44f7-83fe-ef7c07686873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.245333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6bc19-16cb-4338-962e-c373618d44ce None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:23.255504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-80a746d6-bab3-44f7-83fe-ef7c07686873 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:23.257636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80a746d6-bab3-44f7-83fe-ef7c07686873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:23.314385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:23.315028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.315311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.315571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.341043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:23.342713 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:23.350052 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:23.350945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:23.351725 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:23.356389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 195/384] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:23.357927 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 190/385] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:23.362720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a746d6-bab3-44f7-83fe-ef7c07686873 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:23.494065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a746d6-bab3-44f7-83fe-ef7c07686873 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:23.546986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:23.547925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.548391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.548874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.549781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:23.550273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:23.552623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:23.564457 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 191/386] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:23.570804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:23.693122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f50e-b4f9-4a34-9533-a89231747cd2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:23.724370 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:23.730142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:23.731166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.731645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.732115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.733454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:23.735177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:23.737261 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 196/387] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:23 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:23.746125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:23.820178 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:23.846009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:23.913429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f179d-1239-40f3-a523-fd883aa9332b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:23.986070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:23.986701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:23.986976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:23.987241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:23.991952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:23.993405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:23.995061 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 192/388] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:23 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:24.000952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:24.044508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774a948-2510-4a05-af47-3fa72d2b3699 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:24.091395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:24.093335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.094656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.096163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.118819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:24.124471 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:24.125408 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:24.126328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:24.133328 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 197/389] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:24.139512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:24.168323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcc00e-c756-48e8-8926-a5438b463732 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:24.200053 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:24.211773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:24.212819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.213350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.213816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.216305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e0a0c5eaf43aea21ba643db80846e, group_id=0dbf2b6b74c0467e9afa5585e44641b4, role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:24.218024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:24.242303 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 193/390] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 00:47:24 2022] PUT /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:24.269593 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:24.328090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daaaac-c248-47ac-878d-6915f097b4c5 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:24.377776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:24.378734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.379365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.379955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.380814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:24.381342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:24.383032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:24.394638 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 198/391] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:24.401048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:24.536472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bcc1e-4f77-439a-84cd-292234f9a8db None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:24.573380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e31cc2-c462-440c-8e54-a94fe0cdf2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:24.574013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e31cc2-c462-440c-8e54-a94fe0cdf2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.574285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e31cc2-c462-440c-8e54-a94fe0cdf2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.574606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e31cc2-c462-440c-8e54-a94fe0cdf2d1 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.575720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e31cc2-c462-440c-8e54-a94fe0cdf2d1 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:24.577167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e31cc2-c462-440c-8e54-a94fe0cdf2d1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:24.579144 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 194/392] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:24 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:24.585632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:24.708391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d1d3-fd9c-4b5e-b118-c96f0a23143c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:24.716274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cad89-8576-4c6f-80a3-5e858d49ea71 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.716553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cad89-8576-4c6f-80a3-5e858d49ea71 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.716825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cad89-8576-4c6f-80a3-5e858d49ea71 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.718455 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 195/393] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:24.723162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78a32d-b268-42c3-94da-eb301dd0eeb6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.723440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78a32d-b268-42c3-94da-eb301dd0eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.723705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78a32d-b268-42c3-94da-eb301dd0eeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.747850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1f78a32d-b268-42c3-94da-eb301dd0eeb6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:24.749032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f78a32d-b268-42c3-94da-eb301dd0eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:24.767296 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:24.790587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:24.791146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:24.791421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:24.791689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:24.793804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:24.795476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:24.797708 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 199/394] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:24 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:24.804204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:24.828762 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:24.847744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 196/395] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:24.963420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d031fc0-b3c7-4a65-ae87-a8c92c2b8546 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:25.009788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78acd3-4e5a-46ed-b615-97d6286f98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:25.010472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78acd3-4e5a-46ed-b615-97d6286f98b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.010755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78acd3-4e5a-46ed-b615-97d6286f98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.011035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78acd3-4e5a-46ed-b615-97d6286f98b6 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.013032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78acd3-4e5a-46ed-b615-97d6286f98b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b07e0a0c5eaf43aea21ba643db80846e, group_id=0dbf2b6b74c0467e9afa5585e44641b4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:25.014480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78acd3-4e5a-46ed-b615-97d6286f98b6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:25.038816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3bfb-06bf-4371-a7ce-26b8885c3052 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.039419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3bfb-06bf-4371-a7ce-26b8885c3052 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.039908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3bfb-06bf-4371-a7ce-26b8885c3052 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.041618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 197/396] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:25.042624 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 200/397] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 00:47:24 2022] PUT /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:47:25.046804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53885fe-1156-46d5-a3cc-d40143718de5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.047088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53885fe-1156-46d5-a3cc-d40143718de5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.047361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53885fe-1156-46d5-a3cc-d40143718de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.074325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e53885fe-1156-46d5-a3cc-d40143718de5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:25.075550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e53885fe-1156-46d5-a3cc-d40143718de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:25.137473 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:25.161173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 201/398] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:25.192741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e3bfb-06bf-4371-a7ce-26b8885c3052 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:25.319175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e3bfb-06bf-4371-a7ce-26b8885c3052 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:25.371227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:25.371866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.372140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.372410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.386973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:25.392182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:25.393282 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:25.394269 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:25.398138 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 198/399] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:25.399606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53885fe-1156-46d5-a3cc-d40143718de5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:25.498183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:25.522080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53885fe-1156-46d5-a3cc-d40143718de5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:25.559990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:25.560624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.560905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.561226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.561918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:25.562216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:25.563614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:25.573735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 202/400] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:25.579501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:25.616170 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:25.666603 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:25.669980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef06177-b298-4d08-8178-71a76fc04ce3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:25.707098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:25.707783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.708115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.708411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.725465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:25.740372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:25.741384 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:25.742197 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 199/401] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:25.747490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:25.802542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112caad5-0c0a-40db-ab45-765cd450a0f9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:25.875771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bac865-a7c4-4a29-a1ab-4da8a51d2432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:25.876387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bac865-a7c4-4a29-a1ab-4da8a51d2432 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.876669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bac865-a7c4-4a29-a1ab-4da8a51d2432 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.877010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bac865-a7c4-4a29-a1ab-4da8a51d2432 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.878083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bac865-a7c4-4a29-a1ab-4da8a51d2432 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:25.880391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bac865-a7c4-4a29-a1ab-4da8a51d2432 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:25.882314 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 203/402] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:25 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:25.887970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891641f-9229-47ad-a790-743fa5930256 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.888251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891641f-9229-47ad-a790-743fa5930256 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.888525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891641f-9229-47ad-a790-743fa5930256 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.894615 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 204/403] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:25.894615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891641f-9229-47ad-a790-743fa5930256 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:25.925499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b21a8-0e14-4bb4-8ff4-4365a220c33f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:25.934278 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:25.967111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065056e-20d3-4f29-b603-63dce746762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:25.968305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065056e-20d3-4f29-b603-63dce746762f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.968825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065056e-20d3-4f29-b603-63dce746762f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.969833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065056e-20d3-4f29-b603-63dce746762f None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:25.970920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065056e-20d3-4f29-b603-63dce746762f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:25.971366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065056e-20d3-4f29-b603-63dce746762f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:25.975049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065056e-20d3-4f29-b603-63dce746762f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:25.985359 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 200/404] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:25.987056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932acc2-35fc-4400-8991-5d9f705fb38f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:25.987743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932acc2-35fc-4400-8991-5d9f705fb38f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:25.988153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932acc2-35fc-4400-8991-5d9f705fb38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.010794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891641f-9229-47ad-a790-743fa5930256 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:26.012888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5932acc2-35fc-4400-8991-5d9f705fb38f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:26.015133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5932acc2-35fc-4400-8991-5d9f705fb38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:26.023821 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:26.058532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:26.059435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:26.059850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:26.060258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.061663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:26.063325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:26.070521 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 205/405] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:25 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:26.071643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:26.097762 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 201/406] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:26.099189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932acc2-35fc-4400-8991-5d9f705fb38f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:26.194290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294d1a1-647f-4994-ac94-701e986c6f18 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:26.198749 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:26.201883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932acc2-35fc-4400-8991-5d9f705fb38f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:26.239339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:26.240167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:26.240428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:26.240641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:26.241003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.241530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:26.242270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:26.242677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.243292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef55a652856b48b0a04ac5a1e9cae197, group_id=0dbf2b6b74c0467e9afa5585e44641b4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:26.244017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:26.244907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:26.245805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:26.248979 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 206/407] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:26 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:26.253585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:26.260668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 202/408] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 00:47:26 2022] PUT /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:26.327629 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:26.403840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533894f7-738b-4e6d-9abf-5d71d4880255 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:26.447638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:26.448523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:26.448942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:26.449395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.453876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:26.455604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:26.458048 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 207/409] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:26 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:26.463813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:26.487896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:26.592874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99679635-3f3d-4687-b786-fe5c0b1beba5 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:26.629007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:26.629938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:26.630215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:26.630486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.632625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] RBAC: Authorizing `identity:create_grant(project_id=ef55a652856b48b0a04ac5a1e9cae197, group_id=0dbf2b6b74c0467e9afa5585e44641b4, role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:26.634082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:26.654712 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 203/410] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 00:47:26 2022] PUT /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197/groups/0dbf2b6b74c0467e9afa5585e44641b4/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:26.667202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7275f-1f96-42b1-840d-b6207ae6003f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:26.685268 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:26.709191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:26.710055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:26.710481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:26.710900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.723726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:26.729581 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:26.730741 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:26.731752 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:26.734121 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 208/411] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:26.740797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:26.770558 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:26.887366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2111-03ed-4fde-9ca8-755da7a1df4d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:26.925565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:26.926924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:26.927288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:26.927558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:26.928339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:26.928640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:26.930159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:26.943021 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 204/412] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:26.948644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:27.074037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873c78-9d37-45d5-b1bf-67154050fc4a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:27.109423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad2859-2663-4f88-bcb3-f83f3aa98095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:27.110060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad2859-2663-4f88-bcb3-f83f3aa98095 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.110337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad2859-2663-4f88-bcb3-f83f3aa98095 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.110610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad2859-2663-4f88-bcb3-f83f3aa98095 None admin] PATH_INFO: `/v3/groups/1813abb33e3346698d7d54b198d0f1c8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.111743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad2859-2663-4f88-bcb3-f83f3aa98095 None admin] RBAC: Authorizing `identity:get_group(group_id=1813abb33e3346698d7d54b198d0f1c8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:27.113202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad2859-2663-4f88-bcb3-f83f3aa98095 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:27.115155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 209/413] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:26 2022] GET /identity/v3/groups/1813abb33e3346698d7d54b198d0f1c8 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:27.120604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:27.123311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ee0d-649d-482c-bcaa-34719d6f6242 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.123597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ee0d-649d-482c-bcaa-34719d6f6242 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.123873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ee0d-649d-482c-bcaa-34719d6f6242 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.125479 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 210/414] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:27.131463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5570-c581-4755-8988-823b53244293 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.131762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5570-c581-4755-8988-823b53244293 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.132017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb5570-c581-4755-8988-823b53244293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.151169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-48bb5570-c581-4755-8988-823b53244293 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:27.152375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-48bb5570-c581-4755-8988-823b53244293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:27.188559 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:27.223891 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 211/415] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:27.269589 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:27.282852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3218c-bc9b-458d-bd31-7fdcc1ca28b8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:27.319929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:27.320552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.320825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.321115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] PATH_INFO: `/v3/projects/677f08d32cea40f083b85bb0df613dd0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.322336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] RBAC: Authorizing `identity:get_project(project_id=677f08d32cea40f083b85bb0df613dd0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:27.323812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:27.325952 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 205/416] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:27 2022] GET /identity/v3/projects/677f08d32cea40f083b85bb0df613dd0 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:27.331454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5570-c581-4755-8988-823b53244293 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:27.489266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb5570-c581-4755-8988-823b53244293 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:27.556775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:27.557482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.557758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.558031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] PATH_INFO: `/v3/projects/677f08d32cea40f083b85bb0df613dd0/groups/1813abb33e3346698d7d54b198d0f1c8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.562368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=677f08d32cea40f083b85bb0df613dd0, group_id=1813abb33e3346698d7d54b198d0f1c8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:27.563066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:27.563807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:27.594162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 212/417] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 11 00:47:27 2022] PUT /identity/v3/projects/677f08d32cea40f083b85bb0df613dd0/groups/1813abb33e3346698d7d54b198d0f1c8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:27.681591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b043-40bb-47e2-9fdb-c0035a703f7e None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:27.718967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:27.719608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.719882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.720149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.732830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:27.741540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:27.742420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:27.743254 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:27.747449 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 206/418] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:27.750167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:27.808635 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:27.902996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa3682-332c-46d3-85eb-55a95ded48f9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:27.948305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62126a1a-d687-47be-8110-ab081a2d3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:27.948934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126a1a-d687-47be-8110-ab081a2d3354 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:27.949246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126a1a-d687-47be-8110-ab081a2d3354 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:27.949519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126a1a-d687-47be-8110-ab081a2d3354 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:27.950197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126a1a-d687-47be-8110-ab081a2d3354 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:27.950497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126a1a-d687-47be-8110-ab081a2d3354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:27.951868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126a1a-d687-47be-8110-ab081a2d3354 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:27.962882 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 213/419] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:27.968733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:27.982041 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:28.068713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787464f-1391-46cc-b57a-27456d1ed630 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:28.069036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787464f-1391-46cc-b57a-27456d1ed630 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:28.069300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787464f-1391-46cc-b57a-27456d1ed630 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:28.070923 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 214/420] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:28.075972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab808d5-5e32-4d44-9771-270207dbc4ad None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:28.076254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab808d5-5e32-4d44-9771-270207dbc4ad None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:28.076593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab808d5-5e32-4d44-9771-270207dbc4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:28.098900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1ab808d5-5e32-4d44-9771-270207dbc4ad None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:28.105085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1ab808d5-5e32-4d44-9771-270207dbc4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:28.133081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6a477-8173-4086-9906-b728c724c0af None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:28.181848 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 215/421] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:28.188294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:28.188920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:28.189230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:28.189507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:28.290992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:28.292514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:28.303047 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:28.419668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 207/422] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:47:28.421336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab808d5-5e32-4d44-9771-270207dbc4ad None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:28.461810 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:28.474096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:28.600264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9972f2-ca57-4a9a-9d80-c6dfb7590f56 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:28.608024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab808d5-5e32-4d44-9771-270207dbc4ad None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:28.610405 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:28.649313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:28.649951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:28.650224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:28.650494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:28.668941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:28.675418 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:28.676379 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:28.677709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 208/423] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:28.679574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:28.680215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:28.680494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:28.680761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:28.681991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:28.683483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:28.685230 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 216/424] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:28 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:28.685936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:28.691071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:28.869556 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:28.876031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207b53-4b22-492b-a70e-02a0125a07f3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:28.878973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdff38-beff-4feb-98da-16022c31b2a5 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:28.956532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:28.957972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:28.959237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:28.960017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:28.960477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:28.961347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:28.962154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:28.962627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:28.963061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:28.964625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:28.965146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:28.968008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:28.969630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:28.980437 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 217/425] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:28 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:28.984813 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 209/426] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:28.986251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:28.991094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.053459 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.118219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696accd3-dc69-4caa-b999-d2a09338c473 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.122198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a1c3-ac90-4b0c-8c13-877e58487928 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.155717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd7a52-f041-44f7-ac59-4c9dd27f636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.156423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7a52-f041-44f7-ac59-4c9dd27f636e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.156768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7a52-f041-44f7-ac59-4c9dd27f636e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.157138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7a52-f041-44f7-ac59-4c9dd27f636e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.157558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6aec31-0c66-4904-9665-8b97efcd5aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.157989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd7a52-f041-44f7-ac59-4c9dd27f636e None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:29.158365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd7a52-f041-44f7-ac59-4c9dd27f636e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:29.158756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aec31-0c66-4904-9665-8b97efcd5aca None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.159290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aec31-0c66-4904-9665-8b97efcd5aca None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.159724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aec31-0c66-4904-9665-8b97efcd5aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.160053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd7a52-f041-44f7-ac59-4c9dd27f636e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:29.170305 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 218/427] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:28 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:29.170305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c35e3-59b0-442d-b855-7a141dc2e6a7 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.170305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c35e3-59b0-442d-b855-7a141dc2e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.170305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c35e3-59b0-442d-b855-7a141dc2e6a7 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.170305 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 219/428] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:29.176333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996d7cb-e03f-4b70-ac57-c33875372680 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.176333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996d7cb-e03f-4b70-ac57-c33875372680 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.176333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996d7cb-e03f-4b70-ac57-c33875372680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.196865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5996d7cb-e03f-4b70-ac57-c33875372680 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:29.198396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5996d7cb-e03f-4b70-ac57-c33875372680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:29.218544 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.258869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6aec31-0c66-4904-9665-8b97efcd5aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:29.260666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6aec31-0c66-4904-9665-8b97efcd5aca None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:29.289752 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 220/429] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:29.295255 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.377488 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 210/430] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:29.382708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996d7cb-e03f-4b70-ac57-c33875372680 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.488147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb0c46-a81d-44a5-a381-ef984928ec1a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.488455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb0c46-a81d-44a5-a381-ef984928ec1a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.488809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb0c46-a81d-44a5-a381-ef984928ec1a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.491281 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 211/431] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:29.495360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8460435-224b-4819-a314-f97869e06a2f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.495651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8460435-224b-4819-a314-f97869e06a2f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.496034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8460435-224b-4819-a314-f97869e06a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.514300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996d7cb-e03f-4b70-ac57-c33875372680 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.523525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a8460435-224b-4819-a314-f97869e06a2f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:29.524711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a8460435-224b-4819-a314-f97869e06a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:29.554779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.555758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.556340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.556820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] PATH_INFO: `/v3/projects/b07e0a0c5eaf43aea21ba643db80846e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.558225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] RBAC: Authorizing `identity:get_project(project_id=b07e0a0c5eaf43aea21ba643db80846e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:29.559955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:29.562168 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 221/432] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/projects/b07e0a0c5eaf43aea21ba643db80846e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:29.568636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.595811 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.610531 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 212/433] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:29.611675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8460435-224b-4819-a314-f97869e06a2f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.684359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f8fc-cb9d-442e-a7a0-b4193716b9ac None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.686464 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.723766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.724763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.725264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.725725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.727067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:29.729509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:29.731128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8460435-224b-4819-a314-f97869e06a2f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.731883 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 222/434] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:29.738380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.768172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.768899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.769261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.769648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.780832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:29.786050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:29.786946 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:47:29.787753 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:29.792141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 213/435] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:29.793490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.848928 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.860555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48108c-655f-4637-ae28-a51f2b8feecb None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.904844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.905845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.906274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.906611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.907508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=b07e0a0c5eaf43aea21ba643db80846e) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:29.907892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:29.909658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:29.919190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6f210-7359-41ef-8923-eb5c5a0d70ed None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:29.921421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 223/436] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=b07e0a0c5eaf43aea21ba643db80846e&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:29.941475 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:29.951543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:29.961232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:29.961858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:29.962134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:29.962519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:29.963200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] RBAC: Adding query filter params (name=member) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:29.963502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:29.964919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:29.975668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 214/437] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:29.982384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:30.091991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595e9cb-bf08-4819-a3b7-53e79628e103 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:30.119028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7cf99-53e2-4612-8459-76e3cbc13c34 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:30.140374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:30.141026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.141344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.141617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.155608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:30.162546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:30.164028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:30.166215 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 224/438] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:30.169552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:30.169552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.169552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.169552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.171228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:30.200965 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:30.234045 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:30.261250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:30.263053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:30.321025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461fbe-55ef-4a07-af1c-ddc83229ae09 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:30.372733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:30.375009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.375280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.375541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.376207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:30.376505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:30.377965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:30.392568 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 225/439] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:30.398326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:30.429098 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 215/440] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:47:30.437194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:30.523625 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:30.544520 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:30.560910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a669476-6d65-48fc-bb6d-fb7a0dcafd31 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:30.568980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555169-7f29-40d3-bc5c-04886bf87fb1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:30.606783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53430710-aaf4-486e-9d48-6ee68495b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:30.607486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430710-aaf4-486e-9d48-6ee68495b46c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.607762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430710-aaf4-486e-9d48-6ee68495b46c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.608228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430710-aaf4-486e-9d48-6ee68495b46c None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.609241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53430710-aaf4-486e-9d48-6ee68495b46c None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:30.610730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53430710-aaf4-486e-9d48-6ee68495b46c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:30.613183 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 216/441] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:30 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:30.618382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaa9dd-e7fc-4248-b1ed-aa43db92a2c2 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.618665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaa9dd-e7fc-4248-b1ed-aa43db92a2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.618944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaa9dd-e7fc-4248-b1ed-aa43db92a2c2 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.620246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 217/442] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:30.620995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:30.622250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.622689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaa9dd-e7fc-4248-b1ed-aa43db92a2c2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:30.623072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.623697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.698917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:30.701142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:30.738301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaa9dd-e7fc-4248-b1ed-aa43db92a2c2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:30.777690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1596c-7579-4a40-85d8-3811ff005bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:30.778249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1596c-7579-4a40-85d8-3811ff005bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.778663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1596c-7579-4a40-85d8-3811ff005bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.779154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1596c-7579-4a40-85d8-3811ff005bd6 None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.780897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1596c-7579-4a40-85d8-3811ff005bd6 None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:30.781568 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:30.783441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1596c-7579-4a40-85d8-3811ff005bd6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:30.786741 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 218/443] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:30 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:30.788374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b30a8-4579-40fb-bb34-9bdd04275b85 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.788837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b30a8-4579-40fb-bb34-9bdd04275b85 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.789313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b30a8-4579-40fb-bb34-9bdd04275b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.809244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-859b30a8-4579-40fb-bb34-9bdd04275b85 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:30.811127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-859b30a8-4579-40fb-bb34-9bdd04275b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:30.811775 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 226/444] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:30.812616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:30.828430 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:30.901685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 219/445] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:30.902046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b30a8-4579-40fb-bb34-9bdd04275b85 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:30.944652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88934927-ffcc-4c4b-b1d7-7237698c56dd None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:30.980592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:30.981222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:30.981502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:30.981771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:30.982490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=275ac2aaf11e4619be3ad7f3890fb7b1, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:30.982799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:30.984234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:30.990507 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 227/446] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:30 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=275ac2aaf11e4619be3ad7f3890fb7b1 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:31.022630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b30a8-4579-40fb-bb34-9bdd04275b85 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.059535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.060089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.060362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.060628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] PATH_INFO: `/v3/projects/ef55a652856b48b0a04ac5a1e9cae197` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.061897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] RBAC: Authorizing `identity:get_project(project_id=ef55a652856b48b0a04ac5a1e9cae197)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:31.063342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:31.065194 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 220/447] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:30 2022] GET /identity/v3/projects/ef55a652856b48b0a04ac5a1e9cae197 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:31.070852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:31.117733 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:31.171659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:31.180514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5735dcd-6989-492c-9d30-35936530ae6d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.193024 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:31.219854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.220489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.220765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.221035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] PATH_INFO: `/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.222173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] RBAC: Authorizing `identity:get_group(group_id=0dbf2b6b74c0467e9afa5585e44641b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:31.224133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:31.225908 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 228/448] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/groups/0dbf2b6b74c0467e9afa5585e44641b4 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:31.237817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:31.287236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcba689-ff3a-45d1-81ee-42687956f761 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.329537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.330098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.330378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.330643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.344814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:31.349869 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:31.350947 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:31.351953 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 221/449] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:31.358236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:31.373951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d781c-d59c-4f55-8cc6-4e1f13fd9e5a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.385078 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:31.416684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.417302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.417581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.417843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.418558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] RBAC: Adding query filter params (group.id=0dbf2b6b74c0467e9afa5585e44641b4, role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=ef55a652856b48b0a04ac5a1e9cae197) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:31.418857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:31.420254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:31.426038 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 229/450] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/role_assignments?group.id=0dbf2b6b74c0467e9afa5585e44641b4&scope.project.id=ef55a652856b48b0a04ac5a1e9cae197&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:31.447318 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:31.472856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48b8f-6f36-43cf-9df2-f16433549d5d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.512390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.513012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.513341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.513609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.514301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:31.514607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:31.516009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:31.525309 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 222/451] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:31.531221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:31.635076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f31b4-0903-4f90-9aa3-eb9b550303f0 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.668919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.669554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.669829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.670096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.711101 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:31.739652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:31.741118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:31.837340 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 230/452] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:47:31.843243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:31.938775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847da148-640c-4d47-ba0a-6b07536d5bb0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:31.970451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:31.971057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:31.971326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:31.971592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] PATH_INFO: `/v3/projects/677f08d32cea40f083b85bb0df613dd0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:31.972686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] RBAC: Authorizing `identity:get_project(project_id=677f08d32cea40f083b85bb0df613dd0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:31.974865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:31.976442 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 223/453] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/projects/677f08d32cea40f083b85bb0df613dd0 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:31.981850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:32.047835 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:32.075213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40cb09-8149-4682-81e0-8d5e77fc94d6 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:32.108087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2a3d7-79f9-4cc0-ae8a-add25cbfe47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:32.108686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a3d7-79f9-4cc0-ae8a-add25cbfe47a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:32.108957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a3d7-79f9-4cc0-ae8a-add25cbfe47a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:32.109251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a3d7-79f9-4cc0-ae8a-add25cbfe47a None admin] PATH_INFO: `/v3/groups/1813abb33e3346698d7d54b198d0f1c8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:32.110330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2a3d7-79f9-4cc0-ae8a-add25cbfe47a None admin] RBAC: Authorizing `identity:get_group(group_id=1813abb33e3346698d7d54b198d0f1c8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:32.111730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2a3d7-79f9-4cc0-ae8a-add25cbfe47a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:32.113277 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 231/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 11 00:47:31 2022] GET /identity/v3/groups/1813abb33e3346698d7d54b198d0f1c8 => generated 229 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:32.119155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:32.128202 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:32.217393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15099c32-40df-480e-b2ce-475e55921f77 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:32.249209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5b9b-4de3-406b-a206-3c8eae65bc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:32.249796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5b9b-4de3-406b-a206-3c8eae65bc0d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:32.250069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5b9b-4de3-406b-a206-3c8eae65bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:32.250336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5b9b-4de3-406b-a206-3c8eae65bc0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:32.251046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5b9b-4de3-406b-a206-3c8eae65bc0d None admin] RBAC: Adding query filter params (group.id=1813abb33e3346698d7d54b198d0f1c8, role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=677f08d32cea40f083b85bb0df613dd0) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:32.251350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5b9b-4de3-406b-a206-3c8eae65bc0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:32.252762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5b9b-4de3-406b-a206-3c8eae65bc0d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:32.258887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 224/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 11 00:47:32 2022] GET /identity/v3/role_assignments?group.id=1813abb33e3346698d7d54b198d0f1c8&scope.project.id=677f08d32cea40f083b85bb0df613dd0&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:34.857254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f1e70-fa15-40de-95be-845d3cf90ad9 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:34.858197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f1e70-fa15-40de-95be-845d3cf90ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:34.858675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f1e70-fa15-40de-95be-845d3cf90ad9 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:34.860199 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 232/456] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:34.866676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be9b9-c715-4313-aca9-0abd4ed22f36 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:34.867501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be9b9-c715-4313-aca9-0abd4ed22f36 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:34.867984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be9b9-c715-4313-aca9-0abd4ed22f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:34.897112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-143be9b9-c715-4313-aca9-0abd4ed22f36 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:34.898691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-143be9b9-c715-4313-aca9-0abd4ed22f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:34.935122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3d187-af99-499d-9daf-23bb9865186d None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:34.935823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3d187-af99-499d-9daf-23bb9865186d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:34.936319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3d187-af99-499d-9daf-23bb9865186d None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:34.938099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 233/457] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:34.943643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dbbc3-698b-4968-85eb-bdfcd108dec2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:34.944170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dbbc3-698b-4968-85eb-bdfcd108dec2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:34.944668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dbbc3-698b-4968-85eb-bdfcd108dec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:34.975159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b16dbbc3-698b-4968-85eb-bdfcd108dec2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:34.977690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b16dbbc3-698b-4968-85eb-bdfcd108dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:34.993518 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:35.000007 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 225/458] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:35.061686 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 234/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:35.368381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be9b9-c715-4313-aca9-0abd4ed22f36 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:35.375614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dbbc3-698b-4968-85eb-bdfcd108dec2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:35.483998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be9b9-c715-4313-aca9-0abd4ed22f36 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:35.514346 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:35.540966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6563c-5a42-4ed9-8af7-c566e4e6827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:35.541919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6563c-5a42-4ed9-8af7-c566e4e6827b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.542381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6563c-5a42-4ed9-8af7-c566e4e6827b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.542813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6563c-5a42-4ed9-8af7-c566e4e6827b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.550713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dbbc3-698b-4968-85eb-bdfcd108dec2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:35.553732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6563c-5a42-4ed9-8af7-c566e4e6827b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:35.555239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6563c-5a42-4ed9-8af7-c566e4e6827b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-50b6563c-5a42-4ed9-8af7-c566e4e6827b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:35.571303 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:35.572718 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:35.574423 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:35.574423 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:35.574423 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:35.576837 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 226/460] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:35.578896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae8680-a63c-487e-b650-b8b987a688b3 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.579342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae8680-a63c-487e-b650-b8b987a688b3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.579766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae8680-a63c-487e-b650-b8b987a688b3 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.585995 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 227/461] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:35.587806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4410-4aed-47d9-a63b-08d087e8bb7b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.588287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4410-4aed-47d9-a63b-08d087e8bb7b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.589008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4410-4aed-47d9-a63b-08d087e8bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.595332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:35.596075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.596424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.596783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.609154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:35.610404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e90c4410-4aed-47d9-a63b-08d087e8bb7b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:35.611046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:35.612042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e90c4410-4aed-47d9-a63b-08d087e8bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:35.629141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:35.630896 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:35.631945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:35.631945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:35.631945 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:35.633977 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 235/462] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:35.634994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:35.707621 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 228/463] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:35.708695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c4410-4aed-47d9-a63b-08d087e8bb7b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:35.713475 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:35.778265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bef5d-2c60-4859-a3c3-fec2ab7c8856 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:35.805831 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:35.820151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42aa413-19d8-469c-a93c-a08170db2f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:35.821273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aa413-19d8-469c-a93c-a08170db2f5d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.822080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aa413-19d8-469c-a93c-a08170db2f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.822499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aa413-19d8-469c-a93c-a08170db2f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.823282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42aa413-19d8-469c-a93c-a08170db2f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:35.823726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42aa413-19d8-469c-a93c-a08170db2f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:35.825930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42aa413-19d8-469c-a93c-a08170db2f5d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:35.839458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c4410-4aed-47d9-a63b-08d087e8bb7b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:35.840247 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 236/464] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:35.845093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49842-d7c5-4a25-af31-2177b9399116 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.845093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49842-d7c5-4a25-af31-2177b9399116 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.845093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49842-d7c5-4a25-af31-2177b9399116 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.845093 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 237/465] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:35.848458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49842-d7c5-4a25-af31-2177b9399116 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:35.887656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7978d-b306-49b7-8cb0-b7aba0544ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:35.888159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7978d-b306-49b7-8cb0-b7aba0544ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.888423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7978d-b306-49b7-8cb0-b7aba0544ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.888855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7978d-b306-49b7-8cb0-b7aba0544ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.889662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7978d-b306-49b7-8cb0-b7aba0544ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:35.890213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7978d-b306-49b7-8cb0-b7aba0544ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:35.891746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7978d-b306-49b7-8cb0-b7aba0544ba5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:35.904156 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 229/466] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:35.905706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6b69-5cc1-4aac-95dd-2a5d14674ccb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:35.906191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6b69-5cc1-4aac-95dd-2a5d14674ccb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:35.906660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6b69-5cc1-4aac-95dd-2a5d14674ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:35.926128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5c5c6b69-5cc1-4aac-95dd-2a5d14674ccb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:35.927696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5c5c6b69-5cc1-4aac-95dd-2a5d14674ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:35.971234 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:35.975559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49842-d7c5-4a25-af31-2177b9399116 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.006566 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 230/467] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:36.007704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6b69-5cc1-4aac-95dd-2a5d14674ccb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.015952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.016789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.017500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.017910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.018816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.020699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.046767 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 238/468] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:47:35 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:36.048080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.097806 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:36.209372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6b69-5cc1-4aac-95dd-2a5d14674ccb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.219380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c8fd1-ebf9-4b7d-90cc-f1b8a040666c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.279905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.281806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.282936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.283578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.284952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.288170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.293998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.294955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.295237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.295508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.309551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.311477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.316685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 231/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:47:36 2022] POST /identity/v3/users => generated 246 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:36.317691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:36.327860 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:36.328861 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:36.329837 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:36.329837 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:36.329837 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:36.331763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 239/470] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:36.339077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.358094 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:36.452788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8919326-afd4-42e4-b72c-b6400f752636 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.467404 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:36.482526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58eeb-6528-4944-af64-58f851752c29 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.499438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.500089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.500368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.500635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.519592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.522704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.531640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.532736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.533248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.533712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.534549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:36.535029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.536918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:36.545573 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:36.546579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:36.547433 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:36.547433 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:36.547433 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:36.547433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 232/471] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:36.553659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.555145 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 240/472] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:36.562104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.659689 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:36.682127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d4315-1d4c-4fff-b49b-637b8686ccef None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.692995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9e75c-260b-4390-86d8-f862a8b04952 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:36.724173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf7fcd-c49a-44aa-bd0e-4ee8b583b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.725138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7fcd-c49a-44aa-bd0e-4ee8b583b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.725621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7fcd-c49a-44aa-bd0e-4ee8b583b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.726149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7fcd-c49a-44aa-bd0e-4ee8b583b7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.727047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf7fcd-c49a-44aa-bd0e-4ee8b583b7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:36.727545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf7fcd-c49a-44aa-bd0e-4ee8b583b7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.729133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf7fcd-c49a-44aa-bd0e-4ee8b583b7b6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.744077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698cffe-c9ca-4020-bd75-fac760e96062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:36.744694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698cffe-c9ca-4020-bd75-fac760e96062 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.744971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698cffe-c9ca-4020-bd75-fac760e96062 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.745291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698cffe-c9ca-4020-bd75-fac760e96062 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.745948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698cffe-c9ca-4020-bd75-fac760e96062 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:36.746588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 233/473] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:36.747429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698cffe-c9ca-4020-bd75-fac760e96062 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:36.748323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6a269-da07-461e-b3cf-46ff58485306 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.748803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6a269-da07-461e-b3cf-46ff58485306 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.749311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6a269-da07-461e-b3cf-46ff58485306 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.751215 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 234/474] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:36.752105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6a269-da07-461e-b3cf-46ff58485306 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:36.775400 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 241/475] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:47:36 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:36.781707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068ef0-d635-4966-9834-34ef9db3fc0c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:36.781995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068ef0-d635-4966-9834-34ef9db3fc0c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:36.782273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6068ef0-d635-4966-9834-34ef9db3fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:36.803983 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:36.814432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c6068ef0-d635-4966-9834-34ef9db3fc0c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:36.822058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c6068ef0-d635-4966-9834-34ef9db3fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:36.912361 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 242/476] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:36.944042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6a269-da07-461e-b3cf-46ff58485306 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:37.000117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:37.000976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:37.001416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:37.001839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:37.002621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:37.004184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:37.016680 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:37.031590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 235/477] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:47:36 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:37.217369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068ef0-d635-4966-9834-34ef9db3fc0c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:37.323609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6068ef0-d635-4966-9834-34ef9db3fc0c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:37.360142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:37.361152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:37.361651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:37.362128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:37.363011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:37.365267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:37.371240 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:37.377885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.sql.core [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:47:37.377885 n-d-master-1 devstack@keystone.service[81860]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 00:47:37.377885 n-d-master-1 devstack@keystone.service[81860]: [parameters: {'id': '3675efd7122143be8c6b4d0fe3b9b080', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 00:47:37.377885 n-d-master-1 devstack@keystone.service[81860]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81860) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application result.read() Sep 11 00:47:37.399134 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return ref.to_dict() Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:47:37.400062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application yield resource Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise self.value Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application session.commit() Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:47:37.401015 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:47:37.401910 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:47:37.402785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application result.read() Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:47:37.403655 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [parameters: {'id': '3675efd7122143be8c6b4d0fe3b9b080', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:37.404443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 00:47:37.406595 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:37.407811 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 243/478] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 00:47:37 2022] POST /identity/v3/roles => generated 144 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:37.408974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:37.530303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0c711-4ec1-4a70-93cc-13d88bbc0e58 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:37.568379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d204b-a4ba-4d9b-b6d0-e506256d6bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:37.569007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d204b-a4ba-4d9b-b6d0-e506256d6bcf None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:37.569308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d204b-a4ba-4d9b-b6d0-e506256d6bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:37.569574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d204b-a4ba-4d9b-b6d0-e506256d6bcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:37.580096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d204b-a4ba-4d9b-b6d0-e506256d6bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-e40d204b-a4ba-4d9b-b6d0-e506256d6bcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:37.585531 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:37.586459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:37.587302 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 236/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:47:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:37.593860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:37.735968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe35a-a565-4703-898a-e96b10bccb62 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:37.784938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8db0e5-ed3f-4f42-80c9-48afff87d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:37.785633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8db0e5-ed3f-4f42-80c9-48afff87d3ff None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:37.787079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8db0e5-ed3f-4f42-80c9-48afff87d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:37.787365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8db0e5-ed3f-4f42-80c9-48afff87d3ff None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:37.788030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8db0e5-ed3f-4f42-80c9-48afff87d3ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:37.788328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8db0e5-ed3f-4f42-80c9-48afff87d3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:37.789707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8db0e5-ed3f-4f42-80c9-48afff87d3ff None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:37.805290 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 244/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:39.069035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58521af-ac61-43ab-bd09-005d1f5cb06d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.070064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58521af-ac61-43ab-bd09-005d1f5cb06d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.070546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58521af-ac61-43ab-bd09-005d1f5cb06d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.072363 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 237/481] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:39.077504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07cef-45bd-47f6-b2ea-d2ceb31f81eb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.078319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07cef-45bd-47f6-b2ea-d2ceb31f81eb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.078795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07cef-45bd-47f6-b2ea-d2ceb31f81eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.102909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-72f07cef-45bd-47f6-b2ea-d2ceb31f81eb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:39.104456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-72f07cef-45bd-47f6-b2ea-d2ceb31f81eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:39.128830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd1ac-2a5f-4019-b5db-96fe223557ac None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.129150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd1ac-2a5f-4019-b5db-96fe223557ac None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.129475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbd1ac-2a5f-4019-b5db-96fe223557ac None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.131204 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 238/482] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:39.136091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ffab2-fc20-4203-b68f-d54d46eacffa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.136371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ffab2-fc20-4203-b68f-d54d46eacffa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.136644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ffab2-fc20-4203-b68f-d54d46eacffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.166125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b86ffab2-fc20-4203-b68f-d54d46eacffa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:39.167343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b86ffab2-fc20-4203-b68f-d54d46eacffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:39.173534 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:39.184934 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 245/483] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:39.262231 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:39.286463 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 239/484] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:39.597472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07cef-45bd-47f6-b2ea-d2ceb31f81eb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:39.605594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9929d97-9e96-447a-bf96-362489b6c86e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.605868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9929d97-9e96-447a-bf96-362489b6c86e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.606142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9929d97-9e96-447a-bf96-362489b6c86e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.607724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 240/485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:39.612307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1539-f25d-4bd1-b313-641618e9b5b3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.612802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1539-f25d-4bd1-b313-641618e9b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.613309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1539-f25d-4bd1-b313-641618e9b5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.645927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8dcf1539-f25d-4bd1-b313-641618e9b5b3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:39.647695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8dcf1539-f25d-4bd1-b313-641618e9b5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:39.713955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07cef-45bd-47f6-b2ea-d2ceb31f81eb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:39.733540 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 241/486] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:39.735045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1539-f25d-4bd1-b313-641618e9b5b3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:39.780040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:39.781914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.783089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.783725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.818104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:39.823262 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:39.824137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:39.825521 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 246/487] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:39.829755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:39.882069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1539-f25d-4bd1-b313-641618e9b5b3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:39.903143 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:39.918656 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:39.929767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e9014-8b18-47b1-a2c6-58803d2c1564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:39.930790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e9014-8b18-47b1-a2c6-58803d2c1564 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.931080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e9014-8b18-47b1-a2c6-58803d2c1564 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.931355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e9014-8b18-47b1-a2c6-58803d2c1564 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.945991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e9014-8b18-47b1-a2c6-58803d2c1564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8b2e9014-8b18-47b1-a2c6-58803d2c1564 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:39.951868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:39.952773 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 242/488] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:39.957897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5965d-9bf6-4825-9933-546a9dcbff3d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.959141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5965d-9bf6-4825-9933-546a9dcbff3d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.959141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5965d-9bf6-4825-9933-546a9dcbff3d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.959141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 243/489] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:39.963239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce7211-fc4c-450b-8b3b-5938d0b5c02b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:39.963529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce7211-fc4c-450b-8b3b-5938d0b5c02b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:39.963806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce7211-fc4c-450b-8b3b-5938d0b5c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:39.990351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a2c5-dc0a-47c4-89e7-4fb58bf6688b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:39.992049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f6ce7211-fc4c-450b-8b3b-5938d0b5c02b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:39.994130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f6ce7211-fc4c-450b-8b3b-5938d0b5c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:40.035472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.037263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.037738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.038696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.039595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:40.040558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.042823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.052895 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 247/490] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:40.054159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.073347 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 244/491] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:40.073347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce7211-fc4c-450b-8b3b-5938d0b5c02b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.179052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a03ca9-39df-45a8-a1a5-fd027415963c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.181687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce7211-fc4c-450b-8b3b-5938d0b5c02b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.189783 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:40.196631 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:40.221242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.221841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.222112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.222379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.223030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:40.223996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.224675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.225390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.225763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.226254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.226809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.234163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 248/492] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:40.237923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.243000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:40.248130 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:40.249100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:40.249904 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:40.252360 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 245/493] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:40.258352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.356488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffc1ec-dc45-40f6-a4de-b71e0504d5eb None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.370328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418108a-afc1-4d7d-99f1-1009207bb99d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.402578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.403231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.403472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.403904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.406999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.407626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.407909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.408178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.414976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.416471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.418970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.420408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:40.431507 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:40.432398 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:40.433268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:40.433268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:40.433268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:40.433268 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 249/494] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:40.433498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:40.439667 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:40.440550 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:40.446920 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:40.446920 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:40.446920 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:40.446920 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 246/495] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:40.446920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.466914 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:40.467918 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:40.553759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7d6dd-eadd-4d03-b276-b9581d1f4459 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.556925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712a68e-0aad-44eb-8a76-e26b72f1a95e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.589240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.589869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.590148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.590423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.592535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.593164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.593444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.593712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.594370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:40.594736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.596185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.601642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:40.613165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 250/496] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:40.613165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:40.613398 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:40.614368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 247/497] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:40.615177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.702792 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:40.713466 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:40.725321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e92ba-c92d-428c-824d-03dd93701ca6 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.729215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bcc4b-e84e-4cca-b78a-1b5a0bc6dc00 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.760081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.760684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.760962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.761265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.761904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:40.762206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.763554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.765207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.765813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.766090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.766360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.766993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:40.767544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.768889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.775762 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 251/498] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:40.776555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.786684 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 248/499] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:40.787354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.872036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33a674-dd97-4f92-9281-9c92d2c37a8c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.883870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3917f9-d46d-47d1-a742-80577fd957ba None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:40.904826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.905555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.905836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.906114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.916475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.917133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf918fc-388c-424f-9bb4-3a1f4c5dc4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:40.917723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf918fc-388c-424f-9bb4-3a1f4c5dc4ca None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.917947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.918039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf918fc-388c-424f-9bb4-3a1f4c5dc4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.918249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf918fc-388c-424f-9bb4-3a1f4c5dc4ca None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.918887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf918fc-388c-424f-9bb4-3a1f4c5dc4ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:40.919184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf918fc-388c-424f-9bb4-3a1f4c5dc4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:40.920512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf918fc-388c-424f-9bb4-3a1f4c5dc4ca None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:40.925289 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:40.929500 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 249/500] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:40.930663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6654-6d96-4749-b259-6a2e9e0a4d51 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:40.930945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6654-6d96-4749-b259-6a2e9e0a4d51 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:40.931214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6654-6d96-4749-b259-6a2e9e0a4d51 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:40.932539 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 250/501] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:40.933628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:40.934498 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:40.935352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:40.935352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:40.935352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:40.935352 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 252/502] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:40.936110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.936715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef6654-6d96-4749-b259-6a2e9e0a4d51 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:40.939539 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.039542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef6654-6d96-4749-b259-6a2e9e0a4d51 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.045455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed96499-7eb8-4c57-a34a-b1f9a46ef056 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.072693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.073339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.073617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.074148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.080862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce06ae4-03e0-4909-a939-10fdfd67fde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.081302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.081865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06ae4-03e0-4909-a939-10fdfd67fde3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.082209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06ae4-03e0-4909-a939-10fdfd67fde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.082884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06ae4-03e0-4909-a939-10fdfd67fde3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.082994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.090476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce06ae4-03e0-4909-a939-10fdfd67fde3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.091902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce06ae4-03e0-4909-a939-10fdfd67fde3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:41.095248 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:41.096140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:47:41.097041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:41.097606 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 251/503] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:41.098378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-6ce06ae4-03e0-4909-a939-10fdfd67fde3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:41.104949 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:41.105995 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:41.106923 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 253/504] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:41.107482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd8f7-35a0-4384-872a-e4a799b0dc4c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.107482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd8f7-35a0-4384-872a-e4a799b0dc4c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.107777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cd8f7-35a0-4384-872a-e4a799b0dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.126327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-981cd8f7-35a0-4384-872a-e4a799b0dc4c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:41.127438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-981cd8f7-35a0-4384-872a-e4a799b0dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:41.162925 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.185893 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.198085 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 254/505] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:41.198685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cd8f7-35a0-4384-872a-e4a799b0dc4c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.214909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c923eeb-868d-42b1-8fa2-1aa2481b5114 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.248646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.249292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.249574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.249846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.261052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.262531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:41.277291 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:41.278197 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:41.279059 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:41.279059 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:41.279059 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:41.279059 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 252/506] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:41.279283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.308065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cd8f7-35a0-4384-872a-e4a799b0dc4c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.345541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.346456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.346735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.347003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.347629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:41.347925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.349619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.368450 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 255/507] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:41.368450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.388944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cb79-4132-4bd6-afd1-752489228a47 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.402603 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.424663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.425302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.425576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.425846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.426104 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.427088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:41.427323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.428736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.466823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 253/508] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:41.467714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.477950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e33594-471b-4478-8403-e5efd11147fb None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.510966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.511571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.511848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.512120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.512841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:41.513174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.514603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.551763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 256/509] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:41.552812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.568781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e6aa-57e8-47a0-90a0-ad61b4c9a1e6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.601790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.602390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.602666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.602943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.603573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:41.603876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.605275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.616588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 254/510] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:41.617397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.646845 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.658798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f49b5-180a-4d9b-a0f8-494ccece4bed None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.669917 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.693843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.694467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.694744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.695018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.701948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.703378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.716017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba13b96-baa2-4f84-9890-fe7a73f63511 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:41.716352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:41.717448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:41.718432 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 257/511] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:41.719001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.751934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.752557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.752832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.753123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.763895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.765371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:41.780123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:41.781270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:41.782182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:41.782182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:41.782182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:41.782182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 255/512] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:41.782397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:41.816297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be571d1-80f1-4272-a3c9-a634dc1dd62f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.849012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.849626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.849907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.850169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.862322 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.880824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c958-e20f-4138-b72c-6afb344d37a1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:41.888552 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:41.913832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:41.914360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:41.914635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:41.914904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:41.917192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.918640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:41.980093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:41.981572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.016957 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 258/513] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:42.018093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.068585 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.086767 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.088285 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 256/514] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:42.089222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.119679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878734b-5f4f-434e-9f6f-23bf441796f8 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.152414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.153028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.153335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.153602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.161617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.163042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:42.174460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:42.175335 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:42.176271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 259/515] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:42.177434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.193281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafdb4d-92b6-48dd-b86c-07d791200949 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.227780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.228378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.228651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.228920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.229671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:42.229975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.231410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.248473 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 257/516] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:42.249292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.275645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e715d0-0f2c-4fcc-bdc4-ebdb0f33e5c9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.290632 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.304904 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.311004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.311617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.311897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.312169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.312807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:42.313140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.314505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.326324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 260/517] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:42.327142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.350466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e638fe4-38cc-4978-b156-ab211285ecc1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.384282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.384909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.385255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.385528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.396010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.397511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:42.413863 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:42.414948 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:42.415811 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:42.415811 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:42.415811 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:42.415811 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 258/518] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:42.415811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.428120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525879-025d-4661-86fb-dcd4be513248 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.462251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.462877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.463154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.463433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.473775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.475224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:42.489422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:42.490329 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:42.491182 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:42.491182 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:42.491182 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:42.491182 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 261/519] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:42.491405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.511420 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.521684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890dc8e-1110-4a94-b3cb-848175e4c4ca None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.538224 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.556100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.556700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.556970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.557278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.557990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:42.558296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.559697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.576435 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 259/520] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:42.577043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.596926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe90da-2789-4090-ace2-f9947a6f94b5 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.630377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.630980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.631259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.631531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.675235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2afc-6a67-4a4d-853a-ce3472ee8ff0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.699834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.701223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.711489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.712100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.712379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.712652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.713331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.714739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.736208 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 260/521] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:47:42 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:42.737017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.745411 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.748682 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:42.816450 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 262/522] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:42.816450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.861545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f22317-212d-4c21-a149-92feffa82563 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.900585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.901233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.901565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.901929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.902581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:42.902891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.904469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:42.918082 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 261/523] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:42.918835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:42.933685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07865c4-8d78-4970-ac91-2fa1d758657e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:42.975565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:42.976678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:42.977235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:42.977757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:42.978846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:42.979423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:42.981874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.001366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 263/524] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:43.001366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.001366 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.006367 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.048483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1b2a0-210d-46c2-91d0-765e8985e748 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.088057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.088661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.089232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.089232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.115584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac80f7-54ab-428c-99bc-358747cf4cf2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.151176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.151812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.152093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.152364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.161901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.163350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.163812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.165271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:43.179712 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:43.180786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:43.181670 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:43.181670 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:43.181670 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:43.181670 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 264/525] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:43.181670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.239615 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.242533 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.278644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 262/526] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:43.279743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.294312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb60192-5465-4ad2-872e-be2daa31a666 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.330425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880187ae-deed-484e-9efc-251516273a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.331047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880187ae-deed-484e-9efc-251516273a75 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.331320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880187ae-deed-484e-9efc-251516273a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.331585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880187ae-deed-484e-9efc-251516273a75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.339418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880187ae-deed-484e-9efc-251516273a75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.340931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880187ae-deed-484e-9efc-251516273a75 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-880187ae-deed-484e-9efc-251516273a75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:43.354151 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:43.355060 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:43.356578 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 265/527] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:43.362004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880187ae-deed-484e-9efc-251516273a75 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.388693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f33a9-67a4-4feb-949d-6297ab1da85f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.425924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.427090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.427376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.427638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.434457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.435875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:43.447836 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:43.448726 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:43.449652 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 263/528] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:43.450123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.475944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880187ae-deed-484e-9efc-251516273a75 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.480853 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.492941 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.516394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.516998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.517302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.517822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.518453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:43.518743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.520732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.533096 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 266/529] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:43.534007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.569508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbbf97-9a56-44e7-a213-7abba1006b75 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.603866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.604481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.604762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.605026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.616197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.617666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:43.632189 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:43.633162 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:43.638568 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:43.638568 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:43.638568 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:43.638568 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 264/530] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:43.638568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.646377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e0d0e-f34f-4ed6-9636-681d3a75ba1d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.685515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.686120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.686398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.686949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.687357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:43.687705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.689125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.713522 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 267/531] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:43.713522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.724778 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.748037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c9cb2-7196-4ea2-84c6-b49a9bc7e58b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.749314 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.784302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.784913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.785227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.785503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.786844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:43.787150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.788589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.806424 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 265/532] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:43.807513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.818163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb01a57-40ab-4883-8c3a-8aea353a2750 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.858611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.859508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.859969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.860388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.869330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.870779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:43.883784 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:43.884785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:43.885688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 268/533] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:43.886144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.916435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5715f2-af86-44e4-8e7f-1f3b05972fe6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:43.953523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:43.954127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:43.954393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:43.954648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:43.955272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:43.955567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:43.956912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:43.964685 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.975135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:43.976206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:43.990091 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:43.997573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a145f-6007-4eb7-adbf-3eb58fdbf663 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:44.033736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a328-9862-477f-88b6-669818e51162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:44.034262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a328-9862-477f-88b6-669818e51162 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:44.034544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a328-9862-477f-88b6-669818e51162 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:44.034814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a328-9862-477f-88b6-669818e51162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:44.035543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a328-9862-477f-88b6-669818e51162 None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=22f4d77320794bb39b2dda5daa402a16) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:44.036442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a328-9862-477f-88b6-669818e51162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:44.037869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a328-9862-477f-88b6-669818e51162 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:44.043482 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 269/535] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/role_assignments?user.id=22f4d77320794bb39b2dda5daa402a16&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:44.044260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a328-9862-477f-88b6-669818e51162 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:44.118896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24a26e-0aee-4681-8cb0-328f15895bc7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:44.165370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:44.166055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:44.166636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:44.166801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:44.167560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=d7306de1f2fb4ebfb4177d9acfb25fab) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:44.167902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:44.169419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:44.178914 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 267/536] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:43 2022] GET /identity/v3/role_assignments?user.id=d7306de1f2fb4ebfb4177d9acfb25fab&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:44.179965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:44.191294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a328-9862-477f-88b6-669818e51162 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:44.234872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:44.235548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:44.235833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:44.236106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:44.236818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:44.237157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:44.238623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:44.253114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:44.260885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:44.283909 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:44.295590 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:44.334035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025bc93-f3f2-4f4f-ae21-21b4455a188a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:44.374850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:44.375860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:44.376343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:44.376860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:44.385005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:44.386819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:44.401175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:44.402128 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:44.402985 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:44.405573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 268/538] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:44.412042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:44.486197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea60f3c-d113-45de-9636-4fc9cd05537c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:44.550898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95c947-6956-4aa5-9ad2-d2ebf98dba8a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:44.580545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:44.581178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:44.581455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:44.581724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:44.582659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=47323e4e757c49eea3e6695a68fc267a) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:44.583025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:44.585222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:44.591639 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:44.591798 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 271/539] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:44 2022] GET /identity/v3/role_assignments?user.id=47323e4e757c49eea3e6695a68fc267a&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:44.608044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ad87b-6a53-4ca4-abe2-f42e99afd21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:44.609017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad87b-6a53-4ca4-abe2-f42e99afd21c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:44.609569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad87b-6a53-4ca4-abe2-f42e99afd21c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:44.610098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ad87b-6a53-4ca4-abe2-f42e99afd21c None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:44.611545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad87b-6a53-4ca4-abe2-f42e99afd21c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:44.612140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad87b-6a53-4ca4-abe2-f42e99afd21c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:44.614890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ad87b-6a53-4ca4-abe2-f42e99afd21c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:44.631907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 269/540] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:44.638244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:44.769357 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:44.798448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de763-c032-4d33-bf1b-1caba0a5ac00 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:44.842523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9d70c-ee95-4581-928b-4809e262c06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:44.843470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d70c-ee95-4581-928b-4809e262c06b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:44.843954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d70c-ee95-4581-928b-4809e262c06b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:44.844442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9d70c-ee95-4581-928b-4809e262c06b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:44.845419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9d70c-ee95-4581-928b-4809e262c06b None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=0492b5b414354bce909e395d44d215c3) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:44.845948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9d70c-ee95-4581-928b-4809e262c06b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:44.847598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9d70c-ee95-4581-928b-4809e262c06b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:44.855423 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 272/541] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:44 2022] GET /identity/v3/role_assignments?user.id=0492b5b414354bce909e395d44d215c3&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:45.069825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207e1d-74c5-466d-bf2a-b7741a342415 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:45.070183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207e1d-74c5-466d-bf2a-b7741a342415 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:45.070453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207e1d-74c5-466d-bf2a-b7741a342415 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:45.071837 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 270/542] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:45.077254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db313407-25ae-4a30-a9dc-24459e915dba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:45.077541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db313407-25ae-4a30-a9dc-24459e915dba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:45.077814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db313407-25ae-4a30-a9dc-24459e915dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:45.102533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-db313407-25ae-4a30-a9dc-24459e915dba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:45.103656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-db313407-25ae-4a30-a9dc-24459e915dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:45.179954 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 273/543] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:45.507757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207e1d-74c5-466d-bf2a-b7741a342415 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:45.629327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207e1d-74c5-466d-bf2a-b7741a342415 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:45.681652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:45.682306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:45.682583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:45.682851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:45.699450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:45.704277 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:45.705206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:45.706013 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 271/544] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:45.712374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db313407-25ae-4a30-a9dc-24459e915dba None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:45.849555 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:45.877536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db313407-25ae-4a30-a9dc-24459e915dba None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:45.924057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:45.924659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:45.924931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:45.925236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:45.925889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:45.926185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:45.928490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:45.936812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 274/545] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:45.942319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:46.019215 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:46.094867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba500e7-18f9-40fa-83ee-61d5958ba3ea None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:46.147113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:46.147658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.147933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.148200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.159020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:46.160466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:46.175224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:46.176145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:46.177046 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:46.177046 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:46.177046 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:46.177046 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 272/546] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:46.182140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:46.323542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3581d-a846-4403-8314-16fff5ecec38 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:46.364030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:46.364637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.364909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.365201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.365839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:46.366131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:46.367481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:46.380821 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 275/547] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:46.381440 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:46.386336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:46.546882 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:46.554322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68dcf6-afe6-45a0-ba01-86d56fccb26d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:46.594505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f6e9-0bec-4346-a453-7188ec2ad637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:46.595138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f6e9-0bec-4346-a453-7188ec2ad637 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.595417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f6e9-0bec-4346-a453-7188ec2ad637 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.595689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f6e9-0bec-4346-a453-7188ec2ad637 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.603829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f6e9-0bec-4346-a453-7188ec2ad637 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:46.605297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f6e9-0bec-4346-a453-7188ec2ad637 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-e740f6e9-0bec-4346-a453-7188ec2ad637 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:46.617655 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:46.619088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:46.620825 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 273/548] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:47:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:46.624700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:46.753966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfd66-b1c0-41ef-8dc2-73ca8f6057f6 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:46.801771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda387d-cc32-477d-935c-f42fabfb167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:46.802280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda387d-cc32-477d-935c-f42fabfb167b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.802553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda387d-cc32-477d-935c-f42fabfb167b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.802815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda387d-cc32-477d-935c-f42fabfb167b None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.803591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda387d-cc32-477d-935c-f42fabfb167b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:46.803945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda387d-cc32-477d-935c-f42fabfb167b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:46.805376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda387d-cc32-477d-935c-f42fabfb167b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:46.812542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce650b9-fa15-46a9-bf74-e7169ef7f364 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.813117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce650b9-fa15-46a9-bf74-e7169ef7f364 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.813618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce650b9-fa15-46a9-bf74-e7169ef7f364 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.815405 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 274/549] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:46.820627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986811ef-16ac-425d-bc98-12440774db26 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.820908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986811ef-16ac-425d-bc98-12440774db26 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.821210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986811ef-16ac-425d-bc98-12440774db26 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.822738 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 275/550] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:46.824191 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 276/551] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 00:47:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:46.824377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d12503-ce98-4df1-af1c-7e74229320a6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.824623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d12503-ce98-4df1-af1c-7e74229320a6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.824899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d12503-ce98-4df1-af1c-7e74229320a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.829168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0584-6968-4af9-94f2-08f8e1bac59a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:46.829457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0584-6968-4af9-94f2-08f8e1bac59a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:46.829834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0584-6968-4af9-94f2-08f8e1bac59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:46.843469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f5d12503-ce98-4df1-af1c-7e74229320a6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:46.844666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f5d12503-ce98-4df1-af1c-7e74229320a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:46.851306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-394f0584-6968-4af9-94f2-08f8e1bac59a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:46.852453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-394f0584-6968-4af9-94f2-08f8e1bac59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:46.917892 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 276/552] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:46.919894 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:46.923458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d12503-ce98-4df1-af1c-7e74229320a6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:46.939480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 277/553] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:47.022546 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:47.039847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d12503-ce98-4df1-af1c-7e74229320a6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.076283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.076804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.077097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.077370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.149761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:47.151224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:47.217254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f0584-6968-4af9-94f2-08f8e1bac59a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.249083 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:47.273679 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 277/554] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:47.282123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.324413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f0584-6968-4af9-94f2-08f8e1bac59a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.359962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.360525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.360805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.361094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.372398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:47.377397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:47.378320 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:47.380313 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 278/555] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:47.384730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.407625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029e6d-c96d-4357-99dc-a4f58b6646e1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.448867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.449520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.449791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.450040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.470303 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:47.473402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:47.476242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:47.497295 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:47.499542 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:47.501815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:47.501815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:47.501815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:47.501815 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 278/556] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:47.501815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.534107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639864b9-5712-4b37-a770-4a7ce6ff6357 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.548238 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:47.572273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.572907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.573243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.573548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.574240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:47.574547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:47.576103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:47.592097 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 279/557] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:47.593191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.633242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168695f-74d2-4558-baf7-53e2591f1b64 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.678738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.680339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.680614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.680882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.694836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:47.701562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:47.703145 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 279/558] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:47.704013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.716433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4891635-2178-4e11-8c86-945ae382dd3a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.725980 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:47.751728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc850812-15e7-4197-bc4e-74e970d09f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.752322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc850812-15e7-4197-bc4e-74e970d09f8d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.752602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc850812-15e7-4197-bc4e-74e970d09f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.752865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc850812-15e7-4197-bc4e-74e970d09f8d None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.753532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc850812-15e7-4197-bc4e-74e970d09f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:47.753829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc850812-15e7-4197-bc4e-74e970d09f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:47.755270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc850812-15e7-4197-bc4e-74e970d09f8d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:47.766587 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 280/559] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:47.767971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e7c8-e23c-44c1-b277-186ed1b2994a None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.768247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e7c8-e23c-44c1-b277-186ed1b2994a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.768510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e7c8-e23c-44c1-b277-186ed1b2994a None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.769714 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 281/560] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:47.771787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c95ea-ab09-4c32-843d-f8c7e3abaedd None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.771787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c95ea-ab09-4c32-843d-f8c7e3abaedd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.771787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c95ea-ab09-4c32-843d-f8c7e3abaedd None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.773001 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 282/561] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:47.773383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c95ea-ab09-4c32-843d-f8c7e3abaedd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.801658 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:47.808118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c82bf-a6f8-44ed-96cc-691cd72142cc None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.840276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.840896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.841215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.841487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.852441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:47.853908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:47.869516 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:47.870477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:47.871347 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:47.871347 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:47.871347 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:47.877346 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 280/562] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:47.878036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:47.879234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c95ea-ab09-4c32-843d-f8c7e3abaedd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:47.914593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60548dc4-4b57-4555-9621-7e995d699f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:47.915115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548dc4-4b57-4555-9621-7e995d699f8c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.915388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548dc4-4b57-4555-9621-7e995d699f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.915651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60548dc4-4b57-4555-9621-7e995d699f8c None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.916294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548dc4-4b57-4555-9621-7e995d699f8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:47.916588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548dc4-4b57-4555-9621-7e995d699f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:47.917965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60548dc4-4b57-4555-9621-7e995d699f8c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:47.930480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 283/563] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:47.930480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1659409-5fc9-4899-a922-451108f64eb4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:47.930480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1659409-5fc9-4899-a922-451108f64eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:47.930480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1659409-5fc9-4899-a922-451108f64eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:47.946682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e1659409-5fc9-4899-a922-451108f64eb4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:47.947876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e1659409-5fc9-4899-a922-451108f64eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:47.970261 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:47.978629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f565d7f-47b6-4b69-b23b-5a1df8e43f8c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.013635 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 284/564] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:48.013797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.014404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.014679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.014948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.015691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bb64a-4878-435e-b751-8d01ab97668e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.016119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bb64a-4878-435e-b751-8d01ab97668e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.016633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bb64a-4878-435e-b751-8d01ab97668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.022420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.023837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:48.035905 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:48.036867 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:48.037814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 281/565] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:48.038316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.048946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a50bb64a-4878-435e-b751-8d01ab97668e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:48.050141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a50bb64a-4878-435e-b751-8d01ab97668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:48.058471 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.133090 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 285/566] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:48.133090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bb64a-4878-435e-b751-8d01ab97668e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.166198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef849c-583c-42ee-a38b-c6961ba97585 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.217789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.218883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.219379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.219768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.220413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:48.220717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.222389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.238011 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 282/567] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:48.238693 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.239429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.250627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bb64a-4878-435e-b751-8d01ab97668e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.291423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.292053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.292336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.292605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.303441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.304951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.315343 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:48.321673 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:48.322634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:48.323533 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:48.323533 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:48.323533 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:48.323533 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 286/568] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:48.324171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.353528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0bf3b-d702-42c2-9fab-b27cb4db40f5 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.394721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.395631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.395631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.395980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.396549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:48.396844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.398290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.409885 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 283/569] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:48.414211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.435028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927019c-9de1-4c4c-8033-cfb2fdcfc17b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.468818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.469473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.469750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.470017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.477382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.478792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:48.489470 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:48.490531 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 287/570] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:48.491510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.494859 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.521100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14578a9a-9c08-485a-b8c8-bf525aa01470 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.547271 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.556227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.556858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.557178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.557453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.567536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:48.572828 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:48.573812 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:48.574646 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 284/571] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:48.575917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.597569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c285d-ee8d-4499-8713-105f9e63c02b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.631228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.631823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.632094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.632359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.632985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:48.633309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.634646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.646993 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 288/572] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:48.649918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.676969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300fa8-0da6-40a9-8412-bf423c349a59 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.709521 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.710888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.711481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.711816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.712067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.712809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=3ada7c97c73b43e09c30a603e648bcb4) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:48.713152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.714599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.719878 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 285/573] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/role_assignments?user.id=3ada7c97c73b43e09c30a603e648bcb4&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:48.720646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.763132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543de344-28a7-4ebf-8893-b3dc857b2cbe None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.784268 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.803624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.804285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.804567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.805031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.819445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:48.824484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:48.825557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 289/574] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:48.826406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.846742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc517-88cf-40c9-a1de-94c10948e94c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.887905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.888523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.888799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.889096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.889830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:48.890132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.891572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:48.912336 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 286/575] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:48.913116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:48.944246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe5125-6ec1-41cb-95d9-7992b43bc721 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:48.971090 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:48.983584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:48.984186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:48.984460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:48.984726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:48.985411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:48.985707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:48.987314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.000570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 290/576] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:49.000570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.025232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877896f3-6d37-4e31-91a9-4659019408f8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.037012 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.062337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.063066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.063336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.063603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.071368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.072790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:49.085794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:49.086777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 287/577] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:49.087776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.108704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07f62c-d844-4d06-ae92-8f677b1e29d1 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.148273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.149272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.149735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.150155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.151156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:49.151916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.153555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.163709 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 291/578] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:49.164685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.194833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac852-3f67-40ad-a195-449bead156e2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.217019 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.233955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.234684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.234968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.235546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.249186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.251011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:49.266760 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:49.268030 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:49.268974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:49.268974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.268974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:49.268974 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 288/579] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:49.268974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.280319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f028a1c-f1d2-4809-916e-2b41d7a16146 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.299945 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.316598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.317993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.318277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.318547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.329187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.330445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:49.344988 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:49.346159 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:49.347109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:49.347109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.347109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:49.347109 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 292/580] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:49.347336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.387877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad853-4d00-4d80-8568-403d90ab8176 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.428224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.428827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.429127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.429404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.430156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:49.430460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.431886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.451354 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 289/581] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:49.452535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.456503 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.460986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da945ba-afb7-47ee-9970-025efc653c6a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.499389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.500234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.500509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.500781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.514860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.516288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:49.534557 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:49.535509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:49.537163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:49.537163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.537163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:49.537163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 293/582] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:49.537163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.554353 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.574369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb0fbf-7823-488b-8908-7ca7645986f4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.611997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.612621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.612903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.613207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.614229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:49.614229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.615794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.631262 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 290/583] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:49.632335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.664205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d691-66f3-451e-a260-df40618dbead None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.699927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.700523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.700802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.701097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.701734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:49.702039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.703398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.716105 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 294/584] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:49.721332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.734219 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.741255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23782a-2dec-4acc-8812-aee709fa32b4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.784462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.785620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.786439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.786709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.797291 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.799778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.801411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:49.816442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:49.817575 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:49.818475 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:49.818475 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:49.818475 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:49.818475 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 291/585] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:49.818475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.833655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4437-219a-459b-a3e0-05a0f32f7cb3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.874649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.875789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.876704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.877321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.878252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:49.878839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.881175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.896585 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 295/586] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:49.898200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:49.923421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc20f7-fe4b-4bac-b47f-57bcfe36c08b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:49.957315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:49.958122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:49.958398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:49.958667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:49.965296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:49.966730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:49.974833 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:49.978463 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:49.979362 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:49.980280 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 292/587] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:49.980771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.011787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f7c49-cf00-4167-bfba-9c5b923c39e4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.038212 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:50.048487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.049145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.049422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.049688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.058919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.060337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:50.073009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:50.073996 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 296/588] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:50.074943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.099499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0d6cb-925f-4df0-89b8-11317c54caac None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.137378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.138249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.138531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.138802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.139591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:50.140209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.142007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.161601 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 293/589] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:50.162923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.187737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8af4a4-fdf9-45f1-928f-2caa53d6f820 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.217785 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:50.224656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.225424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.225703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.226189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.234735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.236174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:50.248684 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:50.254452 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 297/590] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:50.256330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.269515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b361fa0-c801-4620-b919-2316af773c3c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.282691 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:50.305440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.306251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.306526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.306794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.307479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:50.307781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.309244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.326315 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 294/591] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:50.327031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.360632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd68d7f-6c5d-4848-95c6-80533dd55b8e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.396762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.397391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.397702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.397937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.399105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:50.399105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.400422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.418729 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 298/592] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:50.423965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.434429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e44c2e-a7f7-4f33-bfaf-3a74b09d311f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.468906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.469552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.469828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.470090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.476919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.478983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.480763 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:50.491577 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:50.492540 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:50.493492 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:50.497307 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 295/593] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:50.498118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.535618 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:50.546048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f91572-cd38-4864-8d52-9592602f05be None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.580521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.581232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.581612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.581983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.582976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:50.583381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.584947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.602826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 299/594] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:50.603712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.610699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c23e48-782a-403b-b7e3-a2aa40df07bf None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.650835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.651626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.651999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.652332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/d7306de1f2fb4ebfb4177d9acfb25fab/roles/bb0dba2691804589a999e0f81f843412` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.668563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=d7306de1f2fb4ebfb4177d9acfb25fab, role_id=bb0dba2691804589a999e0f81f843412)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.670136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.683534 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 296/595] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:50 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/d7306de1f2fb4ebfb4177d9acfb25fab/roles/bb0dba2691804589a999e0f81f843412 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:50.684416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.724483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c92d6-a162-424d-bf41-370d569dd98c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.734179 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:50.769955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.771726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.772176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.772614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.786428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.788400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.806873 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:50.808410 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:50.810756 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:50.811692 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:50.811692 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:50.811692 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:50.813147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 300/596] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:50.814188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.841004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f079c-7e26-43c9-bdc0-8396a5aa007c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.891536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.892146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.892419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.892927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.893660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:50.894630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.895989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:50.909149 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 297/597] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:50.910178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:50.944895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605e8bd-88d8-4ffd-8da7-7306aa703e0c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:50.983627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:50.984252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:50.984524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:50.984793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:50.995941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:50.997414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:51.013491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:51.014818 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:51.015977 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:51.015977 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:51.015977 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:51.019305 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 301/598] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:51.020011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.028352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a67c7e-4ed1-4d61-bdb7-16a699df1fa4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.033940 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.069162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b31250-bed7-4ebe-b44f-e6bc0b22847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.069882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b31250-bed7-4ebe-b44f-e6bc0b22847e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.070156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b31250-bed7-4ebe-b44f-e6bc0b22847e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.070431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b31250-bed7-4ebe-b44f-e6bc0b22847e None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.071064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b31250-bed7-4ebe-b44f-e6bc0b22847e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:51.071361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b31250-bed7-4ebe-b44f-e6bc0b22847e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.072829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b31250-bed7-4ebe-b44f-e6bc0b22847e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.097103 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 298/599] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:51.099581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1305c3-acf8-424c-81d7-2cbff4235499 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.100007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1305c3-acf8-424c-81d7-2cbff4235499 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.100412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1305c3-acf8-424c-81d7-2cbff4235499 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.105572 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 299/600] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:51.105572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1305c3-acf8-424c-81d7-2cbff4235499 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.107904 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.133282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2410f-fb04-4c7b-b7a8-569fb4b47f5f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.171998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.172810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.173248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.173652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/22f4d77320794bb39b2dda5daa402a16/roles/bb0dba2691804589a999e0f81f843412` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.189573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=22f4d77320794bb39b2dda5daa402a16, role_id=bb0dba2691804589a999e0f81f843412)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.191138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.213088 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 302/601] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:51 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/22f4d77320794bb39b2dda5daa402a16/roles/bb0dba2691804589a999e0f81f843412 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:51.213088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.234673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1305c3-acf8-424c-81d7-2cbff4235499 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.276041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42009fa0-a21f-4c2f-8133-54d51a270564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.276692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42009fa0-a21f-4c2f-8133-54d51a270564 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.276969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42009fa0-a21f-4c2f-8133-54d51a270564 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.277267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42009fa0-a21f-4c2f-8133-54d51a270564 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.277977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42009fa0-a21f-4c2f-8133-54d51a270564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:51.278282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42009fa0-a21f-4c2f-8133-54d51a270564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.279703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42009fa0-a21f-4c2f-8133-54d51a270564 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.297329 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 300/602] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:51.297329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446ad2-55b5-41e6-a816-003d43b5dac0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.297329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446ad2-55b5-41e6-a816-003d43b5dac0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.297329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446ad2-55b5-41e6-a816-003d43b5dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.313975 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.315731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-11446ad2-55b5-41e6-a816-003d43b5dac0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:51.318223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-11446ad2-55b5-41e6-a816-003d43b5dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:51.374867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22911ff5-e2ee-4231-b3c9-2a9c5ecbbc4f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.388358 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.404727 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 301/603] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:51.406814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446ad2-55b5-41e6-a816-003d43b5dac0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.422288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.422933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.423209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.423482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.431342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.432907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:51.447927 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:51.448898 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:51.450169 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 303/604] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:51.455849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.549019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446ad2-55b5-41e6-a816-003d43b5dac0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.575210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c6829-e56c-42de-8918-f9b7387faf91 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.595490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.596364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.596783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.597249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.598862 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.609962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.611949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.614589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.615411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.615762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.616121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.616886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:51.617284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.618872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:51.626104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:51.626971 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:51.627871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:51.635732 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 302/605] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:51.637381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.639496 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 304/606] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:51.648227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.707248 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.788808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646a7c-6cac-41b6-99e4-8f805def2bb4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.817677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8cb20-6332-4341-8b87-42e6ca693983 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.833741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.834698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.835290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.835762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.836709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:51.837259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.838975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.857087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:51.857087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:51.857087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:51.857087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/0492b5b414354bce909e395d44d215c3/roles/bb0dba2691804589a999e0f81f843412` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:51.857789 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 303/607] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:51.858818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.869656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=0492b5b414354bce909e395d44d215c3, role_id=bb0dba2691804589a999e0f81f843412)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:51.871110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:51.888316 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 305/608] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:51 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/0492b5b414354bce909e395d44d215c3/roles/bb0dba2691804589a999e0f81f843412 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:47:51.893479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:51.934115 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:51.980029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730a4b6-db0a-47b8-b4ab-7390378a0b2b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:51.995361 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:52.014250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68188a74-7b5a-4f63-a13b-cbdd1ddd52e1 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:52.021115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:52.022073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:52.022555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:52.023025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:52.034296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:52.039658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:52.040766 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:52.041663 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:52.044367 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 304/609] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:52.054423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:52.072156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:52.072835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:52.073132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:52.073408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/47323e4e757c49eea3e6695a68fc267a/roles/bb0dba2691804589a999e0f81f843412` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:52.104249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=47323e4e757c49eea3e6695a68fc267a, role_id=bb0dba2691804589a999e0f81f843412)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:52.105757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:52.125732 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 306/610] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:51 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/47323e4e757c49eea3e6695a68fc267a/roles/bb0dba2691804589a999e0f81f843412 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:47:52.229990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2478c-9279-4f8b-8269-9a726599674a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:52.269226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:52.269843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:52.270148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:52.270798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:52.271477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:52.271780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:52.273197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:52.284132 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 305/611] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:52.290704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:52.381679 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:52.402997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6629-f8c0-44d8-adb9-9ff0cf16a308 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:52.438540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:52.439172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:52.439447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:52.439780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:52.451143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:52.452615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:52.471222 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:52.472218 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:52.473938 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:52.473938 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:52.473938 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:52.473938 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 307/612] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:52.478486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:52.514511 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:52.610902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b29d3-2c1a-4bdf-a802-a44f8af90eb3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:52.664597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:52.665253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:52.665490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:52.665752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:52.666391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:52.666688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:52.668046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:52.684794 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 306/613] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:52.691980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:52.825118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb92af-53ba-43f3-8b6c-8dbfdf0c67df None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:52.855827 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:52.861298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:52.861938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:52.862217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:52.862491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:52.870879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:52.872438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:52.885253 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:52.886244 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:52.887786 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 308/614] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:47:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:52.892352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:53.007153 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:53.014640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e7ddc-3e12-46e0-9361-510d4d9eb57d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:53.061353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:53.061962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:53.062238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:53.062508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:53.063233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:53.063535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:53.065014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:53.084118 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 307/615] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 00:47:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:53.089857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:53.199385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd2242-cbe6-46c5-824e-c1f73dcbf99c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:53.234532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374009-b369-4375-83b9-393956326b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:53.235166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374009-b369-4375-83b9-393956326b08 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:53.235442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374009-b369-4375-83b9-393956326b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:53.235712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374009-b369-4375-83b9-393956326b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:53.247763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35374009-b369-4375-83b9-393956326b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:53.249233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35374009-b369-4375-83b9-393956326b08 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-35374009-b369-4375-83b9-393956326b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:53.264250 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:53.265274 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:53.266785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:53.266785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:53.266785 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:53.266785 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 309/616] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:53.272073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:53.289911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710df86-0b97-4411-a783-f641663fa003 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:53.290190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710df86-0b97-4411-a783-f641663fa003 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:53.290458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710df86-0b97-4411-a783-f641663fa003 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:53.292089 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 310/617] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:47:53.297632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64489de-697d-4029-b42a-beb1a7aa4a3d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:53.297914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64489de-697d-4029-b42a-beb1a7aa4a3d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:53.298188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64489de-697d-4029-b42a-beb1a7aa4a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:53.318582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b64489de-697d-4029-b42a-beb1a7aa4a3d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:53.319999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b64489de-697d-4029-b42a-beb1a7aa4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:53.373879 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:53.393722 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 311/618] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:53.454871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c7872-7c54-40fa-b043-dde1ddf2d58a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:53.506098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:53.506993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:53.507404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:53.507673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:53.508309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:53.508645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:53.510313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:53.527413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 308/619] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:53.534709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64489de-697d-4029-b42a-beb1a7aa4a3d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:53.691089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64489de-697d-4029-b42a-beb1a7aa4a3d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:53.734645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:53.735200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:53.736215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:53.736644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:53.737090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:53.744448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:53.746138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:53.755354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:53.759005 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:53.759901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:53.760808 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:53.761765 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:53.770169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:53.837471 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:53.922015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22e60-23e7-4186-90ab-343ef517e6c8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:53.949897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274237c-b24d-4e46-af3e-4a22bc800010 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:53.989936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:53.990613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:53.990895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:53.991159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.007083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:54.012619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:54.013254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.013530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.013798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.014557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:54.014862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:54.016355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:54.023471 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:54.024528 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:54.025399 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:54.031564 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:47:54.036881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:54.050767 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 313/622] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:54.058958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:54.154395 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:54.194882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d014-549c-43f8-8765-d0b869667a12 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:54.232303 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:54.236642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7ead1-b3ef-455e-9053-028a8d143582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:54.237728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7ead1-b3ef-455e-9053-028a8d143582 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.238167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7ead1-b3ef-455e-9053-028a8d143582 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.238573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7ead1-b3ef-455e-9053-028a8d143582 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.240172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ceab6-0845-4ac5-b967-7f6aea98323f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:54.240965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7ead1-b3ef-455e-9053-028a8d143582 None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:54.241431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7ead1-b3ef-455e-9053-028a8d143582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:54.244526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7ead1-b3ef-455e-9053-028a8d143582 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:54.256186 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 310/623] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:54.257674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d1c80-86c2-40eb-917e-995c43e51caf None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.258120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d1c80-86c2-40eb-917e-995c43e51caf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.258534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d1c80-86c2-40eb-917e-995c43e51caf None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.264408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 311/624] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:54.265813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d1c80-86c2-40eb-917e-995c43e51caf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:54.293108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053a4e7-e282-4fbb-8ce2-6a42421937d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:54.294725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a4e7-e282-4fbb-8ce2-6a42421937d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.295159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a4e7-e282-4fbb-8ce2-6a42421937d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.295817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a4e7-e282-4fbb-8ce2-6a42421937d4 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/3ada7c97c73b43e09c30a603e648bcb4/roles/bb0dba2691804589a999e0f81f843412` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.312542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053a4e7-e282-4fbb-8ce2-6a42421937d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=3ada7c97c73b43e09c30a603e648bcb4, role_id=bb0dba2691804589a999e0f81f843412)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:54.314156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053a4e7-e282-4fbb-8ce2-6a42421937d4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:54.331562 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 314/625] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:47:54 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/3ada7c97c73b43e09c30a603e648bcb4/roles/bb0dba2691804589a999e0f81f843412 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:47:54.338836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced950-132f-479a-82aa-023a275206c1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.339199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced950-132f-479a-82aa-023a275206c1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.339587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced950-132f-479a-82aa-023a275206c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.370202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-edced950-132f-479a-82aa-023a275206c1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:54.371632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-edced950-132f-479a-82aa-023a275206c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:54.402311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d1c80-86c2-40eb-917e-995c43e51caf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:54.441307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:54.443222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.443881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.444301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.446800 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:54.459953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:54.461763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:54.479446 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:54.481185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:54.483368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:54.483368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:54.483368 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:54.486940 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 312/626] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:54.495917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:54.527501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 315/627] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:54.625028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e64c-23d3-464d-bd66-089cd1140739 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:54.663277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf878b3-5b31-4261-a89e-16b632f70119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:54.663925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf878b3-5b31-4261-a89e-16b632f70119 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.664205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf878b3-5b31-4261-a89e-16b632f70119 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.664480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf878b3-5b31-4261-a89e-16b632f70119 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.665174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf878b3-5b31-4261-a89e-16b632f70119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:54.665488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf878b3-5b31-4261-a89e-16b632f70119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:54.666914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf878b3-5b31-4261-a89e-16b632f70119 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:54.687331 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 313/628] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:54.693106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced950-132f-479a-82aa-023a275206c1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:54.803281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a8fa-2029-48ae-8b6a-3228a28b2255 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.803780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a8fa-2029-48ae-8b6a-3228a28b2255 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.803780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a8fa-2029-48ae-8b6a-3228a28b2255 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.805437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 314/629] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:54.810975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2df5d-15f4-4443-84c5-e15d06da19ca None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.811297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2df5d-15f4-4443-84c5-e15d06da19ca None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.811524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2df5d-15f4-4443-84c5-e15d06da19ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.824250 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:54.849387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d8e2df5d-15f4-4443-84c5-e15d06da19ca None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:54.850596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d8e2df5d-15f4-4443-84c5-e15d06da19ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:54.853521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced950-132f-479a-82aa-023a275206c1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:54.894541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:54.895308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.895604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.895877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.904036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:54.905507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:54.918677 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:54.919718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:54.920666 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 316/630] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:54.928187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:54.956850 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:54.990801 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 315/631] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:47:54.992368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc737c61-972f-411c-8691-c2173f4c2474 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:54.992752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc737c61-972f-411c-8691-c2173f4c2474 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:54.993311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc737c61-972f-411c-8691-c2173f4c2474 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:54.994741 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 316/632] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:54.995515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc737c61-972f-411c-8691-c2173f4c2474 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.043499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038c364-5809-48d2-9ca8-e94a47794463 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.079784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253e712-9603-4b07-9f71-2fc4f0e26f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.080612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e712-9603-4b07-9f71-2fc4f0e26f67 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.081085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e712-9603-4b07-9f71-2fc4f0e26f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.081507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e712-9603-4b07-9f71-2fc4f0e26f67 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.082405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253e712-9603-4b07-9f71-2fc4f0e26f67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:55.083012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253e712-9603-4b07-9f71-2fc4f0e26f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:55.084817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253e712-9603-4b07-9f71-2fc4f0e26f67 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:55.086846 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:55.105476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 317/633] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 00:47:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:47:55.106939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bc4ed-b7f6-4cb0-821f-a735a374d3a1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.107328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bc4ed-b7f6-4cb0-821f-a735a374d3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.107705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bc4ed-b7f6-4cb0-821f-a735a374d3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.126687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8f7bc4ed-b7f6-4cb0-821f-a735a374d3a1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:55.128011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8f7bc4ed-b7f6-4cb0-821f-a735a374d3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:55.139209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc737c61-972f-411c-8691-c2173f4c2474 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.187975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.189004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.189768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.190217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.205328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:55.209538 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 318/634] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:55.210544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bc4ed-b7f6-4cb0-821f-a735a374d3a1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:55.212635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:55.213789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:55.214639 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:55.216978 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 317/635] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:55.229024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.271452 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:55.360768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bc4ed-b7f6-4cb0-821f-a735a374d3a1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.365654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c5a7-2662-43a9-915a-b611ea5ca8df None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.385276 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:55.398548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.399148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.399845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.399845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.409746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.410550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.411502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.411950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.412910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:55.413478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:55.415011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:55.424489 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 318/636] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:55.425515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.471385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:55.472933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:55.531224 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:55.534986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769945-b362-40fd-9a3a-ed5ec7497e9b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.569830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.570447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.571052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.571052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.581540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:55.584791 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 319/637] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:55.587441 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:55.588373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 319/638] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:55.589658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.590426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.616671 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:55.695827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33341c0d-ecab-4e27-bf6e-f41b3943c126 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.702637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3b26c-e272-4e7d-996b-78ac57f55b37 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.737279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.737635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.737910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.738187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.738286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.738483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.738581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.738753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.750085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:55.751831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:55.752004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:55.759294 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:55.760252 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:55.761208 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:55.763517 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 320/639] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:55.765029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:55.770734 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:55.771666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:55.772549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:55.772549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:55.772549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:55.772549 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 320/640] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:55.773179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.792183 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:55.854896 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:55.883173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288b9f-3fd1-41df-aab8-0e82e9a6fe29 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.886237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1fbd-27f0-45e1-bcce-1679486c6635 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:55.922497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.923103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.923381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.923653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.923882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:55.924309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:55.924613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:55.925114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:55.925569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:55.925992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:55.926185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:55.934472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 321/641] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:55.935258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:55.944002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:55.945700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:55.961833 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:55.963015 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:55.963925 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:55.963925 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:55.963925 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:55.963925 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 321/642] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:55.963925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.034855 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.053420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f33e7-a083-4b19-affb-553ab2f13822 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.069180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7b03-07e9-4f71-8928-f2085e604e29 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.091590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.092627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.093173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.093663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.094881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:56.095430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.097997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.101559 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.105770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.106370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.106638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.106914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.107530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:56.107827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.113126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 322/643] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:56.113260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.113376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.129045 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 322/644] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:56.129045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.231676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae4ab-a626-4280-a100-ce89d82a9a68 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.243208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4794641-57f6-4d97-bf23-c267c4e6de49 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.267581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.268463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.268740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.269011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.275627 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.280383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.281954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.282829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.283681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.283965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.284262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.285291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:56.285597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.287078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:56.296588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:56.297833 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:56.299091 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:56.299091 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:56.299091 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:56.299287 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 323/645] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:56.300079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.301280 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 323/646] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:56.302795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.357407 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.408348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048abdd0-a4bc-46cc-bb71-f288d2088094 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.411711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afc571-0bd0-4ea0-8690-409b2e16069a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.445009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.445724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.446002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.446292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.447435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.448074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.448350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.448623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.453980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.455418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.460167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.461628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:56.467354 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:56.468247 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 324/647] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:56.469673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:56.481119 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:56.488722 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:56.490444 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:56.490444 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:56.490444 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:56.490444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 324/648] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:56.490444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.543197 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.603760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1bb3f-11c0-4dda-9976-324f610729fc None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.611335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebad263-6f6b-4a20-b0ac-3ada92380852 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.613146 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.644367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.644999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.646006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.646281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.646913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:56.647214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.648580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.650091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.650717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.651298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.651298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.658146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.659573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.661507 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 325/649] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:56.667240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:56.676338 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:56.677682 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:56.678799 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:56.680598 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 325/650] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:56.681542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.783190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d4118-58b8-4c02-8875-17c2e63bb2e5 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.784319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39447-45f4-4bb0-9c4f-60410a5e77d4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.794039 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.819114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.819527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.819720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.819997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.820136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.820330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.820435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.820666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.820970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:56.821328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.821437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:56.821703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.822671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.823088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.834633 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 326/651] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:56.835422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.846838 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 326/652] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:56.846838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.859991 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:56.934621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6eefc-c4c9-4858-9679-798559939a04 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.946206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df34063-90a9-48f3-acd9-52f61335f585 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:56.967715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03a164-7404-46ff-a33a-833553e35080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.968336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a164-7404-46ff-a33a-833553e35080 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.968613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a164-7404-46ff-a33a-833553e35080 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.968879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a164-7404-46ff-a33a-833553e35080 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.975975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03a164-7404-46ff-a33a-833553e35080 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.977418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03a164-7404-46ff-a33a-833553e35080 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.978239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:56.978830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.979104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.979365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.980044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:56.980340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:56.981749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1e03a164-7404-46ff-a33a-833553e35080 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:56.991591 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:56.992549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:56.994200 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 327/653] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:56.995007 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 327/654] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:56.995007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:56.995339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551958a1-60f0-4f06-9505-0c0ffb405d4e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:56.995787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551958a1-60f0-4f06-9505-0c0ffb405d4e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:56.996066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551958a1-60f0-4f06-9505-0c0ffb405d4e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:56.997744 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 328/655] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:56.998555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551958a1-60f0-4f06-9505-0c0ffb405d4e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.027294 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.081814 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.098215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1dbd4-bb97-411b-9109-89b0884d4730 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.101360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551958a1-60f0-4f06-9505-0c0ffb405d4e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.131520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.132135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.132409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.132677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.135036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71176941-372c-4348-9328-5acd86174324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.135636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71176941-372c-4348-9328-5acd86174324 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.135917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71176941-372c-4348-9328-5acd86174324 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.136189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71176941-372c-4348-9328-5acd86174324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.139873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.141323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:57.152459 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:57.153419 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 328/656] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:57.154391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.202460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71176941-372c-4348-9328-5acd86174324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.203897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71176941-372c-4348-9328-5acd86174324 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.243019 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.255146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b10dd-57f8-4284-afd5-f63ac42aab9e None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.285779 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.289277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f291ea9-d6dd-4c32-9845-1816f516c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.289886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291ea9-d6dd-4c32-9845-1816f516c16f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.290162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291ea9-d6dd-4c32-9845-1816f516c16f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.290433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291ea9-d6dd-4c32-9845-1816f516c16f None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.291148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f291ea9-d6dd-4c32-9845-1816f516c16f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:57.291450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f291ea9-d6dd-4c32-9845-1816f516c16f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.293085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f291ea9-d6dd-4c32-9845-1816f516c16f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.305836 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 329/657] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:57.306945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71176941-372c-4348-9328-5acd86174324 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.311889 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 329/658] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:57.311889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c425-5c27-49ac-a5e7-499d5cc72373 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.311889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c425-5c27-49ac-a5e7-499d5cc72373 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.311889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c425-5c27-49ac-a5e7-499d5cc72373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.329452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6de0c425-5c27-49ac-a5e7-499d5cc72373 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:57.330646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6de0c425-5c27-49ac-a5e7-499d5cc72373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:57.396969 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 330/659] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:47:57.397753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c425-5c27-49ac-a5e7-499d5cc72373 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.418899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71176941-372c-4348-9328-5acd86174324 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.453164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.453755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.454025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.454288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.454998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=d7306de1f2fb4ebfb4177d9acfb25fab) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:57.455305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.456701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.473090 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 330/660] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/role_assignments?user.id=d7306de1f2fb4ebfb4177d9acfb25fab&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:57.473090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.488264 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.529099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c425-5c27-49ac-a5e7-499d5cc72373 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.535467 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.576695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.578158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.578539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.578911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.580275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:57.580683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.584100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.604902 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 331/661] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:57.605946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.608004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc07fdf-70a2-4b3f-955b-6be0b0b810b6 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.646138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.647235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.647709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.648169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.659973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.662009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:57.677474 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:57.678772 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:57.679705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:57.679705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:57.679705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:57.681858 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 331/662] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:57.682795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:57.731986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54776df-5d51-47b6-a0d8-7ff0c6169f93 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.771170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.771940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.772215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.772526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.775114 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.789195 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:57.793141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c7f5c-5c82-43e7-abbe-72227ecf536a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:57.837201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:57.838729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:57.839481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:57.839964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:57.854960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.856409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.922130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:57.923992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:57.989920 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 332/663] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:57.991495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.026216 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.030749 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.040663 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 332/664] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:47:58.041720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.103025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f3687-7692-4d96-8146-d0993573d198 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.140625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.141282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.141562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.142087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.158688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:47:58.164689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb0053-0fa5-4746-9e2e-5eadaed4fb65 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:47:58.166206 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:58.167154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 333/665] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:58.168052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.216527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.217164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.217440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.217707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.218499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:58.218617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.219988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.236272 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 333/666] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:58.241829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.309637 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.312266 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.324908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0640d-e918-4ed3-ae8f-b6c166f47ef4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.362572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.363200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.363472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.363737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.365564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667952f-5adc-4afc-b8cf-826df40de0aa None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.374026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.375474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:58.390787 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:58.391817 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:58.392724 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:58.392724 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:58.392724 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:58.392724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 334/667] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:58.392724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.409692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.410443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.410725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.411561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.425373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.427469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:58.445493 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:58.446508 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:58.452628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:58.452628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:58.452628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:58.452628 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 334/668] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:58.452628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.503514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5575-02e4-4335-8e8e-e88ecf3063bf None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.545027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.545666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.545949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.546219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.546875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:58.547175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.548523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.556839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 335/669] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:58.557684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.571955 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.583659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a7ab-108f-4db8-bc78-239d96d7c64b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.595755 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.622063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.623062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.623548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.624015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.631055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.632674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:58.644293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:58.645768 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:58.647127 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:58.653416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 335/670] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:58.654019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.670888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60bb5-a61c-442d-8462-246bbcf24ecc None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.706401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.707016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.707294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.707595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.708880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:58.709249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.710616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.722839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 336/671] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:58.723534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.770711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c621b0-5b14-4485-bb3b-5c98f0c6e804 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.794447 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.805729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.806070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.806350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.806625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.807268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:58.807569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.809092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.825818 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 336/672] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:58.825818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.836654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e0b9b-ba36-4140-a586-5b58b99c022b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.858589 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:58.876797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.877464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.877797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.878077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.889447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.890883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:47:58.906219 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:58.907198 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:47:58.913752 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:47:58.913752 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:47:58.913752 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:58.913752 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 337/673] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:58.913752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:58.939904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2bdc5-0431-4fb5-84a3-31a7a7e1d14e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:58.982307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:58.982927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:58.983487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:58.983770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:58.984468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:58.984924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:58.987169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.005855 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 337/674] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.005855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.018654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2ce49-6ded-4d89-8a58-0da6918b5444 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.041373 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.057012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.057659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.057936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.058207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.064632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.066080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:59.077594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:59.083559 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 338/675] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:59.084764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.109252 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.122086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baec18-ded9-4169-8520-824ec88b5aaf None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.157849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.158482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.158761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.159028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.166611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.168024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:47:59.179503 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:59.180642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:47:59.181817 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:47:59.185468 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 338/676] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:59.186220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.194393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded72fa2-acf1-44d4-b567-63969faad81f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.230594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.231331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.231729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.232095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.232826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:59.233289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.234747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.250735 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 339/677] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.250735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.292242 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.298140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879dd0-b79d-4d80-9800-ae620bbaff23 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.334275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.334881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.335160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.335434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.336155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=22f4d77320794bb39b2dda5daa402a16) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:59.336463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.337899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.343974 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 339/678] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/role_assignments?user.id=22f4d77320794bb39b2dda5daa402a16&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.344752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.363604 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.372588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef3e2b-af0d-4b2e-b2d7-e1e557c85a4c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.415803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.416424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.416697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.416965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.417703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:59.418006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.419470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.437122 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 340/679] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.437122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.498662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa079ea3-c63e-4edb-bc65-44db87dc429b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.549892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.550438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.550720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.550992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.552191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:59.552500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.554486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.564510 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.569224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd062780-551f-4fc3-962f-80be4230e68a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.570438 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 340/680] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.571691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.617270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.617853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.618134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.618408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.628073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.630183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:47:59.644324 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:59.646011 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:47:59.647216 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 341/681] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:59.647980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.673684 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.701593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75f2f-d196-48cf-b551-f575002aa19c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.737711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.738282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.738561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.738833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.739620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=0492b5b414354bce909e395d44d215c3) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:59.739932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.741436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.747985 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 341/682] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/role_assignments?user.id=0492b5b414354bce909e395d44d215c3&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.753291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:59.812315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc443d8b-4df5-4756-bb6c-175a6f6c3433 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.870298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb797f-d206-42e9-92a1-46a16c13e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.871343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb797f-d206-42e9-92a1-46a16c13e45e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.871881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb797f-d206-42e9-92a1-46a16c13e45e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.872162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb797f-d206-42e9-92a1-46a16c13e45e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.872902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb797f-d206-42e9-92a1-46a16c13e45e None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=47323e4e757c49eea3e6695a68fc267a) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:59.873239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb797f-d206-42e9-92a1-46a16c13e45e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.873686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b0077-c319-406b-9006-252e6a7a52ca None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:59.874702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb797f-d206-42e9-92a1-46a16c13e45e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.889182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 342/683] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/role_assignments?user.id=47323e4e757c49eea3e6695a68fc267a&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.890695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b7f16-ce19-4f74-adc8-33e59d1474d0 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.890977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b7f16-ce19-4f74-adc8-33e59d1474d0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.891245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b7f16-ce19-4f74-adc8-33e59d1474d0 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.898616 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 343/684] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:59.902005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdda69-2426-4f24-847f-58d61fa7b036 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.902310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdda69-2426-4f24-847f-58d61fa7b036 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.902550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdda69-2426-4f24-847f-58d61fa7b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.944469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-98fdda69-2426-4f24-847f-58d61fa7b036 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:59.945714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98fdda69-2426-4f24-847f-58d61fa7b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:59.950017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:59.950653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:59.950981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:59.951254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:59.953092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:59.953092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:59.953901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:59.975653 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.984914 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:59.990075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 342/685] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:59.997766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.057208 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 344/686] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:48:00.123134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224abb-87b8-4029-8cba-c74e67e9d3db None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:00.162973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:00.164022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.164496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.164985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.231126 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:00.238935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:00.241181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:00.349978 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 343/687] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:48:00.355295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdda69-2426-4f24-847f-58d61fa7b036 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.356601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.513734 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:00.518801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdda69-2426-4f24-847f-58d61fa7b036 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:00.527370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751af3f-6cb5-4c6d-bc73-ca1d87e42596 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:00.563942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:00.564820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.565534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.565979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.578461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:00.580389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:00.599082 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:00.600276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:00.601367 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:00.601367 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:00.601367 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:00.603215 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 345/688] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:00.607635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:00.608598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.610847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.611134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.611411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.623706 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:00.633800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:00.635806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:00.655337 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:00.656324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:00.657269 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:00.657269 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:00.657269 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:00.663952 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 344/689] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:00.666199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.794856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732809fa-c877-4225-8053-9f3a206862c8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:00.798965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbe6fe-5674-4539-8285-af2a8ad82258 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:00.860294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:00.860904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.861210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.861484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.862122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:00.862429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:00.863793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:00.867142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:00.867751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:00.868027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:00.868297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:00.868940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:00.869266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:00.871157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:00.882755 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 346/690] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:00.890635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.895867 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 345/691] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:00.899376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:00.910341 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:00.980620 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:01.017889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d47a-e581-4d6d-a168-4dcacec0f8c5 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:01.089215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:01.091902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:01.092445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:01.093824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:01.108037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:01.111301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:01.131341 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:01.132349 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:01.133306 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:01.137892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e979784-60a6-4acf-a2fc-ddabb50e5b97 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:01.147402 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 347/692] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:01.152719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:01.202318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:01.203207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:01.204463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:01.205648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:01.206552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:01.208946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:01.257162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 346/693] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:48:00 2022] POST /identity/v3/users => generated 254 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:01.331480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698e5b-9c75-4fdf-8e53-0dda4cd6035d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:01.367532 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:01.376375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0e128-e835-43b9-8a9a-ea25a54ae202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:01.378310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e128-e835-43b9-8a9a-ea25a54ae202 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:01.378591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e128-e835-43b9-8a9a-ea25a54ae202 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:01.378864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e128-e835-43b9-8a9a-ea25a54ae202 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:01.380082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0e128-e835-43b9-8a9a-ea25a54ae202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:01.380385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0e128-e835-43b9-8a9a-ea25a54ae202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:01.381934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0e128-e835-43b9-8a9a-ea25a54ae202 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:01.397921 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 348/694] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:01.404036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:01.517144 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:01.565821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4d5bb-e5bf-41e8-9e8c-2f17736a5a68 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:01.602313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcbd49-8ec4-4e9c-8277-bd247f36258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:01.603169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbd49-8ec4-4e9c-8277-bd247f36258d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:01.603592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbd49-8ec4-4e9c-8277-bd247f36258d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:01.604006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcbd49-8ec4-4e9c-8277-bd247f36258d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:01.604905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcbd49-8ec4-4e9c-8277-bd247f36258d None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=3ada7c97c73b43e09c30a603e648bcb4) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:01.605379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcbd49-8ec4-4e9c-8277-bd247f36258d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:01.606938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcbd49-8ec4-4e9c-8277-bd247f36258d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:01.613711 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 347/695] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:01 2022] GET /identity/v3/role_assignments?user.id=3ada7c97c73b43e09c30a603e648bcb4&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:01.908447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0955-84c3-4500-8a64-4519a7405e2d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:01.909017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0955-84c3-4500-8a64-4519a7405e2d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:01.909503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0955-84c3-4500-8a64-4519a7405e2d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:01.911058 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 349/696] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:01.916729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b57f8-aec0-4e76-b287-ccc4eff0ba4e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:01.917220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b57f8-aec0-4e76-b287-ccc4eff0ba4e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:01.917729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b57f8-aec0-4e76-b287-ccc4eff0ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:01.936269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b5b57f8-aec0-4e76-b287-ccc4eff0ba4e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:01.937873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b5b57f8-aec0-4e76-b287-ccc4eff0ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:02.016218 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 348/697] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:48:02.317355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0955-84c3-4500-8a64-4519a7405e2d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:02.443834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0955-84c3-4500-8a64-4519a7405e2d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:02.479629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:02.480620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:02.481116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:02.481586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:02.492868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:02.497876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:02.498856 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:02.499710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:02.502408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 350/698] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:02.503902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145c0d-a190-4191-bb0c-e797c59c6c93 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:02.504253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145c0d-a190-4191-bb0c-e797c59c6c93 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:02.504536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145c0d-a190-4191-bb0c-e797c59c6c93 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:02.507989 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 349/699] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:02.511679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:02.512675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71796e-13b7-4bab-8c23-02aa00b60dc2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:02.512961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71796e-13b7-4bab-8c23-02aa00b60dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:02.513314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71796e-13b7-4bab-8c23-02aa00b60dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:02.549682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ab71796e-13b7-4bab-8c23-02aa00b60dc2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:02.555443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ab71796e-13b7-4bab-8c23-02aa00b60dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:02.591945 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:02.669242 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:02.685300 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 350/700] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:48:02.686088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e037a-1d5c-4cb0-a5c9-c5cd4b4c42b1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:02.686552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f52b7-c51d-4660-84ab-9bbf73bc8bd2 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:02.686831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f52b7-c51d-4660-84ab-9bbf73bc8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:02.687088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f52b7-c51d-4660-84ab-9bbf73bc8bd2 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:02.693037 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 351/701] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:02.695635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15193637-7f86-485a-a819-bc31f05ef67a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:02.696161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15193637-7f86-485a-a819-bc31f05ef67a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:02.696635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15193637-7f86-485a-a819-bc31f05ef67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:02.724076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-15193637-7f86-485a-a819-bc31f05ef67a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:02.725669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-15193637-7f86-485a-a819-bc31f05ef67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:02.747589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:02.748264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:02.748548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:02.748817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:02.749576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:02.749882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:02.751245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:02.772140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 351/702] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:02.775515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:02.832147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 352/703] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:48:02.936506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181141ba-664e-4e18-9923-be5f94203811 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:02.949105 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:02.969506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15193637-7f86-485a-a819-bc31f05ef67a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:02.977321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:02.977956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:02.978235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:02.978505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:02.992754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:02.994241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:03.021534 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:03.022555 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:03.024021 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:03.024021 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:03.024021 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:03.024021 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 352/704] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:03.028749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.123718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15193637-7f86-485a-a819-bc31f05ef67a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.153577 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:03.162657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.163402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.163694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.163972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.164669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.166084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:03.177831 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:03.178944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:03.180379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 353/705] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 00:48:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:03.184954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.234792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c4ab-02c9-417d-90db-93acda491b56 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.274670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.275274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.275551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.275828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.276458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:03.276760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.278154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.296870 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 353/706] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:03.296870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.324692 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:03.334054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d84bc-5c3e-4d4b-b6ba-ac1a0201a70e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.378647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.379612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.379823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.380256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.380886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:03.381225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.382592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.391932 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 354/707] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:03.391932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.429116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb441fa-72c7-4fd2-8817-b50680d97eff None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.453205 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:03.465471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.466236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.466609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.467104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] PATH_INFO: `/v3/services/network` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.467725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.469355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:03.481438 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:03.482699 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:03.483784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:03.490542 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 354/708] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:03.491457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.533975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3b23-2823-4b1c-979a-71be13b42ac5 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.577609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.579191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.580590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.581054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.591800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.593299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.601893 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:03.613894 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:03.615165 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:03.616382 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:03.623069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff875ee-d96c-4ab1-b865-1bf50863f679 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.623492 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 355/709] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:03.624749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.661655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.662556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.662887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.663282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.664130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:03.664576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.666086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.681090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 355/710] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:03.681090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.820047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b13c5-430a-4842-9a5e-15cf411c76c2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.833670 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:03.872865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.873944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.874704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.875194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.876219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] RBAC: Adding query filter params (name=network) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:03.876776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.878370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.884081 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 356/711] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:03.892352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56177-19f7-4fa6-989e-bb5a922f5585 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:03.893969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.934759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:03.935378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:03.935655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:03.935925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:03.936659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:03.936962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:03.938438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:03.959798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 356/712] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:03.966646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:03.989892 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:04.021185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f90f06-79b5-414f-bc8d-9ea9738043bf None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:04.064163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f08c4b-b6c3-4866-a645-7f701c86712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:04.064773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f08c4b-b6c3-4866-a645-7f701c86712c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.065083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f08c4b-b6c3-4866-a645-7f701c86712c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.065383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f08c4b-b6c3-4866-a645-7f701c86712c None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.065973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f08c4b-b6c3-4866-a645-7f701c86712c None admin] RBAC: Adding query filter params (type=network) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:04.066274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f08c4b-b6c3-4866-a645-7f701c86712c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:04.068230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f08c4b-b6c3-4866-a645-7f701c86712c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:04.074447 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 357/713] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:04.075699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c49cb-ca19-4e4e-b33d-0da6d37fcb91 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.075984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c49cb-ca19-4e4e-b33d-0da6d37fcb91 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.076260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c49cb-ca19-4e4e-b33d-0da6d37fcb91 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.082039 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 358/714] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:04.083782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c97264-0f95-4f8e-810f-dd8869929038 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.084172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c97264-0f95-4f8e-810f-dd8869929038 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.087282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c97264-0f95-4f8e-810f-dd8869929038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.087790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aba167-69fb-4ffe-a9b5-3ba785664895 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:04.110916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-77c97264-0f95-4f8e-810f-dd8869929038 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:04.112405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-77c97264-0f95-4f8e-810f-dd8869929038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:04.144357 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:04.177735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:04.178363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.178640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.178910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.231834 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 359/715] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:48:04.283101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:04.284538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:04.292929 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:04.390683 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 357/716] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:04.396278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c97264-0f95-4f8e-810f-dd8869929038 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:04.527215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c97264-0f95-4f8e-810f-dd8869929038 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:04.575982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:04.576614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.576888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.577239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.578742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:04.588828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:04.590324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:04.605775 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:04.606788 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:04.607705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:04.607705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:04.607705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:04.607705 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 360/717] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:04.612593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:04.631740 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:04.692426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc7f0-6ce6-41c2-97a5-5d9d12cc6105 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:04.700385 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:04.719917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf1013-1222-49bc-8e99-819d61fe2b8c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:04.729691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8143-5b94-4aac-8e55-2ae8189b1a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:04.730442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8143-5b94-4aac-8e55-2ae8189b1a72 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.731163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8143-5b94-4aac-8e55-2ae8189b1a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.731542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8143-5b94-4aac-8e55-2ae8189b1a72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.745166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd8143-5b94-4aac-8e55-2ae8189b1a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-94bd8143-5b94-4aac-8e55-2ae8189b1a72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:04.751715 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:04.752696 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:48:04.753928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:04.757142 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 358/718] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:04.758687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa5e8-dc5e-442e-951f-ed59464146a4 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.758967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa5e8-dc5e-442e-951f-ed59464146a4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.759237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa5e8-dc5e-442e-951f-ed59464146a4 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.760622 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 359/719] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:04.761195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffa5e8-dc5e-442e-951f-ed59464146a4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:04.768681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9d02f-8e52-42cc-a071-5836c25aef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:04.769616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d02f-8e52-42cc-a071-5836c25aef88 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.770122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d02f-8e52-42cc-a071-5836c25aef88 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.771150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d02f-8e52-42cc-a071-5836c25aef88 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.772082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9d02f-8e52-42cc-a071-5836c25aef88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:04.773008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9d02f-8e52-42cc-a071-5836c25aef88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:04.774952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9d02f-8e52-42cc-a071-5836c25aef88 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:04.791351 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 361/720] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:04.792858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79959f64-d20f-46b5-a493-4881f6556c6d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.793362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79959f64-d20f-46b5-a493-4881f6556c6d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.793835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79959f64-d20f-46b5-a493-4881f6556c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.815920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79959f64-d20f-46b5-a493-4881f6556c6d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:04.819045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79959f64-d20f-46b5-a493-4881f6556c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:04.875041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffa5e8-dc5e-442e-951f-ed59464146a4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:04.913110 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 362/721] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:48:04.913110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79959f64-d20f-46b5-a493-4881f6556c6d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:04.915667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:04.918791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:04.919227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:04.919707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:04.920718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:04.923139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:04.923543 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:04.925092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:04.938469 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 360/722] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:04.946037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:04.979240 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:05.084643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79959f64-d20f-46b5-a493-4881f6556c6d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.102776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bcc67-d1ae-45db-a083-24d6d5f59845 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.153003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.153800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.154080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.154354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.157699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.158343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.158623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.158939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.166759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:05.168214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:05.174127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:05.175782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:05.184365 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:05.185363 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:05.186251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:05.186251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:05.186251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:05.186251 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 361/723] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:05.191263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:05.202436 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:05.203324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:05.204216 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:05.207341 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 363/724] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:05.213395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.316127 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:05.323258 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:05.343786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9283cc-0b42-4b7f-a1ca-0d4c6e79aef6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.353955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b11551-5ebf-4399-8e5e-52dc7ae7d5f1 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.378044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.378645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.378922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.379195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.379887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:05.380190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:05.381577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:05.389714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.390429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.390719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.391167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.391921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:05.392233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:05.393784 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 362/725] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:05.394214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:05.394591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.414895 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 364/726] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:05.415909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.516326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af361-edaa-481f-bf07-bfd13d079905 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.533764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f403bd0-bb54-4e0a-ac47-0409923521f2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.551512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.552144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.552417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.552683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.560525 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:05.563464 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:05.563594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:05.569276 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:05.570739 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:05.571683 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:05.577021 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 363/727] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:05.577871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.580507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.581517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.582147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.582618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.590690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:05.593168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:05.606465 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:05.607446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:05.608427 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:05.610809 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 365/728] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:05.611841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.703686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4038b3-c6f3-44c6-841f-f07ab558e3c6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.715483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802d479-71a7-4b82-80b6-145b7d6d8d1d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:05.750892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.752253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.753288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.754271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:05.755307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.756308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:05.757296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=22f4d77320794bb39b2dda5daa402a16) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:05.757494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:05.757742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:05.758217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:05.758421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:05.758727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:05.760092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:05.760512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:05.771755 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 364/729] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/role_assignments?user.id=22f4d77320794bb39b2dda5daa402a16&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:05.773296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.776660 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 366/730] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:05.785101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:05.844001 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:05.937530 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:05.954529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03def8a-7383-4719-944f-f5a0979535b3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.002338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.003215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.003640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.004088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.019010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.021413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.024195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fa516-5413-4b36-b10a-1ad22c1c7927 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:06.038627 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:06.039841 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:06.040952 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:06.040952 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:06.040952 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:06.042790 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 367/731] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:06.048998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.106538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.107356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.107748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.108130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.108977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:06.109436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.111009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.152975 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 365/732] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 00:48:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:06.157825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.162549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e616f-56f3-4d64-8650-ce362b44d04e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.165399 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.201972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.202930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.203218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.203497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.204151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:06.204632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.206700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.229481 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 368/733] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:06.232245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.377932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b9a0a-a895-41a3-a335-53894e702a41 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.415191 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.428581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e821a-5d14-4515-916f-3f1c049dcc15 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.430843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f78a4-24bf-45d7-bcb3-a2993a6466e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.432493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f78a4-24bf-45d7-bcb3-a2993a6466e3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.432883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f78a4-24bf-45d7-bcb3-a2993a6466e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.433299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f78a4-24bf-45d7-bcb3-a2993a6466e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.475220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992dfc4-9b94-4124-8a60-20ddcc682e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.476198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992dfc4-9b94-4124-8a60-20ddcc682e4f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.477412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992dfc4-9b94-4124-8a60-20ddcc682e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.477755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992dfc4-9b94-4124-8a60-20ddcc682e4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.487538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992dfc4-9b94-4124-8a60-20ddcc682e4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.489433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992dfc4-9b94-4124-8a60-20ddcc682e4f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-3992dfc4-9b94-4124-8a60-20ddcc682e4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:06.505385 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:06.506868 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:48:06.508028 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:06.508655 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 369/734] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:06.510194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941109-3fdf-49df-b3cb-b550a4c2908b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.510579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941109-3fdf-49df-b3cb-b550a4c2908b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.510984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941109-3fdf-49df-b3cb-b550a4c2908b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.517139 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 370/735] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:06.519767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64204e-60a2-44ce-b5c3-4fadcb49b764 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.520128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64204e-60a2-44ce-b5c3-4fadcb49b764 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.520546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64204e-60a2-44ce-b5c3-4fadcb49b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.525145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f78a4-24bf-45d7-bcb3-a2993a6466e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.527069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f78a4-24bf-45d7-bcb3-a2993a6466e3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.546849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7e64204e-60a2-44ce-b5c3-4fadcb49b764 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:06.548646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7e64204e-60a2-44ce-b5c3-4fadcb49b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:06.568082 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.641174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 371/736] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:48:06.641174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64204e-60a2-44ce-b5c3-4fadcb49b764 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.650451 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 366/737] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:48:06.651804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd392-ba38-4d24-b729-6288e6f712bd None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.652155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd392-ba38-4d24-b729-6288e6f712bd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.652548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd392-ba38-4d24-b729-6288e6f712bd None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.654137 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 367/738] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:06.655639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd392-ba38-4d24-b729-6288e6f712bd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.689371 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.761317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64204e-60a2-44ce-b5c3-4fadcb49b764 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.792619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd392-ba38-4d24-b729-6288e6f712bd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:06.804754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46550121-44bd-4d0d-a84c-318f636d1fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.805857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46550121-44bd-4d0d-a84c-318f636d1fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.806283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46550121-44bd-4d0d-a84c-318f636d1fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.806946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46550121-44bd-4d0d-a84c-318f636d1fd4 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.808299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46550121-44bd-4d0d-a84c-318f636d1fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:06.809007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46550121-44bd-4d0d-a84c-318f636d1fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.811317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46550121-44bd-4d0d-a84c-318f636d1fd4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.829367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:06.829997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.830270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.830538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.834510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 372/739] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:06.835863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e197-6a58-4401-8b41-4e6043f1222c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:06.836307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e197-6a58-4401-8b41-4e6043f1222c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:06.836720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e197-6a58-4401-8b41-4e6043f1222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:06.846833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:06.848285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:06.857248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-03e8e197-6a58-4401-8b41-4e6043f1222c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:06.859093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03e8e197-6a58-4401-8b41-4e6043f1222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:06.861944 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:06.865912 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:06.867134 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:06.868086 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:06.868086 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:06.868086 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:06.868086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 368/740] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:06.868429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.949191 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:06.957109 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:48:06.957109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e197-6a58-4401-8b41-4e6043f1222c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:06.985859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f5cd7-ee7a-4ea2-b91f-a8589bb48022 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.028791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.029430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.029708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.029980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.075350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e197-6a58-4401-8b41-4e6043f1222c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.113841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.115846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.116118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.116801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.117175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.117520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.118232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:07.118720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.120243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.127303 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:07.135332 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 374/742] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:07.135929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.210592 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:07.249135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 369/743] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:48:07.250108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.253834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7c260-7df4-4a96-adc6-391b15751b0c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.293162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.294110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.294540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.294965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.295608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.297692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.321242 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 375/744] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:07 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:07.321242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.376380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be360905-b63b-4bd0-b75c-e8f3c91de68b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.400842 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:07.434789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.435429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.435708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.435973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.443957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.445973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.456703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29601c-69ff-4d2f-b172-e1bd197859d4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:07.459155 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:07.460184 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:07.461251 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 370/745] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:07.461758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.496525 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:07.508031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.508910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.509396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.509810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.510734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.513109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.536653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 376/746] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:07 2022] POST /identity/v3/services => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:07.538848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.593500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a255e-f8c9-4b82-9982-e0b00981562a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.651029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.651958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.652379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.652796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.669660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dcda1-873d-4071-8b81-b89b0c6d8a06 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.670761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.673439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.691365 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:07.697962 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:07.699135 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:07.700034 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:07.700034 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:07.700034 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:07.703018 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 371/747] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:07.711617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.715497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.716892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.716892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.716892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.717887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:07.718302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.719899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.737303 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 377/748] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:07.741886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.825822 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:07.857520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36832771-db8c-4f08-9892-dbcafa45f595 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.873136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637754-f5ce-4994-8b46-b8843ab91c29 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:07.898639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.899252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.899530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.899798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.900440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:07.900743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.902166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.915649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e237822-e7f3-4553-8187-0d9176e2ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:07.915844 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 372/749] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:07.916412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e237822-e7f3-4553-8187-0d9176e2ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:07.916749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e237822-e7f3-4553-8187-0d9176e2ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:07.917028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e237822-e7f3-4553-8187-0d9176e2ddb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:07.917893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e237822-e7f3-4553-8187-0d9176e2ddb7 None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=8ed929b0279d4e9f8910576741158c21) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:07.918201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e237822-e7f3-4553-8187-0d9176e2ddb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:07.919621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e237822-e7f3-4553-8187-0d9176e2ddb7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:07.921159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:07.933186 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 378/750] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:07 2022] GET /identity/v3/role_assignments?user.id=8ed929b0279d4e9f8910576741158c21&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:08.054628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf32aa-6e52-465c-925f-b72433eaef83 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:08.083016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fbff-9e55-4680-9774-4ddd7e108846 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:08.083305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fbff-9e55-4680-9774-4ddd7e108846 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:08.083767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fbff-9e55-4680-9774-4ddd7e108846 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:08.085724 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 379/751] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:08.097547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09afca-0c40-455b-bc61-87269ef16025 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:08.097979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09afca-0c40-455b-bc61-87269ef16025 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:08.099418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09afca-0c40-455b-bc61-87269ef16025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:08.101185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:08.101981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:08.102421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:08.102836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:08.110650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:08.112335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:08.114982 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:08.121756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aa09afca-0c40-455b-bc61-87269ef16025 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:08.122984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa09afca-0c40-455b-bc61-87269ef16025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:08.128304 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:08.129287 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:08.130714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:08.134402 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 373/752] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:08.140313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:08.227535 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:08.279055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250a2d5-0f39-4064-b5d4-018a93110c07 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:08.283010 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 380/753] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:08.344601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:08.345158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:08.345433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:08.345700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:08.346392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:08.346692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:08.348106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:08.364492 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 374/754] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:08.370492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09afca-0c40-455b-bc61-87269ef16025 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:08.497226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09afca-0c40-455b-bc61-87269ef16025 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:08.551344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:08.551993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:08.552414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:08.552684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:08.553437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=3ada7c97c73b43e09c30a603e648bcb4) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:08.553739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:08.555146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:08.565397 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 381/755] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:08 2022] GET /identity/v3/role_assignments?user.id=3ada7c97c73b43e09c30a603e648bcb4&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:08.628834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:08.714670 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:08.767612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c14f45-eaab-4139-a8f2-e147b034b089 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:08.823122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:08.823763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:08.824043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:08.824318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:08.838628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:08.843385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:08.844314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:08.845182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 375/756] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:08.854224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:08.908937 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:08.979269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6824146-3d70-46c8-bccf-6b84f1b7d57b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:09.016886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:09.017527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:09.017808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:09.018075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:09.019000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:09.019301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:09.021365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:09.034650 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 382/757] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:09.036570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:09.193318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01a73a-3163-465f-87fb-4fefca2ed868 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:09.217859 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:09.236167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:09.236857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:09.237170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:09.237446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:09.249050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:09.250508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:09.264708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:09.265679 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:09.266876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:09.266876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:09.266876 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:09.266876 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 376/758] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:09.273793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:09.407055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd7c20-61fa-45d4-953c-ddf28fc20182 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:09.408991 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:09.456555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:09.457100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:09.457384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:09.457651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:09.458466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:09.458799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:09.460115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:09.472378 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 383/759] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:09.478511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:09.632508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc7e3-ce9e-45cc-a75b-27d0161c36c3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:09.691194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:09.691831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:09.692136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:09.692412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] PATH_INFO: `/v3/users/nova` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:09.700456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:09.701924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:09.716903 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:09.717956 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:09.718915 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 377/760] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:48:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:09.724466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:09.883780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247161f8-2302-4fc7-94ef-b7c7d6b1f3be None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:09.942967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:09.943580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:09.943864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:09.944134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:09.944867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:09.945204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:09.946632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:09.980828 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 384/761] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:48:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:09.986130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:10.020368 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.104762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ff90b-85f3-4734-b3e1-2c2cf85e9ded None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:10.142947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3312ac-826a-47be-94ca-143800ebbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:10.143824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3312ac-826a-47be-94ca-143800ebbc6f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.144105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3312ac-826a-47be-94ca-143800ebbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.144378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3312ac-826a-47be-94ca-143800ebbc6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.155735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3312ac-826a-47be-94ca-143800ebbc6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:10.157197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3312ac-826a-47be-94ca-143800ebbc6f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-1d3312ac-826a-47be-94ca-143800ebbc6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:10.172815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:10.173871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:10.174776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:10.174776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:10.174776 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:10.174776 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 378/762] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:10.182317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:10.210275 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.303260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae9fd7-9cf1-4c35-b58b-4ad73724afb5 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.303444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae9fd7-9cf1-4c35-b58b-4ad73724afb5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.303715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae9fd7-9cf1-4c35-b58b-4ad73724afb5 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.305145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 379/763] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:10.310861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f058-8a4e-46dd-94a0-c5c1eedd9d41 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.311179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f058-8a4e-46dd-94a0-c5c1eedd9d41 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.311412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f058-8a4e-46dd-94a0-c5c1eedd9d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.341158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595c45-d77e-4c51-adb0-1e4b3d628e0f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:10.343560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1a40f058-8a4e-46dd-94a0-c5c1eedd9d41 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:10.344760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1a40f058-8a4e-46dd-94a0-c5c1eedd9d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:10.392841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:10.393751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.394036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.394312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.394959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:10.395325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:10.396837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:10.413258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 385/764] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:10.415132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:10.455950 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 380/765] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:10.457351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913771dd-e603-41cb-9ff1-7b742215b872 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.457635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913771dd-e603-41cb-9ff1-7b742215b872 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.458627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913771dd-e603-41cb-9ff1-7b742215b872 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.460140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 381/766] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:10.465092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bda84f-a927-406c-b0d6-2d7699ecefa9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.465380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bda84f-a927-406c-b0d6-2d7699ecefa9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.465655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bda84f-a927-406c-b0d6-2d7699ecefa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.485164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-56bda84f-a927-406c-b0d6-2d7699ecefa9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:10.486465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-56bda84f-a927-406c-b0d6-2d7699ecefa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:10.503836 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.547338 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.589381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6096f30-0197-433e-95f7-4968e7efc321 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:10.634978 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 382/767] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:10.642559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a17403-1972-452f-bd0c-cc9b62f78892 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.642949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a17403-1972-452f-bd0c-cc9b62f78892 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.643231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a17403-1972-452f-bd0c-cc9b62f78892 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.649151 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 383/768] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:10.652982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:10.653852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.654237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb945c2-a61a-4b4c-9dc3-e6443f79961d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.654524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb945c2-a61a-4b4c-9dc3-e6443f79961d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.654802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb945c2-a61a-4b4c-9dc3-e6443f79961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.654904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.655331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.663983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:10.667034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:10.686409 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:10.687419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:10.688353 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:10.694590 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 386/769] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:10.694733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1cb945c2-a61a-4b4c-9dc3-e6443f79961d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:10.694733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1cb945c2-a61a-4b4c-9dc3-e6443f79961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:10.696560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:10.790390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 384/770] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:10.798156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb945c2-a61a-4b4c-9dc3-e6443f79961d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:10.854924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755f4c2-2bcb-4500-9a50-8ee624470c90 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:10.903759 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.916086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:10.917390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.917943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.918882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.920203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:10.922031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:10.923467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:10.933043 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.937470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 387/771] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:10.944465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:10.977595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb945c2-a61a-4b4c-9dc3-e6443f79961d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.031985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.032585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.032864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.033203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] PATH_INFO: `/v3/services/network` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.033789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.035241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:11.044758 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:11.045794 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:11.047195 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 385/772] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:10 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:11.048011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.084158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ddb11-d475-45a2-84c4-d802ff48de70 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.120959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.121679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.122023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.122384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/22f4d77320794bb39b2dda5daa402a16/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.124390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=22f4d77320794bb39b2dda5daa402a16, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.125908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.140795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 388/773] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:48:10 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/22f4d77320794bb39b2dda5daa402a16/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:48:11.141856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.162474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596087-b007-46d0-ab7d-f17e20a4334c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.209557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.210216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.210499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.210809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.211735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.213451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.217535 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:11.220102 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:11.228012 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:11.229308 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:11.230240 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:11.231745 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 386/774] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:11.233636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.270062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33568c-24a9-499d-a8de-9309b549486d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.312405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.313488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.313822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.314162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.314903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:11.315429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.316901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.328027 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 389/775] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:11.329102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.389443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0a4f-82c3-4900-92cb-58fe83d45f4a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.425675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.426312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.427192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.427556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.438711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:11.443700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:11.444635 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:11.445547 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 387/776] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:11.446263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.456230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1783b3-2f9e-4653-a595-ce0cca5bd2c3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.480692 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:11.496866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646392b-e4d9-48fa-ae19-64d948bf3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.497574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646392b-e4d9-48fa-ae19-64d948bf3e10 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.497922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646392b-e4d9-48fa-ae19-64d948bf3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.498185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646392b-e4d9-48fa-ae19-64d948bf3e10 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.498787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646392b-e4d9-48fa-ae19-64d948bf3e10 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:11.499094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646392b-e4d9-48fa-ae19-64d948bf3e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.500746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646392b-e4d9-48fa-ae19-64d948bf3e10 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.505845 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 390/777] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:11.507217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa5a6e-440f-4c69-8ad1-71801a47726c None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.507504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa5a6e-440f-4c69-8ad1-71801a47726c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.507780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa5a6e-440f-4c69-8ad1-71801a47726c None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.509458 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:11.510395 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 391/778] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:11.511296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa5a6e-440f-4c69-8ad1-71801a47726c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.563481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbb020-f1d4-4f84-b0af-35572f9b4ea6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.600554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.601254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.601538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.601811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.602445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] RBAC: Adding query filter params (type=network) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:11.602748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.604108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.614019 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 388/779] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:11.614019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.636173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa5a6e-440f-4c69-8ad1-71801a47726c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.675086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72966cc-0a87-4f77-b069-9a872c16fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.675686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72966cc-0a87-4f77-b069-9a872c16fb8a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.675940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72966cc-0a87-4f77-b069-9a872c16fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.676265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72966cc-0a87-4f77-b069-9a872c16fb8a None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.677590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72966cc-0a87-4f77-b069-9a872c16fb8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:11.677894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72966cc-0a87-4f77-b069-9a872c16fb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.679316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72966cc-0a87-4f77-b069-9a872c16fb8a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.688260 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 392/780] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:11.689505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561191-7b73-4123-85de-5bd26414f721 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.689790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561191-7b73-4123-85de-5bd26414f721 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.690064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561191-7b73-4123-85de-5bd26414f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.710340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d0561191-7b73-4123-85de-5bd26414f721 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:11.711534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d0561191-7b73-4123-85de-5bd26414f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:11.720196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e42e62-7704-40c1-abe9-b5b7084a210a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.746588 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:11.756429 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:11.758743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.759414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.759678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.759945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.760515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:11.760802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.762173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.767173 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 389/781] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:11.767946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.788425 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 393/782] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:11.789547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561191-7b73-4123-85de-5bd26414f721 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.908890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8056-0530-44a1-a0ce-76f26906dc33 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.922855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561191-7b73-4123-85de-5bd26414f721 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:11.956143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.956837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.957501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.958404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.959748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] RBAC: Adding query filter params (interface=public, service_id=55fa6c4c216b4ee4b0aa6c3cbff5a1be, region_id=RegionOne) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:11.960298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.961941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:11.968612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:11.969592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:11.970078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:11.970552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:11.971473 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 390/783] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/endpoints?service_id=55fa6c4c216b4ee4b0aa6c3cbff5a1be&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:11.972334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:11.983515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:11.985383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:12.001759 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:12.002763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:12.003688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:12.003688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:12.003688 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:12.010619 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 394/784] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:12.011854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.035740 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:12.053621 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:12.088302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57998eb6-04d6-4e32-b433-aa224039547b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.124865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.125570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.125845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.126114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.126816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] RBAC: Adding query filter params (interface=public, service_id=51987c026cb546db9d10d9d04e30d3bf, region_id=RegionOne) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:12.127120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:12.128620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.139579 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 391/785] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:48:11 2022] GET /identity/v3/endpoints?service_id=51987c026cb546db9d10d9d04e30d3bf&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:12.139579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.145659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e781910-8bb7-4c7e-821a-2800fb0c326e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.182564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.183171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.183452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.183724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.184322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:12.185714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.190755 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 395/786] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:12.191525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.270871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc9c17-c98f-4cab-b2ce-0e7c557f4c57 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.297529 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:12.314145 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:12.325811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc4fb3-46c0-407c-a38d-c798a2e6581d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.328041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.329904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.330356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.330806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.331621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:12.332075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:12.334309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.357695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 392/787] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:12.358949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.372582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.373424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.373794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.374071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.387123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:12.392426 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:12.393842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:12.394716 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 396/788] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:12.395999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.485610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8656510-3b61-4080-a0ce-487349962f8a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.508699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eeaf5-3d17-438b-83b5-1e18542f9b23 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.540124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.541324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.542247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.543019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.544097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:12.546438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.549536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.550157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.550435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.550745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.561842 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 393/789] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:12.562629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:12.563601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.564409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:12.581109 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:12.582236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:12.583478 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 397/790] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:12.589224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.617785 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:12.651969 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:12.737952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99f03-cc5a-4cb5-ae73-6ce826540b4f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.774931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955d2d2-81c1-4669-93fd-c233829f6b07 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.782559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.783462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.783899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.784311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.785300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:12.785767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:12.788698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.808902 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 398/791] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:12.815321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.839906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.840688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.841085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.841490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.842260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:12.842668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:12.844129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:12.854086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 394/792] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:12.861100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:12.908210 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:12.946551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2cd1-f3fe-47a5-992a-c0062c001f48 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:12.988616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:12.990166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:12.990546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:12.990993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:12.996792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22df22-e779-4507-ad51-a24ccdd33e3c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.005085 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:13.013890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.015357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:13.046516 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:13.047526 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:13.048431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:13.048431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:13.048431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:13.048431 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 399/793] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:13.054854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.081826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.082896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.082896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.083097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.107221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.108746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:13.136133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:13.137199 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:13.138106 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:13.138106 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:13.138106 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:13.138106 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 395/794] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:13.144361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.175173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841a3f-3cd4-4245-898c-480d9b84e72c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.200884 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:13.219172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.219790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.220062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.220328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.220965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:13.221304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.222632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.251110 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 400/795] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:13.256475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.344314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16077d8d-1cef-4a3f-8ba5-6041162ce0af None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.422200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.422810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.423090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.423606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.424254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:13.425880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.428700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.451816 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 396/796] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:13.455623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91139549-94c8-409a-9c14-a7ca88a4fd11 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.458528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.481525 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:13.500881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1b6d-1b5f-45ce-a063-bec5e4b6e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.501907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1b6d-1b5f-45ce-a063-bec5e4b6e330 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.502390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1b6d-1b5f-45ce-a063-bec5e4b6e330 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.502859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1b6d-1b5f-45ce-a063-bec5e4b6e330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.511842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c1b6d-1b5f-45ce-a063-bec5e4b6e330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.514596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c1b6d-1b5f-45ce-a063-bec5e4b6e330 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-666c1b6d-1b5f-45ce-a063-bec5e4b6e330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:13.532041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:13.533137 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:13.534066 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:13.534916 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 401/797] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:13.535839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837f6c6-a256-4278-b37c-172009f56b19 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.536677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837f6c6-a256-4278-b37c-172009f56b19 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.536949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837f6c6-a256-4278-b37c-172009f56b19 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.542823 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 402/798] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:13.543855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837f6c6-a256-4278-b37c-172009f56b19 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.600136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd321b24-8881-4646-be1b-0c9c492ef32c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.603731 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:13.639792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c88248-e416-4f58-9589-ecb982ade708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.640424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c88248-e416-4f58-9589-ecb982ade708 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.640702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c88248-e416-4f58-9589-ecb982ade708 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.641100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c88248-e416-4f58-9589-ecb982ade708 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.649817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c88248-e416-4f58-9589-ecb982ade708 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.651263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c88248-e416-4f58-9589-ecb982ade708 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-f8c88248-e416-4f58-9589-ecb982ade708 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:13.664013 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:13.665803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:48:13.667607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:13.673919 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 397/799] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:13.673919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06edbc3-866e-4e08-b5d7-bdf62e843af2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.673919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06edbc3-866e-4e08-b5d7-bdf62e843af2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.673919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06edbc3-866e-4e08-b5d7-bdf62e843af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.689480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837f6c6-a256-4278-b37c-172009f56b19 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.691594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f06edbc3-866e-4e08-b5d7-bdf62e843af2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:13.693727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f06edbc3-866e-4e08-b5d7-bdf62e843af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:13.731099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.731812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.732197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.732749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.733549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:13.733935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.736140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.753592 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 403/800] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:13.754363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.797175 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 398/801] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:13.798731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06edbc3-866e-4e08-b5d7-bdf62e843af2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.806930 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:13.895765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645007b3-2c73-4df7-ba73-b744d14a7870 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.897546 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:13.940887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.941793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.942275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.942748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.943637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:13.944113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:13.945721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:13.967623 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 404/802] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:13.969619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.992627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06edbc3-866e-4e08-b5d7-bdf62e843af2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.055208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.057028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.058675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.059577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/8ed929b0279d4e9f8910576741158c21/roles/bb0dba2691804589a999e0f81f843412` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.103818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=8ed929b0279d4e9f8910576741158c21, role_id=bb0dba2691804589a999e0f81f843412)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.105706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.129004 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 399/803] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:48:13 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/8ed929b0279d4e9f8910576741158c21/roles/bb0dba2691804589a999e0f81f843412 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:48:14.155440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:14.162370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494aded-49f1-4f94-81a5-490f0053e277 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.232452 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:14.270840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.272061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.272061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.272308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.295280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d10f5-ca30-4161-97be-e80922cf6070 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.305965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.307574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.338253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:14.338617 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:14.339534 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:14.340805 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:14.340805 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:14.340805 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:14.340805 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 405/804] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:14.342043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.342581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.343047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.345601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:14.359855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:14.364225 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:14.372064 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:14.373051 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:14.373961 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:14.381383 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 400/805] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:14.386306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:14.484990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7eb55-4241-40e7-8631-898600775f9c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.525250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.526239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.526717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.527374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.528226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:14.528743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.530344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.545844 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 406/806] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:14.551324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:14.564917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c39d1-684c-4b24-952a-4385edb6b9fe None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.588542 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:14.650547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.651165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.651448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.651716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.652389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:14.652691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.654084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.675463 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 401/807] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:14.681286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:14.685657 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:14.724552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0479fc3-4732-464b-bd42-bf929c818d8f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.773387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239ecea-2b44-450a-a1c3-0b3cac011a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.774740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ecea-2b44-450a-a1c3-0b3cac011a17 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.775549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ecea-2b44-450a-a1c3-0b3cac011a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.776039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239ecea-2b44-450a-a1c3-0b3cac011a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.783310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239ecea-2b44-450a-a1c3-0b3cac011a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.785782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239ecea-2b44-450a-a1c3-0b3cac011a17 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e239ecea-2b44-450a-a1c3-0b3cac011a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:14.799304 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:14.800246 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:14.801239 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:14.803251 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 407/808] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:14.803598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956b07-3ce9-4d00-91ad-46d99664eee5 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.803873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956b07-3ce9-4d00-91ad-46d99664eee5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.804138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9956b07-3ce9-4d00-91ad-46d99664eee5 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.809298 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 408/809] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:14.810067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9956b07-3ce9-4d00-91ad-46d99664eee5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:14.839971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3b8a-aea4-45e1-8ff1-5295b665fffc None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.897739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fc2db-dbdc-420c-a8f5-19ba9c4ffa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.898984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fc2db-dbdc-420c-a8f5-19ba9c4ffa7f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.899414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fc2db-dbdc-420c-a8f5-19ba9c4ffa7f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.899859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fc2db-dbdc-420c-a8f5-19ba9c4ffa7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.917598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fc2db-dbdc-420c-a8f5-19ba9c4ffa7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.919927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fc2db-dbdc-420c-a8f5-19ba9c4ffa7f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.921920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9956b07-3ce9-4d00-91ad-46d99664eee5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-dd7fc2db-dbdc-420c-a8f5-19ba9c4ffa7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:14.936600 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:14.937815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:14.938955 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:14.938955 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:14.938955 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:14.944748 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 402/810] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:14.946151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e18b-625d-4a6e-8ffc-fc32c12d9593 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.946533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e18b-625d-4a6e-8ffc-fc32c12d9593 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.946907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e18b-625d-4a6e-8ffc-fc32c12d9593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.963740 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:14.966265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0997e18b-625d-4a6e-8ffc-fc32c12d9593 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:14.967826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0997e18b-625d-4a6e-8ffc-fc32c12d9593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:14.970419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:14.971725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:14.972282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:14.972784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:14.973881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:14.974333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.975889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.990551 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 409/811] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:14.991790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:14.994888 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:15.053186 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 403/812] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:15.053186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997e18b-625d-4a6e-8ffc-fc32c12d9593 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:15.143016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d5e3c-fe65-4fb0-874a-2a2928705699 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:15.211103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:15.211737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.213092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.213377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.214060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:15.215166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:15.220478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:15.233881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997e18b-625d-4a6e-8ffc-fc32c12d9593 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:15.248428 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 410/813] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:15.254026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:15.283538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f245632-d5b3-44ac-9181-6f75b4125390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:15.285245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f245632-d5b3-44ac-9181-6f75b4125390 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.285529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f245632-d5b3-44ac-9181-6f75b4125390 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.285806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f245632-d5b3-44ac-9181-6f75b4125390 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/3ada7c97c73b43e09c30a603e648bcb4/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.294394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f245632-d5b3-44ac-9181-6f75b4125390 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=3ada7c97c73b43e09c30a603e648bcb4, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:15.296047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f245632-d5b3-44ac-9181-6f75b4125390 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:15.329554 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:15.332370 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 404/814] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:48:15 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/3ada7c97c73b43e09c30a603e648bcb4/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:48:15.355865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618daaf9-8ca7-41a5-bf0d-ebdb84026202 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.356177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618daaf9-8ca7-41a5-bf0d-ebdb84026202 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.356422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618daaf9-8ca7-41a5-bf0d-ebdb84026202 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.358052 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 405/815] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:15.363287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401f56-a4fd-4adc-b53d-2985801069d9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.363568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401f56-a4fd-4adc-b53d-2985801069d9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.363833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401f56-a4fd-4adc-b53d-2985801069d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.391047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0de3-8744-4f02-855a-91b4bce79b2d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:15.407658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b5401f56-a4fd-4adc-b53d-2985801069d9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:15.409769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b5401f56-a4fd-4adc-b53d-2985801069d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:15.430188 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:15.435848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:15.436858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.437483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.437826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.450080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:15.452375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:15.467559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:15.468825 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:15.470043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:15.475698 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 411/816] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:48:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:15.477419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:15.501629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 406/817] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:15.502992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401f56-a4fd-4adc-b53d-2985801069d9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:15.644354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401f56-a4fd-4adc-b53d-2985801069d9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:15.714566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:15.715234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.715524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.715840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.716629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:15.716937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:15.721920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:15.751399 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 407/818] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:48:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:15.757637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:15.770133 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:15.780366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465573-6ad2-496d-9fe9-9a4524408427 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:15.806290 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:15.841972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:15.842605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.842881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.843148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] PATH_INFO: `/v3/services/network` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.844269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:15.846031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:15.856168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:15.857212 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:48:15.858063 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:15.858895 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 412/819] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:15 2022] GET /identity/v3/services/network => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:15.865094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:15.896094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbaa05-97cb-45cc-8099-6b3a1762f9e7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:15.934411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:15.935017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:15.935299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:15.935573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:15.974095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4788d-3d8f-4459-91f1-f99829048716 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.009345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.009980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.010253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.010515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.011101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.012858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.015081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.016848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:16.022343 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:16.023363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:16.024217 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 413/820] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 11 00:48:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:16.025026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.071488 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.137668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5d079-24c7-4307-87eb-17544144f2d6 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.155255 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.176103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.176751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.177277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.177594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.178225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] RBAC: Adding query filter params (name=network) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:16.178764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.180571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.189135 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 414/821] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:16.190601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.265600 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 408/822] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:16.266568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.313354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504078-367c-4a1d-aed2-c95533788cac None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.316772 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.356922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.357590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.357867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.358178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.358764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:16.359128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.360489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.366095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 415/823] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:16.367082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.391466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8af62-9428-4b00-880e-6fad8ea1429b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.406035 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.449309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.451031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.451589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.452010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.452818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] RBAC: Adding query filter params (type=network) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:16.453322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.455259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.463814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 409/824] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:16.465087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.500334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6284c0-159a-49ee-9bba-b8338ae1f623 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.546011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.546854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.547277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.547688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.561629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.563275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:16.580523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:16.581762 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:16.583429 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:16.583429 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:16.583429 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:16.583429 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 416/825] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:16.583429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.589316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c47ca-250f-484a-bc55-a45143a5cd26 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.607929 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.627877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb7547-e6ea-4b43-86a2-03deef687948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.628829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb7547-e6ea-4b43-86a2-03deef687948 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.629132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb7547-e6ea-4b43-86a2-03deef687948 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.629410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb7547-e6ea-4b43-86a2-03deef687948 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.630895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb7547-e6ea-4b43-86a2-03deef687948 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:16.631360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb7547-e6ea-4b43-86a2-03deef687948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.632714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb7547-e6ea-4b43-86a2-03deef687948 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.637636 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 410/826] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:16.643095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d14f8-0603-47f0-a63f-24b21f99d050 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.643387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d14f8-0603-47f0-a63f-24b21f99d050 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.643908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d14f8-0603-47f0-a63f-24b21f99d050 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.646489 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 411/827] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:16.647309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d14f8-0603-47f0-a63f-24b21f99d050 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.685163 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.695529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cf31-db82-4ef9-b40d-5ef05b53ae3a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.734127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.734733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.735011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.735282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.735948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.737327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.758464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d14f8-0603-47f0-a63f-24b21f99d050 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.764556 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 417/828] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:16.769102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.813654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4e31d-95c3-496b-812c-6f92f4f47a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.814326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e31d-95c3-496b-812c-6f92f4f47a58 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.814698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e31d-95c3-496b-812c-6f92f4f47a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.814973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e31d-95c3-496b-812c-6f92f4f47a58 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.815620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4e31d-95c3-496b-812c-6f92f4f47a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:16.816050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4e31d-95c3-496b-812c-6f92f4f47a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.817899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4e31d-95c3-496b-812c-6f92f4f47a58 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.831692 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 412/829] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:16.833358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95963429-27b4-4979-861f-6b21590950ff None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.833681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95963429-27b4-4979-861f-6b21590950ff None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.834075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95963429-27b4-4979-861f-6b21590950ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.855332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-95963429-27b4-4979-861f-6b21590950ff None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:16.856736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-95963429-27b4-4979-861f-6b21590950ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:16.862054 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.898054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2270f4-000f-4f4d-813e-c034aac6a97f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:16.938769 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 413/830] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:16.940283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95963429-27b4-4979-861f-6b21590950ff None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.959592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:16.960226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.960505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.960951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.961587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:16.963150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:16.965665 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:17.003981 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 418/831] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:17.078222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95963429-27b4-4979-861f-6b21590950ff None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.124451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:17.125113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.125394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.125660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.134978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:17.136507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:17.154326 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:17.155318 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:17.156230 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 414/832] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:17.162749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:17.278485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210af3c5-4243-4e25-b04d-9c436fe0d272 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.280956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:17.315591 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:17.324657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:17.325680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.327024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.327301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.328002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:17.328307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:17.329786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:17.344453 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 419/833] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:17.350142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:17.379613 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:17.409334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb533-cdb8-4fee-a280-92e557e7c0dd None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.448123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:17.448885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.449263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.449605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.466266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:17.471103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36242d2-4850-40dc-ab38-1e915eca0280 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:17.472935 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:17.474784 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:17.475625 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 415/834] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:48:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:17.480694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:17.518293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:17.519492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.520192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.520813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.521903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=22f4d77320794bb39b2dda5daa402a16) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:17.522318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:17.523827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:17.534520 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 420/835] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:17 2022] GET /identity/v3/role_assignments?user.id=22f4d77320794bb39b2dda5daa402a16&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:17.607212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ace94-8fae-4729-88c9-ad93dae7c8a1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.646577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555fc66-081b-497c-a126-36474693289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:17.647461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fc66-081b-497c-a126-36474693289a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.647908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fc66-081b-497c-a126-36474693289a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.648322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fc66-081b-497c-a126-36474693289a None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.649256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fc66-081b-497c-a126-36474693289a None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:17.649713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fc66-081b-497c-a126-36474693289a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:17.651351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fc66-081b-497c-a126-36474693289a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:17.654829 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:17.663875 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 416/836] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:48:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:17.669814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:17.735229 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:17.783162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618aa2e-c7ec-4291-8846-589ec0173ed0 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.783439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9fa5-8994-46a7-8713-6f80909d0f2c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.783627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9fa5-8994-46a7-8713-6f80909d0f2c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.783907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b9fa5-8994-46a7-8713-6f80909d0f2c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.785509 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 417/837] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:17.791304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b839-c589-42bd-86a9-0b5e75231081 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.791585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b839-c589-42bd-86a9-0b5e75231081 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.791858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b839-c589-42bd-86a9-0b5e75231081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.812077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-41b9b839-c589-42bd-86a9-0b5e75231081 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:17.813292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-41b9b839-c589-42bd-86a9-0b5e75231081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:17.825793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:17.827077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.827754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.828299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.843174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:17.845454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:17.863867 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:17.865190 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:17.866333 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:17.866333 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:17.866333 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:17.868038 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 421/838] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:17.874063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:17.891794 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 418/839] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:17.982456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2aa12-fc40-427d-85ff-f43784b9f355 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.992664 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:18.020042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.021362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.021791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.022209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.023017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:18.023465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.024956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.039147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 422/840] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:18.044998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9b839-c589-42bd-86a9-0b5e75231081 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.153749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9b839-c589-42bd-86a9-0b5e75231081 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.182848 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:18.186568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.194161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.194993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.195454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.196386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.206615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.209218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:18.226255 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:18.227442 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:18.228714 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:18.230853 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 419/841] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:18.236581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.303367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76df83d-751c-4ed9-ae03-41e4c5485c18 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.345932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.346849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.347438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.347862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.360362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:18.366345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:18.367506 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:18.368437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:18.369097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6a551-8194-44a0-8c9b-ae14c8a673b1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.371161 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 423/842] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:18.376671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.410043 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:18.411399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.412386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.412898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.413467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.414529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:18.415139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.416592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.439704 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 420/843] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:18.440598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.490375 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:18.496295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771a276-17c5-4541-994c-8616947e9d84 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.553768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.555133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.556143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.556690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.557864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:18.558238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.559608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbd26b-2bf0-4a84-a54b-83ef89fe3803 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.559722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.573212 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 424/844] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:18.576579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.601298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.601913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.602184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.602453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.688284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.689878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.695479 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:18.706427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83155c18-8691-45fd-a3c0-2a015e3846d2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.741271 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:18.750714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.751750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.752292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.752765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.766772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.768533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:18.786552 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:18.787558 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:18.788491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:18.788491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:18.788491 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:18.790468 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 425/845] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:18.796752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.803020 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 421/846] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:18.808358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.919637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2dccb-2598-433b-9a6b-8387693c5f9a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.926104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d668bf1-d26a-4e10-b236-0fd22cf85ef0 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:18.965461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.965714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:18.966208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.966487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.966759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.967232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:18.967717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:18.968178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:18.969011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:18.969544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.971101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.978367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:18.980369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:18.987232 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 426/847] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:18.993153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:18.996032 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:18.998393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:18.999330 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:19.000230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:19.000230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:19.000230 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:19.002041 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 422/848] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:19.002512 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:19.008064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.126679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122911e4-e505-4458-931c-4004424bc7e1 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.130514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e341e-677c-47a0-9d11-7c123e34995d None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.163847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.164479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.164757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.165028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.172492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.173967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.174468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.175160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.175436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.176011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.177402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:19.177725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.179075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:19.189395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:19.190374 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:19.191978 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 427/849] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:19.200578 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 423/850] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:19.200730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.203207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.263212 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:19.285769 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:19.307447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4813-96d2-434d-8258-632cd321f75d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.346499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.347128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.347409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.347681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.348947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:19.349301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.350386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727a440-8346-4d69-b2c8-75118ea25b98 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.350741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.370429 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 428/851] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:19.382204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.393407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.394608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.395569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.396099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.406038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.408341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:19.424996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:19.425977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:19.426964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:19.434649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 424/852] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:19.436959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.499605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d784c-fb8f-42c2-8d5e-5cf3e63c486c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.525570 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:19.543904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a83a52-af88-4df4-9ef7-3c7f22529c78 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.545520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0784f5-b7f3-4d8e-bd26-ef0ad36657a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.546209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0784f5-b7f3-4d8e-bd26-ef0ad36657a3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.546556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0784f5-b7f3-4d8e-bd26-ef0ad36657a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.546909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0784f5-b7f3-4d8e-bd26-ef0ad36657a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.562204 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:19.580949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de147814-6aa6-4ab9-a8df-d36071b4156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.581538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147814-6aa6-4ab9-a8df-d36071b4156a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.581816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147814-6aa6-4ab9-a8df-d36071b4156a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.582086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de147814-6aa6-4ab9-a8df-d36071b4156a None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.583273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147814-6aa6-4ab9-a8df-d36071b4156a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:19.583573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147814-6aa6-4ab9-a8df-d36071b4156a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.585015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de147814-6aa6-4ab9-a8df-d36071b4156a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.597017 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 425/853] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:19.598290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260d83-2f45-4a8e-ac48-90d36c16fa56 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.598627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260d83-2f45-4a8e-ac48-90d36c16fa56 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.598901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260d83-2f45-4a8e-ac48-90d36c16fa56 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.601091 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 426/854] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:19.602957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260d83-2f45-4a8e-ac48-90d36c16fa56 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.628126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0784f5-b7f3-4d8e-bd26-ef0ad36657a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.629751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0784f5-b7f3-4d8e-bd26-ef0ad36657a3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.713779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260d83-2f45-4a8e-ac48-90d36c16fa56 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.741397 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 429/855] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:19.742907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92222f-6a6b-43fb-9eed-8c1981cfc5db None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.743193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92222f-6a6b-43fb-9eed-8c1981cfc5db None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.743466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92222f-6a6b-43fb-9eed-8c1981cfc5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.755882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.756780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.757081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.757364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.758090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=8ed929b0279d4e9f8910576741158c21) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:19.758397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.759817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.762621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6a92222f-6a6b-43fb-9eed-8c1981cfc5db None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:19.763820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a92222f-6a6b-43fb-9eed-8c1981cfc5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:19.765842 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/role_assignments?user.id=8ed929b0279d4e9f8910576741158c21&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:19.766899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.803818 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:19.825286 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:19.870093 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 430/857] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:19.871907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed5562-3024-4a4f-8c3b-f6db30ddc2c9 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.872316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed5562-3024-4a4f-8c3b-f6db30ddc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.872602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed5562-3024-4a4f-8c3b-f6db30ddc2c9 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.873953 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 431/858] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:19.879548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ca16-2aca-41de-9906-d139806817cf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.880353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ca16-2aca-41de-9906-d139806817cf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.880632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ca16-2aca-41de-9906-d139806817cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.901968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bcab6-c4bf-42fa-8f68-5448d94c834b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:19.902292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a815ca16-2aca-41de-9906-d139806817cf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:19.903509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a815ca16-2aca-41de-9906-d139806817cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:19.947248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:19.948045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.948427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.948797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.963016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:19.965114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:19.979996 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:19.981274 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:19.982420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:19.982420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:19.982420 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:19.982420 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 428/859] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:19.989881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:19.994350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 432/860] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:20.088217 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.095857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f435651-2706-4fea-abe4-d1fc9601da8f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.133922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.134531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.134788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.135057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.135687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:20.135985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.137362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.150139 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 429/861] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:20.155538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ca16-2aca-41de-9906-d139806817cf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.164475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.265538 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.275519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ca16-2aca-41de-9906-d139806817cf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.279660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c7c97-31e9-4091-aa76-079a73b58d65 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.312602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.313330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.313611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.313881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.315235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.315863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.316141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.316664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.316985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.318413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.321678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.323316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:20.328008 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:20.328999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:20.334527 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 430/862] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:20.335334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:20.341472 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:20.342349 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:20.343251 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:20.344218 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 433/863] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:20.345335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.354074 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.441388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2dccd-071c-4132-8ea1-ca229491036c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.455527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5d455-779a-4190-a398-c967e21656e5 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.476322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.476945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.477255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.477519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.478090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.479433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:20.488122 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:20.489798 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:20.490676 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 431/864] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:20.491864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.498090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.498718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.499021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.499271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.499909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:20.500212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.502018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.513095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 434/865] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:20.513095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.517646 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.589426 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.610045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852c251-7573-4060-9cbf-73bda0c08424 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.624266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1209dc0-828d-4778-835c-1917b025d47b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.647182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.647790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.648066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.648336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.649048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:20.649378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.650805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.667528 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 432/866] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:20.667528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.667789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.667789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.667789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.667789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.668126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:20.668126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.668126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.677940 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 435/867] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:20.677940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.747484 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.766994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e61f77-5555-4d52-8b0f-badb3a14df64 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.786987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd7ff-b68d-4a15-bb43-703547370eed None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.800949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.802119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.802407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.802675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.803297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:20.803602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.804957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.809308 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 433/868] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:20.810076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.833448 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.836353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b3697-2bf3-4de7-9015-161c9b7b5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.837324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b3697-2bf3-4de7-9015-161c9b7b5af0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.837795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b3697-2bf3-4de7-9015-161c9b7b5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.838263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b3697-2bf3-4de7-9015-161c9b7b5af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.839214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b3697-2bf3-4de7-9015-161c9b7b5af0 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=3ada7c97c73b43e09c30a603e648bcb4) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:20.839518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b3697-2bf3-4de7-9015-161c9b7b5af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.840992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b3697-2bf3-4de7-9015-161c9b7b5af0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.849693 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 436/869] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/role_assignments?user.id=3ada7c97c73b43e09c30a603e648bcb4&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:20.956182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096b78-4d77-4a4b-b8fd-0c3b30ae9d5f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.998297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea2d9-eb26-40c5-899f-00060f89e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.999024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea2d9-eb26-40c5-899f-00060f89e41e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.999372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea2d9-eb26-40c5-899f-00060f89e41e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.999709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea2d9-eb26-40c5-899f-00060f89e41e None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:21.000424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cea2d9-eb26-40c5-899f-00060f89e41e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:21.000855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cea2d9-eb26-40c5-899f-00060f89e41e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:21.002373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cea2d9-eb26-40c5-899f-00060f89e41e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:21.009211 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 434/870] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:22.136561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927bc8-c165-46bc-a12a-9307531e468e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:22.137422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927bc8-c165-46bc-a12a-9307531e468e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:22.137422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927bc8-c165-46bc-a12a-9307531e468e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:22.140175 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 437/871] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:22.146726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880155c1-f15f-491d-a154-7a26fe365b1d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:22.147340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880155c1-f15f-491d-a154-7a26fe365b1d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:22.147340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880155c1-f15f-491d-a154-7a26fe365b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:22.166013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-880155c1-f15f-491d-a154-7a26fe365b1d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:22.167181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-880155c1-f15f-491d-a154-7a26fe365b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:22.235610 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:22.241074 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 435/872] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:22.521295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927bc8-c165-46bc-a12a-9307531e468e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:22.625238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927bc8-c165-46bc-a12a-9307531e468e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:22.655044 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:22.660759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:22.661488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:22.661991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:22.662326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:22.674149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:22.679524 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:22.680519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:22.681464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 438/873] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 00:48:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:22.686680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880155c1-f15f-491d-a154-7a26fe365b1d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:22.789313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880155c1-f15f-491d-a154-7a26fe365b1d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:22.824641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:22.825276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:22.825553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:22.825821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:22.826483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:22.826782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:22.828149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:22.841180 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 436/874] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 00:48:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:22.842979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:22.948357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef6d8b-cbc5-4072-ae12-73ad241c331b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:22.987581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd61a5c-1481-495a-8ac9-1a87d5918ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:22.988235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd61a5c-1481-495a-8ac9-1a87d5918ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:22.988515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd61a5c-1481-495a-8ac9-1a87d5918ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:22.988788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd61a5c-1481-495a-8ac9-1a87d5918ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.001214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd61a5c-1481-495a-8ac9-1a87d5918ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:23.002665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd61a5c-1481-495a-8ac9-1a87d5918ad2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-8dd61a5c-1481-495a-8ac9-1a87d5918ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:23.017924 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:23.019230 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:23.020515 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:23.020515 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:23.020515 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:23.020515 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 439/875] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:23.026915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:23.087330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dae13-3159-45e3-9e3c-4bab29374d9e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.087574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dae13-3159-45e3-9e3c-4bab29374d9e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.087913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dae13-3159-45e3-9e3c-4bab29374d9e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.089806 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 440/876] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:23.095875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fec51-ad27-4b72-acae-09eb419103e3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.096517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fec51-ad27-4b72-acae-09eb419103e3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.097019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fec51-ad27-4b72-acae-09eb419103e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.097621 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.123828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e42fec51-ad27-4b72-acae-09eb419103e3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:23.125692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e42fec51-ad27-4b72-acae-09eb419103e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:23.150061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ab0a-44be-4208-9ebf-f0201c24531b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:23.177353 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.199368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:23.201223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.201540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.201821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.202500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:23.202809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:23.204231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:23.222120 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 441/877] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:23.226146 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 437/878] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:23.233083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7e02-d467-4fed-aff0-64711653faea None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.233083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7e02-d467-4fed-aff0-64711653faea None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.233083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a7e02-d467-4fed-aff0-64711653faea None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.233083 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 442/879] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:23.234493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:23.236112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54d0e-2b83-4e1f-b4a9-9943c61d5828 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.236559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54d0e-2b83-4e1f-b4a9-9943c61d5828 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.236989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54d0e-2b83-4e1f-b4a9-9943c61d5828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.256667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d0e54d0e-2b83-4e1f-b4a9-9943c61d5828 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:23.257891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d0e54d0e-2b83-4e1f-b4a9-9943c61d5828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:23.339460 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 443/880] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:23.340987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91cd1-53de-4f50-9ecb-4a2e0ce8a2dd None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.341303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91cd1-53de-4f50-9ecb-4a2e0ce8a2dd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.342085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a91cd1-53de-4f50-9ecb-4a2e0ce8a2dd None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.343710 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 444/881] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:23.348674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d694b-1dd7-40d8-becc-1caa41399c32 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.348945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d694b-1dd7-40d8-becc-1caa41399c32 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.349258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d694b-1dd7-40d8-becc-1caa41399c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.370312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824240d-472d-48a6-a74c-c7c071a11e9b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:23.374196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-469d694b-1dd7-40d8-becc-1caa41399c32 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:23.375381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-469d694b-1dd7-40d8-becc-1caa41399c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:23.397360 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.410430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:23.411745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.412087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.412357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.421171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:23.422588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:23.435179 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:23.436144 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:23.437147 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 438/882] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:48:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:23.442084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:23.444650 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 445/883] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:23.500157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d694b-1dd7-40d8-becc-1caa41399c32 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:23.537735 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.559824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f945d4-97c8-4379-8aee-0cd51c54b1db None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:23.595705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:23.596232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.596505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.596770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.597520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:23.597821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:23.599929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:23.611847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d694b-1dd7-40d8-becc-1caa41399c32 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:23.618854 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 439/884] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 00:48:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:23.624077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:23.648722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:23.649357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.649642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.649931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.650544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:23.651903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:23.667000 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 446/885] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:23 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:48:23.668071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:23.669052 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.742628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48353038-e9ba-4449-ae0b-de07bc4463ca None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:23.787709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:23.788330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.788594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.788864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.802186 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.810607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d850b-a650-4719-8fc5-7d4ad210ab2a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:23.850649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:23.851209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.851484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.851748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.852327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:23.853714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:23.864379 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:23.865706 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:23.866589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 447/886] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:23.867409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:23.870255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:23.872006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:23.912933 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.979499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430109-cbc5-469a-9560-c503bb055af3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:23.984417 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 440/887] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:23 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:23.985591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.017528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.018134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.018416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.018697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.019602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.021663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.039149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 448/888] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:23 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:24.040025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.068844 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.115029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4806f-392c-46bd-b94d-682c8ce0253b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.158001 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.164519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.165268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.165744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.166022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.167044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:24.167044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.168475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.178433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 441/889] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:24.180393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855906b-32ab-47fa-a9df-cc44c103ad67 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.182095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.224437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.225516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.226018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.226426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.240455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.242308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:24.260235 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:24.261324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:24.262207 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:24.262207 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:24.262207 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:24.262207 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 449/890] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:24.269680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.306642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0dde-8661-48ec-a0a9-9e8017361ba9 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.343187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.343790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.344066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.344335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.345363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:24.345703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.347240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.353298 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 442/891] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:24.355939 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.396020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f5c02-12b3-4128-b0b5-5b2bf9e58627 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.437307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.438187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.438646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.439075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.439898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:24.440349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.441922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.456431 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 450/892] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:24.462501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.544288 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.595113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5e45f-2dfa-4db6-8e9c-96501ff0b3fb None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.632677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.633410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.633689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.633963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.640849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.642325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:24.654823 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:24.655708 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:24.656605 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 443/893] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:24.663660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.767652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59477f84-bbec-4a1c-9fd4-a12d7efc1dd8 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.797720 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.805458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569a0d-2b7b-434a-9b0f-d71e9244ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.806491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569a0d-2b7b-434a-9b0f-d71e9244ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.806984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569a0d-2b7b-434a-9b0f-d71e9244ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.807454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569a0d-2b7b-434a-9b0f-d71e9244ebe1 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.808352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25569a0d-2b7b-434a-9b0f-d71e9244ebe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:24.808846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25569a0d-2b7b-434a-9b0f-d71e9244ebe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.810490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25569a0d-2b7b-434a-9b0f-d71e9244ebe1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.823284 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 451/894] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:24.829394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.938586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1cf08-8a2d-4758-802a-df96e79d9bc7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.959607 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.975069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9828b43-9f16-4885-9707-734696213e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.975671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828b43-9f16-4885-9707-734696213e1d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.975942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828b43-9f16-4885-9707-734696213e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.976206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828b43-9f16-4885-9707-734696213e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.976925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828b43-9f16-4885-9707-734696213e1d None admin] RBAC: Adding query filter params (role.id=51a6797e9ee54318a43790cb076ce834, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=8ed929b0279d4e9f8910576741158c21) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:24.977263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828b43-9f16-4885-9707-734696213e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.978669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828b43-9f16-4885-9707-734696213e1d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.984415 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 444/895] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:24 2022] GET /identity/v3/role_assignments?user.id=8ed929b0279d4e9f8910576741158c21&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=51a6797e9ee54318a43790cb076ce834 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:25.890158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0b6a-f393-47f6-8648-0f12a7e382a8 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:25.890668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0b6a-f393-47f6-8648-0f12a7e382a8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:25.890668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0b6a-f393-47f6-8648-0f12a7e382a8 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:25.892188 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 452/896] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:25.898393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7d49-5154-4924-b45e-7aeb01dd61f2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:25.898812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7d49-5154-4924-b45e-7aeb01dd61f2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:25.898964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7d49-5154-4924-b45e-7aeb01dd61f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:25.917462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7dac7d49-5154-4924-b45e-7aeb01dd61f2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:25.918669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7dac7d49-5154-4924-b45e-7aeb01dd61f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:25.992626 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 445/897] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:26.259792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea0b6a-f393-47f6-8648-0f12a7e382a8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:26.345768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5c0b2-e5be-4e4e-b230-a55c9fe06da4 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.346126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5c0b2-e5be-4e4e-b230-a55c9fe06da4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.346314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5c0b2-e5be-4e4e-b230-a55c9fe06da4 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.349163 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 446/898] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:26.353606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532529f-0e86-4b13-9f12-ce68c57cfc3d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.353828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532529f-0e86-4b13-9f12-ce68c57cfc3d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.354100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532529f-0e86-4b13-9f12-ce68c57cfc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.371617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea0b6a-f393-47f6-8648-0f12a7e382a8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:26.380958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1532529f-0e86-4b13-9f12-ce68c57cfc3d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:26.382231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1532529f-0e86-4b13-9f12-ce68c57cfc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:26.411000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:26.412041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.412512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.412976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.413925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:26.416086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:26.427009 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:26.428039 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:26.428895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:26.432032 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 453/899] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:26.437412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:26.481207 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 447/900] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:26.508822 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.567900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4809018-6251-4235-ab75-1b3e2eb8cc8d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:26.604602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c8111-d185-4620-b49e-9e95b61a78f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:26.605238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c8111-d185-4620-b49e-9e95b61a78f2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.605517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c8111-d185-4620-b49e-9e95b61a78f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.605790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c8111-d185-4620-b49e-9e95b61a78f2 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.606414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c8111-d185-4620-b49e-9e95b61a78f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:26.606715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c8111-d185-4620-b49e-9e95b61a78f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:26.608061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c8111-d185-4620-b49e-9e95b61a78f2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:26.613201 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 454/901] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:26.618519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532529f-0e86-4b13-9f12-ce68c57cfc3d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:26.666626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6499-382c-4c64-8c16-c22258fb36de None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.666942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6499-382c-4c64-8c16-c22258fb36de None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.667175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6499-382c-4c64-8c16-c22258fb36de None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.668512 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 455/902] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:26.668805 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.673935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461677-adee-402d-9e4c-4e54c87cfc7f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.674216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461677-adee-402d-9e4c-4e54c87cfc7f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.674493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461677-adee-402d-9e4c-4e54c87cfc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.696687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3b461677-adee-402d-9e4c-4e54c87cfc7f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:26.697918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3b461677-adee-402d-9e4c-4e54c87cfc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:26.738766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532529f-0e86-4b13-9f12-ce68c57cfc3d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:26.781164 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 456/903] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:26.783644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b461677-adee-402d-9e4c-4e54c87cfc7f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:26.788697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:26.789340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.789616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.789884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.790515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:26.790813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:26.792761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:26.800191 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 448/904] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:26.806020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:26.844300 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.907703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7a22-3acd-4c85-9383-b952a4d130c3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:26.912257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b461677-adee-402d-9e4c-4e54c87cfc7f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:26.929420 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:26.946881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:26.947605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.947989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.948329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.949229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] RBAC: Adding query filter params (interface=public, service_id=d41d98700d854f4195c1632cfff90b8f, region_id=RegionOne) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:26.949612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:26.951016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:26.958968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:26.959810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:26.960225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:26.960622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:26.961448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:26.961575 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 449/905] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:48:26 2022] GET /identity/v3/endpoints?service_id=d41d98700d854f4195c1632cfff90b8f&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:26.963419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:26.964061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:26.975985 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:26.977236 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:26.978141 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:26.981194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 457/906] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 00:48:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:26.984142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.084913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7b9f-7be6-47b7-a5d8-b62b76474cb1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.106496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13411e-cb93-4141-88f8-47decc64e5ea None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.118994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.119612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.119889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.120185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.120772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.122240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.122656 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.133185 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 450/907] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:26 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:48:27.133185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.155043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.155637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.155914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.156445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.156860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:27.157192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.158606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.165178 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 458/908] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:27.171666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.196676 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.291357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503691-5c75-48c7-aa7f-c6a2fd9d74d5 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.310023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3397143-c3e4-43ab-9fbb-5a9d4a874bad None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.328951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475b8d-9880-4f6b-aa1d-f423c407c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.329677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475b8d-9880-4f6b-aa1d-f423c407c1af None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.329958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475b8d-9880-4f6b-aa1d-f423c407c1af None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.330230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475b8d-9880-4f6b-aa1d-f423c407c1af None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.330883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475b8d-9880-4f6b-aa1d-f423c407c1af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.332232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475b8d-9880-4f6b-aa1d-f423c407c1af None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.351797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.352329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.352604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.352869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.353302 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 451/909] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:27 2022] POST /identity/v3/services => generated 241 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:27.353533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:27.353836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.354663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aa0ff-c21b-4117-84c6-da120b660c31 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.354960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aa0ff-c21b-4117-84c6-da120b660c31 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.355252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.355349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aa0ff-c21b-4117-84c6-da120b660c31 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.356839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 452/910] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:27.360633 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 459/911] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:27.363161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdb93-8a5e-4618-ab09-8c035d495cd9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.363449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdb93-8a5e-4618-ab09-8c035d495cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.363720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cdb93-8a5e-4618-ab09-8c035d495cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.367484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.386546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2d0cdb93-8a5e-4618-ab09-8c035d495cd9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:27.388016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2d0cdb93-8a5e-4618-ab09-8c035d495cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.420643 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.485087 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 453/912] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:27.499601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5d57-96ee-4bf6-bf1e-95755635d56c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.556442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.557050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.557383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.557656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.558390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] RBAC: Adding query filter params (interface=public, service_id=4061d724b46b4c848be8518e4c77c9b2, region_id=RegionOne) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:27.558701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.560051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.568577 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 460/913] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:48:27 2022] GET /identity/v3/endpoints?service_id=4061d724b46b4c848be8518e4c77c9b2&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:27.574429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cdb93-8a5e-4618-ab09-8c035d495cd9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.604767 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.693639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cdb93-8a5e-4618-ab09-8c035d495cd9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.727898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.728893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.729389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.729852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.730644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.732216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.738834 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 454/914] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:27 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:48:27.756025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.877447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5fbb-c6c8-4bba-a775-560771ae1572 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.880985 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.925374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.926018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.926276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.926581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.937729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:27.943484 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:27.944431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:27.945476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 461/915] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 00:48:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:27.956243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:28.051556 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:28.066573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807242d-1fd7-4794-8095-0be197e9a862 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:28.102673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:28.103276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:28.103549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:28.103811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:28.104460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:28.104757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:28.106157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:28.115009 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 455/916] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 00:48:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:28.120745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:28.229984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46a90f-a593-468c-9d87-0fcb801fc4c4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:28.267425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:28.268468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:28.269265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:28.269748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:28.281698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:28.283371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:28.298255 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:28.299248 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:28.300177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:28.300177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:28.300177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:28.302567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 462/917] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:28.308017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:28.415762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ff6a-d2ee-4b8b-beab-90553ff731c0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:28.458566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:28.459289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:28.459574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:28.459847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:28.460489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:28.460786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:28.462247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:28.475736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 456/918] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:28.481706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:28.501387 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:28.593186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f3d5-843e-4c4e-a259-cfcf2629330a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:28.628359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:28.629034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:28.629344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:28.629642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:28.637338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:28.638765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:28.650810 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:28.651750 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:28.653293 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 463/919] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:48:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:28.657958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:28.669343 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:28.768575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63387fd1-6a32-49b8-99fe-23b2b22fb3ee None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:28.803328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:28.803931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:28.804204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:28.804469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:28.805222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:28.805522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:28.806933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:28.826056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 457/920] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 00:48:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:28.831462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:28.915416 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:28.938606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d14384-15e8-454a-8837-7cb097e1db8c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:28.973637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:28.974268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:28.974546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:28.974817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:28.985814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:28.987257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:29.001708 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:29.002667 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:29.003570 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:29.003570 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:29.003570 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:29.003570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 464/921] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:29.010753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:29.080129 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:29.119782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c37362-b7c8-463f-beec-40df7869b9ff None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:29.154876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:29.155479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.155752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.156017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.156646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:29.156941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:29.158318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:29.170697 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 458/922] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:29.178436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:29.291138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463acb-3a2f-4db4-8ac6-5b5963b88311 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:29.328321 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:29.337160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37a03a-3e2e-4bbf-88eb-f8ceb89bf758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:29.337745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37a03a-3e2e-4bbf-88eb-f8ceb89bf758 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.338101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37a03a-3e2e-4bbf-88eb-f8ceb89bf758 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.338319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37a03a-3e2e-4bbf-88eb-f8ceb89bf758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.345931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37a03a-3e2e-4bbf-88eb-f8ceb89bf758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:29.347369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37a03a-3e2e-4bbf-88eb-f8ceb89bf758 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-db37a03a-3e2e-4bbf-88eb-f8ceb89bf758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:29.359616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:29.360514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:29.361456 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 465/923] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:29.368738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:29.417707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903f5f6-7d30-41f8-9c03-2d594a50bb61 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.418033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903f5f6-7d30-41f8-9c03-2d594a50bb61 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.418243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903f5f6-7d30-41f8-9c03-2d594a50bb61 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.419815 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 466/924] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:29.424687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e346-060c-47d0-b7ea-6a676490b7e1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.424972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e346-060c-47d0-b7ea-6a676490b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.425275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e346-060c-47d0-b7ea-6a676490b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.445419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7df6e346-060c-47d0-b7ea-6a676490b7e1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:29.446609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7df6e346-060c-47d0-b7ea-6a676490b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:29.483761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0273c-0527-4e33-ba8b-ef13bb0d5f39 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:29.518788 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:29.532138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:29.532850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.533317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.533688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.534473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:29.535016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:29.537136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:29.544564 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 467/925] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:29.552185 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 459/926] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:29.558249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6e346-060c-47d0-b7ea-6a676490b7e1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:29.665460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6e346-060c-47d0-b7ea-6a676490b7e1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:29.684195 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:29.703126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a45fe-1bab-4aaf-a941-9b7e17b029d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:29.704160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a45fe-1bab-4aaf-a941-9b7e17b029d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.704643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a45fe-1bab-4aaf-a941-9b7e17b029d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.705179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a45fe-1bab-4aaf-a941-9b7e17b029d7 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/8ed929b0279d4e9f8910576741158c21/roles/51a6797e9ee54318a43790cb076ce834` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.707596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a45fe-1bab-4aaf-a941-9b7e17b029d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=8ed929b0279d4e9f8910576741158c21, role_id=51a6797e9ee54318a43790cb076ce834)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:29.710076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a45fe-1bab-4aaf-a941-9b7e17b029d7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:29.727162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 468/927] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:48:29 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/8ed929b0279d4e9f8910576741158c21/roles/51a6797e9ee54318a43790cb076ce834 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:48:29.826340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:29.903033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd1cd-4547-441c-ae61-4a59470dacf0 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.903363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd1cd-4547-441c-ae61-4a59470dacf0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.903639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd1cd-4547-441c-ae61-4a59470dacf0 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.905263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 469/928] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:29.910597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80bc00-ec25-4e9d-8038-d53561a66154 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.911470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80bc00-ec25-4e9d-8038-d53561a66154 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.911662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80bc00-ec25-4e9d-8038-d53561a66154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.937030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6f80bc00-ec25-4e9d-8038-d53561a66154 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:29.939009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6f80bc00-ec25-4e9d-8038-d53561a66154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:29.943995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3f220-d771-422d-8189-7bfecf4a4968 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:29.992091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:29.992741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:29.993017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:29.993313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:29.993891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:29.995491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:30.006006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:30.007095 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:30.007964 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 460/929] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:30.014181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.027304 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 470/930] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:30.078141 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.126252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188cdfb-af2a-4bc9-bc62-b18a3fcc0967 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.126937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188cdfb-af2a-4bc9-bc62-b18a3fcc0967 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.127416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188cdfb-af2a-4bc9-bc62-b18a3fcc0967 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.129560 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 471/931] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:30.137190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398cf2-2d8b-46e9-98a5-9dfa39c1f626 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.137756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08085f4-c14f-4124-84af-42a71cc3b4fa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.138271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08085f4-c14f-4124-84af-42a71cc3b4fa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.139003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08085f4-c14f-4124-84af-42a71cc3b4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.161850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d08085f4-c14f-4124-84af-42a71cc3b4fa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:30.163371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d08085f4-c14f-4124-84af-42a71cc3b4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:30.172412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.173026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.173333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.173602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.174286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:30.174587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.176055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.182416 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 461/932] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:30.187547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.259674 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 472/933] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:30.304520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d868e7a-3248-4634-bfe0-c86dafaa23c7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.320191 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.322688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08085f4-c14f-4124-84af-42a71cc3b4fa None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.348641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.349859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.350336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.350812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.351608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:30.352151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.353836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.359708 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 462/934] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:30.365121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.366669 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.443184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08085f4-c14f-4124-84af-42a71cc3b4fa None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.476702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0a27-578b-45ab-9a4b-ae0400965ab7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.489323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.490559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.491021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.491967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.493011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.494843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:30.508352 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:30.509459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:30.510345 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:30.516519 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 473/935] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:30.516869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.531142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.531992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.532464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.532946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.533855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.536203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.565766 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 463/936] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:48:30.566901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.617605 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.644544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f718a-dd9a-4f4c-8abd-df0da0cf4c95 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.647051 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.699619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.700151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.700428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.700694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.701380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:30.701681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.703068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.713591 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 474/937] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:30.715973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.720747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38ab60-cb82-474e-be24-64a02b405c93 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.771928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.772883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.773237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.773496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.774090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.775497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:30.784473 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:30.785465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:48:30.786997 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:30.787730 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 464/938] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:30.793256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.839731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9949-fd09-4c03-906b-15f10f463d22 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.885010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.885997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.886476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.887017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.887936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:30.888428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.889981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.896337 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 475/939] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:30.902728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.902873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7868-c82b-4162-a2aa-19d1a4721e91 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.904405 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.944183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.944795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.945112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.945379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.946006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:30.946306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.948228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.954863 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 465/940] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:30.957450 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.961724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:31.026122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ca41-c268-42ff-8ad3-24f1f0e5be8e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:31.074014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:31.074960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:31.075457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:31.075936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:31.076821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] RBAC: Adding query filter params (interface=public, service_id=a729cfee113d4284912bb24f497c477d, region_id=RegionOne) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:31.077361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:31.078950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:31.089099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3beb-5904-4f1b-8674-5ce07f56abb2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:31.089998 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 476/941] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/endpoints?service_id=a729cfee113d4284912bb24f497c477d&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:31.091940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:31.124910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:31.125956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:31.126513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:31.126977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:31.127787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:31.128278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:31.130777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:31.136227 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 466/942] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:31.142215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:31.209622 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:31.211922 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:31.226364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13f707-e7e3-4640-8328-88f2e1da16ef None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:31.270256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cde2a-0ba9-4d6d-b872-5031b0cb8c87 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:31.272451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ff292-beaa-4ade-8ddb-d7aff3299c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:31.273241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ff292-beaa-4ade-8ddb-d7aff3299c1a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:31.273525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ff292-beaa-4ade-8ddb-d7aff3299c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:31.274602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ff292-beaa-4ade-8ddb-d7aff3299c1a None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:31.275231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ff292-beaa-4ade-8ddb-d7aff3299c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:31.276586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ff292-beaa-4ade-8ddb-d7aff3299c1a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:31.289098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 477/943] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:31 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:48:31.312002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add94c95-6e5d-4d6c-99be-727a5bf15774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:31.312630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94c95-6e5d-4d6c-99be-727a5bf15774 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:31.312911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94c95-6e5d-4d6c-99be-727a5bf15774 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:31.313226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add94c95-6e5d-4d6c-99be-727a5bf15774 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:31.313913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94c95-6e5d-4d6c-99be-727a5bf15774 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:31.315532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add94c95-6e5d-4d6c-99be-727a5bf15774 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:31.342684 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 467/944] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:48:32.117855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50ade-fe0c-499f-a4fb-d10913b78e82 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:32.118375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50ade-fe0c-499f-a4fb-d10913b78e82 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:32.118375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50ade-fe0c-499f-a4fb-d10913b78e82 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:32.120033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 478/945] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:32.125631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76fa58-bec5-42de-808d-d6cf7bfe5757 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:32.126280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76fa58-bec5-42de-808d-d6cf7bfe5757 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:32.126280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76fa58-bec5-42de-808d-d6cf7bfe5757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:32.147617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7f76fa58-bec5-42de-808d-d6cf7bfe5757 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:32.148937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7f76fa58-bec5-42de-808d-d6cf7bfe5757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:32.230624 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 468/946] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:32.518223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50ade-fe0c-499f-a4fb-d10913b78e82 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:32.643632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50ade-fe0c-499f-a4fb-d10913b78e82 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:32.683043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:32.683713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:32.683994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:32.684267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:32.697937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:32.702899 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:32.703878 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:32.704718 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 479/947] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 00:48:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:32.710807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76fa58-bec5-42de-808d-d6cf7bfe5757 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:32.725446 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:32.828131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76fa58-bec5-42de-808d-d6cf7bfe5757 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:32.865701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a5f29-f2fa-40ac-b998-9497261fbd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:32.866319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a5f29-f2fa-40ac-b998-9497261fbd6e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:32.866665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a5f29-f2fa-40ac-b998-9497261fbd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:32.866938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a5f29-f2fa-40ac-b998-9497261fbd6e None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:32.867669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a5f29-f2fa-40ac-b998-9497261fbd6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:32.867974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a5f29-f2fa-40ac-b998-9497261fbd6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:32.870184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a5f29-f2fa-40ac-b998-9497261fbd6e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:32.884663 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 469/948] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 00:48:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:32.891224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:32.912357 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.009701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1dc18-0069-4010-a51b-0a722085a149 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.024104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0673b-17dd-413a-bee2-8fc14f7ef2fb None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.024709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0673b-17dd-413a-bee2-8fc14f7ef2fb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.025261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0673b-17dd-413a-bee2-8fc14f7ef2fb None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.027022 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 470/949] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:33.032419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faece9-0d0e-48e4-b44b-cf426b530f68 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.032934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faece9-0d0e-48e4-b44b-cf426b530f68 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.033465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faece9-0d0e-48e4-b44b-cf426b530f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.047420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.048063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.048339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.048608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.055366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-55faece9-0d0e-48e4-b44b-cf426b530f68 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:33.056827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-55faece9-0d0e-48e4-b44b-cf426b530f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.063061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.064528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:33.081100 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:33.082078 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:33.083512 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:33.083512 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:33.083512 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:33.083512 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 480/950] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:33.089399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.139377 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.149481 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 471/951] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:33.168916 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.206568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9c740-3320-4594-8127-d9be770d11cc None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.242312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.243010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.243292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.243565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.244212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:33.244514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.246006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.259735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 481/952] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:33.265317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faece9-0d0e-48e4-b44b-cf426b530f68 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.373914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faece9-0d0e-48e4-b44b-cf426b530f68 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.409854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.410479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.410759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.411077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.418422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.419851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:33.431637 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:33.432610 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.433627 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 472/953] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:33.439383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.482098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.565481 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.572380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a9c7d-a92a-4f74-a5b9-44b7b070d213 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.608410 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.625744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.626372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.626930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.627212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.627974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:33.628284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.630170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c8472-1f68-4fc6-b02a-39e398e55962 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.630293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.657193 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 482/954] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:33.660770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.677946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.678555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.678837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.679110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.679765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.681234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.683923 n-d-master-1 devstack@keystone.service[81859]: WARNING keystone.server.flask.common [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 00:48:33.702375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.sql.core [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:48:33.702375 n-d-master-1 devstack@keystone.service[81859]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 00:48:33.702375 n-d-master-1 devstack@keystone.service[81859]: [parameters: {'id': '10a8710f0e09487a8e32d2b6d075b3e7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 00:48:33.702375 n-d-master-1 devstack@keystone.service[81859]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81859) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-c731b50d-8023-47c6-a9b6-1a0ef5db8452 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10a8710f0e09487a8e32d2b6d075b3e7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10a8710f0e09487a8e32d2b6d075b3e7. Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:48:33.720041 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 00:48:33.720902 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application yield resource Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise self.value Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application session.commit() Sep 11 00:48:33.722138 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:48:33.723268 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:48:33.724588 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:48:33.726123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [parameters: {'id': '10a8710f0e09487a8e32d2b6d075b3e7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:33.727704 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:33.728802 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10a8710f0e09487a8e32d2b6d075b3e7. Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 473/955] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 11 00:48:33 2022] POST /identity/v3/projects => generated 262 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ce28-3fe7-43f6-9bc9-29dfb72ae02f None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.730031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ce28-3fe7-43f6-9bc9-29dfb72ae02f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.730921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ce28-3fe7-43f6-9bc9-29dfb72ae02f None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.733228 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 474/956] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:33.734166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fa862-e951-4c3c-ad2a-7ddff47fbbdf None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.734540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fa862-e951-4c3c-ad2a-7ddff47fbbdf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.734844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fa862-e951-4c3c-ad2a-7ddff47fbbdf None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.736082 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 475/957] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:33.736767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fa862-e951-4c3c-ad2a-7ddff47fbbdf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.777926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73533c92-adc4-48de-beda-32d73fd11419 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.811665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.812264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.812542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.812813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.839830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fa862-e951-4c3c-ad2a-7ddff47fbbdf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.855517 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.863609 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.874825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470fa65-916d-4e8a-b503-baa724e59578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.875438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fa65-916d-4e8a-b503-baa724e59578 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.875713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fa65-916d-4e8a-b503-baa724e59578 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.876026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fa65-916d-4e8a-b503-baa724e59578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.880327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.881802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.883395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470fa65-916d-4e8a-b503-baa724e59578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.884922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470fa65-916d-4e8a-b503-baa724e59578 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-6470fa65-916d-4e8a-b503-baa724e59578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:33.896242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:33.897278 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:33.898244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 476/958] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:33.898736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56f81-b6e9-4e14-84fe-19eeac34bbec None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.898804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56f81-b6e9-4e14-84fe-19eeac34bbec None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.899035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56f81-b6e9-4e14-84fe-19eeac34bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.916628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-98d56f81-b6e9-4e14-84fe-19eeac34bbec None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:33.918147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98d56f81-b6e9-4e14-84fe-19eeac34bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.982558 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 477/959] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:33.983777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac1f8-826e-4f8f-b062-a2ed77e83307 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.984059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac1f8-826e-4f8f-b062-a2ed77e83307 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.984329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac1f8-826e-4f8f-b062-a2ed77e83307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.989930 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 483/960] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:33.989930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.013945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4a9ac1f8-826e-4f8f-b062-a2ed77e83307 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:34.015415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4a9ac1f8-826e-4f8f-b062-a2ed77e83307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:34.079588 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.084126 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 478/961] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:34.084781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac1f8-826e-4f8f-b062-a2ed77e83307 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.107320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebffe7-60e3-4038-87f0-cdfbfe05a0da None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.133678 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.145260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.146056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.146443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.146806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.147844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:34.148047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.149769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.169122 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 484/962] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:34.221524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac1f8-826e-4f8f-b062-a2ed77e83307 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.258177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.266796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.267461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.267734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.268005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.280580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.282524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:34.304589 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:34.305666 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:34.306594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:34.306594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:34.306594 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:34.313649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 479/963] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:34.315943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.383019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932f551-b8d8-42c2-9faf-477ba387702f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.425081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.425793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.426078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.426347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.427463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.428813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.429273 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:34.438958 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:34.440062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:34.440955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:34.441791 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 485/964] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:34.441935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.443813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b09d5-8c6d-4db2-a698-3edae41279a0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.459137 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.480581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.481301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.481493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.481763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.482571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:34.482700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.484025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.497711 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 480/965] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:34.498851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.562989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9183dee-b34d-477a-9047-17b9c13cdd64 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.598571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.599246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.599524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.599793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.600377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.601885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.610325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406860be-93ed-4722-aa90-764b9fbe9e70 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:34.611226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:34.612205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:34.613102 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:34.613861 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 486/966] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:34.614997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.651623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.652623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.653200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.653474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.654101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:34.654404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.656865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.662928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 481/967] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:34.663762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.681203 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.698589 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.729031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de187-db8a-4cb2-ab85-259b9b27d1a7 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.766344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.766972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.767247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.767515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.775049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7abde-5484-4e1e-a71d-445923bd3765 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.775322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.776742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:34.788126 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:34.789043 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 487/968] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:34.789991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.815007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.815612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.815886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.816359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.816765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:34.817591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.819359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.828793 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 482/969] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:34.828793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.900520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a17e00-4013-427e-a4b8-6b841d9dd09a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.918813 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.932515 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:34.938513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.939117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.939391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.939663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.940284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:34.940591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.941958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.945430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e6138-e19c-4018-b178-cba0fc60d12b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:34.947749 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 488/970] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:34.949953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:34.981632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:34.982232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:34.982505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:34.982773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:34.983449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:34.983747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:34.985182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:34.997353 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 483/971] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:34.998059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:35.077189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a97c2-9597-42c9-9bfc-c8510d76bdde None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:35.112963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23918d5-d0a4-44c7-9907-ca0c5fc6004f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:35.121121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:35.121727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:35.122118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:35.122391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:35.123013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:35.123310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:35.124647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:35.129427 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 489/972] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:35.130227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:35.157757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbab50-6f07-485c-ac6a-d23c884f9c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:35.158293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbab50-6f07-485c-ac6a-d23c884f9c46 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:35.158571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbab50-6f07-485c-ac6a-d23c884f9c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:35.158841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbab50-6f07-485c-ac6a-d23c884f9c46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:35.159547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbab50-6f07-485c-ac6a-d23c884f9c46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:35.161552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbab50-6f07-485c-ac6a-d23c884f9c46 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:35.168171 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:35.197235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 484/973] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:35.225460 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:35.272495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7a8c5-7dee-4c4c-b8d2-98f5d852cc87 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:35.320075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a81884-c0bf-4e36-9c97-1e4468ff03aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:35.320699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81884-c0bf-4e36-9c97-1e4468ff03aa None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:35.320956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81884-c0bf-4e36-9c97-1e4468ff03aa None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:35.321256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81884-c0bf-4e36-9c97-1e4468ff03aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:35.321982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a81884-c0bf-4e36-9c97-1e4468ff03aa None admin] RBAC: Adding query filter params (role.id=51a6797e9ee54318a43790cb076ce834, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=8ed929b0279d4e9f8910576741158c21) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:35.322283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a81884-c0bf-4e36-9c97-1e4468ff03aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:35.323701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a81884-c0bf-4e36-9c97-1e4468ff03aa None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:35.330239 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 490/974] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:35 2022] GET /identity/v3/role_assignments?user.id=8ed929b0279d4e9f8910576741158c21&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=51a6797e9ee54318a43790cb076ce834 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:36.480959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2b70-a6a3-484b-93b2-86889cee6afa None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.481529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2b70-a6a3-484b-93b2-86889cee6afa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.481529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2b70-a6a3-484b-93b2-86889cee6afa None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.483113 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 485/975] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:36.488297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b799e4-77ec-47bc-adc9-1fd295d0eaad None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.488692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b799e4-77ec-47bc-adc9-1fd295d0eaad None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.488872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b799e4-77ec-47bc-adc9-1fd295d0eaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.508177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a8b799e4-77ec-47bc-adc9-1fd295d0eaad None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:36.509770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a8b799e4-77ec-47bc-adc9-1fd295d0eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:36.594683 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 491/976] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:36.870108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2b70-a6a3-484b-93b2-86889cee6afa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:36.978978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2b70-a6a3-484b-93b2-86889cee6afa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:37.014964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:37.015569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.015848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.016116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.016763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:37.018325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:37.035075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.sql.core [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:48:37.035075 n-d-master-1 devstack@keystone.service[81859]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 00:48:37.035075 n-d-master-1 devstack@keystone.service[81859]: [parameters: {'user_id': '35e27b77b7e5470d8705a547fd332fb0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 00:48:37.035075 n-d-master-1 devstack@keystone.service[81859]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81859) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 00:48:37.043088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:48:37.043995 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application yield resource Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise self.value Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application session.commit() Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:48:37.044959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:48:37.045928 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:48:37.046848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:48:37.047803 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [parameters: {'user_id': '35e27b77b7e5470d8705a547fd332fb0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:37.048688 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 11 00:48:37.051660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 11 00:48:37.053941 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 11 00:48:37.053941 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 11 00:48:37.053941 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:48:37.053941 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:48:37.053941 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 00:48:37.053941 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:37.053941 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 486/977] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 11 00:48:36 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:37.058401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b799e4-77ec-47bc-adc9-1fd295d0eaad None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:37.111143 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:37.174144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b799e4-77ec-47bc-adc9-1fd295d0eaad None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:37.210902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f32def-2bcf-4dfe-b3f9-79b8a24ce5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:37.211776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f32def-2bcf-4dfe-b3f9-79b8a24ce5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.212221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f32def-2bcf-4dfe-b3f9-79b8a24ce5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.212631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f32def-2bcf-4dfe-b3f9-79b8a24ce5b1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.220655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f32def-2bcf-4dfe-b3f9-79b8a24ce5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:37.222281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f32def-2bcf-4dfe-b3f9-79b8a24ce5b1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-a2f32def-2bcf-4dfe-b3f9-79b8a24ce5b1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:37.236390 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:37.237662 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:48:37.239069 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:37.242079 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 492/978] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:37.248564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:37.312014 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:37.366964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402b56-7545-448c-b37b-dc10ed8025ca None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:37.372810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae926-e3c7-4321-83e2-461a33f7203e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.374853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae926-e3c7-4321-83e2-461a33f7203e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.374853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae926-e3c7-4321-83e2-461a33f7203e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.374853 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 493/979] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:37.382264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a675a3f-222e-496a-962e-ba66332aec53 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.382539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a675a3f-222e-496a-962e-ba66332aec53 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.382810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a675a3f-222e-496a-962e-ba66332aec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.404996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3a675a3f-222e-496a-962e-ba66332aec53 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:37.406419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3a675a3f-222e-496a-962e-ba66332aec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:37.408213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e847a-26cd-4384-8cee-40f7ab5640b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:37.409110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e847a-26cd-4384-8cee-40f7ab5640b5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.409595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e847a-26cd-4384-8cee-40f7ab5640b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.410071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e847a-26cd-4384-8cee-40f7ab5640b5 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.411561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e847a-26cd-4384-8cee-40f7ab5640b5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:37.412079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e847a-26cd-4384-8cee-40f7ab5640b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:37.413972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e847a-26cd-4384-8cee-40f7ab5640b5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:37.455389 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 487/980] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 11 00:48:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:37.456627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b734-25d6-4faf-b1ac-2fa94ac5bbc3 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.456920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b734-25d6-4faf-b1ac-2fa94ac5bbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.457249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b734-25d6-4faf-b1ac-2fa94ac5bbc3 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.459341 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 488/981] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:37.464974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f5afc-2f10-4795-b9b8-9e1f548b1799 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.465290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f5afc-2f10-4795-b9b8-9e1f548b1799 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.465559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f5afc-2f10-4795-b9b8-9e1f548b1799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.486116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-377f5afc-2f10-4795-b9b8-9e1f548b1799 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:37.487817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-377f5afc-2f10-4795-b9b8-9e1f548b1799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:37.499195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 494/982] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:37.574787 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 489/983] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:37.609232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f782bb-2005-48ad-84c0-0b49a4e899ab None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.609546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f782bb-2005-48ad-84c0-0b49a4e899ab None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.609808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f782bb-2005-48ad-84c0-0b49a4e899ab None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.611450 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 495/984] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:37.618101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c701f0-5f0e-4e4a-939a-368d41ec047b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.618390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c701f0-5f0e-4e4a-939a-368d41ec047b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.618652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c701f0-5f0e-4e4a-939a-368d41ec047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.638452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-55c701f0-5f0e-4e4a-939a-368d41ec047b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:37.639651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-55c701f0-5f0e-4e4a-939a-368d41ec047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:37.679962 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:37.716306 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 490/985] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:37.791197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f782bb-2005-48ad-84c0-0b49a4e899ab None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:37.834730 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:37.858475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c701f0-5f0e-4e4a-939a-368d41ec047b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:37.897990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f782bb-2005-48ad-84c0-0b49a4e899ab None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:37.934412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:37.935009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:37.935281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:37.935543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:37.936224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:37.937594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:37.952879 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 496/986] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:37 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:37.959512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c701f0-5f0e-4e4a-939a-368d41ec047b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.005646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.005873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.006121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.006405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.007007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.008421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.016265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:38.018223 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:38.019499 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:38.020630 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 491/987] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:38.026027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:38.060345 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:38.139113 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:38.143242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1305b3-5012-4b4d-8f7c-bdc1f78f7604 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.144696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fe0cc-45e3-45ee-98ce-8810082be074 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.186229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.186802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.186957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.187148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.187379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] PATH_INFO: `/v3/services/image` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.187493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.187669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.187938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.188034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.188561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:38.188860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.189320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.190243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.196413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 492/988] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:38.199232 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:38.200252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:38.201163 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:38.202892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:38.205145 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 497/989] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 00:48:38 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:38.206383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:38.311147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6cd6-91b9-43fb-93bc-b61d3b739b6c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.313107 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:38.323551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc91305-016d-4421-84be-af04e57fe72c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.348555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.349287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.349615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.349865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.350457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] RBAC: Adding query filter params (name=image) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:38.350755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.352114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.362342 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 498/990] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:38.362508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.362508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.362508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.362508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.362809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:38.362809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.363267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.363367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:38.370314 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 493/991] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:38.376503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:38.395212 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:38.479006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bcb42-30dd-4263-8328-3b76759485da None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.483126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067632ff-d6cf-45f3-8f71-85daaa133eff None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.515078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.515689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.515971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.516244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.516879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] RBAC: Adding query filter params (type=image) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:38.517216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.518573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.530466 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 499/992] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:38.530666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f97b-8d23-40fa-b9e6-c08cc534f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.530666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f97b-8d23-40fa-b9e6-c08cc534f396 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.530666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f97b-8d23-40fa-b9e6-c08cc534f396 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.530666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f97b-8d23-40fa-b9e6-c08cc534f396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.531306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926f97b-8d23-40fa-b9e6-c08cc534f396 None admin] RBAC: Adding query filter params (interface=admin, service_id=a729cfee113d4284912bb24f497c477d, region_id=RegionOne) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:38.531306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926f97b-8d23-40fa-b9e6-c08cc534f396 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.531306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926f97b-8d23-40fa-b9e6-c08cc534f396 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.545776 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 494/993] 10.222.0.16 () {56 vars in 1249 bytes} [Sun Sep 11 00:48:38 2022] GET /identity/v3/endpoints?service_id=a729cfee113d4284912bb24f497c477d&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:38.552285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:38.653859 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:38.665154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129086a-39f5-4319-8ef8-5fbabe72f90a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:38.702047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fbc7c-08c4-47ce-8233-3839f728db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:38.702683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbc7c-08c4-47ce-8233-3839f728db37 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:38.702964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbc7c-08c4-47ce-8233-3839f728db37 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:38.703233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fbc7c-08c4-47ce-8233-3839f728db37 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:38.703841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fbc7c-08c4-47ce-8233-3839f728db37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:38.705250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fbc7c-08c4-47ce-8233-3839f728db37 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:38.711835 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 500/994] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:38 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:48:40.256977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60228f2-63e4-4d77-8d3f-7419b99c02e7 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.257562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60228f2-63e4-4d77-8d3f-7419b99c02e7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.257562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60228f2-63e4-4d77-8d3f-7419b99c02e7 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.259040 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 495/995] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:40.264080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a50618-d3fd-4955-97ea-64c69055b01f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.264460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a50618-d3fd-4955-97ea-64c69055b01f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.264620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a50618-d3fd-4955-97ea-64c69055b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.283890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-49a50618-d3fd-4955-97ea-64c69055b01f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:40.285097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-49a50618-d3fd-4955-97ea-64c69055b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:40.355754 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 501/996] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:40.623849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60228f2-63e4-4d77-8d3f-7419b99c02e7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:40.651476 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:40.725791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dae94-87ac-43b4-8379-3a8c214ea358 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.726140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dae94-87ac-43b4-8379-3a8c214ea358 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.726341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dae94-87ac-43b4-8379-3a8c214ea358 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.727787 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 502/997] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:40.733102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677ce3-202c-4d8e-9db4-033ee5d25103 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.733102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677ce3-202c-4d8e-9db4-033ee5d25103 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.733301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60228f2-63e4-4d77-8d3f-7419b99c02e7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:40.733403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677ce3-202c-4d8e-9db4-033ee5d25103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.753344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a7677ce3-202c-4d8e-9db4-033ee5d25103 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:40.754664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7677ce3-202c-4d8e-9db4-033ee5d25103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:40.772480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:40.773160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.773435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.773702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.774309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:40.775679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:40.784959 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:40.786793 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:40.787851 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:40.792100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 496/998] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:40.792803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:40.845251 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 503/999] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:40.876871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97180cc4-e349-4a3b-b167-0e135e719d23 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.877144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97180cc4-e349-4a3b-b167-0e135e719d23 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.877391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97180cc4-e349-4a3b-b167-0e135e719d23 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.878737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 504/1000] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:40.883994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f978b-a345-4860-bfdb-da6c3540b86d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.884275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f978b-a345-4860-bfdb-da6c3540b86d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.884548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f978b-a345-4860-bfdb-da6c3540b86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.886862 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:40.901950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d867f-362a-4430-b3fd-fad9c965493b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:40.903961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cb4f978b-a345-4860-bfdb-da6c3540b86d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:40.906230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb4f978b-a345-4860-bfdb-da6c3540b86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:40.920969 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:40.938131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:40.938733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.939012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.939283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.939893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:40.940199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:40.941591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:40.946641 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 497/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:40.951999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.000662 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 505/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:41.059785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1667c4e-d54b-44b6-9159-348d157c6fe9 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.093870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.094554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.094807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.095156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.095993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:41.096349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.098158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.108363 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 498/1003] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:41.109626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f978b-a345-4860-bfdb-da6c3540b86d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.116290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.134464 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:41.224673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f978b-a345-4860-bfdb-da6c3540b86d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.225411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174442e-d89d-4946-8826-d9c7ed3f350b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.261248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.261856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.262127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.262392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.263343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] RBAC: Adding query filter params (interface=public, service_id=e928d8af79874623b8519c247c401747, region_id=RegionOne) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:41.263478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.264708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.275851 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 506/1004] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:48:41 2022] GET /identity/v3/endpoints?service_id=e928d8af79874623b8519c247c401747&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:41.275851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.280950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.281596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.282290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.282569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.283219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.284585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.285276 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:41.300552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 499/1005] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:41 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:48:41.301393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.386813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b996054-2628-472c-9761-d826d1c13ea4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.404591 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:41.432599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.433274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.433558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.433830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.434419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.434631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829410-ee0c-4e60-ab5b-09dddf2992dd None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.435821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:41.447991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:41.449208 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:41.450062 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 507/1006] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 11 00:48:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:41.455922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.476590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.477474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.477600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.477764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.478379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.479740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.486576 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 500/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:41 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:48:41.550081 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:41.588212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3fb60-1a8f-4f8c-a75a-23a6bfcff9cb None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.626397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.627021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.627298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.627570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.628210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:41.628514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.630013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.640354 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 508/1008] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:41.642083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.747741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203b618-dc60-40b2-b6fc-674ea19d1435 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.783082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa6c1-64fc-4f9f-87f7-7e74f0b75af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.783750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa6c1-64fc-4f9f-87f7-7e74f0b75af3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.784035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa6c1-64fc-4f9f-87f7-7e74f0b75af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.784308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa6c1-64fc-4f9f-87f7-7e74f0b75af3 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.784993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa6c1-64fc-4f9f-87f7-7e74f0b75af3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:41.785341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa6c1-64fc-4f9f-87f7-7e74f0b75af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.786886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa6c1-64fc-4f9f-87f7-7e74f0b75af3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.796220 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 501/1009] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 11 00:48:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:41.797820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:41.902003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fce327-dcdd-420b-9918-68c2b8ebda29 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:41.935730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f1e9-bc68-4d30-9fdd-3f178c6e4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:41.936338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f1e9-bc68-4d30-9fdd-3f178c6e4753 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:41.936618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f1e9-bc68-4d30-9fdd-3f178c6e4753 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:41.936882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f1e9-bc68-4d30-9fdd-3f178c6e4753 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:41.937588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f1e9-bc68-4d30-9fdd-3f178c6e4753 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:41.938943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f1e9-bc68-4d30-9fdd-3f178c6e4753 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:41.943787 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:41.956167 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 509/1010] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:43.537021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e268a-7274-4c37-92bc-4a4ca9c3b31b None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:43.537495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e268a-7274-4c37-92bc-4a4ca9c3b31b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:43.537781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e268a-7274-4c37-92bc-4a4ca9c3b31b None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:43.539914 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 502/1011] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:43.547230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648abaf-5e2d-4ae5-a77d-a5b4f8c9244b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:43.547674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648abaf-5e2d-4ae5-a77d-a5b4f8c9244b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:43.547753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648abaf-5e2d-4ae5-a77d-a5b4f8c9244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:43.570414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3648abaf-5e2d-4ae5-a77d-a5b4f8c9244b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:43.571663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3648abaf-5e2d-4ae5-a77d-a5b4f8c9244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:43.652720 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 510/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:43.692128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde02c1-d796-4481-9fa5-b9b565956d4e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:43.692436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde02c1-d796-4481-9fa5-b9b565956d4e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:43.692750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde02c1-d796-4481-9fa5-b9b565956d4e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:43.694156 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 503/1013] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:43.699318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0730-e040-45b2-857e-f036072f2bbb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:43.699609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0730-e040-45b2-857e-f036072f2bbb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:43.699885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0730-e040-45b2-857e-f036072f2bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:43.718597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fb9a0730-e040-45b2-857e-f036072f2bbb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:43.719771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fb9a0730-e040-45b2-857e-f036072f2bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:43.789201 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 511/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:43 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:43.933169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde02c1-d796-4481-9fa5-b9b565956d4e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:43.937089 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.046940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde02c1-d796-4481-9fa5-b9b565956d4e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.063611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0730-e040-45b2-857e-f036072f2bbb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.086479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.087114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.087394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.087665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.088246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.089644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:44.100133 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:44.101188 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:44.102057 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 504/1015] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 00:48:43 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:44.107088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.125862 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.175242 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.178656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0730-e040-45b2-857e-f036072f2bbb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.209487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8ccd1-b8a7-4485-b994-7833fd350ea1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.212162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb5726-d3a0-4805-888f-f2e23d034caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.212781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5726-d3a0-4805-888f-f2e23d034caf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.213053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5726-d3a0-4805-888f-f2e23d034caf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.213348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5726-d3a0-4805-888f-f2e23d034caf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.213919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb5726-d3a0-4805-888f-f2e23d034caf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.215254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb5726-d3a0-4805-888f-f2e23d034caf None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-12fb5726-d3a0-4805-888f-f2e23d034caf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:44.223900 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:44.224905 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:44.231053 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 512/1016] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:44.232498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76d3c2-e8bf-4ed6-9641-040126c3ccf7 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.232498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76d3c2-e8bf-4ed6-9641-040126c3ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.232498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76d3c2-e8bf-4ed6-9641-040126c3ccf7 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.232498 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 513/1017] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:44.232498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76d3c2-e8bf-4ed6-9641-040126c3ccf7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.244661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf8498-b08f-4791-8851-a0624e9567fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.245296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8498-b08f-4791-8851-a0624e9567fd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.245569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8498-b08f-4791-8851-a0624e9567fd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.245836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8498-b08f-4791-8851-a0624e9567fd None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.246455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf8498-b08f-4791-8851-a0624e9567fd None admin] RBAC: Adding query filter params (name=image) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:44.246752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf8498-b08f-4791-8851-a0624e9567fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.248100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf8498-b08f-4791-8851-a0624e9567fd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.252764 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 505/1018] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:44.252764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630676e-1838-420c-82e1-1fef5957b7b6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.252764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630676e-1838-420c-82e1-1fef5957b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.252764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630676e-1838-420c-82e1-1fef5957b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.274109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8630676e-1838-420c-82e1-1fef5957b7b6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:44.275276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8630676e-1838-420c-82e1-1fef5957b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:44.336909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76d3c2-e8bf-4ed6-9641-040126c3ccf7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.340628 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 506/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:44 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:44.341480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630676e-1838-420c-82e1-1fef5957b7b6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.350961 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.373252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.373877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.374307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.374582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.375206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:44.375507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.376845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.382696 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 514/1020] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:44.388103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.424453 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.466244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630676e-1838-420c-82e1-1fef5957b7b6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.501311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.501732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64748a8d-a36c-49a8-8873-23e2dbd4e6b9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.501926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.502191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.502465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.503091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] RBAC: Adding query filter params (type=image) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:44.503394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.505362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.510076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 507/1021] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:44.515860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.550154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.550764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.551045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.551324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.552169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:44.552478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.554014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.558929 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 515/1022] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:44.564576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.613260 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.637267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb2d6-d107-487d-a2b6-79c53d453b0c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.664148 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.672317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a4948-ee8f-406e-8c98-1b35cac9c93c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.673129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.673726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.673998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.674262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.674953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] RBAC: Adding query filter params (interface=public, service_id=a93eea0792a9451280d583f7496281f1, region_id=RegionOne) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:44.675254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.676630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.681655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 508/1023] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/endpoints?service_id=a93eea0792a9451280d583f7496281f1&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:44.682431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.710958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.711560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.711828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.712101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.712754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.714146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.734179 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 516/1024] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:48:44.735443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.789685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb715ec-e87f-478c-8aad-a0056bc55afd None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.835800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.836441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.836713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.836981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.838149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.839651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.846335 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 509/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:44.847072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:44.857664 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.862970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840275f-b775-4294-bcf3-d8fa0106ed32 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:44.903330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109da491-f35c-42e6-ba48-340c82c128c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:44.904228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109da491-f35c-42e6-ba48-340c82c128c1 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.904505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109da491-f35c-42e6-ba48-340c82c128c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.904776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109da491-f35c-42e6-ba48-340c82c128c1 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.906067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109da491-f35c-42e6-ba48-340c82c128c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:44.907438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109da491-f35c-42e6-ba48-340c82c128c1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:44.916154 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 517/1026] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:48:44 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:48:44.917710 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.985097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31a5ea-cf4f-430d-9802-3bf0f5e6fddc None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:45.030345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bf989-5e41-48bf-9e3a-55850f2a6809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:45.030962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf989-5e41-48bf-9e3a-55850f2a6809 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:45.031235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf989-5e41-48bf-9e3a-55850f2a6809 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:45.031500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf989-5e41-48bf-9e3a-55850f2a6809 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:45.032152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bf989-5e41-48bf-9e3a-55850f2a6809 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:45.033636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bf989-5e41-48bf-9e3a-55850f2a6809 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:45.066155 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 510/1027] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:48:44 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:47.080873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b208e5-1240-43fe-abaf-d001df4c70df None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.081449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b208e5-1240-43fe-abaf-d001df4c70df None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.081449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b208e5-1240-43fe-abaf-d001df4c70df None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.082921 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 518/1028] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:47.088075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2493-8c17-46ee-b1e8-69ceadcef1e4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.088486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2493-8c17-46ee-b1e8-69ceadcef1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.088672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2493-8c17-46ee-b1e8-69ceadcef1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.099289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c32f-803c-467c-8481-9736053f7422 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.099639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c32f-803c-467c-8481-9736053f7422 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.099854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c32f-803c-467c-8481-9736053f7422 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.101271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 519/1029] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:47.107050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd060-b2a6-4b20-ac01-fd38ae910c71 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.107344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd060-b2a6-4b20-ac01-fd38ae910c71 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.107613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd060-b2a6-4b20-ac01-fd38ae910c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.108997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8aaa2493-8c17-46ee-b1e8-69ceadcef1e4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:47.110203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8aaa2493-8c17-46ee-b1e8-69ceadcef1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:47.126318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-769fd060-b2a6-4b20-ac01-fd38ae910c71 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:47.127495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-769fd060-b2a6-4b20-ac01-fd38ae910c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:47.194090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 511/1030] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:47.205993 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 520/1031] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:47.284689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dba55-5fec-4387-9d8b-0adbddb92cc5 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.284967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dba55-5fec-4387-9d8b-0adbddb92cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.285293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dba55-5fec-4387-9d8b-0adbddb92cc5 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.286753 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 512/1032] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:47.292659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f374c-7268-4671-a632-51f0983a434b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.293048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f374c-7268-4671-a632-51f0983a434b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.293418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f374c-7268-4671-a632-51f0983a434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.311597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-381f374c-7268-4671-a632-51f0983a434b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:47.312776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-381f374c-7268-4671-a632-51f0983a434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:47.381163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 521/1033] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:47.466160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dba55-5fec-4387-9d8b-0adbddb92cc5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.483753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f374c-7268-4671-a632-51f0983a434b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.503429 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:47.519749 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:47.577501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dba55-5fec-4387-9d8b-0adbddb92cc5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:47.603695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f374c-7268-4671-a632-51f0983a434b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:47.612885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:47.613527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.613798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.614750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.625437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:47.630789 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:47.631991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:47.632873 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 513/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 00:48:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:47.637950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.640682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:47.641412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.641687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.641956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.642532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:47.643867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:47.653289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:47.654344 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:47.655205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 522/1035] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 11 00:48:47 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:47.656024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.736463 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:47.738791 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:47.743343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccb5c8-26f3-46e1-9cdc-c5f027dc1214 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:47.755254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0772989-fa94-4881-b009-204419c42be2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:47.777926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:47.778525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.778803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.779071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.779722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:47.780022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:47.781406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:47.789752 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 514/1036] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 00:48:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:47.790233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:47.790526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.790850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.791123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.791386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.795331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:47.796754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:47.799409 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 523/1037] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:47.799409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.891451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709edfe-038a-4ef0-891d-1e2f6091afcf None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:47.898885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf73af-3b94-41a8-8871-473d4353f605 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:47.924911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:47.925529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.925802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.926069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.927199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] RBAC: Adding query filter params (name=image) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:47.927513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:47.928928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:47.932161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:47.932784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:47.933079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:47.933360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:47.933573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 515/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:47.934317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.945358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:47.946818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:47.959192 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:47.960751 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:47.961946 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:47.962865 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:47.962865 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:47.962865 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:47.962865 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 524/1039] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:47.963103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:47.971579 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:48.037684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6885e-f9d7-4f6d-9b1e-a8217b080965 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.062362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baf451-2e10-4507-9ef5-1d126b2b6f49 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.070925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.071527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.071830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.072103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.072746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:48.074201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:48.096010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.096610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.096755 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 516/1040] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:48:47 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:48:48.097133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.097247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.097578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:48.097862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] RBAC: Adding query filter params (type=image) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:48.098169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:48.099568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:48.105342 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 525/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:48.111274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:48.189443 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:48.208742 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:48.229168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86d9f1-d804-4ec9-be90-6abbc56fc80e None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.234476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3216b-76ff-423f-82a5-08e29954c0a0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.270977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.272062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.272431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.272790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.273484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:48.274701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.274828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:48.275314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.275593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.275865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.276514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:48.276821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:48.278203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:48.291648 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 517/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:48.297860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:48.298259 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 526/1043] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:48:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:48:48.415262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de24e8-baa8-42d1-b091-bb5dce358dcf None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.461308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.461954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.462230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.462498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.464629 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:48.472073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:48.473593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:48.486382 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:48.487364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:48.488319 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:48.490811 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 518/1044] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:48:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:48.496509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:48.610743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e60f5-e7a1-4b50-b449-a7b57d0e2db6 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.637933 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:48.650345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.650960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.651241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.651515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.652243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:48.652550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:48.653995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:48.672483 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 527/1045] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:48:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:48.678580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:48.779571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77081eae-1d38-44c6-8539-1af098bff3fd None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.813473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.814075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.814353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.814625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.876268 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:48.884947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:48.886417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:48.985976 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 519/1046] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:48:48.992097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:49.098182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06b381-e666-4d78-9563-342f67f047a5 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:49.132245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:49.132876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:49.133184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:49.133459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:49.143522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:49.145863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:49.160252 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:49.161483 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:49.162432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:49.162432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:49.162432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:49.165373 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 528/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:49.167111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:49.260805 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:49.268535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e066c-2aa0-4f02-a781-73da7e7632ba None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:49.302826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:49.303428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:49.303706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:49.303975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:49.304606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:49.304907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:49.306289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:49.317675 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 520/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:49.323139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:49.358281 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:49.425508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07999-7e66-4da3-b143-a84fd4727d8b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:49.459537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:49.460168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:49.460447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:49.460715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:49.467425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:49.468841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:49.480482 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:49.481431 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:49.482332 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:49.483306 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 529/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:49.487440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:49.601175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f02f2-21d1-4250-b784-00ec273fd2e3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:49.634311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092abe7-db73-46b9-94f6-6c20705ca55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:49.634831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092abe7-db73-46b9-94f6-6c20705ca55e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:49.635104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092abe7-db73-46b9-94f6-6c20705ca55e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:49.635368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092abe7-db73-46b9-94f6-6c20705ca55e None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:49.636038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092abe7-db73-46b9-94f6-6c20705ca55e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:49.636335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092abe7-db73-46b9-94f6-6c20705ca55e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:49.637777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092abe7-db73-46b9-94f6-6c20705ca55e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:49.650575 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 521/1050] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:49.660667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:49.755938 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:49.762624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4dba-98b9-4a98-ad51-4eb2d8735f3f None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:49.796684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef5bb7-7f91-4d65-9d02-9ea78204461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:49.797310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5bb7-7f91-4d65-9d02-9ea78204461c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:49.797588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5bb7-7f91-4d65-9d02-9ea78204461c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:49.797856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5bb7-7f91-4d65-9d02-9ea78204461c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:49.798569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5bb7-7f91-4d65-9d02-9ea78204461c None admin] RBAC: Adding query filter params (role.id=51a6797e9ee54318a43790cb076ce834, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=22f4d77320794bb39b2dda5daa402a16) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:49.798871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5bb7-7f91-4d65-9d02-9ea78204461c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:49.800269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5bb7-7f91-4d65-9d02-9ea78204461c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:49.813346 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 530/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:49 2022] GET /identity/v3/role_assignments?user.id=22f4d77320794bb39b2dda5daa402a16&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=51a6797e9ee54318a43790cb076ce834 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:50.350732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be15e-3d9e-4169-a1b5-5e545c47d610 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:50.351256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be15e-3d9e-4169-a1b5-5e545c47d610 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:50.351256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be15e-3d9e-4169-a1b5-5e545c47d610 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:50.352731 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 522/1052] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:50.357866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17274-95c4-418d-a8a9-4d47d8cefa17 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:50.358297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17274-95c4-418d-a8a9-4d47d8cefa17 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:50.358452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17274-95c4-418d-a8a9-4d47d8cefa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:50.378894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-61e17274-95c4-418d-a8a9-4d47d8cefa17 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:50.380684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-61e17274-95c4-418d-a8a9-4d47d8cefa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:50.453391 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 531/1053] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:50.530848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2843d-11b0-4d1c-9d1a-590554eac599 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:50.530848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2843d-11b0-4d1c-9d1a-590554eac599 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:50.530848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2843d-11b0-4d1c-9d1a-590554eac599 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:50.532274 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 523/1054] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:50.538122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8491-e01f-4538-b53a-7a808320ef26 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:50.538417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8491-e01f-4538-b53a-7a808320ef26 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:50.538693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8491-e01f-4538-b53a-7a808320ef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:50.556891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3a6b8491-e01f-4538-b53a-7a808320ef26 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:50.558125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3a6b8491-e01f-4538-b53a-7a808320ef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:50.630186 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 532/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:50.728022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2843d-11b0-4d1c-9d1a-590554eac599 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:50.745019 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:50.830373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2843d-11b0-4d1c-9d1a-590554eac599 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:50.864495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:50.865008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:50.865315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:50.865585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:50.875492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:50.880298 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:50.881484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:50.882355 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:50.885378 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 524/1056] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:50.887338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b8491-e01f-4538-b53a-7a808320ef26 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:50.902725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:50.909546 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:50.982026 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:51.000344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b8491-e01f-4538-b53a-7a808320ef26 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.009234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419abfe-a365-4f58-ae73-785c53d69f04 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.040158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.040751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.041025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.041577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.041970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:51.042267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.043607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.046607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.047214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.047494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.047764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.059962 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 533/1057] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:51.061502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:51.123351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.124798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.153517 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:51.173346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30365ae0-1ce2-4c4b-b8ba-f35ae89fbdbc None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.205423 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:51.210693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.211495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.211835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.212229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] PATH_INFO: `/v3/users/3ff53015c7934dd4bcd5be4e8820eab6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.228127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff53015c7934dd4bcd5be4e8820eab6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.230188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.236992 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 534/1058] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:48:51 2022] GET /identity/v3/users/3ff53015c7934dd4bcd5be4e8820eab6 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:51.237140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 525/1059] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:48:51.237972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:51.238937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:51.341419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92635b66-236a-493a-b62a-931d2d0b59d0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.348081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c2fe4-09c6-4bd8-b503-ce5c0ae0fa83 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.376557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.377235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.377500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.377757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.383553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.384164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.384442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.384705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.388651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.390132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.396464 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:51.406804 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:51.413257 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:51.414364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:51.414364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:51.414364 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:51.414364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 526/1060] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:51.414364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:51.441716 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:51.463698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.465151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.539453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02564d-fe4e-40be-a828-9d50df7dd6b3 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.575606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 535/1061] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:48:51.576082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.576686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.576959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.577258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.577891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:51.578216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.579564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.581313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:51.592626 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 527/1062] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:51.629003 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:51.694079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d4d8-7735-4172-9d3d-f5731c783907 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.732631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988069d5-b0ec-4812-9b2c-8a9e643b4b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.733335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988069d5-b0ec-4812-9b2c-8a9e643b4b1c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.733616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988069d5-b0ec-4812-9b2c-8a9e643b4b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.733890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988069d5-b0ec-4812-9b2c-8a9e643b4b1c None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.735064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988069d5-b0ec-4812-9b2c-8a9e643b4b1c None admin] RBAC: Authorizing `identity:get_project(project_id=0f21f3fe59ef4478969abcdf541c7a5e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.736510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988069d5-b0ec-4812-9b2c-8a9e643b4b1c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.743612 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 536/1063] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:48:51 2022] GET /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:51.744720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:51.841511 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:51.857551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00249396-7a62-45c0-a96d-3032c31e0e00 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:51.897361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a081-ba72-463b-af45-ed9e4ee23910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:51.897993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a081-ba72-463b-af45-ed9e4ee23910 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:51.898271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a081-ba72-463b-af45-ed9e4ee23910 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:51.898534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a081-ba72-463b-af45-ed9e4ee23910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:51.899278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a081-ba72-463b-af45-ed9e4ee23910 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e, user.id=3ff53015c7934dd4bcd5be4e8820eab6) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:51.899585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a081-ba72-463b-af45-ed9e4ee23910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:51.901105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a081-ba72-463b-af45-ed9e4ee23910 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:51.907680 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 528/1064] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:51 2022] GET /identity/v3/role_assignments?user.id=3ff53015c7934dd4bcd5be4e8820eab6&scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:52.008107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c721be-8a66-4d71-8942-e89dca5c1cab None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:52.008383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c721be-8a66-4d71-8942-e89dca5c1cab None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:52.008653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c721be-8a66-4d71-8942-e89dca5c1cab None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:52.010028 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 537/1065] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:52.015723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee54-086d-458d-8db4-152d77876e9d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:52.016008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee54-086d-458d-8db4-152d77876e9d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:52.016279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee54-086d-458d-8db4-152d77876e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:52.037970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b2d2ee54-086d-458d-8db4-152d77876e9d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:52.039189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b2d2ee54-086d-458d-8db4-152d77876e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:52.110061 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 529/1066] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:48:52.381418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c721be-8a66-4d71-8942-e89dca5c1cab None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:52.486465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c721be-8a66-4d71-8942-e89dca5c1cab None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:52.495954 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:52.521305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:52.521929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:52.522207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:52.522478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:52.532935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:52.538291 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:52.541276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:52.542462 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 538/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 00:48:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:52.545344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee54-086d-458d-8db4-152d77876e9d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:52.632603 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:52.652266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee54-086d-458d-8db4-152d77876e9d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:52.685995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:52.686595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:52.686869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:52.687135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:52.687814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:52.688110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:52.689488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:52.697364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 530/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 00:48:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:52.703173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:52.803793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee49703-a016-41a8-8958-dfb7e24fe489 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:52.837909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:52.838530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:52.838808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:52.839079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:52.848797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:52.850247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:52.864422 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:52.865549 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:52.866473 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:52.866473 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:52.866473 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:52.866473 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 539/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:52.871369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:52.968220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93996-cddf-40ff-b94e-30e265d3846a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.000396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.000982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.001282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.001550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.002170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:53.002466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.003810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.015649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 531/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:53.021817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:53.043601 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.119025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41deaf-61ad-4df5-aaad-d153867e3d65 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.152114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.152733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.153007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.153301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.160604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.162687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:53.173432 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:53.174559 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:53.175538 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 540/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:48:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:53.180654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:53.183549 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.279404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164eeab-0ba0-46c8-97dc-936c5cc1257b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.312599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.313230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.313511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.313782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.314498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:53.314805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.316221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.333570 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 532/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:48:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:53.339484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:53.420735 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.444233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6919d-97eb-49ed-8a80-962ce1d2f770 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.477694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.478309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.478581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.478869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.489011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.490599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:53.504122 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:53.505136 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:53.506083 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:53.506083 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:53.506083 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:53.506083 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 541/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:53.511243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:53.571912 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.613493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96dca-0db8-4bac-a44d-064de4de57ab None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.648884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.649522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.649803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.650076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.650708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:53.651011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.652364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.663956 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 533/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:53.669793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:53.780491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d0e9-b6b0-4125-a667-28b26f2c09be None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.808253 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.813523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.814141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.814411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.814674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.821694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.823107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:53.834681 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:53.835604 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:53.836509 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 542/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:53.841530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:53.940313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4c23f-bbb2-494e-8af4-dccc9fe12c02 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.962645 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.976684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a7b4-3940-4cd4-b0aa-209e04e72a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.977311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a7b4-3940-4cd4-b0aa-209e04e72a08 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.977588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a7b4-3940-4cd4-b0aa-209e04e72a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.977853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a7b4-3940-4cd4-b0aa-209e04e72a08 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.978537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62a7b4-3940-4cd4-b0aa-209e04e72a08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:53.978834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62a7b4-3940-4cd4-b0aa-209e04e72a08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.980242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62a7b4-3940-4cd4-b0aa-209e04e72a08 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.993222 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 534/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:53.999094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:54.054783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb255-bd6e-42b2-a599-b1bc77f28c99 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:54.054976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb255-bd6e-42b2-a599-b1bc77f28c99 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:54.055256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb255-bd6e-42b2-a599-b1bc77f28c99 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:54.056591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 535/1077] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:54.061467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf36b-41f5-414b-ad6c-c916840ba33f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:54.061755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf36b-41f5-414b-ad6c-c916840ba33f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:54.062031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf36b-41f5-414b-ad6c-c916840ba33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:54.079487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c2cbf36b-41f5-414b-ad6c-c916840ba33f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:54.080676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c2cbf36b-41f5-414b-ad6c-c916840ba33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:54.101088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0331091-97bb-4e51-8b64-8f58df855cda None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:54.133708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:54.134360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:54.134637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:54.134908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/22f4d77320794bb39b2dda5daa402a16/roles/51a6797e9ee54318a43790cb076ce834` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:54.137028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=22f4d77320794bb39b2dda5daa402a16, role_id=51a6797e9ee54318a43790cb076ce834)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:54.138483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:54.148361 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 536/1078] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:54.152114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 543/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:48:53 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/22f4d77320794bb39b2dda5daa402a16/roles/51a6797e9ee54318a43790cb076ce834 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:48:54.424149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf36b-41f5-414b-ad6c-c916840ba33f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:54.524322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf36b-41f5-414b-ad6c-c916840ba33f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:54.537925 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:54.561887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:54.562516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:54.562793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:54.563060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:54.573538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:54.578270 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:54.579360 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:54.580224 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 537/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:54.585709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:54.640059 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:54.689924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a42c1a-8d9e-4f94-b5ff-60ca456cc522 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:54.722717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:54.723852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:54.724270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:54.724546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:54.725268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:54.725571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:54.726920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:54.735106 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 544/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:54.741181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:54.839842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f8153-0e0f-4b60-ba16-21e02733db03 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:54.878683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:54.879307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:54.879633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:54.880218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] PATH_INFO: `/v3/users/3ff53015c7934dd4bcd5be4e8820eab6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:54.881004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff53015c7934dd4bcd5be4e8820eab6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:54.882468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:54.884033 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 538/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:48:54 2022] GET /identity/v3/users/3ff53015c7934dd4bcd5be4e8820eab6 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:54.889758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:54.988252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac522b-8e46-4cb9-97ed-e173401b2848 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:55.003020 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:55.026889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94186d9c-7518-4b4d-be8c-74ee999567cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:55.027521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186d9c-7518-4b4d-be8c-74ee999567cd None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:55.027797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186d9c-7518-4b4d-be8c-74ee999567cd None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:55.028066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94186d9c-7518-4b4d-be8c-74ee999567cd None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:55.029210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94186d9c-7518-4b4d-be8c-74ee999567cd None admin] RBAC: Authorizing `identity:get_project(project_id=0f21f3fe59ef4478969abcdf541c7a5e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:55.030622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94186d9c-7518-4b4d-be8c-74ee999567cd None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:55.032236 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 545/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:48:54 2022] GET /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:55.040381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:55.088241 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:55.148745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f7ff-d79a-41fb-8ca1-0300dd989b51 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:55.181884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396d1b-d81a-4471-b21c-d630ce478976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:55.182527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396d1b-d81a-4471-b21c-d630ce478976 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:55.182806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396d1b-d81a-4471-b21c-d630ce478976 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:55.183077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396d1b-d81a-4471-b21c-d630ce478976 None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e/users/3ff53015c7934dd4bcd5be4e8820eab6/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:55.184940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396d1b-d81a-4471-b21c-d630ce478976 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f21f3fe59ef4478969abcdf541c7a5e, user_id=3ff53015c7934dd4bcd5be4e8820eab6, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:55.186401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396d1b-d81a-4471-b21c-d630ce478976 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:55.199041 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 539/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:48:55 2022] PUT /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e/users/3ff53015c7934dd4bcd5be4e8820eab6/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:48:56.295679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6348f5-b558-4994-82b8-5cb8e9cff93e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:56.296248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6348f5-b558-4994-82b8-5cb8e9cff93e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:56.296248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6348f5-b558-4994-82b8-5cb8e9cff93e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:56.297569 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 546/1085] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:56.302846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309dbd-3a0d-4b5e-9da5-1fe0b91162c0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:56.303262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309dbd-3a0d-4b5e-9da5-1fe0b91162c0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:56.303459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309dbd-3a0d-4b5e-9da5-1fe0b91162c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:56.321468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-85309dbd-3a0d-4b5e-9da5-1fe0b91162c0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:56.322650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-85309dbd-3a0d-4b5e-9da5-1fe0b91162c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:56.390176 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 540/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:56.670068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6348f5-b558-4994-82b8-5cb8e9cff93e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:56.776800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6348f5-b558-4994-82b8-5cb8e9cff93e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:56.811027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:56.811655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:56.811932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:56.812197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:56.822581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:56.827305 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:56.828286 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:56.829183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 547/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 11 00:48:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:56.834922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85309dbd-3a0d-4b5e-9da5-1fe0b91162c0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:56.862214 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:56.935016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85309dbd-3a0d-4b5e-9da5-1fe0b91162c0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:56.968265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:56.968870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:56.969176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:56.969446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:56.970102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:56.970404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:56.971906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:56.982292 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 541/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 00:48:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:56.988067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:57.032649 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:57.089637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd697c9-767a-415e-b6b3-a7623565e67d None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:57.129599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:57.130250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.130508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.130779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.140544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:57.141992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:57.156870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:57.158138 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:57.159430 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:57.159430 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:57.159430 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:57.161502 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 548/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:57.164360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:57.254545 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:57.266257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c29a-005c-424d-a5dd-3a10c6d7bfe6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:57.303128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526be40-fc6f-4247-ac72-e10c6a4090eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:57.303793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526be40-fc6f-4247-ac72-e10c6a4090eb None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.303994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526be40-fc6f-4247-ac72-e10c6a4090eb None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.304266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526be40-fc6f-4247-ac72-e10c6a4090eb None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.304902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526be40-fc6f-4247-ac72-e10c6a4090eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:57.305243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526be40-fc6f-4247-ac72-e10c6a4090eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:57.306602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526be40-fc6f-4247-ac72-e10c6a4090eb None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:57.323530 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 542/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:57.324738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:57.380527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ee9a-33de-435a-b722-a937cc5031c1 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.380952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ee9a-33de-435a-b722-a937cc5031c1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.381277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ee9a-33de-435a-b722-a937cc5031c1 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.382622 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 543/1091] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:57.387742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a9c23-4e5c-4ecf-8271-1fba8524cf7f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.388025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a9c23-4e5c-4ecf-8271-1fba8524cf7f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.388323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a9c23-4e5c-4ecf-8271-1fba8524cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.406748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d30a9c23-4e5c-4ecf-8271-1fba8524cf7f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:57.407938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d30a9c23-4e5c-4ecf-8271-1fba8524cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:57.422240 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:57.429813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ca4ef-d912-4a6c-b651-23d4f748fc18 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:57.464211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:57.464829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.465137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.465408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.472782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:57.474257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:57.475555 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 544/1092] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:48:57.485259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:57.486405 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:57.487421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 549/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 11 00:48:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:48:57.494221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a9c23-4e5c-4ecf-8271-1fba8524cf7f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:57.575171 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:57.594157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a9c23-4e5c-4ecf-8271-1fba8524cf7f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:57.627890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:57.628484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.628760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.629031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.630023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:57.630329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:57.631767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:57.648309 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 545/1094] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 11 00:48:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:57.654165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:57.746313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:57.753415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eba32a-c399-414d-9c2c-1accb81f47d3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:57.788520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:57.789043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.789349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.789624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.812784 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:57.844052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782181-dc98-44f0-8476-037d673bbfe2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:57.855988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:57.857457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:57.877998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:57.878616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:57.878891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:57.879159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:57.885830 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:57.889788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:48:57.894914 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:57.896522 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:48:57.897436 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 546/1095] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:57.903031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:57.956144 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 550/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:48:57.962372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.006824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784559-5058-4dfd-88f7-a15c01e2fca7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.014532 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.041399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.041924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.042203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.042472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.043128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:58.043426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.044796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.053151 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 547/1097] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:58.058922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.062955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325ed70-995b-455d-8524-dab5563bbe38 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.097822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.098514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.098790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.099068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.109116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.110561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.118358 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:48:58.124797 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:58.125836 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:48:58.126770 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:48:58.126770 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:48:58.126770 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:58.126770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 551/1098] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:58.132000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.166325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664647f-1f41-4df9-b130-98d511484d4f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.198967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.199580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.199853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.200117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] PATH_INFO: `/v3/users/3ff53015c7934dd4bcd5be4e8820eab6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.201254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] RBAC: Authorizing `identity:get_user(user_id=3ff53015c7934dd4bcd5be4e8820eab6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.202711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.204270 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 548/1099] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/users/3ff53015c7934dd4bcd5be4e8820eab6 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:58.210022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.230943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2aa45-cc18-4499-9708-d6f570cdbd59 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.237858 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.265962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.266563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.266847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.267118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.267756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:58.268053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.269440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.281367 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 552/1100] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:58.287638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.311329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1e014-0685-442c-bba4-4143be584c6a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.336160 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.345745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.346350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.346630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.346890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.394084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4d53-ede9-4463-b138-d8bcbd532f05 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.439265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.439552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.440368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.440717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.440970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.441438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.450321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.451760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:48:58.464628 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:48:58.465616 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:48:58.466523 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 553/1101] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:48:58.471564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.500268 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.552582 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 549/1102] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:48:58.557996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.588554 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.589854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1506f60-43d9-47de-8be6-4e44955ee468 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.628487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.629239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.630153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.630481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.631281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:58.632059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.633126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.646190 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 554/1103] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:58.652691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.678030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f18d0f-1250-455f-be0d-6ed0536baf3c None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.713218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.713857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.714132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.714406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.715516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] RBAC: Authorizing `identity:get_project(project_id=0f21f3fe59ef4478969abcdf541c7a5e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.716940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.723730 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 550/1104] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:48:58.724730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:58.744024 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.759454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967df42d-2f03-4983-9d8f-20d3e525859a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.796263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738451f-6e24-479b-8022-2fdd5a4e103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.796856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738451f-6e24-479b-8022-2fdd5a4e103b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.797162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738451f-6e24-479b-8022-2fdd5a4e103b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.797433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738451f-6e24-479b-8022-2fdd5a4e103b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.798142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738451f-6e24-479b-8022-2fdd5a4e103b None admin] RBAC: Adding query filter params (role.id=51a6797e9ee54318a43790cb076ce834, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=22f4d77320794bb39b2dda5daa402a16) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:58.798443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738451f-6e24-479b-8022-2fdd5a4e103b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.799836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738451f-6e24-479b-8022-2fdd5a4e103b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.806464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 555/1105] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/role_assignments?user.id=22f4d77320794bb39b2dda5daa402a16&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=51a6797e9ee54318a43790cb076ce834 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:48:58.831115 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:58.838220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e788dd-1e59-4e51-8139-8d1f4bc3881b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:58.875189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bcc36-5952-4371-86e8-e1c453498368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:58.875718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bcc36-5952-4371-86e8-e1c453498368 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.875989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bcc36-5952-4371-86e8-e1c453498368 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.876254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bcc36-5952-4371-86e8-e1c453498368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.876992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bcc36-5952-4371-86e8-e1c453498368 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e, user.id=3ff53015c7934dd4bcd5be4e8820eab6) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:48:58.877332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bcc36-5952-4371-86e8-e1c453498368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:58.878779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bcc36-5952-4371-86e8-e1c453498368 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:58.885382 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 551/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:48:58 2022] GET /identity/v3/role_assignments?user.id=3ff53015c7934dd4bcd5be4e8820eab6&scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:49:01.071631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe7389-228c-4b64-84ce-af49ffbe79d5 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:01.072192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe7389-228c-4b64-84ce-af49ffbe79d5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:01.072192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe7389-228c-4b64-84ce-af49ffbe79d5 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:01.073521 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 556/1107] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:01.078864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad467d-2411-413b-a079-a42e4843f789 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:01.079257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad467d-2411-413b-a079-a42e4843f789 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:01.079413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad467d-2411-413b-a079-a42e4843f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:01.098161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1aad467d-2411-413b-a079-a42e4843f789 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:01.099363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1aad467d-2411-413b-a079-a42e4843f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:01.173073 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 552/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:01.442887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe7389-228c-4b64-84ce-af49ffbe79d5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:01.542706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe7389-228c-4b64-84ce-af49ffbe79d5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:01.575071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47e0c4-5f6e-49ca-8e34-75f35d60d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:01.575688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e0c4-5f6e-49ca-8e34-75f35d60d6be None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:01.575966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e0c4-5f6e-49ca-8e34-75f35d60d6be None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:01.576238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47e0c4-5f6e-49ca-8e34-75f35d60d6be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:01.577376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e0c4-5f6e-49ca-8e34-75f35d60d6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:01.578779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47e0c4-5f6e-49ca-8e34-75f35d60d6be None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:01.580325 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 557/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:01.586491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad467d-2411-413b-a079-a42e4843f789 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:01.673193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:01.683540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad467d-2411-413b-a079-a42e4843f789 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:01.717067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b5e7-6c92-47e2-9b9d-0ccb44cecd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:01.717676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b5e7-6c92-47e2-9b9d-0ccb44cecd93 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:01.717953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b5e7-6c92-47e2-9b9d-0ccb44cecd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:01.718224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b5e7-6c92-47e2-9b9d-0ccb44cecd93 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:01.718857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458b5e7-6c92-47e2-9b9d-0ccb44cecd93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:01.720262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458b5e7-6c92-47e2-9b9d-0ccb44cecd93 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:01.740798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 553/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:49:01 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:49:03.911286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ad0f1-128d-4041-b967-d4d39d7c15cf None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:03.911805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ad0f1-128d-4041-b967-d4d39d7c15cf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:03.911805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ad0f1-128d-4041-b967-d4d39d7c15cf None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:03.912950 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 558/1111] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:03.918132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2011-a019-46dd-b1a0-6ae42afaa301 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:03.918520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2011-a019-46dd-b1a0-6ae42afaa301 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:03.918672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2011-a019-46dd-b1a0-6ae42afaa301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:03.937418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bb5a2011-a019-46dd-b1a0-6ae42afaa301 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:03.938596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb5a2011-a019-46dd-b1a0-6ae42afaa301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:04.003265 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 554/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:04.283190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ad0f1-128d-4041-b967-d4d39d7c15cf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:04.302005 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:04.383815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ad0f1-128d-4041-b967-d4d39d7c15cf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:04.416562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:04.417197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:04.417479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:04.417752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] PATH_INFO: `/v3/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:04.419290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] RBAC: Authorizing `identity:get_role(role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:04.420637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:04.421945 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 559/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:04 2022] GET /identity/v3/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:04.428272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2011-a019-46dd-b1a0-6ae42afaa301 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:04.503159 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:04.527023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2011-a019-46dd-b1a0-6ae42afaa301 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:04.560692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:04.561286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:04.561563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:04.561831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] PATH_INFO: `/v3/users/4acca5bf2c8b49ec86eed087258cb069` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:04.574928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] RBAC: Authorizing `identity:get_user(user_id=4acca5bf2c8b49ec86eed087258cb069)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:04.576347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:04.577963 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 555/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:04 2022] GET /identity/v3/users/4acca5bf2c8b49ec86eed087258cb069 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:04.583914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:04.665737 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:04.680857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1422c9a-bda3-4cf2-9039-ea30e5b8c3b4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:04.713916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:04.714506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:04.714779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:04.715042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:04.778607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:04.780010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:04.858723 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:04.874019 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 560/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:49:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:04.880007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:04.975480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cfd44-3d0e-4b4d-8e09-6fcfffc2a3ef None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:05.008731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ce8c4-bc4a-44bc-b0af-312a8041dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:05.009360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce8c4-bc4a-44bc-b0af-312a8041dae5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:05.009634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce8c4-bc4a-44bc-b0af-312a8041dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:05.009902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ce8c4-bc4a-44bc-b0af-312a8041dae5 None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:05.010987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ce8c4-bc4a-44bc-b0af-312a8041dae5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f21f3fe59ef4478969abcdf541c7a5e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:05.012392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ce8c4-bc4a-44bc-b0af-312a8041dae5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:05.013999 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 556/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:04 2022] GET /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:05.020688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:05.115146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc1181-022b-4552-99e6-1a901ed64059 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:05.148373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624968fe-3d6d-44e4-8743-be37d86a8c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:05.148971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624968fe-3d6d-44e4-8743-be37d86a8c2c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:05.149281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624968fe-3d6d-44e4-8743-be37d86a8c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:05.149554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624968fe-3d6d-44e4-8743-be37d86a8c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:05.150272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624968fe-3d6d-44e4-8743-be37d86a8c2c None admin] RBAC: Adding query filter params (role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e, user.id=4acca5bf2c8b49ec86eed087258cb069) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:05.150576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624968fe-3d6d-44e4-8743-be37d86a8c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:05.151976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624968fe-3d6d-44e4-8743-be37d86a8c2c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:05.157363 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 561/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:49:05 2022] GET /identity/v3/role_assignments?user.id=4acca5bf2c8b49ec86eed087258cb069&scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:07.246670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66ada-d7cf-4e5c-a250-d63c94826805 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:07.247199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66ada-d7cf-4e5c-a250-d63c94826805 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:07.247199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66ada-d7cf-4e5c-a250-d63c94826805 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:07.248549 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 557/1118] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:07.253580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad840d-ff2b-476a-8c0a-23d6f83c5e0c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:07.253983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad840d-ff2b-476a-8c0a-23d6f83c5e0c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:07.254123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad840d-ff2b-476a-8c0a-23d6f83c5e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:07.273287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fdad840d-ff2b-476a-8c0a-23d6f83c5e0c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:07.274454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fdad840d-ff2b-476a-8c0a-23d6f83c5e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:07.318046 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:07.339144 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 562/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:07.608807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66ada-d7cf-4e5c-a250-d63c94826805 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:07.611713 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:07.707042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66ada-d7cf-4e5c-a250-d63c94826805 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:07.739677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:07.740274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:07.740547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:07.740813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] PATH_INFO: `/v3/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:07.742206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] RBAC: Authorizing `identity:get_role(role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:07.743544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:07.744807 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 558/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:07 2022] GET /identity/v3/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:07.750560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad840d-ff2b-476a-8c0a-23d6f83c5e0c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:07.847365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad840d-ff2b-476a-8c0a-23d6f83c5e0c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:07.880741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:07.881382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:07.881656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:07.881921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] PATH_INFO: `/v3/users/4acca5bf2c8b49ec86eed087258cb069` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:07.883021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] RBAC: Authorizing `identity:get_user(user_id=4acca5bf2c8b49ec86eed087258cb069)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:07.884420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:07.885977 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 563/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:07 2022] GET /identity/v3/users/4acca5bf2c8b49ec86eed087258cb069 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:07.891748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:07.958606 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:07.988727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6485d-bc76-4b25-93d7-ef19d4281617 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:08.021924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d924b-f50c-4abf-9da6-916381d8a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:08.022535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d924b-f50c-4abf-9da6-916381d8a155 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:08.022862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d924b-f50c-4abf-9da6-916381d8a155 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:08.023073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d924b-f50c-4abf-9da6-916381d8a155 None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:08.024165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d924b-f50c-4abf-9da6-916381d8a155 None admin] RBAC: Authorizing `identity:get_project(project_id=0f21f3fe59ef4478969abcdf541c7a5e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:08.025612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d924b-f50c-4abf-9da6-916381d8a155 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:08.027209 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 559/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:07 2022] GET /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:08.033114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:08.081795 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:08.131812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c5f3-dae2-444c-8566-46bf7aba5f2b None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:08.165332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a494072-c024-43cc-be0a-33a24e6fe22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:08.165983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494072-c024-43cc-be0a-33a24e6fe22e None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:08.166261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494072-c024-43cc-be0a-33a24e6fe22e None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:08.166530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494072-c024-43cc-be0a-33a24e6fe22e None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e/users/4acca5bf2c8b49ec86eed087258cb069/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:08.168647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a494072-c024-43cc-be0a-33a24e6fe22e None admin] RBAC: Authorizing `identity:create_grant(project_id=0f21f3fe59ef4478969abcdf541c7a5e, user_id=4acca5bf2c8b49ec86eed087258cb069, role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:08.170083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a494072-c024-43cc-be0a-33a24e6fe22e None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:08.182711 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 564/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:49:08 2022] PUT /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e/users/4acca5bf2c8b49ec86eed087258cb069/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:49:10.322834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990485d-e1b7-4cdf-98fc-490f6f9098f4 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:10.323368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990485d-e1b7-4cdf-98fc-490f6f9098f4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:10.323368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990485d-e1b7-4cdf-98fc-490f6f9098f4 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:10.324697 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 560/1124] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:10.329782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271bd5-7f47-457a-bc78-e3df84041308 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:10.330167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271bd5-7f47-457a-bc78-e3df84041308 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:10.330326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271bd5-7f47-457a-bc78-e3df84041308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:10.348977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-75271bd5-7f47-457a-bc78-e3df84041308 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:10.350174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75271bd5-7f47-457a-bc78-e3df84041308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:10.413688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:10.683815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990485d-e1b7-4cdf-98fc-490f6f9098f4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:10.785286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990485d-e1b7-4cdf-98fc-490f6f9098f4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:10.818410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:10.819026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:10.819302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:10.819572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] PATH_INFO: `/v3/roles/7ec7c3be90c047219c63fb3ce8c23ade` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:10.820956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] RBAC: Authorizing `identity:get_role(role_id=7ec7c3be90c047219c63fb3ce8c23ade)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:10.822343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:10.823643 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 561/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:10 2022] GET /identity/v3/roles/7ec7c3be90c047219c63fb3ce8c23ade => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:10.829487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271bd5-7f47-457a-bc78-e3df84041308 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:10.867418 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:10.925080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271bd5-7f47-457a-bc78-e3df84041308 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:10.957394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:10.958057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:10.958329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:10.958598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] PATH_INFO: `/v3/users/4acca5bf2c8b49ec86eed087258cb069` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:10.959704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] RBAC: Authorizing `identity:get_user(user_id=4acca5bf2c8b49ec86eed087258cb069)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:10.961118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:10.962642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 566/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:10 2022] GET /identity/v3/users/4acca5bf2c8b49ec86eed087258cb069 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:10.968397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:10.977739 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:11.065985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9b43-2e00-44ae-821e-09478408b3ac None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:11.098052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:11.099161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:11.099427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:11.099698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:11.165178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:11.166604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:11.173906 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:11.260293 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:49:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:11.266358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:11.362233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d699-f9d2-43a3-9cac-b493fda079ae None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:11.369217 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:11.394785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307af5c-109a-482e-831c-5d5206c10e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:11.395925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307af5c-109a-482e-831c-5d5206c10e71 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:11.396207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307af5c-109a-482e-831c-5d5206c10e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:11.396482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307af5c-109a-482e-831c-5d5206c10e71 None admin] PATH_INFO: `/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:11.397636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307af5c-109a-482e-831c-5d5206c10e71 None admin] RBAC: Authorizing `identity:get_project(project_id=0f21f3fe59ef4478969abcdf541c7a5e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:11.399050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307af5c-109a-482e-831c-5d5206c10e71 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:11.400658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 567/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:11 2022] GET /identity/v3/projects/0f21f3fe59ef4478969abcdf541c7a5e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:11.406688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:11.500685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ccbba-c23a-4bde-b673-7db3994c892a None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:11.507821 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:11.534129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fac8d-0b8f-4dfc-b29a-8ca973a7f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:11.534726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fac8d-0b8f-4dfc-b29a-8ca973a7f36a None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:11.534997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fac8d-0b8f-4dfc-b29a-8ca973a7f36a None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:11.535261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fac8d-0b8f-4dfc-b29a-8ca973a7f36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:11.536539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fac8d-0b8f-4dfc-b29a-8ca973a7f36a None admin] RBAC: Adding query filter params (role.id=7ec7c3be90c047219c63fb3ce8c23ade, scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e, user.id=4acca5bf2c8b49ec86eed087258cb069) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:11.536836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fac8d-0b8f-4dfc-b29a-8ca973a7f36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:11.538283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fac8d-0b8f-4dfc-b29a-8ca973a7f36a None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:11.543788 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 563/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:49:11 2022] GET /identity/v3/role_assignments?user.id=4acca5bf2c8b49ec86eed087258cb069&scope.project.id=0f21f3fe59ef4478969abcdf541c7a5e&role.id=7ec7c3be90c047219c63fb3ce8c23ade => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:13.711010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065e263-da4b-458f-ab11-975a7f522b17 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:13.711581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065e263-da4b-458f-ab11-975a7f522b17 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:13.711581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065e263-da4b-458f-ab11-975a7f522b17 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:13.712894 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 568/1131] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:13.718117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74c61-226a-4c21-a07b-94f7ac2caed4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:13.718490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74c61-226a-4c21-a07b-94f7ac2caed4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:13.718655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74c61-226a-4c21-a07b-94f7ac2caed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:13.736201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-02e74c61-226a-4c21-a07b-94f7ac2caed4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:13.737383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-02e74c61-226a-4c21-a07b-94f7ac2caed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:13.804327 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 564/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:14.071999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065e263-da4b-458f-ab11-975a7f522b17 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:14.191240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065e263-da4b-458f-ab11-975a7f522b17 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:14.228660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a6571-4a31-4e3a-bfdd-4c6993209f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:14.229311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6571-4a31-4e3a-bfdd-4c6993209f24 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:14.229589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6571-4a31-4e3a-bfdd-4c6993209f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:14.229859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a6571-4a31-4e3a-bfdd-4c6993209f24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:14.230966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a6571-4a31-4e3a-bfdd-4c6993209f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:14.232373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a6571-4a31-4e3a-bfdd-4c6993209f24 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:14.233946 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 569/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:14.240730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74c61-226a-4c21-a07b-94f7ac2caed4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:14.334307 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:14.337239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74c61-226a-4c21-a07b-94f7ac2caed4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:14.370395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f72b-f56c-44d7-a1da-63506df1d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:14.370985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f72b-f56c-44d7-a1da-63506df1d108 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:14.371258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f72b-f56c-44d7-a1da-63506df1d108 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:14.371525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f72b-f56c-44d7-a1da-63506df1d108 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:14.372158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f72b-f56c-44d7-a1da-63506df1d108 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:14.373608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f72b-f56c-44d7-a1da-63506df1d108 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:14.400016 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 565/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:49:14 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:49:16.609002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd71a-d969-4f40-89a8-f7bee424969c None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:16.609513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd71a-d969-4f40-89a8-f7bee424969c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:16.609605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd71a-d969-4f40-89a8-f7bee424969c None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:16.610905 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 570/1135] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:16.616948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32ea96-0cad-4052-8e3e-1fd09aae5944 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:16.617407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32ea96-0cad-4052-8e3e-1fd09aae5944 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:16.617512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32ea96-0cad-4052-8e3e-1fd09aae5944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:16.635743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4d32ea96-0cad-4052-8e3e-1fd09aae5944 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:16.636908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d32ea96-0cad-4052-8e3e-1fd09aae5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:16.700330 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 566/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:16.978845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd71a-d969-4f40-89a8-f7bee424969c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:17.022656 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:17.078025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd71a-d969-4f40-89a8-f7bee424969c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:17.112040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618ac1b-a106-42ad-8d0c-78a6687b4ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:17.112657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ac1b-a106-42ad-8d0c-78a6687b4ccf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:17.112934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ac1b-a106-42ad-8d0c-78a6687b4ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:17.113234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618ac1b-a106-42ad-8d0c-78a6687b4ccf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:17.115496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618ac1b-a106-42ad-8d0c-78a6687b4ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:17.116907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618ac1b-a106-42ad-8d0c-78a6687b4ccf None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:17.118505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 571/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:49:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:17.124180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32ea96-0cad-4052-8e3e-1fd09aae5944 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:17.201287 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:17.220218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32ea96-0cad-4052-8e3e-1fd09aae5944 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:17.253625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c988e-0d7f-4e79-badc-6ca2b25e034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:17.254139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c988e-0d7f-4e79-badc-6ca2b25e034c None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:17.254567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c988e-0d7f-4e79-badc-6ca2b25e034c None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:17.254856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c988e-0d7f-4e79-badc-6ca2b25e034c None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:17.255486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c988e-0d7f-4e79-badc-6ca2b25e034c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:17.256888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c988e-0d7f-4e79-badc-6ca2b25e034c None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:17.277777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 567/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:49:17 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:49:19.442996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44dbb-959a-4320-9b5a-e8f3eb2cdf08 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:19.443525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44dbb-959a-4320-9b5a-e8f3eb2cdf08 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:19.443525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44dbb-959a-4320-9b5a-e8f3eb2cdf08 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:19.444850 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 572/1139] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:19.450196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e173b8-2619-4975-9842-4aede59791e9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:19.450618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e173b8-2619-4975-9842-4aede59791e9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:19.450720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e173b8-2619-4975-9842-4aede59791e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:19.468900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-68e173b8-2619-4975-9842-4aede59791e9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:19.470110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-68e173b8-2619-4975-9842-4aede59791e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:19.534661 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 568/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:19.802533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44dbb-959a-4320-9b5a-e8f3eb2cdf08 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:19.901599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44dbb-959a-4320-9b5a-e8f3eb2cdf08 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:19.911807 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:19.934094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:19.934705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:19.934977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:19.935241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:19.945622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:49:19.950281 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:49:19.951360 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:49:19.952289 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 573/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:49:19.958090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e173b8-2619-4975-9842-4aede59791e9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:20.021605 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:20.053429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e173b8-2619-4975-9842-4aede59791e9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:20.086252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:20.086838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:20.087114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:20.087383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:20.088031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:20.088331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:20.089721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:20.101811 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 569/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:49:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:20.103916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:20.199903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749dd4b-7eff-4030-ad43-6c8c4e4e0278 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:20.231230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:20.231836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:20.232115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:20.232381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] PATH_INFO: `/v3/users/3782d405f702457991d4abc0c2097db4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:20.245393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] RBAC: Authorizing `identity:get_user(user_id=3782d405f702457991d4abc0c2097db4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:20.246808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:20.248347 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 574/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:20 2022] GET /identity/v3/users/3782d405f702457991d4abc0c2097db4 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:20.254076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:20.350278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e30c1-d751-457b-ac80-59c5e3118ee8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:20.377345 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:20.383783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:20.384377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:20.384654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:20.384927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:20.449300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:20.450721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:20.544889 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 570/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:49:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:20.550790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:20.578834 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:20.650438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994165d-2063-4c1d-a012-528589681c8a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:20.683816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f5203-70bb-4454-9aa5-c991e55469cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:20.684478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f5203-70bb-4454-9aa5-c991e55469cd None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:20.684711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f5203-70bb-4454-9aa5-c991e55469cd None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:20.684980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f5203-70bb-4454-9aa5-c991e55469cd None admin] PATH_INFO: `/v3/projects/b71b09a0594f44148e04ab39590e6697` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:20.686108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f5203-70bb-4454-9aa5-c991e55469cd None admin] RBAC: Authorizing `identity:get_project(project_id=b71b09a0594f44148e04ab39590e6697)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:20.687516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f5203-70bb-4454-9aa5-c991e55469cd None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:20.689123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 575/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:20 2022] GET /identity/v3/projects/b71b09a0594f44148e04ab39590e6697 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:49:20.695253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:20.724457 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:20.796018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc158-9dd7-4df8-ba3f-725f49052bef None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:20.828564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb03b-1c2c-4025-83d0-ca335ecfb599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:20.829176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb03b-1c2c-4025-83d0-ca335ecfb599 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:20.829451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb03b-1c2c-4025-83d0-ca335ecfb599 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:20.829716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb03b-1c2c-4025-83d0-ca335ecfb599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:20.830418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb03b-1c2c-4025-83d0-ca335ecfb599 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=b71b09a0594f44148e04ab39590e6697, user.id=3782d405f702457991d4abc0c2097db4) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:20.830721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb03b-1c2c-4025-83d0-ca335ecfb599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:20.832118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb03b-1c2c-4025-83d0-ca335ecfb599 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:20.837354 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 571/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:49:20 2022] GET /identity/v3/role_assignments?user.id=3782d405f702457991d4abc0c2097db4&scope.project.id=b71b09a0594f44148e04ab39590e6697&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:22.929676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78ada-be78-453c-b994-c6eab0d5aa75 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:22.930190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78ada-be78-453c-b994-c6eab0d5aa75 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:22.930190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78ada-be78-453c-b994-c6eab0d5aa75 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:22.931458 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 576/1147] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:22.936636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd62d-2d3b-4039-8cb5-b0f2b2e89b23 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:22.937034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd62d-2d3b-4039-8cb5-b0f2b2e89b23 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:22.937192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd62d-2d3b-4039-8cb5-b0f2b2e89b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:22.954824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-93bcd62d-2d3b-4039-8cb5-b0f2b2e89b23 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:22.955982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-93bcd62d-2d3b-4039-8cb5-b0f2b2e89b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:23.019342 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 572/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:23.296097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78ada-be78-453c-b994-c6eab0d5aa75 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:23.387855 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:23.394881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78ada-be78-453c-b994-c6eab0d5aa75 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:23.427617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:23.428226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:23.428502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:23.428771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:23.438471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:49:23.443811 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:49:23.445013 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:49:23.445998 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 577/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:49:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:49:23.451012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcd62d-2d3b-4039-8cb5-b0f2b2e89b23 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:23.474205 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:23.546521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcd62d-2d3b-4039-8cb5-b0f2b2e89b23 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:23.579620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:23.580210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:23.580481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:23.580745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:23.581417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:23.581713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:23.583228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:23.590966 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 573/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:49:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:23.596765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:23.694508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c39261-bc13-41ca-9d73-d4ed57ea7215 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:23.727229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:23.727832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:23.728111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:23.728379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] PATH_INFO: `/v3/users/3782d405f702457991d4abc0c2097db4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:23.729515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] RBAC: Authorizing `identity:get_user(user_id=3782d405f702457991d4abc0c2097db4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:23.730917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:23.732443 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 578/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:23 2022] GET /identity/v3/users/3782d405f702457991d4abc0c2097db4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:23.738124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:23.823491 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:23.838788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251de6-1207-4e07-9a9d-251e5a186717 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:23.872577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ad34d-ea4e-4f6a-b968-a32bdd9334c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:23.873218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad34d-ea4e-4f6a-b968-a32bdd9334c3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:23.873494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad34d-ea4e-4f6a-b968-a32bdd9334c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:23.873763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad34d-ea4e-4f6a-b968-a32bdd9334c3 None admin] PATH_INFO: `/v3/projects/b71b09a0594f44148e04ab39590e6697` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:23.874862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ad34d-ea4e-4f6a-b968-a32bdd9334c3 None admin] RBAC: Authorizing `identity:get_project(project_id=b71b09a0594f44148e04ab39590e6697)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:23.876264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ad34d-ea4e-4f6a-b968-a32bdd9334c3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:23.877882 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 574/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:23 2022] GET /identity/v3/projects/b71b09a0594f44148e04ab39590e6697 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:23.883907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:23.908205 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:23.981213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc61c-0ed5-47b5-abd6-6e714219a9bb None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:24.013415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50307aff-0e79-4608-9b41-c656ed91a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:24.014045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307aff-0e79-4608-9b41-c656ed91a1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:24.014320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307aff-0e79-4608-9b41-c656ed91a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:24.014587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307aff-0e79-4608-9b41-c656ed91a1b7 None admin] PATH_INFO: `/v3/projects/b71b09a0594f44148e04ab39590e6697/users/3782d405f702457991d4abc0c2097db4/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:24.016446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50307aff-0e79-4608-9b41-c656ed91a1b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b71b09a0594f44148e04ab39590e6697, user_id=3782d405f702457991d4abc0c2097db4, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:24.017875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50307aff-0e79-4608-9b41-c656ed91a1b7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:24.031409 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 579/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:49:23 2022] PUT /identity/v3/projects/b71b09a0594f44148e04ab39590e6697/users/3782d405f702457991d4abc0c2097db4/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:49:26.130070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f1f7-48b8-4a79-8b51-38139d0cc94e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:26.130603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f1f7-48b8-4a79-8b51-38139d0cc94e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:26.130718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f1f7-48b8-4a79-8b51-38139d0cc94e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:26.132126 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 575/1154] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:26.138010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0f44-cec2-45ad-8912-b55cfab0034a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:26.138442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0f44-cec2-45ad-8912-b55cfab0034a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:26.138540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0f44-cec2-45ad-8912-b55cfab0034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:26.157025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-01ad0f44-cec2-45ad-8912-b55cfab0034a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:26.158220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-01ad0f44-cec2-45ad-8912-b55cfab0034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:26.224084 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 580/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:26.491036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f1f7-48b8-4a79-8b51-38139d0cc94e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:26.590610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f1f7-48b8-4a79-8b51-38139d0cc94e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:26.623802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:26.624417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:26.624693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:26.624962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:26.634858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:49:26.639592 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:49:26.640762 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:49:26.641654 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 576/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:49:26.647142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0f44-cec2-45ad-8912-b55cfab0034a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:26.663065 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:26.745099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0f44-cec2-45ad-8912-b55cfab0034a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:26.783264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:26.783860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:26.784138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:26.784408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:26.785082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:26.785909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:26.787487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:26.795222 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 581/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:49:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:26.802389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:26.817527 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:26.899238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f41fa-7f4c-4920-86e4-24af9d8dbde2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:26.932501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:26.933129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:26.933405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:26.933670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] PATH_INFO: `/v3/users/3782d405f702457991d4abc0c2097db4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:26.934758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=3782d405f702457991d4abc0c2097db4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:26.936168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:26.937740 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 577/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:26 2022] GET /identity/v3/users/3782d405f702457991d4abc0c2097db4 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:26.943726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:27.019412 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:27.043603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded936e-de98-4e35-ba48-02637930f1cf None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:27.075984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:27.076573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:27.076849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:27.077145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:27.142743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:27.144158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:27.216909 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:27.239813 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 582/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:49:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:27.245976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:27.324181 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:27.342043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c7f37-a153-4e6a-aea8-1312295f1bb9 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:27.374248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb523399-bb80-4c77-a632-fa9be6159577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:27.374856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523399-bb80-4c77-a632-fa9be6159577 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:27.375129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523399-bb80-4c77-a632-fa9be6159577 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:27.375392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb523399-bb80-4c77-a632-fa9be6159577 None admin] PATH_INFO: `/v3/projects/b71b09a0594f44148e04ab39590e6697` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:27.376471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb523399-bb80-4c77-a632-fa9be6159577 None admin] RBAC: Authorizing `identity:get_project(project_id=b71b09a0594f44148e04ab39590e6697)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:27.377910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb523399-bb80-4c77-a632-fa9be6159577 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:27.379495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 578/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:27 2022] GET /identity/v3/projects/b71b09a0594f44148e04ab39590e6697 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:27.386101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:27.481816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a51c79-d9fb-424f-af0d-b34f2c15a118 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:27.514515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1253558-195e-463a-9609-8228cd5b44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:27.515106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1253558-195e-463a-9609-8228cd5b44d5 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:27.515376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1253558-195e-463a-9609-8228cd5b44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:27.515641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1253558-195e-463a-9609-8228cd5b44d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:27.516355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1253558-195e-463a-9609-8228cd5b44d5 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=b71b09a0594f44148e04ab39590e6697, user.id=3782d405f702457991d4abc0c2097db4) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:27.516651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1253558-195e-463a-9609-8228cd5b44d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:27.518069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1253558-195e-463a-9609-8228cd5b44d5 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:27.524768 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 583/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:49:27 2022] GET /identity/v3/role_assignments?user.id=3782d405f702457991d4abc0c2097db4&scope.project.id=b71b09a0594f44148e04ab39590e6697&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:29.676638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42119-f0ff-46e5-94e1-12b705944a48 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:29.677373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42119-f0ff-46e5-94e1-12b705944a48 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:29.677373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42119-f0ff-46e5-94e1-12b705944a48 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:29.678588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 579/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:29.683739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8fc1e-8737-4014-b7eb-a1b8e4734367 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:29.684146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8fc1e-8737-4014-b7eb-a1b8e4734367 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:29.684292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8fc1e-8737-4014-b7eb-a1b8e4734367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:29.702719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9de8fc1e-8737-4014-b7eb-a1b8e4734367 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:29.703908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9de8fc1e-8737-4014-b7eb-a1b8e4734367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:29.737037 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:29.769635 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 584/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:30.044234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42119-f0ff-46e5-94e1-12b705944a48 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:30.146882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42119-f0ff-46e5-94e1-12b705944a48 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:30.181500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:30.182085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:30.182356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:30.182619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:30.201025 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:30.247478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:30.248900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:30.342205 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 580/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:49:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:30.348097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8fc1e-8737-4014-b7eb-a1b8e4734367 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:30.446543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8fc1e-8737-4014-b7eb-a1b8e4734367 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:30.479798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3d9c5-12b0-4dc7-8664-dc1f9967ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:30.480430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d9c5-12b0-4dc7-8664-dc1f9967ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:30.480690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d9c5-12b0-4dc7-8664-dc1f9967ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:30.480960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d9c5-12b0-4dc7-8664-dc1f9967ba66 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:30.487401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3d9c5-12b0-4dc7-8664-dc1f9967ba66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:30.488810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3d9c5-12b0-4dc7-8664-dc1f9967ba66 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-82f3d9c5-12b0-4dc7-8664-dc1f9967ba66 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:49:30.500895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:49:30.502172 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:49:30.503041 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 585/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:49:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:49:30.508061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:30.557113 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:30.605266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5b7b-e1eb-411a-9634-aabedc080e2b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:30.637988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a519-38c4-4f11-8d89-845741f62264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:30.638577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a519-38c4-4f11-8d89-845741f62264 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:30.638853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a519-38c4-4f11-8d89-845741f62264 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:30.639121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a519-38c4-4f11-8d89-845741f62264 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:30.639745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a519-38c4-4f11-8d89-845741f62264 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:30.640043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a519-38c4-4f11-8d89-845741f62264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:30.641421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7a519-38c4-4f11-8d89-845741f62264 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:30.649041 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 581/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 11 00:49:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:32.831469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3ada-17bd-497f-a1d8-b4c11efc3c99 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:32.832003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3ada-17bd-497f-a1d8-b4c11efc3c99 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:32.832003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3ada-17bd-497f-a1d8-b4c11efc3c99 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:32.833408 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 586/1167] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:32.838797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630420-8011-469f-82c5-bf99f0bb7fd6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:32.839193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630420-8011-469f-82c5-bf99f0bb7fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:32.839338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d630420-8011-469f-82c5-bf99f0bb7fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:32.857851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5d630420-8011-469f-82c5-bf99f0bb7fd6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:32.859014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5d630420-8011-469f-82c5-bf99f0bb7fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:32.934261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 582/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:33.207232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3ada-17bd-497f-a1d8-b4c11efc3c99 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:33.239209 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:33.314862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3ada-17bd-497f-a1d8-b4c11efc3c99 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:33.350016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4d775-6587-4757-b555-d418690aa262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:33.350618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d775-6587-4757-b555-d418690aa262 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:33.350899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d775-6587-4757-b555-d418690aa262 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:33.352717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d775-6587-4757-b555-d418690aa262 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:33.352717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4d775-6587-4757-b555-d418690aa262 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:33.353875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4d775-6587-4757-b555-d418690aa262 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:33.369788 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 587/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sun Sep 11 00:49:33 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:49:35.571821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a260b-1fa8-4d6e-a5f9-e05798691cbf None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.572337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a260b-1fa8-4d6e-a5f9-e05798691cbf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.572434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a260b-1fa8-4d6e-a5f9-e05798691cbf None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.573830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 583/1170] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:35.578950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355e2c1-c4ea-46d7-bd00-e4412d02570d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.579326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355e2c1-c4ea-46d7-bd00-e4412d02570d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.579499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355e2c1-c4ea-46d7-bd00-e4412d02570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.597970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3355e2c1-c4ea-46d7-bd00-e4412d02570d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:35.599170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3355e2c1-c4ea-46d7-bd00-e4412d02570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:35.663850 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 588/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:35.931578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a260b-1fa8-4d6e-a5f9-e05798691cbf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:35.977380 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:36.029598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a260b-1fa8-4d6e-a5f9-e05798691cbf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:36.061827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b3eef-c7ce-4c44-a607-bf610cc4cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:36.062433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3eef-c7ce-4c44-a607-bf610cc4cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:36.062707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3eef-c7ce-4c44-a607-bf610cc4cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:36.062971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3eef-c7ce-4c44-a607-bf610cc4cdd3 None admin] PATH_INFO: `/v3/domains/6cc32974464f4cbcb31ccd2ab25eb18d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:36.072984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b3eef-c7ce-4c44-a607-bf610cc4cdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6cc32974464f4cbcb31ccd2ab25eb18d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:36.074468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b3eef-c7ce-4c44-a607-bf610cc4cdd3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:36.076002 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 584/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 11 00:49:35 2022] GET /identity/v3/domains/6cc32974464f4cbcb31ccd2ab25eb18d => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:36.081926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355e2c1-c4ea-46d7-bd00-e4412d02570d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:36.103469 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:36.179685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355e2c1-c4ea-46d7-bd00-e4412d02570d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:36.212094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11ffe-d63e-4d0c-8f4d-4ccd3e24d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:36.212680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11ffe-d63e-4d0c-8f4d-4ccd3e24d935 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:36.212955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11ffe-d63e-4d0c-8f4d-4ccd3e24d935 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:36.213254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11ffe-d63e-4d0c-8f4d-4ccd3e24d935 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:36.213888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11ffe-d63e-4d0c-8f4d-4ccd3e24d935 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:36.215289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d11ffe-d63e-4d0c-8f4d-4ccd3e24d935 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:36.240435 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 589/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:49:36 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:49:38.388607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafd22-ddd3-49d3-b50d-e4f3328670d2 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:38.389179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafd22-ddd3-49d3-b50d-e4f3328670d2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:38.389179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafd22-ddd3-49d3-b50d-e4f3328670d2 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:38.390550 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 585/1174] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:38.396096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d58b3-7d6a-4131-8ead-d6b25b04c517 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:38.396512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d58b3-7d6a-4131-8ead-d6b25b04c517 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:38.396645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d58b3-7d6a-4131-8ead-d6b25b04c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:38.414582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a11d58b3-7d6a-4131-8ead-d6b25b04c517 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:38.415760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a11d58b3-7d6a-4131-8ead-d6b25b04c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:38.480059 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:38.751808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eafd22-ddd3-49d3-b50d-e4f3328670d2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:38.850995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eafd22-ddd3-49d3-b50d-e4f3328670d2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:38.853275 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:38.885866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6ff4-fc90-4c6c-8e80-bc20d0844744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:38.886479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6ff4-fc90-4c6c-8e80-bc20d0844744 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:38.886752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6ff4-fc90-4c6c-8e80-bc20d0844744 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:38.887020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6ff4-fc90-4c6c-8e80-bc20d0844744 None admin] PATH_INFO: `/v3/domains/6cc32974464f4cbcb31ccd2ab25eb18d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:38.888111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd6ff4-fc90-4c6c-8e80-bc20d0844744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6cc32974464f4cbcb31ccd2ab25eb18d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:38.889553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd6ff4-fc90-4c6c-8e80-bc20d0844744 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:38.891078 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 586/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 11 00:49:38 2022] GET /identity/v3/domains/6cc32974464f4cbcb31ccd2ab25eb18d => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:38.898949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d58b3-7d6a-4131-8ead-d6b25b04c517 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:38.901127 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:38.995237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d58b3-7d6a-4131-8ead-d6b25b04c517 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:39.027382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae74a82-42a1-4d12-86c4-ea16db5865f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:39.027908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74a82-42a1-4d12-86c4-ea16db5865f1 None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:39.028178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74a82-42a1-4d12-86c4-ea16db5865f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:39.028442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae74a82-42a1-4d12-86c4-ea16db5865f1 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:39.029108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae74a82-42a1-4d12-86c4-ea16db5865f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:39.030506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae74a82-42a1-4d12-86c4-ea16db5865f1 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:39.052277 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 591/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:49:38 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:49:41.240719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3493d-0b5f-4c4b-b620-2a8289cd4648 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:41.241312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3493d-0b5f-4c4b-b620-2a8289cd4648 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:41.241312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3493d-0b5f-4c4b-b620-2a8289cd4648 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:41.242633 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 587/1178] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:41.247835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728ad27-e144-46fe-9e3f-b9ad1003fd2b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:41.248211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728ad27-e144-46fe-9e3f-b9ad1003fd2b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:41.248379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728ad27-e144-46fe-9e3f-b9ad1003fd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:41.269689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7728ad27-e144-46fe-9e3f-b9ad1003fd2b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:41.271372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7728ad27-e144-46fe-9e3f-b9ad1003fd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:41.324709 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:41.339598 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 592/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:49:41.606260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3493d-0b5f-4c4b-b620-2a8289cd4648 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:41.705456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3493d-0b5f-4c4b-b620-2a8289cd4648 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:41.738144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:41.738748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:41.739052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:41.739972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:41.749529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:49:41.754212 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:49:41.755342 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:49:41.756410 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 588/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:49:41.761495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728ad27-e144-46fe-9e3f-b9ad1003fd2b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:41.855646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728ad27-e144-46fe-9e3f-b9ad1003fd2b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:41.888210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:41.888808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:41.889107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:41.889382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:41.890032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:41.890330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:41.891668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:41.900045 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 593/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:41.905848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:41.936306 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:42.002344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56d12e-451a-421a-8b3a-c220930ca666 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:42.035144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:42.035741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:42.036633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:42.037028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] PATH_INFO: `/v3/users/593823cba8dc4c05975b6ede5ce1c3c9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:42.049341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] RBAC: Authorizing `identity:get_user(user_id=593823cba8dc4c05975b6ede5ce1c3c9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:42.050756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:42.052513 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 589/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:41 2022] GET /identity/v3/users/593823cba8dc4c05975b6ede5ce1c3c9 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:42.058213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:42.107728 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:42.158638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1062a-2a97-48c4-ae62-ca8f6f2a472a None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:42.191295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:42.191881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:42.192845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:42.193529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:42.259352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:42.260766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:42.308272 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:42.357793 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 594/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:49:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:42.363631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:42.450990 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:42.460763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cd5d6-4c5a-4bb5-a328-6c25d64f40f6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:42.493966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d327a5-f912-4198-8ea9-2c0cdf2d3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:42.494580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d327a5-f912-4198-8ea9-2c0cdf2d3900 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:42.494857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d327a5-f912-4198-8ea9-2c0cdf2d3900 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:42.495129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d327a5-f912-4198-8ea9-2c0cdf2d3900 None admin] PATH_INFO: `/v3/projects/612744e68b7545e180e5b31f79d353ef` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:42.496226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d327a5-f912-4198-8ea9-2c0cdf2d3900 None admin] RBAC: Authorizing `identity:get_project(project_id=612744e68b7545e180e5b31f79d353ef)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:42.497674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d327a5-f912-4198-8ea9-2c0cdf2d3900 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:42.499311 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 590/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:42 2022] GET /identity/v3/projects/612744e68b7545e180e5b31f79d353ef => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:42.505452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:42.601068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a82a2-6d9b-4fa8-99fe-0a5ba1045056 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:42.633881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134c13d-69d0-423a-b985-69b38f562ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:42.634414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134c13d-69d0-423a-b985-69b38f562ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:42.634692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134c13d-69d0-423a-b985-69b38f562ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:42.634965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134c13d-69d0-423a-b985-69b38f562ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:42.635682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134c13d-69d0-423a-b985-69b38f562ff4 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=612744e68b7545e180e5b31f79d353ef, user.id=593823cba8dc4c05975b6ede5ce1c3c9) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:42.635990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134c13d-69d0-423a-b985-69b38f562ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:42.637428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134c13d-69d0-423a-b985-69b38f562ff4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:42.642561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 595/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:49:42 2022] GET /identity/v3/role_assignments?user.id=593823cba8dc4c05975b6ede5ce1c3c9&scope.project.id=612744e68b7545e180e5b31f79d353ef&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:44.799688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899a0ef-54fb-4973-98e9-c2c720386518 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:44.800208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899a0ef-54fb-4973-98e9-c2c720386518 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:44.800208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899a0ef-54fb-4973-98e9-c2c720386518 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:44.802112 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 591/1186] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:44.807557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2ad1c-d0df-49e9-946f-5a5e5967d4d3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:44.807959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2ad1c-d0df-49e9-946f-5a5e5967d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:44.808096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2ad1c-d0df-49e9-946f-5a5e5967d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:44.825878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eaa2ad1c-d0df-49e9-946f-5a5e5967d4d3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:44.827038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eaa2ad1c-d0df-49e9-946f-5a5e5967d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:44.835971 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:44.891233 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 596/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:45.167748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899a0ef-54fb-4973-98e9-c2c720386518 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:45.265820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899a0ef-54fb-4973-98e9-c2c720386518 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:45.299959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:45.300580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:45.300854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:45.301150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:45.311740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:49:45.316477 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:49:45.317689 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:49:45.318987 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 592/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:49:45.323928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2ad1c-d0df-49e9-946f-5a5e5967d4d3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:45.422004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2ad1c-d0df-49e9-946f-5a5e5967d4d3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:45.455420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:45.456016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:45.456292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:45.456559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:45.457243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:45.457546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:45.459478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:45.467139 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 597/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:45.472896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:45.493265 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:45.572116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c48eab-b1e3-4232-9a15-302a89be81c0 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:45.604443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:45.605087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:45.605366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:45.605635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] PATH_INFO: `/v3/users/593823cba8dc4c05975b6ede5ce1c3c9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:45.606838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] RBAC: Authorizing `identity:get_user(user_id=593823cba8dc4c05975b6ede5ce1c3c9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:45.612319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:45.614029 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 593/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:45 2022] GET /identity/v3/users/593823cba8dc4c05975b6ede5ce1c3c9 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:45.620740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:45.630580 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:45.722662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914d15-e195-4187-9ba8-4622047ba55c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:45.756394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d17018-6167-4d42-ac2b-20cbf1e534bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:45.757015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17018-6167-4d42-ac2b-20cbf1e534bd None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:45.757333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17018-6167-4d42-ac2b-20cbf1e534bd None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:45.757605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17018-6167-4d42-ac2b-20cbf1e534bd None admin] PATH_INFO: `/v3/projects/612744e68b7545e180e5b31f79d353ef` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:45.758720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d17018-6167-4d42-ac2b-20cbf1e534bd None admin] RBAC: Authorizing `identity:get_project(project_id=612744e68b7545e180e5b31f79d353ef)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:45.760134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d17018-6167-4d42-ac2b-20cbf1e534bd None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:45.761774 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 598/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:45 2022] GET /identity/v3/projects/612744e68b7545e180e5b31f79d353ef => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:45.767680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:45.851421 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:45.866428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4b86-5e7b-4476-9976-7f57ff8ad2ea None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:45.899976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c91a4-c342-474a-8b34-7b353e82d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:45.900608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c91a4-c342-474a-8b34-7b353e82d279 None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:45.900885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c91a4-c342-474a-8b34-7b353e82d279 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:45.901184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c91a4-c342-474a-8b34-7b353e82d279 None admin] PATH_INFO: `/v3/projects/612744e68b7545e180e5b31f79d353ef/users/593823cba8dc4c05975b6ede5ce1c3c9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:45.903049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c91a4-c342-474a-8b34-7b353e82d279 None admin] RBAC: Authorizing `identity:create_grant(project_id=612744e68b7545e180e5b31f79d353ef, user_id=593823cba8dc4c05975b6ede5ce1c3c9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:45.904450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c91a4-c342-474a-8b34-7b353e82d279 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:45.917749 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 594/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:49:45 2022] PUT /identity/v3/projects/612744e68b7545e180e5b31f79d353ef/users/593823cba8dc4c05975b6ede5ce1c3c9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:49:48.037674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deabae9-50fb-4987-bd21-45ad3b1201e7 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:48.038237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deabae9-50fb-4987-bd21-45ad3b1201e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:48.038237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deabae9-50fb-4987-bd21-45ad3b1201e7 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:48.039523 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 599/1193] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:48.044932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39520-4d33-44aa-8283-a6bd114f9cb6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:48.045344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39520-4d33-44aa-8283-a6bd114f9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:48.045513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39520-4d33-44aa-8283-a6bd114f9cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:48.063611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-19d39520-4d33-44aa-8283-a6bd114f9cb6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:48.064807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-19d39520-4d33-44aa-8283-a6bd114f9cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:48.129260 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 595/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:49:48.399039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deabae9-50fb-4987-bd21-45ad3b1201e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:48.474265 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:48.500345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deabae9-50fb-4987-bd21-45ad3b1201e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:48.533104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:48.533733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:48.534010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:48.534276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:48.546154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:49:48.550895 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:49:48.553148 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:49:48.554350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 600/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:49:48.558579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39520-4d33-44aa-8283-a6bd114f9cb6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:48.631505 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:48.655215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39520-4d33-44aa-8283-a6bd114f9cb6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:48.687749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:48.688333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:48.688606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:48.688872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:48.689545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:48.689843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:48.691186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:48.698830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 596/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:49:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:48.704757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:48.801075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed06ad0-3806-47cb-8124-ee55b5382bdb None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:48.833780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:48.834387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:48.834665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:48.834936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] PATH_INFO: `/v3/users/593823cba8dc4c05975b6ede5ce1c3c9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:48.836058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] RBAC: Authorizing `identity:get_user(user_id=593823cba8dc4c05975b6ede5ce1c3c9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:48.837499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:48.839044 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 601/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 11 00:49:48 2022] GET /identity/v3/users/593823cba8dc4c05975b6ede5ce1c3c9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:48.844643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:48.942090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd392e0-ffa7-402e-954e-fd3db8805552 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:48.974864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:48.975445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:48.975719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:48.975985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:48.983962 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:49.039949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:49.041389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:49.134408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 597/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:49:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:49:49.140324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:49.143396 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:49.236665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e35c4-982a-448f-983c-a6d0cb031044 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:49.268552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e828d2a-7805-4bd0-b644-fc846bd043b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:49.269191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828d2a-7805-4bd0-b644-fc846bd043b0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:49.269470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828d2a-7805-4bd0-b644-fc846bd043b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:49.269738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828d2a-7805-4bd0-b644-fc846bd043b0 None admin] PATH_INFO: `/v3/projects/612744e68b7545e180e5b31f79d353ef` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:49.271666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e828d2a-7805-4bd0-b644-fc846bd043b0 None admin] RBAC: Authorizing `identity:get_project(project_id=612744e68b7545e180e5b31f79d353ef)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:49.273074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e828d2a-7805-4bd0-b644-fc846bd043b0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:49.274681 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 602/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 11 00:49:49 2022] GET /identity/v3/projects/612744e68b7545e180e5b31f79d353ef => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:49:49.280741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:49.318888 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:49.375479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d6c29-8dde-4a68-b521-a3e0c0beda12 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:49.408311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c6f6e-551e-4692-b7bb-e3022b82ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:49.408891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6f6e-551e-4692-b7bb-e3022b82ff1b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:49.409190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6f6e-551e-4692-b7bb-e3022b82ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:49.409458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6f6e-551e-4692-b7bb-e3022b82ff1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:49.410155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c6f6e-551e-4692-b7bb-e3022b82ff1b None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=612744e68b7545e180e5b31f79d353ef, user.id=593823cba8dc4c05975b6ede5ce1c3c9) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:49:49.410453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c6f6e-551e-4692-b7bb-e3022b82ff1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:49.411884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c6f6e-551e-4692-b7bb-e3022b82ff1b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:49.417409 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 598/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:49:49 2022] GET /identity/v3/role_assignments?user.id=593823cba8dc4c05975b6ede5ce1c3c9&scope.project.id=612744e68b7545e180e5b31f79d353ef&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:49:59.264749 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=65 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:59.415445 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=49 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:45.297974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7e4f-ed3b-4aa9-ae19-04e70574112f None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:45.298856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7e4f-ed3b-4aa9-ae19-04e70574112f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:45.298856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf7e4f-ed3b-4aa9-ae19-04e70574112f None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:45.299993 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 603/1201] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:45.306154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24aef-dcf9-4833-8f1d-616ebe57df77 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:45.306656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24aef-dcf9-4833-8f1d-616ebe57df77 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:45.306736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24aef-dcf9-4833-8f1d-616ebe57df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:45.325809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4bb24aef-dcf9-4833-8f1d-616ebe57df77 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:45.326994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4bb24aef-dcf9-4833-8f1d-616ebe57df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:45.416398 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 599/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:50:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:50:45.695942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf7e4f-ed3b-4aa9-ae19-04e70574112f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:45.824456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf7e4f-ed3b-4aa9-ae19-04e70574112f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:45.870348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:45.870602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:45.870770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:45.871065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:45.886571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:45.888233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:50:45.906509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:45.907638 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:50:45.908642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:50:45.908642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:45.908642 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:50:45.908642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 604/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:45.917089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb24aef-dcf9-4833-8f1d-616ebe57df77 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:46.038326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb24aef-dcf9-4833-8f1d-616ebe57df77 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:46.078618 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:46.086756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e268a0-64ca-4b0c-8742-637a67a8f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:46.087452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e268a0-64ca-4b0c-8742-637a67a8f7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:46.087658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e268a0-64ca-4b0c-8742-637a67a8f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:46.088074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e268a0-64ca-4b0c-8742-637a67a8f7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:46.088751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e268a0-64ca-4b0c-8742-637a67a8f7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:46.089256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e268a0-64ca-4b0c-8742-637a67a8f7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:46.090649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e268a0-64ca-4b0c-8742-637a67a8f7c3 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:46.104319 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 600/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:46.110471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:46.177435 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:46.254387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507392c-0457-4abb-853e-3ecc97220c88 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:46.303088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421888e-1caa-4d7c-a09a-d637a8baaa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:46.303760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421888e-1caa-4d7c-a09a-d637a8baaa5c None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:46.304004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421888e-1caa-4d7c-a09a-d637a8baaa5c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:46.304188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421888e-1caa-4d7c-a09a-d637a8baaa5c None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:46.304808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421888e-1caa-4d7c-a09a-d637a8baaa5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:46.306336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421888e-1caa-4d7c-a09a-d637a8baaa5c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:46.332229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 605/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 11 00:50:46 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:50:48.796597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024b99-29e8-4286-b1fa-1e123b8b288a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:48.797149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024b99-29e8-4286-b1fa-1e123b8b288a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:48.797149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024b99-29e8-4286-b1fa-1e123b8b288a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:48.798591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 601/1206] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:48.805648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2dab-cb3b-4095-b1f3-aa928f959117 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:48.806103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2dab-cb3b-4095-b1f3-aa928f959117 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:48.806191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2dab-cb3b-4095-b1f3-aa928f959117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:48.827797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6b3c2dab-cb3b-4095-b1f3-aa928f959117 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:48.829295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b3c2dab-cb3b-4095-b1f3-aa928f959117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:48.911307 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:50:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:50:49.201538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f024b99-29e8-4286-b1fa-1e123b8b288a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:49.347435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f024b99-29e8-4286-b1fa-1e123b8b288a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:49.392789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:49.393831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:49.394924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:49.395398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:49.407466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:50:49.413203 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:49.414447 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:50:49.415524 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:49.417250 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 602/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:50:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:49.422798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c2dab-cb3b-4095-b1f3-aa928f959117 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:49.471744 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:49.552016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c2dab-cb3b-4095-b1f3-aa928f959117 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:49.589756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:49.590508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:49.590957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:49.591232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:49.591994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:49.592335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:49.593794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:49.603416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 607/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:49.610112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:49.683562 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:49.750908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95f072-2daa-405c-a844-0b1f93efd12f None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:49.813778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:49.814505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:49.814941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:49.815267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:49.828736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:49.830462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:50:49.847662 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:49.848899 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:50:49.850078 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:50:49.850078 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:49.850078 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:49.850607 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 603/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:50:49.857097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:49.965282 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:49.970065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8863a2-8df4-4116-81d9-ff53ab7cd4e3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:50.009288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:50.009922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:50.010294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:50.010650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:50.011371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:50.011771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:50.013275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:50.030676 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 608/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:50.036499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:50.150332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a29a-bf13-4f46-a790-d6a289c2f49b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:50.152053 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:50.188584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:50.189366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:50.191806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:50.191806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:50.198698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:50.200208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:50:50.212816 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:50.214067 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:50.215201 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 604/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:50.219793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:50.338188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c46a-b922-4b7f-9205-b666710fac60 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:50.375536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:50.376242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:50.376581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:50.376771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:50.377522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:50.377831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:50.379905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:50.399572 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 609/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 00:50:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:50.405446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:50.529262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add0819-8c2a-4668-8e2b-6a0ea90503d2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:50.567722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:50.568327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:50.568604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:50.568878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:50.602446 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:50.645187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:50.646904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:50.772495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 605/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:50:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:50:50.778487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:50.801255 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:50.898249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8e2f-2700-4b9e-b582-ff3673e466c3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:50.939524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:50.940176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:50.940435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:50.940743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:50.951568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:50.953104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:50:50.973082 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:50.974571 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:50:50.975669 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:50:50.975669 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:50.975669 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:50:50.976747 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 610/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:50.984069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:51.050147 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:51.096181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70323a-6ae2-43dd-b706-c07474a53391 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:51.135763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:51.136308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:51.136595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:51.136848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:51.137501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:51.137798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:51.139160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:51.154332 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 606/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:51.160462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:51.246475 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:51.286519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741ff49-bda9-42c9-8f5d-ed3d61312172 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:51.330967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:51.332858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:51.333415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:51.333813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:51.343289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:51.345185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:50:51.360051 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:51.361146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:50:51.367311 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 611/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:51.367832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:51.482664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5336-95d9-420b-b5e1-b8e705de6cc7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:51.509746 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:51.526009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316ad8-5d55-456f-93a3-834464b5b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:51.526639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316ad8-5d55-456f-93a3-834464b5b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:51.526913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316ad8-5d55-456f-93a3-834464b5b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:51.529742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316ad8-5d55-456f-93a3-834464b5b8b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:51.529742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316ad8-5d55-456f-93a3-834464b5b8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:51.529742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316ad8-5d55-456f-93a3-834464b5b8b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:51.529742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316ad8-5d55-456f-93a3-834464b5b8b9 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:51.546535 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 607/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:50:51.553308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:51.673327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2cef3-0fc6-43e4-ade0-a537b30a7fe2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:51.706302 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:51.715462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f84103-3199-4b0a-aca2-a82b205c29dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:51.716154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f84103-3199-4b0a-aca2-a82b205c29dc None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:51.716497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f84103-3199-4b0a-aca2-a82b205c29dc None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:51.716827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f84103-3199-4b0a-aca2-a82b205c29dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:51.717660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f84103-3199-4b0a-aca2-a82b205c29dc None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=639fb5545d5a475b9c8bd973c3af520a) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:51.718039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f84103-3199-4b0a-aca2-a82b205c29dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:51.719510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f84103-3199-4b0a-aca2-a82b205c29dc None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:51.736241 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 612/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:50:51 2022] GET /identity/v3/role_assignments?user.id=639fb5545d5a475b9c8bd973c3af520a&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:50:53.908707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a062a-f3b1-474e-ab9a-a15ee9f3c3b3 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:53.909252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a062a-f3b1-474e-ab9a-a15ee9f3c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:53.909252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a062a-f3b1-474e-ab9a-a15ee9f3c3b3 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:53.910645 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 608/1220] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:53.916079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7062-4df3-49a3-a1e0-0072369dadb1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:53.916574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7062-4df3-49a3-a1e0-0072369dadb1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:53.916675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7062-4df3-49a3-a1e0-0072369dadb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:53.935470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f13e7062-4df3-49a3-a1e0-0072369dadb1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:53.936611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f13e7062-4df3-49a3-a1e0-0072369dadb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:54.004846 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 613/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:50:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:50:54.322372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a062a-f3b1-474e-ab9a-a15ee9f3c3b3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:54.429123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a062a-f3b1-474e-ab9a-a15ee9f3c3b3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:54.464525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:54.465358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:54.465665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:54.465955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:54.478987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:50:54.485860 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:54.488651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:50:54.490613 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:54.493696 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 609/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:54.495031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7062-4df3-49a3-a1e0-0072369dadb1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:54.606006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7062-4df3-49a3-a1e0-0072369dadb1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:54.630548 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:54.641762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:54.642363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:54.642640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:54.642906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:54.643556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:54.643853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:54.645726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:54.653936 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 614/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:54.659690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:54.707165 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:54.766453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051abb-ee50-4e3f-8938-cff4c6333bef None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:54.801782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:54.802443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:54.802729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:54.802995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:54.813004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:54.814459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:50:54.829579 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:54.830764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:50:54.832700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:50:54.832700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:54.832700 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:54.832700 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 610/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:54.837186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:54.951792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18da737-b251-486f-b439-c102302ff9e7 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:54.989641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:54.990241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:54.990521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:54.990790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:54.991422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:54.991721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:54.994563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:55.009977 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 615/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:55.016683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:55.127974 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:55.138240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207f1ef-be24-4114-96e1-a088d1d0b2e8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:55.177054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:55.177695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:55.177996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:55.178304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:55.186567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:55.187989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:50:55.201436 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:55.202703 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:55.203868 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 611/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:55.209614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:55.259750 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:55.334248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94bb07-479a-44a1-a58e-486b93127d39 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:55.378125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:55.379001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:55.379278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:55.379547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:55.380261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:55.380631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:55.382164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:55.402060 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 616/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 00:50:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:50:55.408050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:55.520897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4df1d-756d-455f-a3f9-b23cf5055f08 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:55.560106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:55.560753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:55.561048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:55.561388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:55.573375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:55.574810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:50:55.590736 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:55.592137 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:50:55.593190 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:50:55.593190 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:55.593190 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:55.593190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 612/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:50:55.599254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:55.712799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98300088-07e7-4ff6-b3f7-dea8002dc9e3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:55.715351 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:55.751715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:55.752392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:55.752662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:55.753024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:55.753794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:55.754130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:55.755488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:55.766637 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 617/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:50:55.773373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:55.782760 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:55.885388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec67b4-661f-4eff-ae47-9cf79c67b6ef None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:55.921441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:55.922073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:55.922350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:55.922640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:55.929895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:55.931427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:50:55.943375 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:55.944491 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:50:55.945587 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 613/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:55.950880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:56.063601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3391cf4-bbc4-4903-845f-30d1da475696 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:56.100622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787a18c-81fd-4474-be0b-555a4b3fde6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:56.101300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a18c-81fd-4474-be0b-555a4b3fde6b None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:56.101644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a18c-81fd-4474-be0b-555a4b3fde6b None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:56.101931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a18c-81fd-4474-be0b-555a4b3fde6b None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:56.102637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787a18c-81fd-4474-be0b-555a4b3fde6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:56.102938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787a18c-81fd-4474-be0b-555a4b3fde6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:56.104916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787a18c-81fd-4474-be0b-555a4b3fde6b None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:56.118939 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 618/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:56.125640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:56.204334 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:56.246246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6256c-c911-4a3d-bb60-c4147faa7d76 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:56.284369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b2335-f871-4a29-9399-58f02988888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:56.285224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b2335-f871-4a29-9399-58f02988888e None admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:56.285446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b2335-f871-4a29-9399-58f02988888e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:56.285726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b2335-f871-4a29-9399-58f02988888e None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/639fb5545d5a475b9c8bd973c3af520a/roles/bb0dba2691804589a999e0f81f843412` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:56.301434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b2335-f871-4a29-9399-58f02988888e None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=639fb5545d5a475b9c8bd973c3af520a, role_id=bb0dba2691804589a999e0f81f843412)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:56.302837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b2335-f871-4a29-9399-58f02988888e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:56.315128 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:50:56 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/639fb5545d5a475b9c8bd973c3af520a/roles/bb0dba2691804589a999e0f81f843412 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:50:58.601380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76ffb9-bf69-4863-b70e-fde98cc1337e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:58.601944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76ffb9-bf69-4863-b70e-fde98cc1337e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:58.601944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76ffb9-bf69-4863-b70e-fde98cc1337e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:58.603439 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 619/1233] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:58.609371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde97b3-5907-49b7-8980-55cf5d0e54bf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:58.609770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde97b3-5907-49b7-8980-55cf5d0e54bf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:58.610030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde97b3-5907-49b7-8980-55cf5d0e54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:58.630467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6fde97b3-5907-49b7-8980-55cf5d0e54bf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:58.631809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6fde97b3-5907-49b7-8980-55cf5d0e54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:58.714809 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:50:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:50:59.025363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76ffb9-bf69-4863-b70e-fde98cc1337e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:59.054208 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:59.157440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76ffb9-bf69-4863-b70e-fde98cc1337e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:59.199221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:59.199940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:59.200223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:59.200550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:59.212911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:50:59.218459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:59.219535 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:50:59.220401 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:50:59.226964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde97b3-5907-49b7-8980-55cf5d0e54bf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:59.228954 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 620/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 11 00:50:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:59.281344 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:59.348175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde97b3-5907-49b7-8980-55cf5d0e54bf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:59.393014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:59.393717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:59.394402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:59.394754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:59.395456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:59.395795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:59.397624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:59.410089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 616/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 11 00:50:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:50:59.419060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:59.510833 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:59.528933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc790b-c201-4af5-9825-c9cfffc62f74 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:59.568708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:59.569401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:59.569757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:59.570096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:59.580724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:59.582344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:50:59.599307 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:59.600675 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:50:59.602440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:50:59.602440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:50:59.602440 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:50:59.602440 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 621/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:59.606563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:59.715740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ddc5-a10f-4ce4-bc05-03d5ee4f0ba2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:59.726061 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:59.755322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:59.756023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:59.756345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:59.756626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:59.757300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:50:59.757603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:59.759054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:59.774062 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 617/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:50:59.779957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:59.884536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c592-625c-4b2e-b33b-7906da3206a4 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:59.919505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:59.920142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:59.920413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:59.920677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:59.923619 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:59.929441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:59.931121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:50:59.943519 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:50:59.944771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:50:59.946014 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 622/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:50:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:50:59.951250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:00.061358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bb43-598a-464a-ad2d-882a32611a78 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:00.100280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:00.100976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:00.101281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:00.101624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:00.102347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:00.102649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:00.104102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:00.124212 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 618/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 00:50:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:00.130582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:00.244355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3ec5-8a90-4bb2-8ae8-6dc6fcde15bf None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:00.280698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:00.281370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:00.281643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:00.281936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:00.351905 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:00.359049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:00.360554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:00.470389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 623/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:51:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:51:00.478747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:00.512924 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:00.601402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea22cd-2624-40b4-bc93-9b0257cc93f7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:00.635917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:00.636541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:00.636818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:00.637221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:00.647788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:00.649514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:51:00.666101 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:00.667369 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:51:00.668728 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:51:00.668728 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:00.668728 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:00.672875 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 619/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:00.674175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:00.785237 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:00.794945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89b219-9fb0-4076-b081-e580a17a67d9 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:00.840184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:00.840851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:00.841229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:00.841578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:00.842215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:00.842529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:00.844007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:00.856348 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 624/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:00.862924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:00.956353 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:00.981708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4df44-6086-4f1a-a50d-d4435740b1a6 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:01.019780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:01.020689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:01.020969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:01.021271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:01.028370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:01.029827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:51:01.041583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:01.042660 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:01.043993 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 620/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:01.049496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:01.164679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816d8b6-a771-4c1c-8550-1d3d7f5e0a97 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:01.211611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965bac-dc98-4512-8fcc-9384e451e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:01.212526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965bac-dc98-4512-8fcc-9384e451e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:01.212806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965bac-dc98-4512-8fcc-9384e451e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:01.213102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965bac-dc98-4512-8fcc-9384e451e6b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:01.213860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965bac-dc98-4512-8fcc-9384e451e6b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:01.214169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965bac-dc98-4512-8fcc-9384e451e6b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:01.215758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965bac-dc98-4512-8fcc-9384e451e6b0 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:01.229120 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 625/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:01.235641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:01.344731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdbcc4-9fca-4eb4-b196-0565ccea6eaa None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:01.381322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255541-4539-453c-bcd3-e095d0e75d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:01.381958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255541-4539-453c-bcd3-e095d0e75d4b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:01.382304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255541-4539-453c-bcd3-e095d0e75d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:01.382641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255541-4539-453c-bcd3-e095d0e75d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:01.383440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255541-4539-453c-bcd3-e095d0e75d4b None admin] RBAC: Adding query filter params (role.id=bb0dba2691804589a999e0f81f843412, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=639fb5545d5a475b9c8bd973c3af520a) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:01.383798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255541-4539-453c-bcd3-e095d0e75d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:01.385502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255541-4539-453c-bcd3-e095d0e75d4b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:01.392203 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 621/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:51:01 2022] GET /identity/v3/role_assignments?user.id=639fb5545d5a475b9c8bd973c3af520a&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=bb0dba2691804589a999e0f81f843412 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:51:03.825198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12486-3414-4a60-b96c-3d350e355038 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:03.825198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12486-3414-4a60-b96c-3d350e355038 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:03.825840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12486-3414-4a60-b96c-3d350e355038 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:03.826855 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 626/1247] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:03.832773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656df09-daff-4e8e-b390-18b162b262dc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:03.833330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656df09-daff-4e8e-b390-18b162b262dc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:03.833557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656df09-daff-4e8e-b390-18b162b262dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:03.840787 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:03.855879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1656df09-daff-4e8e-b390-18b162b262dc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:03.857193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1656df09-daff-4e8e-b390-18b162b262dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:03.943392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 622/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:51:04.252461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e12486-3414-4a60-b96c-3d350e355038 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:04.271798 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:04.373659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e12486-3414-4a60-b96c-3d350e355038 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:04.413711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:04.414339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:04.414617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:04.414885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:04.424889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:51:04.430275 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:04.431459 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:04.432514 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 627/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:04.437409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656df09-daff-4e8e-b390-18b162b262dc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:04.557946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656df09-daff-4e8e-b390-18b162b262dc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:04.592061 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:04.598737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:04.599426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:04.599708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:04.600103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:04.600792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:04.601215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:04.602755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:04.615850 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 623/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:04.621649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:04.708642 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:04.735290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd27561-a2ff-4d8e-8f05-062eda43aaca None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:04.776822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:04.777663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:04.778085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:04.778459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:04.789362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:04.790797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:51:04.808704 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:04.810460 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:51:04.811605 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:51:04.811605 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:04.811605 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:04.811605 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 628/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:51:04.816058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:04.920569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857d34-2672-4f3b-83d3-e5f41355cf0e None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:04.956644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:04.957276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:04.957556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:04.957828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:04.958498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:04.958848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:04.960385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:04.979744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 624/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:51:04.980915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:05.102472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289be2-0dbc-4eab-9cf7-7957b3162fe2 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:05.135433 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:05.144066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:05.144786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:05.145096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:05.145354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:05.153625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:05.155071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:51:05.166545 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:05.167906 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:05.169276 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 629/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:05.173489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:05.231774 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:05.279703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fec957-84c1-4ff9-9c93-2a6581e820f2 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:05.322664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:05.323175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:05.323450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:05.323718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:05.324439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:05.324741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:05.326231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:05.343164 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 625/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 00:51:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:51:05.349489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:05.466145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbad01-ab2a-41d3-8ed1-088f55037e56 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:05.503181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:05.503853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:05.504127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:05.504390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:05.564973 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:05.579090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:05.580776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:05.691720 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:51:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:51:05.697614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:05.806739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae527c-85e3-490d-9279-d4b70ce2d5e7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:05.822532 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:05.847703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:05.848328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:05.848598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:05.848900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:05.860263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:05.861841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:51:05.877580 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:05.878848 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:51:05.879874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:51:05.879874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:05.879874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:05.879874 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 626/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:05.884909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:05.979511 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:05.992672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdda1fb-5324-44c4-b61f-2702136e6237 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:06.027849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:06.028459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:06.028730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:06.028995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:06.029661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:06.029959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:06.031308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:06.049289 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 631/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:06.050913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:06.163485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdfab8-2d50-42ab-a0f5-6b679452cdc8 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:06.199592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:06.200239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:06.200517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:06.200787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:06.208581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:06.210085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:51:06.223010 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:06.224150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:06.230150 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 627/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:06.230741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:06.335540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40656ed0-bb23-4746-8948-dbd5e2f7cdd3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:06.370093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd82ce-9ee8-460c-8f00-26f34ef22e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:06.370692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd82ce-9ee8-460c-8f00-26f34ef22e21 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:06.370965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd82ce-9ee8-460c-8f00-26f34ef22e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:06.371231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd82ce-9ee8-460c-8f00-26f34ef22e21 None admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:06.371917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd82ce-9ee8-460c-8f00-26f34ef22e21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:06.372213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd82ce-9ee8-460c-8f00-26f34ef22e21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:06.373658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd82ce-9ee8-460c-8f00-26f34ef22e21 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:06.385712 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 632/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:06.391572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:06.420218 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:06.499226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be1ad-ad0b-4db2-9f6e-a12b908cd939 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:06.535519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea17c2-cc72-4046-9e02-f95d6a2343d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:06.536124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea17c2-cc72-4046-9e02-f95d6a2343d7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:06.536400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea17c2-cc72-4046-9e02-f95d6a2343d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:06.536670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea17c2-cc72-4046-9e02-f95d6a2343d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:06.537424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea17c2-cc72-4046-9e02-f95d6a2343d7 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=639fb5545d5a475b9c8bd973c3af520a) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:06.537729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea17c2-cc72-4046-9e02-f95d6a2343d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:06.539146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea17c2-cc72-4046-9e02-f95d6a2343d7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:06.544918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 628/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:51:06 2022] GET /identity/v3/role_assignments?user.id=639fb5545d5a475b9c8bd973c3af520a&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:08.689327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217f34-d09a-40f5-9968-2e0fe742783b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:08.689875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217f34-d09a-40f5-9968-2e0fe742783b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:08.689875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217f34-d09a-40f5-9968-2e0fe742783b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:08.691346 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 633/1261] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:08.696347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e1f68-91df-4851-b414-5088342f4d49 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:08.696749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e1f68-91df-4851-b414-5088342f4d49 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:08.696896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e1f68-91df-4851-b414-5088342f4d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:08.715386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-582e1f68-91df-4851-b414-5088342f4d49 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:08.716571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-582e1f68-91df-4851-b414-5088342f4d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:08.781419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 629/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:51:09.049648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217f34-d09a-40f5-9968-2e0fe742783b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:09.060507 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:09.157130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217f34-d09a-40f5-9968-2e0fe742783b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:09.194009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:09.194634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:09.194910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:09.195177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:09.205018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:51:09.211000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:09.212146 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:09.213174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 634/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:09.218120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e1f68-91df-4851-b414-5088342f4d49 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:09.235957 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:09.314407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e1f68-91df-4851-b414-5088342f4d49 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:09.348083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:09.348678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:09.348952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:09.349255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:09.349910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:09.350211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:09.351561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:09.359508 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 630/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:09.365825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:09.430177 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:09.462736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5e36f-32b3-4850-9903-94be92d473b0 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:09.496763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:09.497401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:09.497676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:09.497941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:09.508608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:09.510046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:51:09.524268 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:09.525397 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:51:09.526328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:51:09.526328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:09.526328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:09.529215 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 635/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:09.531045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:09.609213 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:09.629719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af828a-391d-4836-b50f-c52a051a870b None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:09.662248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:09.662838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:09.663115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:09.663386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:09.664010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:09.664311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:09.665694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:09.677514 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 631/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:09.683315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:09.781193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6dc79-3d9c-43d8-9777-167e66a64010 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:09.801246 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:09.815045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:09.815700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:09.815987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:09.816250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:09.823438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:09.824849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:51:09.835687 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:09.841050 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:09.842183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 636/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:09.842790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:09.939306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2260681-afbc-4804-911d-656bc01b0199 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:09.972778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:09.973396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:09.973674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:09.973941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:09.974651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:09.974953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:09.976356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:09.984752 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:09.993924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 632/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 00:51:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:09.999677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:10.095607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c53389-6eeb-4f71-bf6c-7ac28acd0803 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:10.133900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:10.134660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:10.135051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:10.135372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:10.148789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:10.150256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:51:10.164634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:10.165610 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:51:10.166587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:51:10.166587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:10.166587 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:10.166587 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 637/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:10.171445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:10.267178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c6378-b56e-4190-ba5b-905329c6d0b1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:10.300870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:10.301484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:10.301765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:10.302035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:10.302661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:10.302964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:10.304307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:10.315154 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 633/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:10.321254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:10.352646 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:10.418785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e42d9-0cc3-4cf0-92a9-ae11d87ed959 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:10.450850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:10.451459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:10.451733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:10.451997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:10.458932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:10.460348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:51:10.471249 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:10.473030 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:10.474012 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 638/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:51:10.478820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:10.536281 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:10.577184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f846-e2f2-4bcc-bac3-1eb73a1dcf74 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:10.609720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bd5cf-bf90-4ae3-9276-1554ade24acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:10.610311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bd5cf-bf90-4ae3-9276-1554ade24acc None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:10.610588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bd5cf-bf90-4ae3-9276-1554ade24acc None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:10.610856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bd5cf-bf90-4ae3-9276-1554ade24acc None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:10.611532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bd5cf-bf90-4ae3-9276-1554ade24acc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:10.611835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bd5cf-bf90-4ae3-9276-1554ade24acc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:10.613301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bd5cf-bf90-4ae3-9276-1554ade24acc None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:10.625431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 634/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:10.632071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:10.722266 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:10.731494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da947ee-dd37-45d4-b91c-9c5ec105a4ef None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:10.764011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae78e6f-5617-4012-bbf9-009ed2301178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:10.764648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e6f-5617-4012-bbf9-009ed2301178 None admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:10.764924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e6f-5617-4012-bbf9-009ed2301178 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:10.765222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e6f-5617-4012-bbf9-009ed2301178 None admin] PATH_INFO: `/v3/projects/3ae874a8b86641ac95888a289db15c54/users/639fb5545d5a475b9c8bd973c3af520a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:10.767092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae78e6f-5617-4012-bbf9-009ed2301178 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae874a8b86641ac95888a289db15c54, user_id=639fb5545d5a475b9c8bd973c3af520a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:10.768495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae78e6f-5617-4012-bbf9-009ed2301178 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:10.780653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 11 00:51:10 2022] PUT /identity/v3/projects/3ae874a8b86641ac95888a289db15c54/users/639fb5545d5a475b9c8bd973c3af520a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:51:12.929299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf4259-fcb8-422e-87f2-e9f09df8b1b9 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:12.929791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf4259-fcb8-422e-87f2-e9f09df8b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:12.929791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf4259-fcb8-422e-87f2-e9f09df8b1b9 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:12.931089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 635/1274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:12.936351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f3827-7dc3-4a1d-b101-0a01aa30d5db None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:12.936721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f3827-7dc3-4a1d-b101-0a01aa30d5db None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:12.936902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f3827-7dc3-4a1d-b101-0a01aa30d5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:12.955250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-677f3827-7dc3-4a1d-b101-0a01aa30d5db None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:12.957146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-677f3827-7dc3-4a1d-b101-0a01aa30d5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:13.022451 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 640/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:51:13.294960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf4259-fcb8-422e-87f2-e9f09df8b1b9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:13.394219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf4259-fcb8-422e-87f2-e9f09df8b1b9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:13.411033 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:13.428029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:13.428649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:13.428925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:13.429229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:13.438977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:51:13.444435 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:13.445652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:13.446706 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 636/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 11 00:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:13.451682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f3827-7dc3-4a1d-b101-0a01aa30d5db None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:13.532151 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:13.551810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f3827-7dc3-4a1d-b101-0a01aa30d5db None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:13.583997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:13.584588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:13.584863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:13.585158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:13.585810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:13.586107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:13.587451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:13.595110 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 641/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 11 00:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:13.601663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:13.698002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d1ac-037a-4122-9ef8-2952ab264992 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:13.730516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:13.731151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:13.731427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:13.731694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:13.741910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:13.743334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:51:13.757392 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:13.758597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:51:13.759731 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:51:13.759731 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:13.759731 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:13.759731 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 637/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:13.764202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:13.860577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83da29-047e-4df5-880b-c833df3c3d8c None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:13.893506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:13.894108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:13.894386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:13.894655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:13.895287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:13.895582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:13.897202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:13.908835 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 642/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:13.914546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:13.945043 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.012521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce5ab-79da-4754-8c30-5180fec3ace1 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.044733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.045371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.045645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.045910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.053547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:14.054960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:51:14.066100 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:14.067202 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:14.068167 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 638/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:14.073221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:14.076946 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.173606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360beaa-7d80-4866-b684-b6ab3ff51d05 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.207310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.207906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.208186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.208459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.209209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:14.209523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:14.210940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:14.227789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 643/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 11 00:51:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:14.233670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:14.321927 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.332275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1a07-6c15-4a5d-ab7f-428049048c02 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.365076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.365672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.365942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.366209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.430900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:14.432249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:14.516382 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.527274 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 11 00:51:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:51:14.533040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:14.593202 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.632249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e1dd-8c76-4534-b4aa-936efcb00d40 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.665404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.666018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.666292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.666556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.676323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:14.677760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:51:14.691758 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:14.692852 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:51:14.694226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:51:14.694226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:51:14.694226 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:14.694226 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 644/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:14.698530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:14.808374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d33425-6e2c-4809-8152-8e8d76f552c7 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.841917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.842509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.842784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.843053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.843675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:14.843975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:14.845352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:14.857014 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 640/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 11 00:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:14.862652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:14.959746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55529f-7cfd-49ee-8215-9dc30da9b036 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.973073 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.992844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.993478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.993752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.994021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:15.000314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:15.001865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:51:15.013363 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:15.014407 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 00:51:15.015372 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 645/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 11 00:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:15.020879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:15.068027 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:15.118872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0638a-5e2c-48ca-b083-30b933b2ed80 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:15.152048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbdf2e-0983-4c48-8a82-dfb23aeebf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:15.152638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdf2e-0983-4c48-8a82-dfb23aeebf8d None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:15.152909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdf2e-0983-4c48-8a82-dfb23aeebf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:15.153204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdf2e-0983-4c48-8a82-dfb23aeebf8d None admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:15.153881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbdf2e-0983-4c48-8a82-dfb23aeebf8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:15.154177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbdf2e-0983-4c48-8a82-dfb23aeebf8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:15.155578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbdf2e-0983-4c48-8a82-dfb23aeebf8d None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:15.167552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 641/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 11 00:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:15.173720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:15.270342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75f8f1-ef19-4011-9b20-2ba537e946e3 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:15.302555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b46d3-2cd8-4125-9841-75e9080a01d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:15.303138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b46d3-2cd8-4125-9841-75e9080a01d9 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:15.303416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b46d3-2cd8-4125-9841-75e9080a01d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:15.303687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b46d3-2cd8-4125-9841-75e9080a01d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:15.304504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b46d3-2cd8-4125-9841-75e9080a01d9 None admin] RBAC: Adding query filter params (role.id=26647ebe21344cfbb8086d4b36b11321, scope.project.id=3ae874a8b86641ac95888a289db15c54, user.id=639fb5545d5a475b9c8bd973c3af520a) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:15.304816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b46d3-2cd8-4125-9841-75e9080a01d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:15.306260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b46d3-2cd8-4125-9841-75e9080a01d9 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:15.311729 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 646/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 11 00:51:15 2022] GET /identity/v3/role_assignments?user.id=639fb5545d5a475b9c8bd973c3af520a&scope.project.id=3ae874a8b86641ac95888a289db15c54&role.id=26647ebe21344cfbb8086d4b36b11321 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:17.574730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251fc9-7e42-48a2-83ec-13d52a4adbf8 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:17.575211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251fc9-7e42-48a2-83ec-13d52a4adbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:17.575305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251fc9-7e42-48a2-83ec-13d52a4adbf8 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:17.576584 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 642/1288] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:17.582444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fffcb5-d93b-482a-9dd3-0dedea2a9b86 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:17.582841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fffcb5-d93b-482a-9dd3-0dedea2a9b86 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:17.582989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fffcb5-d93b-482a-9dd3-0dedea2a9b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:17.600787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-27fffcb5-d93b-482a-9dd3-0dedea2a9b86 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:17.602011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-27fffcb5-d93b-482a-9dd3-0dedea2a9b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:17.631127 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:17.667090 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 647/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:51:17.935460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251fc9-7e42-48a2-83ec-13d52a4adbf8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:18.032804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251fc9-7e42-48a2-83ec-13d52a4adbf8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:18.043812 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:18.066573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:18.067179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:18.067451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:18.067714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] PATH_INFO: `/v3/services/placement` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:18.068277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:18.069646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:18.077974 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:18.079225 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:18.080242 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 643/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:51:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:18.085594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fffcb5-d93b-482a-9dd3-0dedea2a9b86 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:18.188376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fffcb5-d93b-482a-9dd3-0dedea2a9b86 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:18.220564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217ed1c-645e-4ce4-b4e8-9e3d349e4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:18.221178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ed1c-645e-4ce4-b4e8-9e3d349e4de8 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:18.221454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ed1c-645e-4ce4-b4e8-9e3d349e4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:18.222229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ed1c-645e-4ce4-b4e8-9e3d349e4de8 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:18.222842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ed1c-645e-4ce4-b4e8-9e3d349e4de8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:18.223132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ed1c-645e-4ce4-b4e8-9e3d349e4de8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:18.224466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ed1c-645e-4ce4-b4e8-9e3d349e4de8 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:18.229019 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 648/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 00:51:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:18.234843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:18.332800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c655db-eb9e-4f04-8400-83973406dbad None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:18.365186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85876b2b-5fe6-41dc-a646-542f6b4503bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:18.365773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85876b2b-5fe6-41dc-a646-542f6b4503bb None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:18.366052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85876b2b-5fe6-41dc-a646-542f6b4503bb None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:18.366323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85876b2b-5fe6-41dc-a646-542f6b4503bb None admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:18.366939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85876b2b-5fe6-41dc-a646-542f6b4503bb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:18.367240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85876b2b-5fe6-41dc-a646-542f6b4503bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:18.368586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85876b2b-5fe6-41dc-a646-542f6b4503bb None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:18.372808 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 644/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 00:51:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:51:20.514086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ab6f-cb57-45f9-abc4-67957da64a1e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:20.514639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ab6f-cb57-45f9-abc4-67957da64a1e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:20.514639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ab6f-cb57-45f9-abc4-67957da64a1e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:20.515962 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 649/1293] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:20.522167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8372fba-5112-498d-84c1-027a206c9c34 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:20.522614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8372fba-5112-498d-84c1-027a206c9c34 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:20.522718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8372fba-5112-498d-84c1-027a206c9c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:20.542340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e8372fba-5112-498d-84c1-027a206c9c34 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:20.543550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e8372fba-5112-498d-84c1-027a206c9c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:20.573173 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:20.610254 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 645/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:51:20.886535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7ab6f-cb57-45f9-abc4-67957da64a1e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:20.918243 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:20.986170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7ab6f-cb57-45f9-abc4-67957da64a1e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:21.018899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9bf24-b1ce-4d06-80ea-4d817f839e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:21.019488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bf24-b1ce-4d06-80ea-4d817f839e5c None admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:21.019767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bf24-b1ce-4d06-80ea-4d817f839e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:21.020039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bf24-b1ce-4d06-80ea-4d817f839e5c None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:21.020680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9bf24-b1ce-4d06-80ea-4d817f839e5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:21.022322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9bf24-b1ce-4d06-80ea-4d817f839e5c None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:21.036321 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 650/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 11 00:51:20 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:51:23.190614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419c99f-42e5-42bb-b176-cb72b65b86a8 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.191151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419c99f-42e5-42bb-b176-cb72b65b86a8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.191241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419c99f-42e5-42bb-b176-cb72b65b86a8 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.192557 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 646/1296] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:23.197903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01e98-8718-42ed-a177-b12ed12a155c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.198284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01e98-8718-42ed-a177-b12ed12a155c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.198454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01e98-8718-42ed-a177-b12ed12a155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.217284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d4d01e98-8718-42ed-a177-b12ed12a155c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:23.218468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d4d01e98-8718-42ed-a177-b12ed12a155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:23.289937 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 651/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:51:23.556285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419c99f-42e5-42bb-b176-cb72b65b86a8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:23.653423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419c99f-42e5-42bb-b176-cb72b65b86a8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:23.685373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:23.685980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.686250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.686514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.687077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:23.688416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:23.696964 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:23.698177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:23.699068 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 647/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:51:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:23.703981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d01e98-8718-42ed-a177-b12ed12a155c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:23.723151 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:23.802316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d01e98-8718-42ed-a177-b12ed12a155c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:23.834542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:23.835131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.835405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.835674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.836292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:23.836591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:23.837972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:23.842841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 652/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 00:51:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:23.849321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:23.879281 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:23.946426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d15f75-df8b-49bb-bfc7-10b1f6b965d4 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:23.979365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ec35c-fe8c-477a-80e8-224274774144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:23.979950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ec35c-fe8c-477a-80e8-224274774144 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.980226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ec35c-fe8c-477a-80e8-224274774144 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.980497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ec35c-fe8c-477a-80e8-224274774144 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.981206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ec35c-fe8c-477a-80e8-224274774144 None admin] RBAC: Adding query filter params (interface=public, service_id=f6903e10cdff44f497f3229b49f4b014, region_id=RegionOne) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:23.981510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ec35c-fe8c-477a-80e8-224274774144 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:23.982849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ec35c-fe8c-477a-80e8-224274774144 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:23.987763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 648/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 11 00:51:23 2022] GET /identity/v3/endpoints?service_id=f6903e10cdff44f497f3229b49f4b014&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:23.993402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:24.074394 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:24.092159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202c38-0afa-462f-ba81-2143912a7588 None admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:24.125402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e1e03-f0d8-4a7c-95f3-8a4e9176afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:24.125992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e1e03-f0d8-4a7c-95f3-8a4e9176afec None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:24.126268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e1e03-f0d8-4a7c-95f3-8a4e9176afec None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:24.126537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e1e03-f0d8-4a7c-95f3-8a4e9176afec None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:24.127130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e1e03-f0d8-4a7c-95f3-8a4e9176afec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:24.129555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e1e03-f0d8-4a7c-95f3-8a4e9176afec None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:24.136152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 653/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 11 00:51:23 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:51:26.254237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21202b4-2e5c-4372-9b2f-08b13510d79d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.254885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21202b4-2e5c-4372-9b2f-08b13510d79d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.254885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21202b4-2e5c-4372-9b2f-08b13510d79d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.256097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 649/1302] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:26.261226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2197f0f-e768-4188-ba94-e5b457417500 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.261642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2197f0f-e768-4188-ba94-e5b457417500 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.261768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2197f0f-e768-4188-ba94-e5b457417500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.280268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c2197f0f-e768-4188-ba94-e5b457417500 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:26.281480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c2197f0f-e768-4188-ba94-e5b457417500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:26.344763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 654/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:51:26.607242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21202b4-2e5c-4372-9b2f-08b13510d79d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:26.699150 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:26.706708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21202b4-2e5c-4372-9b2f-08b13510d79d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:26.738955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:26.739562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.739836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.740104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.740675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:26.742053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:51:26.750484 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:51:26.751614 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 00:51:26.752651 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 650/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 11 00:51:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:51:26.757655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2197f0f-e768-4188-ba94-e5b457417500 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:26.830118 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:26.853318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2197f0f-e768-4188-ba94-e5b457417500 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:26.885077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7838f4f-83b9-45fd-b9a6-3670c016c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:26.885677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7838f4f-83b9-45fd-b9a6-3670c016c163 None admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.885950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7838f4f-83b9-45fd-b9a6-3670c016c163 None admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.886218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7838f4f-83b9-45fd-b9a6-3670c016c163 None admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.886834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7838f4f-83b9-45fd-b9a6-3670c016c163 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:51:26.887131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7838f4f-83b9-45fd-b9a6-3670c016c163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:26.888468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7838f4f-83b9-45fd-b9a6-3670c016c163 None admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:26.893890 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 655/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 11 00:51:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:51:26.900016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:26.995585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba978447-5ec3-4acc-8342-f1c74d0ae9c5 None admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:27.028464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb95cfb-aa52-4527-962a-bb649764ace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:27.029041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb95cfb-aa52-4527-962a-bb649764ace4 None admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:27.029341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb95cfb-aa52-4527-962a-bb649764ace4 None admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:27.029609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb95cfb-aa52-4527-962a-bb649764ace4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:27.030258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb95cfb-aa52-4527-962a-bb649764ace4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:27.031595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb95cfb-aa52-4527-962a-bb649764ace4 None admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:27.050195 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 651/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:51:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:51:36.890592 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=30 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:37.045981 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:31.990129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0c92-6f2d-4543-8578-7c8af19a5162 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:31.990578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0c92-6f2d-4543-8578-7c8af19a5162 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:31.990659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0c92-6f2d-4543-8578-7c8af19a5162 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:31.997339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3d4c8-90a9-405f-bea1-76568e2a44b2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:31.997720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3d4c8-90a9-405f-bea1-76568e2a44b2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:31.997954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3d4c8-90a9-405f-bea1-76568e2a44b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:32.002929 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 656/1307] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:32.156503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cfa3d4c8-90a9-405f-bea1-76568e2a44b2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:32.159897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cfa3d4c8-90a9-405f-bea1-76568e2a44b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:32.316257 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 652/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:52:32.624791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8225-7fb3-4aa7-bb76-41d28ad26043 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:32.625442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8225-7fb3-4aa7-bb76-41d28ad26043 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:32.625973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8225-7fb3-4aa7-bb76-41d28ad26043 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:32.627790 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 657/1309] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 11 00:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:32.635032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaccc9-c414-4726-8a41-68cc11402974 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:32.635319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaccc9-c414-4726-8a41-68cc11402974 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:32.635593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaccc9-c414-4726-8a41-68cc11402974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:32.716962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a1aaccc9-c414-4726-8a41-68cc11402974 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:32.718424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a1aaccc9-c414-4726-8a41-68cc11402974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:32.741328 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:32.805732 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 653/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 00:52:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:32.815467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8225-7fb3-4aa7-bb76-41d28ad26043 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:32.817454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b23e8225-7fb3-4aa7-bb76-41d28ad26043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:32.959030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8225-7fb3-4aa7-bb76-41d28ad26043 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:33.051699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141629a-a5fd-4c65-82b4-fdd0770aada0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:33.052379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141629a-a5fd-4c65-82b4-fdd0770aada0 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:33.052612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141629a-a5fd-4c65-82b4-fdd0770aada0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:33.052853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141629a-a5fd-4c65-82b4-fdd0770aada0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:33.054740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4141629a-a5fd-4c65-82b4-fdd0770aada0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:33.122924 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:33.202480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141629a-a5fd-4c65-82b4-fdd0770aada0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:33.203941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141629a-a5fd-4c65-82b4-fdd0770aada0 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:33.229833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 658/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:35.774815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087981f-0d98-4775-af68-1fb1f21991ca None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:35.775300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087981f-0d98-4775-af68-1fb1f21991ca None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:35.775395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087981f-0d98-4775-af68-1fb1f21991ca None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:35.776677 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 654/1312] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:35.781754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d6d47-0af9-424b-8407-61d613cf1e00 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:35.782682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d6d47-0af9-424b-8407-61d613cf1e00 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:35.782910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d6d47-0af9-424b-8407-61d613cf1e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:35.863208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a07d6d47-0af9-424b-8407-61d613cf1e00 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:35.864417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a07d6d47-0af9-424b-8407-61d613cf1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:35.961621 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 659/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:36.245818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087981f-0d98-4775-af68-1fb1f21991ca None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:36.247357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9087981f-0d98-4775-af68-1fb1f21991ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:36.351241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087981f-0d98-4775-af68-1fb1f21991ca None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:36.422438 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:36.425511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee25ca-a4a3-4adf-91f4-e6406435bff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:36.426351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee25ca-a4a3-4adf-91f4-e6406435bff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:36.426818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee25ca-a4a3-4adf-91f4-e6406435bff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:36.427134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee25ca-a4a3-4adf-91f4-e6406435bff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:36.428952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2bee25ca-a4a3-4adf-91f4-e6406435bff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:36.536524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee25ca-a4a3-4adf-91f4-e6406435bff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:36.537993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee25ca-a4a3-4adf-91f4-e6406435bff7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:36.556771 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 655/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:39.041741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be17a-75ec-4a98-af8d-0411a31bb5d4 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:39.042278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be17a-75ec-4a98-af8d-0411a31bb5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:39.042278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be17a-75ec-4a98-af8d-0411a31bb5d4 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:39.043629 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 660/1315] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:39.049333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd55400-3ce5-4252-a716-b3d816b0da9c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:39.049745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd55400-3ce5-4252-a716-b3d816b0da9c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:39.049863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd55400-3ce5-4252-a716-b3d816b0da9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:39.114059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ccd55400-3ce5-4252-a716-b3d816b0da9c None None] MFA Rules not processed for user `2459cbb42d584a5c886610385b44f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:39.115278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ccd55400-3ce5-4252-a716-b3d816b0da9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:39.166859 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:39.210714 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 656/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:39.498028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220be17a-75ec-4a98-af8d-0411a31bb5d4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:39.499617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-220be17a-75ec-4a98-af8d-0411a31bb5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:39.509429 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:39.601880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220be17a-75ec-4a98-af8d-0411a31bb5d4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:39.675279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cddef3-1533-4679-a647-972dabaf6a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:39.675877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cddef3-1533-4679-a647-972dabaf6a89 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:39.676154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cddef3-1533-4679-a647-972dabaf6a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:39.676423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cddef3-1533-4679-a647-972dabaf6a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:39.678047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f8cddef3-1533-4679-a647-972dabaf6a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:39.739970 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:39.788635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cddef3-1533-4679-a647-972dabaf6a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:39.790020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cddef3-1533-4679-a647-972dabaf6a89 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:39.808396 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 661/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:42.509303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab039f-57c3-45b1-b014-83005a93495a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:42.509881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab039f-57c3-45b1-b014-83005a93495a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:42.509881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab039f-57c3-45b1-b014-83005a93495a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:42.511208 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 657/1318] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:42.516430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32109ee-0afa-43d0-8f19-423e0db1c3ba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:42.516883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32109ee-0afa-43d0-8f19-423e0db1c3ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:42.517335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32109ee-0afa-43d0-8f19-423e0db1c3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:42.582713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a32109ee-0afa-43d0-8f19-423e0db1c3ba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:42.583907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a32109ee-0afa-43d0-8f19-423e0db1c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:42.678715 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 662/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:42.963622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab039f-57c3-45b1-b014-83005a93495a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:42.965180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-14ab039f-57c3-45b1-b014-83005a93495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:43.067886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab039f-57c3-45b1-b014-83005a93495a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:43.142170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58be4a8-e177-4c19-8a66-fd4abae09bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:43.142762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be4a8-e177-4c19-8a66-fd4abae09bab service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:43.143041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be4a8-e177-4c19-8a66-fd4abae09bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:43.143307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be4a8-e177-4c19-8a66-fd4abae09bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:43.144900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b58be4a8-e177-4c19-8a66-fd4abae09bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:43.152000 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:43.252600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58be4a8-e177-4c19-8a66-fd4abae09bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:43.254036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58be4a8-e177-4c19-8a66-fd4abae09bab service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:43.271276 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 658/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:46.073112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e94924-8317-4c04-bc23-98d17bdcff29 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:46.073678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e94924-8317-4c04-bc23-98d17bdcff29 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:46.073678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e94924-8317-4c04-bc23-98d17bdcff29 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:46.074983 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 663/1321] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:46.080819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1aa6-b430-47ae-8e59-c6fc6b59a727 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:46.081271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1aa6-b430-47ae-8e59-c6fc6b59a727 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:46.081442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1aa6-b430-47ae-8e59-c6fc6b59a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:46.159829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5f0d1aa6-b430-47ae-8e59-c6fc6b59a727 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:46.161079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f0d1aa6-b430-47ae-8e59-c6fc6b59a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:46.225200 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:46.270008 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 659/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:52:46.554504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e94924-8317-4c04-bc23-98d17bdcff29 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:46.556044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-81e94924-8317-4c04-bc23-98d17bdcff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:46.576046 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:46.660415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e94924-8317-4c04-bc23-98d17bdcff29 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:46.731956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff11a50-b85c-40d0-ac9b-50b37077f8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:46.732548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11a50-b85c-40d0-ac9b-50b37077f8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:46.732819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11a50-b85c-40d0-ac9b-50b37077f8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:46.733113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff11a50-b85c-40d0-ac9b-50b37077f8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:46.734686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dff11a50-b85c-40d0-ac9b-50b37077f8d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:46.812289 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:46.850608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff11a50-b85c-40d0-ac9b-50b37077f8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:46.852040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff11a50-b85c-40d0-ac9b-50b37077f8d6 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:46.870559 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 664/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:49.085362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53284a0-0811-4ff8-bc6e-98c208f46e20 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:49.085890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53284a0-0811-4ff8-bc6e-98c208f46e20 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:49.085890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53284a0-0811-4ff8-bc6e-98c208f46e20 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:49.087252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 660/1324] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:49.092579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582755-acc5-4bf6-99e6-76b1d4399797 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:49.093004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582755-acc5-4bf6-99e6-76b1d4399797 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:49.093163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582755-acc5-4bf6-99e6-76b1d4399797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:49.162029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e1582755-acc5-4bf6-99e6-76b1d4399797 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:49.163230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e1582755-acc5-4bf6-99e6-76b1d4399797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:49.270355 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 665/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:49.548491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53284a0-0811-4ff8-bc6e-98c208f46e20 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:49.550085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b53284a0-0811-4ff8-bc6e-98c208f46e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:49.652279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53284a0-0811-4ff8-bc6e-98c208f46e20 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:49.727018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb44b29-7202-4303-8be3-0179ded22c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:49.727619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44b29-7202-4303-8be3-0179ded22c0c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:49.727895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44b29-7202-4303-8be3-0179ded22c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:49.728155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb44b29-7202-4303-8be3-0179ded22c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:49.729752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6eb44b29-7202-4303-8be3-0179ded22c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:49.746384 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:49.845859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb44b29-7202-4303-8be3-0179ded22c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:49.847254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb44b29-7202-4303-8be3-0179ded22c0c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:49.865812 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 661/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:52.090327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9214f-9434-4158-a9a6-24c305806cea None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.090841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9214f-9434-4158-a9a6-24c305806cea None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.090841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9214f-9434-4158-a9a6-24c305806cea None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.092115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 666/1327] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:52.098154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0007-6b2a-4b3d-91e6-886f0c970339 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.098565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0007-6b2a-4b3d-91e6-886f0c970339 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.098707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0007-6b2a-4b3d-91e6-886f0c970339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.168913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ba3c0007-6b2a-4b3d-91e6-886f0c970339 None None] MFA Rules not processed for user `2459cbb42d584a5c886610385b44f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:52.170080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba3c0007-6b2a-4b3d-91e6-886f0c970339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.234195 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:52.266019 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 662/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:52.553831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9214f-9434-4158-a9a6-24c305806cea None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:52.555433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c4a9214f-9434-4158-a9a6-24c305806cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.588364 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:52.661736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9214f-9434-4158-a9a6-24c305806cea None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:52.733862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616e465-0ceb-4bc2-91a9-97b809816657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:52.734458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e465-0ceb-4bc2-91a9-97b809816657 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:52.735423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e465-0ceb-4bc2-91a9-97b809816657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:52.735596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e465-0ceb-4bc2-91a9-97b809816657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:52.737371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2616e465-0ceb-4bc2-91a9-97b809816657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:52.814160 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:52.846756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616e465-0ceb-4bc2-91a9-97b809816657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:52.848171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616e465-0ceb-4bc2-91a9-97b809816657 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:52.866119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 667/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:55.298561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21400f-c781-40b3-9899-bae18f8f0f7c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:55.299098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21400f-c781-40b3-9899-bae18f8f0f7c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:55.299098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21400f-c781-40b3-9899-bae18f8f0f7c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:55.300349 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 663/1330] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:55.305485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930385-58c1-4b3e-9b82-b3ea1d725893 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:55.305866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930385-58c1-4b3e-9b82-b3ea1d725893 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:55.306029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930385-58c1-4b3e-9b82-b3ea1d725893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:55.372147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ae930385-58c1-4b3e-9b82-b3ea1d725893 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:55.373365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ae930385-58c1-4b3e-9b82-b3ea1d725893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:55.467374 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 668/1331] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:55.746730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21400f-c781-40b3-9899-bae18f8f0f7c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:55.748302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fa21400f-c781-40b3-9899-bae18f8f0f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:55.850974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21400f-c781-40b3-9899-bae18f8f0f7c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:55.924734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e9a63-f494-4448-9587-aac5703b93c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:55.925365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9a63-f494-4448-9587-aac5703b93c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:55.925643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9a63-f494-4448-9587-aac5703b93c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:55.925909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e9a63-f494-4448-9587-aac5703b93c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:55.927489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b77e9a63-f494-4448-9587-aac5703b93c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:55.954560 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:56.038013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9a63-f494-4448-9587-aac5703b93c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:56.039437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e9a63-f494-4448-9587-aac5703b93c9 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:56.057965 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 664/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:58.245078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628f48-168d-4b3a-8744-ba9915c39e8c None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:58.245725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628f48-168d-4b3a-8744-ba9915c39e8c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:58.245725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7628f48-168d-4b3a-8744-ba9915c39e8c None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:58.246974 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 669/1333] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:58.252786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74b8c3-a1dc-4287-832d-8f32ffd5b40e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:58.253246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74b8c3-a1dc-4287-832d-8f32ffd5b40e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:58.253384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74b8c3-a1dc-4287-832d-8f32ffd5b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:58.318457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1d74b8c3-a1dc-4287-832d-8f32ffd5b40e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:58.319673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1d74b8c3-a1dc-4287-832d-8f32ffd5b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:58.394253 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:58.416530 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 665/1334] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:58.703005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628f48-168d-4b3a-8744-ba9915c39e8c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:58.705078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c7628f48-168d-4b3a-8744-ba9915c39e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:58.745131 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:58.808216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7628f48-168d-4b3a-8744-ba9915c39e8c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:58.881150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e32aa-cfea-45fd-9742-2fc2637e1eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:58.881780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e32aa-cfea-45fd-9742-2fc2637e1eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:58.882057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e32aa-cfea-45fd-9742-2fc2637e1eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:58.882327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e32aa-cfea-45fd-9742-2fc2637e1eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:58.883915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d84e32aa-cfea-45fd-9742-2fc2637e1eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:58.965720 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:58.992470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e32aa-cfea-45fd-9742-2fc2637e1eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:58.993916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e32aa-cfea-45fd-9742-2fc2637e1eb1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:59.011724 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 670/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:01.504774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30907-d02f-45db-81be-4b78863ed7aa None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:01.505339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30907-d02f-45db-81be-4b78863ed7aa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:01.505339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30907-d02f-45db-81be-4b78863ed7aa None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:01.506712 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 666/1336] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:01.511833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55505a9-624b-4c05-882b-7bb4eb1725b5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:01.512225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55505a9-624b-4c05-882b-7bb4eb1725b5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:01.512385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55505a9-624b-4c05-882b-7bb4eb1725b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:01.578793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c55505a9-624b-4c05-882b-7bb4eb1725b5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:01.580006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c55505a9-624b-4c05-882b-7bb4eb1725b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:01.675099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 671/1337] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:01.962367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30907-d02f-45db-81be-4b78863ed7aa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:01.963901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-85c30907-d02f-45db-81be-4b78863ed7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:02.065394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30907-d02f-45db-81be-4b78863ed7aa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:02.137462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7399b-2890-4b76-bb64-d4adedee6a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:02.138062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7399b-2890-4b76-bb64-d4adedee6a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:02.138335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7399b-2890-4b76-bb64-d4adedee6a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:02.138603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7399b-2890-4b76-bb64-d4adedee6a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:02.140174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b3f7399b-2890-4b76-bb64-d4adedee6a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:02.176299 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:02.254375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7399b-2890-4b76-bb64-d4adedee6a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:02.255798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7399b-2890-4b76-bb64-d4adedee6a27 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:02.274245 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 667/1338] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:06.429748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25f4e-e61e-4fde-baf6-7808aef4d27c None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:06.430297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25f4e-e61e-4fde-baf6-7808aef4d27c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:06.430297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25f4e-e61e-4fde-baf6-7808aef4d27c None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:06.431537 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 672/1339] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:06.436895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a062f-ce38-496e-b11e-4aa718e25460 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:06.437350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a062f-ce38-496e-b11e-4aa718e25460 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:06.437985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a062f-ce38-496e-b11e-4aa718e25460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:06.503769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-699a062f-ce38-496e-b11e-4aa718e25460 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:06.504957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-699a062f-ce38-496e-b11e-4aa718e25460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:06.592971 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:06.604655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 668/1340] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:06.887565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25f4e-e61e-4fde-baf6-7808aef4d27c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:06.889206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c5e25f4e-e61e-4fde-baf6-7808aef4d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:06.938886 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:06.998184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25f4e-e61e-4fde-baf6-7808aef4d27c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:07.075909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079417a9-d5b6-4014-a9cc-49cf67dc6b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:07.076507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079417a9-d5b6-4014-a9cc-49cf67dc6b16 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:07.076778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079417a9-d5b6-4014-a9cc-49cf67dc6b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:07.077036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079417a9-d5b6-4014-a9cc-49cf67dc6b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:07.079155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-079417a9-d5b6-4014-a9cc-49cf67dc6b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:07.178064 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:07.194720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079417a9-d5b6-4014-a9cc-49cf67dc6b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:07.196138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079417a9-d5b6-4014-a9cc-49cf67dc6b16 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:07.214723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 673/1341] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:10.046089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe706-9174-4f2a-b5af-4d7feabf64cd None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:10.046628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe706-9174-4f2a-b5af-4d7feabf64cd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:10.046628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe706-9174-4f2a-b5af-4d7feabf64cd None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:10.048622 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 669/1342] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:10.053737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68aa1-c8c8-4e34-8c8b-de7eecbe21cf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:10.054164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68aa1-c8c8-4e34-8c8b-de7eecbe21cf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:10.054278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff68aa1-c8c8-4e34-8c8b-de7eecbe21cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:10.123912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6ff68aa1-c8c8-4e34-8c8b-de7eecbe21cf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:10.125918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6ff68aa1-c8c8-4e34-8c8b-de7eecbe21cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:10.234073 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 674/1343] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:10.533477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca4c6-350d-40dd-8e78-5c01d8efaa7c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:10.533957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca4c6-350d-40dd-8e78-5c01d8efaa7c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:10.534327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca4c6-350d-40dd-8e78-5c01d8efaa7c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:10.535796 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 670/1344] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 11 00:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:10.542481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176b79-308e-49a6-a88b-92220e582f58 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:10.542763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176b79-308e-49a6-a88b-92220e582f58 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:10.543030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0176b79-308e-49a6-a88b-92220e582f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:10.609364 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:10.618754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b0176b79-308e-49a6-a88b-92220e582f58 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:10.619978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b0176b79-308e-49a6-a88b-92220e582f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:10.696403 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 00:53:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:10.706842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca4c6-350d-40dd-8e78-5c01d8efaa7c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:10.708379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c34ca4c6-350d-40dd-8e78-5c01d8efaa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:10.815222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca4c6-350d-40dd-8e78-5c01d8efaa7c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:10.888248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaf1d2-4cd3-4cef-886c-6ed1dc5e81a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:10.888961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf1d2-4cd3-4cef-886c-6ed1dc5e81a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:10.891907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf1d2-4cd3-4cef-886c-6ed1dc5e81a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:10.896256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf1d2-4cd3-4cef-886c-6ed1dc5e81a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:10.898449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-08eaf1d2-4cd3-4cef-886c-6ed1dc5e81a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:10.951523 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:11.025312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaf1d2-4cd3-4cef-886c-6ed1dc5e81a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:11.026749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaf1d2-4cd3-4cef-886c-6ed1dc5e81a5 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:11.047858 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 671/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:15.925109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae857-d286-45c3-9707-27492b0019b7 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:15.925629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae857-d286-45c3-9707-27492b0019b7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:15.925727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae857-d286-45c3-9707-27492b0019b7 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:15.926997 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 676/1347] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:53:15.932840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da773-a4c0-4dfd-ac97-8e998c9d1027 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:15.933298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da773-a4c0-4dfd-ac97-8e998c9d1027 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:15.933491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da773-a4c0-4dfd-ac97-8e998c9d1027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.006802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9c3da773-a4c0-4dfd-ac97-8e998c9d1027 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:16.008081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9c3da773-a4c0-4dfd-ac97-8e998c9d1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:16.108713 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:16.112253 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 672/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:16.392363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae857-d286-45c3-9707-27492b0019b7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:16.393944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-906ae857-d286-45c3-9707-27492b0019b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:16.497491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae857-d286-45c3-9707-27492b0019b7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:16.545081 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:16.570626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ca890-5bd6-48d2-8424-e6d8602fe6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:16.571221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca890-5bd6-48d2-8424-e6d8602fe6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:16.571493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca890-5bd6-48d2-8424-e6d8602fe6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:16.571755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca890-5bd6-48d2-8424-e6d8602fe6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:16.573359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-220ca890-5bd6-48d2-8424-e6d8602fe6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:16.680174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ca890-5bd6-48d2-8424-e6d8602fe6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:16.681594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ca890-5bd6-48d2-8424-e6d8602fe6d1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:16.699462 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 677/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:21.683907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1a8a2-ae07-4955-a482-e0a74e9be4c8 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.684952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1a8a2-ae07-4955-a482-e0a74e9be4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.685496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1a8a2-ae07-4955-a482-e0a74e9be4c8 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.687838 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 673/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 00:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:21.693040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af107-6eac-430f-ab19-ac9ada0f30b7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:21.693552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af107-6eac-430f-ab19-ac9ada0f30b7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:21.693779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481af107-6eac-430f-ab19-ac9ada0f30b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:21.827356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-481af107-6eac-430f-ab19-ac9ada0f30b7 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:21.834678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-481af107-6eac-430f-ab19-ac9ada0f30b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:21.871938 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:21.979472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 678/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:26.139494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bd6ce-89f2-4229-a69d-b0b021cdf35a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:26.140902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bd6ce-89f2-4229-a69d-b0b021cdf35a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:26.141371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bd6ce-89f2-4229-a69d-b0b021cdf35a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:26.142723 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 674/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 00:53:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:26.149597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d45d2-3f8a-45e8-8481-37d1151c7b6b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:26.150629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d45d2-3f8a-45e8-8481-37d1151c7b6b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:26.151326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d45d2-3f8a-45e8-8481-37d1151c7b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:26.233202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4f3d45d2-3f8a-45e8-8481-37d1151c7b6b None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:26.235100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4f3d45d2-3f8a-45e8-8481-37d1151c7b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:26.311140 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:26.350220 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 679/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:27.758192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3e5b-d7bc-4834-9c86-18c02d64f01e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:27.758748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3e5b-d7bc-4834-9c86-18c02d64f01e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:27.758748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3e5b-d7bc-4834-9c86-18c02d64f01e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:27.760213 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 675/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 00:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:27.765579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224648-c0e0-4e7e-8cb5-66ff0fc28367 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:27.765968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224648-c0e0-4e7e-8cb5-66ff0fc28367 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:27.766276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224648-c0e0-4e7e-8cb5-66ff0fc28367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:27.842582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f3224648-c0e0-4e7e-8cb5-66ff0fc28367 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:27.844318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f3224648-c0e0-4e7e-8cb5-66ff0fc28367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:27.951241 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 680/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 00:53:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:31.479517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5bb9-a8ab-490e-857c-1c564c99cb95 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:31.480494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5bb9-a8ab-490e-857c-1c564c99cb95 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:31.480987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5bb9-a8ab-490e-857c-1c564c99cb95 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:31.485437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 676/1356] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:31.488537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8c583-35de-4f75-8476-ec015db3c533 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:31.489005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8c583-35de-4f75-8476-ec015db3c533 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:31.489133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8c583-35de-4f75-8476-ec015db3c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:31.542659 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:31.580802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-69f8c583-35de-4f75-8476-ec015db3c533 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:31.582141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-69f8c583-35de-4f75-8476-ec015db3c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:31.685759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 681/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:31.997615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d0262-26b5-4920-80ad-de07579203ea None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:31.998859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d0262-26b5-4920-80ad-de07579203ea None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:32.000075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d0262-26b5-4920-80ad-de07579203ea None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:32.002027 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 677/1358] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 00:53:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:32.026219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71a60-1cda-47f2-823d-ec274ddf4289 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:32.027385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71a60-1cda-47f2-823d-ec274ddf4289 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:32.030158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71a60-1cda-47f2-823d-ec274ddf4289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:32.111771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-85a71a60-1cda-47f2-823d-ec274ddf4289 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:32.113003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-85a71a60-1cda-47f2-823d-ec274ddf4289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:32.165188 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:32.244773 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 682/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 00:53:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:32.255119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d0262-26b5-4920-80ad-de07579203ea None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:32.256855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-330d0262-26b5-4920-80ad-de07579203ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:32.411093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d0262-26b5-4920-80ad-de07579203ea None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:32.488751 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:32.536723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819143-2eb5-4d22-b9df-629443851139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:32.537507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819143-2eb5-4d22-b9df-629443851139 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:32.537950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819143-2eb5-4d22-b9df-629443851139 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:32.538284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819143-2eb5-4d22-b9df-629443851139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:32.539962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f1819143-2eb5-4d22-b9df-629443851139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:32.643535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819143-2eb5-4d22-b9df-629443851139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:32.645248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819143-2eb5-4d22-b9df-629443851139 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:32.669248 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 678/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:35.108284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0c2a-6e67-42aa-901a-734cba1eb176 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.109605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0c2a-6e67-42aa-901a-734cba1eb176 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.109605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0c2a-6e67-42aa-901a-734cba1eb176 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.117224 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 683/1361] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:35.118111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23e2f-36c7-4d6f-8fa2-43d3f4d92764 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.118663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23e2f-36c7-4d6f-8fa2-43d3f4d92764 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.118804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23e2f-36c7-4d6f-8fa2-43d3f4d92764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.189194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-12a23e2f-36c7-4d6f-8fa2-43d3f4d92764 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:35.190395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-12a23e2f-36c7-4d6f-8fa2-43d3f4d92764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:35.236198 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:35.298664 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 679/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:35.584395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e0c2a-6e67-42aa-901a-734cba1eb176 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:35.585971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca2e0c2a-6e67-42aa-901a-734cba1eb176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:35.764396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e0c2a-6e67-42aa-901a-734cba1eb176 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:35.776393 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:35.901485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc236e89-be1a-4255-99a5-9f3002940f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:35.902098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236e89-be1a-4255-99a5-9f3002940f31 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:35.902375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236e89-be1a-4255-99a5-9f3002940f31 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:35.902645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236e89-be1a-4255-99a5-9f3002940f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:35.904266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc236e89-be1a-4255-99a5-9f3002940f31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:36.001304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc236e89-be1a-4255-99a5-9f3002940f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:36.002914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc236e89-be1a-4255-99a5-9f3002940f31 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:36.021826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 684/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:38.568853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b68e-ec29-4ca5-9275-8182c6520db3 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:38.569729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b68e-ec29-4ca5-9275-8182c6520db3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:38.569998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b68e-ec29-4ca5-9275-8182c6520db3 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:38.571486 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 680/1364] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:38.576901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73617-b753-450e-80a3-b8e60000b86e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:38.577968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73617-b753-450e-80a3-b8e60000b86e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:38.578157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73617-b753-450e-80a3-b8e60000b86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:38.595413 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:38.662956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e9f73617-b753-450e-80a3-b8e60000b86e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:38.665411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e9f73617-b753-450e-80a3-b8e60000b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:38.793223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 685/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:39.120446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4d43-6441-4fbb-8b4d-76b125ec685c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.120744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4d43-6441-4fbb-8b4d-76b125ec685c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.121357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4d43-6441-4fbb-8b4d-76b125ec685c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.123576 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 681/1366] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 00:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:39.132431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563461f-e97c-4d80-a6d1-96384a07e8c6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.132856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563461f-e97c-4d80-a6d1-96384a07e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.133277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563461f-e97c-4d80-a6d1-96384a07e8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.232212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f563461f-e97c-4d80-a6d1-96384a07e8c6 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:39.234314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f563461f-e97c-4d80-a6d1-96384a07e8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:39.274683 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:39.437731 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 686/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 00:53:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:39.448710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f4d43-6441-4fbb-8b4d-76b125ec685c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:39.450252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-370f4d43-6441-4fbb-8b4d-76b125ec685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:39.666898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f4d43-6441-4fbb-8b4d-76b125ec685c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:39.699184 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:39.825214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c521d0-3fe3-419d-a731-5ce6f8b80e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:39.825836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c521d0-3fe3-419d-a731-5ce6f8b80e59 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:39.826112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c521d0-3fe3-419d-a731-5ce6f8b80e59 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:39.826384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c521d0-3fe3-419d-a731-5ce6f8b80e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:39.828520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-82c521d0-3fe3-419d-a731-5ce6f8b80e59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:39.948764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c521d0-3fe3-419d-a731-5ce6f8b80e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:39.950599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c521d0-3fe3-419d-a731-5ce6f8b80e59 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:39.984736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 682/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:42.454053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9153563-b2ab-462b-a172-56a25505d114 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:42.454587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9153563-b2ab-462b-a172-56a25505d114 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:42.454587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9153563-b2ab-462b-a172-56a25505d114 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:42.460411 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 687/1369] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:42.461903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530fc2b-9eaf-465b-9a88-6c399b3ecef1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:42.462771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530fc2b-9eaf-465b-9a88-6c399b3ecef1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:42.463276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530fc2b-9eaf-465b-9a88-6c399b3ecef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:42.497494 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:42.545572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f530fc2b-9eaf-465b-9a88-6c399b3ecef1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:42.547438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f530fc2b-9eaf-465b-9a88-6c399b3ecef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:42.667417 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 683/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:42.989177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9153563-b2ab-462b-a172-56a25505d114 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:42.994003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c9153563-b2ab-462b-a172-56a25505d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:43.351823 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:43.359311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9153563-b2ab-462b-a172-56a25505d114 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:43.557428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd439f9a-8db6-4cad-b22b-1e14a01308be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:43.558088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd439f9a-8db6-4cad-b22b-1e14a01308be service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:43.558299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd439f9a-8db6-4cad-b22b-1e14a01308be service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:43.558746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd439f9a-8db6-4cad-b22b-1e14a01308be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:43.560368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dd439f9a-8db6-4cad-b22b-1e14a01308be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:43.657537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd439f9a-8db6-4cad-b22b-1e14a01308be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:43.659070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd439f9a-8db6-4cad-b22b-1e14a01308be service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:43.678455 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:43.682163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 688/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:43.798861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa699e-726d-46f7-af7c-ec2ff16c7ea2 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:43.799469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa699e-726d-46f7-af7c-ec2ff16c7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:43.799469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa699e-726d-46f7-af7c-ec2ff16c7ea2 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:43.800795 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 684/1372] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:43.806817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0342-39a5-40b1-8a2f-0762446955f9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:43.807104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0342-39a5-40b1-8a2f-0762446955f9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:43.807590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0342-39a5-40b1-8a2f-0762446955f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:43.891445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bd2e0342-39a5-40b1-8a2f-0762446955f9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:43.893556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bd2e0342-39a5-40b1-8a2f-0762446955f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:44.008741 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 689/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:44.338132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214403fc-1a9d-4855-9ff2-3b4caee9bfb7 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:44.338412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214403fc-1a9d-4855-9ff2-3b4caee9bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:44.338700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214403fc-1a9d-4855-9ff2-3b4caee9bfb7 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:44.340246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 685/1374] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 11 00:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:44.345216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36353c0c-eaa5-4b13-93a1-9ef9bfdfd537 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:44.345505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36353c0c-eaa5-4b13-93a1-9ef9bfdfd537 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:44.345779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36353c0c-eaa5-4b13-93a1-9ef9bfdfd537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:44.431821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-36353c0c-eaa5-4b13-93a1-9ef9bfdfd537 None None] MFA Rules not processed for user `0492b5b414354bce909e395d44d215c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:44.433201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-36353c0c-eaa5-4b13-93a1-9ef9bfdfd537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:44.457445 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:44.523725 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 690/1375] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 00:53:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:44.532502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214403fc-1a9d-4855-9ff2-3b4caee9bfb7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:44.533585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-214403fc-1a9d-4855-9ff2-3b4caee9bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:44.649120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214403fc-1a9d-4855-9ff2-3b4caee9bfb7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:44.653294 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:44.727380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242174b-95e1-4ad6-a3c9-4709c3010008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:44.728094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242174b-95e1-4ad6-a3c9-4709c3010008 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:44.728433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242174b-95e1-4ad6-a3c9-4709c3010008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:44.728765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242174b-95e1-4ad6-a3c9-4709c3010008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:44.730465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7242174b-95e1-4ad6-a3c9-4709c3010008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:44.849994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242174b-95e1-4ad6-a3c9-4709c3010008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:44.851434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242174b-95e1-4ad6-a3c9-4709c3010008 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:44.871281 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 686/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:45.924785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872543-ef6c-406c-8df2-81992a685732 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:45.925390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872543-ef6c-406c-8df2-81992a685732 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:45.925390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872543-ef6c-406c-8df2-81992a685732 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:45.926677 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 691/1377] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:45.931926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22b91-8db8-4b43-a63a-7cc83dacbeb2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:45.932346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22b91-8db8-4b43-a63a-7cc83dacbeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:45.932612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22b91-8db8-4b43-a63a-7cc83dacbeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:45.982672 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:46.013197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b6f22b91-8db8-4b43-a63a-7cc83dacbeb2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:46.015115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b6f22b91-8db8-4b43-a63a-7cc83dacbeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:46.123203 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 687/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:46.422545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5872543-ef6c-406c-8df2-81992a685732 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:46.424282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a5872543-ef6c-406c-8df2-81992a685732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:46.591755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5872543-ef6c-406c-8df2-81992a685732 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:46.626413 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:46.727312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c05b-de5a-48cd-a31b-0f22d5f3962a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:46.728224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c05b-de5a-48cd-a31b-0f22d5f3962a service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:46.728497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c05b-de5a-48cd-a31b-0f22d5f3962a service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:46.729006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c05b-de5a-48cd-a31b-0f22d5f3962a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:46.730672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a745c05b-de5a-48cd-a31b-0f22d5f3962a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:46.839952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c05b-de5a-48cd-a31b-0f22d5f3962a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:46.841685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c05b-de5a-48cd-a31b-0f22d5f3962a service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:46.863774 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 692/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:49.177316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172bba-0d16-4191-88c3-6ab9481e76eb None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:49.178347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172bba-0d16-4191-88c3-6ab9481e76eb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:49.178852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172bba-0d16-4191-88c3-6ab9481e76eb None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:49.184508 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 688/1380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:49.185926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646460cc-a553-4dc9-80f0-4ebe229eeb79 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:49.186691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646460cc-a553-4dc9-80f0-4ebe229eeb79 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:49.187006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646460cc-a553-4dc9-80f0-4ebe229eeb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:49.243733 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:49.273628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-646460cc-a553-4dc9-80f0-4ebe229eeb79 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:49.274842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-646460cc-a553-4dc9-80f0-4ebe229eeb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:49.400060 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 693/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:53:49.716728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172bba-0d16-4191-88c3-6ab9481e76eb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:49.719026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d172bba-0d16-4191-88c3-6ab9481e76eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:49.843079 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:49.889054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172bba-0d16-4191-88c3-6ab9481e76eb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:50.011313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a15b-df14-41e8-b0de-f3bbb007feb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:50.011917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a15b-df14-41e8-b0de-f3bbb007feb6 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:50.012197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a15b-df14-41e8-b0de-f3bbb007feb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:50.012460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a15b-df14-41e8-b0de-f3bbb007feb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:50.014112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b145a15b-df14-41e8-b0de-f3bbb007feb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:50.122103 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:50.155943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a15b-df14-41e8-b0de-f3bbb007feb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:50.157868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a15b-df14-41e8-b0de-f3bbb007feb6 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:50.193219 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 689/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:52.470578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988066-d08b-4644-8032-560413631dca None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:52.471133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988066-d08b-4644-8032-560413631dca None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:52.471133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988066-d08b-4644-8032-560413631dca None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:52.472602 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 694/1383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:52.477825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dbef3-d27e-464d-be74-1257f7dc1b60 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:52.478229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dbef3-d27e-464d-be74-1257f7dc1b60 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:52.478429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dbef3-d27e-464d-be74-1257f7dc1b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:52.552907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-857dbef3-d27e-464d-be74-1257f7dc1b60 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:52.554244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-857dbef3-d27e-464d-be74-1257f7dc1b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:52.737488 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 690/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:53.026599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988066-d08b-4644-8032-560413631dca None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:53.028209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4a988066-d08b-4644-8032-560413631dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:53.140238 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:53.183447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988066-d08b-4644-8032-560413631dca None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:53.304260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864a689-920d-4939-aae8-6e71d877d145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:53.304925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a689-920d-4939-aae8-6e71d877d145 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:53.305399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a689-920d-4939-aae8-6e71d877d145 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:53.305718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a689-920d-4939-aae8-6e71d877d145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:53.307759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3864a689-920d-4939-aae8-6e71d877d145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:53.389932 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:53.407776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864a689-920d-4939-aae8-6e71d877d145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:53.409928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864a689-920d-4939-aae8-6e71d877d145 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:53.430390 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 695/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:53:56.130716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05b20-8c37-4da0-b0a1-0a1c2c47a4fe None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:56.131331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05b20-8c37-4da0-b0a1-0a1c2c47a4fe None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:56.131803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05b20-8c37-4da0-b0a1-0a1c2c47a4fe None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:56.133746 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 691/1386] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:56.140383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110d54-5913-4672-8208-95d88b52219f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:56.141336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110d54-5913-4672-8208-95d88b52219f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:56.141608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de110d54-5913-4672-8208-95d88b52219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:56.222512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-de110d54-5913-4672-8208-95d88b52219f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:56.224060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-de110d54-5913-4672-8208-95d88b52219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:56.341795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:56.629706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b05b20-8c37-4da0-b0a1-0a1c2c47a4fe None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:56.631289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4b05b20-8c37-4da0-b0a1-0a1c2c47a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:56.697819 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:56.788746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b05b20-8c37-4da0-b0a1-0a1c2c47a4fe None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:53:56.907511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482cc3f-941d-4af9-98e2-d2ea9d095cbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:53:56.908055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482cc3f-941d-4af9-98e2-d2ea9d095cbb service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:56.908327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482cc3f-941d-4af9-98e2-d2ea9d095cbb service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:56.908592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482cc3f-941d-4af9-98e2-d2ea9d095cbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:56.910212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e482cc3f-941d-4af9-98e2-d2ea9d095cbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:56.923395 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:57.006128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482cc3f-941d-4af9-98e2-d2ea9d095cbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:53:57.007594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482cc3f-941d-4af9-98e2-d2ea9d095cbb service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:53:57.025607 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 692/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:53:59.349015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb3f6-6c5c-4365-babb-9515cc136bd4 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.349645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb3f6-6c5c-4365-babb-9515cc136bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.349812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb3f6-6c5c-4365-babb-9515cc136bd4 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.351225 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 697/1389] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:59.356580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce5d2-cbd7-4ad5-9ef1-7c050ef2e562 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.357044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce5d2-cbd7-4ad5-9ef1-7c050ef2e562 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.357189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce5d2-cbd7-4ad5-9ef1-7c050ef2e562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.421827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cb2ce5d2-cbd7-4ad5-9ef1-7c050ef2e562 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:59.423019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb2ce5d2-cbd7-4ad5-9ef1-7c050ef2e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:59.508121 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:59.520605 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 693/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:59.815274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb3f6-6c5c-4365-babb-9515cc136bd4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:59.816800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bfcfb3f6-6c5c-4365-babb-9515cc136bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:59.875013 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:59.977838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb3f6-6c5c-4365-babb-9515cc136bd4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:00.105515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbc2ad-6664-4858-9af3-4a95c7f5fd63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:00.106037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc2ad-6664-4858-9af3-4a95c7f5fd63 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:00.106313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc2ad-6664-4858-9af3-4a95c7f5fd63 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:00.106577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc2ad-6664-4858-9af3-4a95c7f5fd63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:00.108721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c2dbc2ad-6664-4858-9af3-4a95c7f5fd63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:00.122813 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:00.206852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbc2ad-6664-4858-9af3-4a95c7f5fd63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:00.208435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbc2ad-6664-4858-9af3-4a95c7f5fd63 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:00.227219 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 698/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:00.499913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c5c60-e1b5-4070-8e57-fe4cd397ed85 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:00.500510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c5c60-e1b5-4070-8e57-fe4cd397ed85 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:00.500510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c5c60-e1b5-4070-8e57-fe4cd397ed85 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:00.501841 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 694/1392] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:00.507108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf059c-6f2b-4dea-869c-88ec16f284c9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:00.507570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf059c-6f2b-4dea-869c-88ec16f284c9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:00.507685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf059c-6f2b-4dea-869c-88ec16f284c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:00.579017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-30bf059c-6f2b-4dea-869c-88ec16f284c9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:00.580241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-30bf059c-6f2b-4dea-869c-88ec16f284c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:00.665410 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:00.678984 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 699/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:00.976802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389102-fd8c-4291-91b0-88583ed31e08 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:00.977105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389102-fd8c-4291-91b0-88583ed31e08 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:00.977386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389102-fd8c-4291-91b0-88583ed31e08 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:00.978725 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 695/1394] 10.222.0.16 () {54 vars in 966 bytes} [Sun Sep 11 00:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:00.984514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c4018-7ace-40f5-a46e-291245e408cc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:00.984793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c4018-7ace-40f5-a46e-291245e408cc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:00.985084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c4018-7ace-40f5-a46e-291245e408cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:01.062292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aa2c4018-7ace-40f5-a46e-291245e408cc None None] MFA Rules not processed for user `d7306de1f2fb4ebfb4177d9acfb25fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:01.063514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa2c4018-7ace-40f5-a46e-291245e408cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:01.138844 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 700/1395] 10.222.0.16 () {58 vars in 1063 bytes} [Sun Sep 11 00:54:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:01.148570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389102-fd8c-4291-91b0-88583ed31e08 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:01.150277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2c389102-fd8c-4291-91b0-88583ed31e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:01.255630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389102-fd8c-4291-91b0-88583ed31e08 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:01.330478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37670b-830a-404a-b5c8-bb7d274da65b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:01.331109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37670b-830a-404a-b5c8-bb7d274da65b service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:01.331388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37670b-830a-404a-b5c8-bb7d274da65b service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:01.331657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37670b-830a-404a-b5c8-bb7d274da65b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:01.333328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb37670b-830a-404a-b5c8-bb7d274da65b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:01.385620 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:01.452909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37670b-830a-404a-b5c8-bb7d274da65b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:01.454423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37670b-830a-404a-b5c8-bb7d274da65b service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:01.473448 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 696/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:02.233766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ecff-b2a4-47bf-88f8-cbc89d3812ba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:02.234252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ecff-b2a4-47bf-88f8-cbc89d3812ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:02.234378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6ecff-b2a4-47bf-88f8-cbc89d3812ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:02.303976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9ad6ecff-b2a4-47bf-88f8-cbc89d3812ba None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:02.305221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9ad6ecff-b2a4-47bf-88f8-cbc89d3812ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:02.343509 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:02.402381 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 701/1397] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 00:54:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:02.445473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439ff09-723a-4b7f-b3dc-847cec71bd26 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:02.445980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439ff09-723a-4b7f-b3dc-847cec71bd26 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:02.446142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439ff09-723a-4b7f-b3dc-847cec71bd26 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:02.447609 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 697/1398] 10.222.0.16 () {54 vars in 943 bytes} [Sun Sep 11 00:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:02.454318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:02.454494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e832d-1251-48f0-ba80-941de3ec9280 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:02.454612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:02.454716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e832d-1251-48f0-ba80-941de3ec9280 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:02.454869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:02.455002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e832d-1251-48f0-ba80-941de3ec9280 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:02.456269 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 702/1399] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:02.461285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:02.461566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:02.461839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:02.534293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] MFA Rules not processed for user `3ada7c97c73b43e09c30a603e648bcb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:02.535233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:02.535515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:02.536482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:02.620104 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:02.633970 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 703/1400] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:02.648023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 698/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 11 00:54:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:02.657375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:02.658641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:02.685346 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:02.762060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785b51c-8327-4c0a-8119-ef7d199e567f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:02.864891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c878a-7489-45ef-bda8-f6b51ec1c27e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:02.865536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c878a-7489-45ef-bda8-f6b51ec1c27e service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:02.865815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c878a-7489-45ef-bda8-f6b51ec1c27e service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:02.866088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c878a-7489-45ef-bda8-f6b51ec1c27e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:02.867722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7c4c878a-7489-45ef-bda8-f6b51ec1c27e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:02.913089 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:02.923820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:02.925097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:02.954860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c878a-7489-45ef-bda8-f6b51ec1c27e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:02.956627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c878a-7489-45ef-bda8-f6b51ec1c27e service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:02.964675 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 704/1402] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 00:54:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:54:03.026972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145944b-6129-4393-8324-1b88f4a9341e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:03.151516 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:03.162918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fe1e0-d131-491f-8f32-6a21f046a7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:03.163899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe1e0-d131-491f-8f32-6a21f046a7bb service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:03.164176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe1e0-d131-491f-8f32-6a21f046a7bb service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:03.164442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fe1e0-d131-491f-8f32-6a21f046a7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:03.166073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a2fe1e0-d131-491f-8f32-6a21f046a7bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:03.268031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fe1e0-d131-491f-8f32-6a21f046a7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:03.269787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fe1e0-d131-491f-8f32-6a21f046a7bb service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:03.293797 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 699/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:54:05.580410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8a1b-637e-479f-87d9-8baecbf001e7 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:05.580978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8a1b-637e-479f-87d9-8baecbf001e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:05.580978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8a1b-637e-479f-87d9-8baecbf001e7 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:05.582309 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 705/1404] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:05.589397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87ec1-cbea-45f1-8b8f-54517a800152 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:05.590348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87ec1-cbea-45f1-8b8f-54517a800152 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:05.590689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87ec1-cbea-45f1-8b8f-54517a800152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:05.666398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e5a87ec1-cbea-45f1-8b8f-54517a800152 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:05.667633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5a87ec1-cbea-45f1-8b8f-54517a800152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:05.733890 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:05.772732 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 700/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:06.080867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8a1b-637e-479f-87d9-8baecbf001e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:06.082559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f7fc8a1b-637e-479f-87d9-8baecbf001e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:06.247410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8a1b-637e-479f-87d9-8baecbf001e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:06.291998 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:06.382871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9aff-27af-4346-a9b7-1d1c089ce6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:06.383398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9aff-27af-4346-a9b7-1d1c089ce6df service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:06.383667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9aff-27af-4346-a9b7-1d1c089ce6df service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:06.383935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9aff-27af-4346-a9b7-1d1c089ce6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:06.385567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-106f9aff-27af-4346-a9b7-1d1c089ce6df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:06.487872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f9aff-27af-4346-a9b7-1d1c089ce6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:06.489639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f9aff-27af-4346-a9b7-1d1c089ce6df service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:06.510963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 706/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:08.728115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f9d28-837d-4f8e-ad7d-e4eda5b9deef None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:08.728680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f9d28-837d-4f8e-ad7d-e4eda5b9deef None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:08.728680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f9d28-837d-4f8e-ad7d-e4eda5b9deef None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:08.730292 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 701/1407] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:08.736625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05dbf-ffaa-47c6-bcf8-d82bb6e60057 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:08.737130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05dbf-ffaa-47c6-bcf8-d82bb6e60057 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:08.737265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05dbf-ffaa-47c6-bcf8-d82bb6e60057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:08.793677 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:08.812379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b8d05dbf-ffaa-47c6-bcf8-d82bb6e60057 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:08.814106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b8d05dbf-ffaa-47c6-bcf8-d82bb6e60057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:08.926081 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 707/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:09.227337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f9d28-837d-4f8e-ad7d-e4eda5b9deef None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:09.228869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2d4f9d28-837d-4f8e-ad7d-e4eda5b9deef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:09.391733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f9d28-837d-4f8e-ad7d-e4eda5b9deef None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:09.445323 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:09.517374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb10ca-ef15-462f-a20e-f8030d759b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:09.518365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb10ca-ef15-462f-a20e-f8030d759b7a service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:09.519021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb10ca-ef15-462f-a20e-f8030d759b7a service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:09.519363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb10ca-ef15-462f-a20e-f8030d759b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:09.521052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-88cb10ca-ef15-462f-a20e-f8030d759b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:09.627208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb10ca-ef15-462f-a20e-f8030d759b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:09.629085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb10ca-ef15-462f-a20e-f8030d759b7a service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:09.649385 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 702/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:18.924695 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=46 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:19.646549 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=76 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:26.226312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ae54-bac9-41d0-82e3-ba9b223c112b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:26.226908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ae54-bac9-41d0-82e3-ba9b223c112b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:26.226908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ae54-bac9-41d0-82e3-ba9b223c112b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:26.228235 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 708/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 11 00:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:54:26.234001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025100-72d1-4cca-ab00-64619ccd03e7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:26.234452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025100-72d1-4cca-ab00-64619ccd03e7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:26.234563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025100-72d1-4cca-ab00-64619ccd03e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:26.309869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c0025100-72d1-4cca-ab00-64619ccd03e7 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:26.311078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c0025100-72d1-4cca-ab00-64619ccd03e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:26.421195 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 703/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 11 00:54:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:26.435533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e815bff-38e7-4bc6-8fd0-5a557abfdc21 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:26.435819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e815bff-38e7-4bc6-8fd0-5a557abfdc21 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:26.436092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e815bff-38e7-4bc6-8fd0-5a557abfdc21 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:26.437645 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 709/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 11 00:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:26.442542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee09c08-baf7-43c6-87a6-3a7aa61412f5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:26.442824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee09c08-baf7-43c6-87a6-3a7aa61412f5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:26.443096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee09c08-baf7-43c6-87a6-3a7aa61412f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:26.516718 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:26.519644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2ee09c08-baf7-43c6-87a6-3a7aa61412f5 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:26.521500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2ee09c08-baf7-43c6-87a6-3a7aa61412f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:26.637082 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 704/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 11 00:54:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:29.232227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0b4e-ca14-4155-acb7-b7be088c6e64 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:29.232775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0b4e-ca14-4155-acb7-b7be088c6e64 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:29.232902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0b4e-ca14-4155-acb7-b7be088c6e64 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:29.235065 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:29.240336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a175aa6-2fcc-4d43-9630-e6511001fd48 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:29.240777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a175aa6-2fcc-4d43-9630-e6511001fd48 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:29.240884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a175aa6-2fcc-4d43-9630-e6511001fd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:29.309523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0a175aa6-2fcc-4d43-9630-e6511001fd48 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:29.310720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0a175aa6-2fcc-4d43-9630-e6511001fd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:29.365444 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:29.406834 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:29.700119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0b4e-ca14-4155-acb7-b7be088c6e64 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:29.701746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ead0b4e-ca14-4155-acb7-b7be088c6e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:29.849120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0b4e-ca14-4155-acb7-b7be088c6e64 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:29.922008 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:29.962424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c691de-0f8c-44a6-a1e9-ea851051ebb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:29.963025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c691de-0f8c-44a6-a1e9-ea851051ebb2 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:29.963302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c691de-0f8c-44a6-a1e9-ea851051ebb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:29.963571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c691de-0f8c-44a6-a1e9-ea851051ebb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:29.965195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d4c691de-0f8c-44a6-a1e9-ea851051ebb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:30.056477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c691de-0f8c-44a6-a1e9-ea851051ebb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:30.058085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c691de-0f8c-44a6-a1e9-ea851051ebb2 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:30.076593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 711/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:31.231238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f62af-6235-4511-825c-3b1140e29994 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:31.231837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f62af-6235-4511-825c-3b1140e29994 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:31.231837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f62af-6235-4511-825c-3b1140e29994 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:31.233172 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:31.239269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82c13-5829-4748-8758-945d946a5e3c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:31.239703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82c13-5829-4748-8758-945d946a5e3c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:31.239823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82c13-5829-4748-8758-945d946a5e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:31.316078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-56e82c13-5829-4748-8758-945d946a5e3c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:31.317306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56e82c13-5829-4748-8758-945d946a5e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:31.345167 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:31.415923 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:31.586566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f62af-6235-4511-825c-3b1140e29994 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:31.588062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f23f62af-6235-4511-825c-3b1140e29994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:31.732168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f62af-6235-4511-825c-3b1140e29994 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:31.772074 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:31.846242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdb1b-ac26-4662-bca9-1d04304e9692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:31.846769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdb1b-ac26-4662-bca9-1d04304e9692 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:31.847044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdb1b-ac26-4662-bca9-1d04304e9692 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:31.847314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdb1b-ac26-4662-bca9-1d04304e9692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:31.848908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c1ebdb1b-ac26-4662-bca9-1d04304e9692 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:31.938464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebdb1b-ac26-4662-bca9-1d04304e9692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:31.940067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebdb1b-ac26-4662-bca9-1d04304e9692 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:31.958356 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 707/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:33.087462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb62a2-688e-482d-ba4a-aadb11d4256d None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:33.088031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb62a2-688e-482d-ba4a-aadb11d4256d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:33.088031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb62a2-688e-482d-ba4a-aadb11d4256d None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:33.089353 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:33.095526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695924-7e3c-4d9b-9a52-c4f96bbd127e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:33.095959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695924-7e3c-4d9b-9a52-c4f96bbd127e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:33.096074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695924-7e3c-4d9b-9a52-c4f96bbd127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:33.151273 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:33.173464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3f695924-7e3c-4d9b-9a52-c4f96bbd127e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:33.174678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3f695924-7e3c-4d9b-9a52-c4f96bbd127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:33.268289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:33.422240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb62a2-688e-482d-ba4a-aadb11d4256d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:33.423783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0eeb62a2-688e-482d-ba4a-aadb11d4256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:33.569783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb62a2-688e-482d-ba4a-aadb11d4256d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:33.582421 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:33.682350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b7e45-a106-470d-b632-9015e3e1ebe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:33.682874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7e45-a106-470d-b632-9015e3e1ebe4 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:33.683153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7e45-a106-470d-b632-9015e3e1ebe4 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:33.683422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7e45-a106-470d-b632-9015e3e1ebe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:33.685015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e3b7e45-a106-470d-b632-9015e3e1ebe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:33.774547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b7e45-a106-470d-b632-9015e3e1ebe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:33.776125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b7e45-a106-470d-b632-9015e3e1ebe4 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:33.793737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 714/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:34.907218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d375-b589-4026-b3f5-0cdca62a6099 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:34.907759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d375-b589-4026-b3f5-0cdca62a6099 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:34.907759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d375-b589-4026-b3f5-0cdca62a6099 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:34.909042 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:34.915154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90371c-6c6d-49b2-97a9-2423e8b9d003 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:34.915630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90371c-6c6d-49b2-97a9-2423e8b9d003 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:34.915729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90371c-6c6d-49b2-97a9-2423e8b9d003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:34.935593 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:34.991593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3d90371c-6c6d-49b2-97a9-2423e8b9d003 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:34.992782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3d90371c-6c6d-49b2-97a9-2423e8b9d003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:35.093150 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:35.244624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308d375-b589-4026-b3f5-0cdca62a6099 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:35.246204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3308d375-b589-4026-b3f5-0cdca62a6099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:35.359195 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:35.395704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308d375-b589-4026-b3f5-0cdca62a6099 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:35.505608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae3bf-8b26-4901-bb90-85274266f208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:35.506127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae3bf-8b26-4901-bb90-85274266f208 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:35.506398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae3bf-8b26-4901-bb90-85274266f208 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:35.506662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae3bf-8b26-4901-bb90-85274266f208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:35.508232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6f8ae3bf-8b26-4901-bb90-85274266f208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:35.586980 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:35.600875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ae3bf-8b26-4901-bb90-85274266f208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:35.602490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ae3bf-8b26-4901-bb90-85274266f208 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:35.623475 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 710/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:36.760402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969fe1-7173-413b-869f-1aa6c640857d None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:36.760963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969fe1-7173-413b-869f-1aa6c640857d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:36.760963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969fe1-7173-413b-869f-1aa6c640857d None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:36.762327 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:36.769250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025eacdc-a30c-4c80-a68b-3d99ea845138 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:36.769681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025eacdc-a30c-4c80-a68b-3d99ea845138 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:36.769876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025eacdc-a30c-4c80-a68b-3d99ea845138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:36.847206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-025eacdc-a30c-4c80-a68b-3d99ea845138 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:36.848354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-025eacdc-a30c-4c80-a68b-3d99ea845138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:36.943413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:37.094051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58969fe1-7173-413b-869f-1aa6c640857d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:37.095699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-58969fe1-7173-413b-869f-1aa6c640857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:37.179727 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:37.240309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58969fe1-7173-413b-869f-1aa6c640857d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:37.351352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681100d0-9bff-4280-9544-2a91babd10b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:37.351949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681100d0-9bff-4280-9544-2a91babd10b8 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:37.352223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681100d0-9bff-4280-9544-2a91babd10b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:37.352489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681100d0-9bff-4280-9544-2a91babd10b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:37.354120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-681100d0-9bff-4280-9544-2a91babd10b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:37.402006 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:37.443600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681100d0-9bff-4280-9544-2a91babd10b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:37.445118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681100d0-9bff-4280-9544-2a91babd10b8 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:37.462745 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 717/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:38.512113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d04bc-c2c4-4ef1-892b-fa19b05b8b5b None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.512676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d04bc-c2c4-4ef1-892b-fa19b05b8b5b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.512676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d04bc-c2c4-4ef1-892b-fa19b05b8b5b None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.514015 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:38.521003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c590a6-0646-4601-a9d3-8614755ab2be None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:38.521477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c590a6-0646-4601-a9d3-8614755ab2be None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:38.521596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c590a6-0646-4601-a9d3-8614755ab2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:38.600092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-08c590a6-0646-4601-a9d3-8614755ab2be None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:38.601329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-08c590a6-0646-4601-a9d3-8614755ab2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:38.697501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:38.849915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d04bc-c2c4-4ef1-892b-fa19b05b8b5b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:38.851337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c31d04bc-c2c4-4ef1-892b-fa19b05b8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:38.900995 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:39.008823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d04bc-c2c4-4ef1-892b-fa19b05b8b5b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:39.156942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bd012-25ab-4561-926c-7bed2a67ac0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:39.157667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd012-25ab-4561-926c-7bed2a67ac0c service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:39.157960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd012-25ab-4561-926c-7bed2a67ac0c service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:39.158227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd012-25ab-4561-926c-7bed2a67ac0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:39.159818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-897bd012-25ab-4561-926c-7bed2a67ac0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:39.169076 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:39.261799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bd012-25ab-4561-926c-7bed2a67ac0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:39.263422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bd012-25ab-4561-926c-7bed2a67ac0c service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:39.283745 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 713/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:40.355094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd82b-ba15-4750-b1a3-d33ccf19af63 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:40.355675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd82b-ba15-4750-b1a3-d33ccf19af63 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:40.355675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd82b-ba15-4750-b1a3-d33ccf19af63 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:40.356964 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:40.364163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33dd1-f42e-4678-898c-446dece846de None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:40.364571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33dd1-f42e-4678-898c-446dece846de None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:40.364702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33dd1-f42e-4678-898c-446dece846de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:40.439147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-23a33dd1-f42e-4678-898c-446dece846de None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:40.440369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-23a33dd1-f42e-4678-898c-446dece846de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:40.507763 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:40.539039 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:40.690431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fd82b-ba15-4750-b1a3-d33ccf19af63 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:40.691864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a87fd82b-ba15-4750-b1a3-d33ccf19af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:40.709839 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:40.838704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fd82b-ba15-4750-b1a3-d33ccf19af63 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:40.923549 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:40.949375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b432e08-9ee0-4181-80a9-beec463e47a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:40.949909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b432e08-9ee0-4181-80a9-beec463e47a5 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:40.950184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b432e08-9ee0-4181-80a9-beec463e47a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:40.950444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b432e08-9ee0-4181-80a9-beec463e47a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:40.952023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b432e08-9ee0-4181-80a9-beec463e47a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:41.041692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b432e08-9ee0-4181-80a9-beec463e47a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:41.043279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b432e08-9ee0-4181-80a9-beec463e47a5 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:41.060966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 720/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:42.145765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2663-e51f-4271-8ca6-0233a7daf5ff None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:42.146306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2663-e51f-4271-8ca6-0233a7daf5ff None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:42.146306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2663-e51f-4271-8ca6-0233a7daf5ff None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:42.147553 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:42.154224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c209c3-b395-48dc-94dc-079b9af72c31 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:42.154626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c209c3-b395-48dc-94dc-079b9af72c31 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:42.154771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c209c3-b395-48dc-94dc-079b9af72c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:42.231873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-23c209c3-b395-48dc-94dc-079b9af72c31 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:42.233086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23c209c3-b395-48dc-94dc-079b9af72c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:42.274421 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:42.328836 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:42.480191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e2663-e51f-4271-8ca6-0233a7daf5ff None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:42.481835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-781e2663-e51f-4271-8ca6-0233a7daf5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:42.627148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e2663-e51f-4271-8ca6-0233a7daf5ff None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:42.680892 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:42.739702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fefc34-8a88-4b37-8eab-8bc1925a87c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:42.740229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fefc34-8a88-4b37-8eab-8bc1925a87c9 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:42.740505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fefc34-8a88-4b37-8eab-8bc1925a87c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:42.740768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fefc34-8a88-4b37-8eab-8bc1925a87c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:42.742391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f4fefc34-8a88-4b37-8eab-8bc1925a87c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:42.831550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fefc34-8a88-4b37-8eab-8bc1925a87c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:42.833166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fefc34-8a88-4b37-8eab-8bc1925a87c9 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:42.850861 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 716/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:43.899597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14038bb1-0d9a-48b0-b4b4-a795732005c8 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:43.900114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14038bb1-0d9a-48b0-b4b4-a795732005c8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:43.900114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14038bb1-0d9a-48b0-b4b4-a795732005c8 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:43.901520 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:43.908273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a43340-f040-44fa-a0a2-ccb4d114db1a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:43.908704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a43340-f040-44fa-a0a2-ccb4d114db1a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:43.908799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a43340-f040-44fa-a0a2-ccb4d114db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:43.983882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-80a43340-f040-44fa-a0a2-ccb4d114db1a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:43.986077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80a43340-f040-44fa-a0a2-ccb4d114db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:43.988097 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:44.082806 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:44.235060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14038bb1-0d9a-48b0-b4b4-a795732005c8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:44.236611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-14038bb1-0d9a-48b0-b4b4-a795732005c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:44.379866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14038bb1-0d9a-48b0-b4b4-a795732005c8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:44.406362 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:44.495725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ad37b-9462-426a-bba9-170587578631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:44.496240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ad37b-9462-426a-bba9-170587578631 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:44.496513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ad37b-9462-426a-bba9-170587578631 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:44.496779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ad37b-9462-426a-bba9-170587578631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:44.498384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c3ad37b-9462-426a-bba9-170587578631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:44.590948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ad37b-9462-426a-bba9-170587578631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:44.592544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ad37b-9462-426a-bba9-170587578631 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:44.612768 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 723/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:46.674336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76086b0-1b59-40a0-92c6-55814cdba9a9 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:46.674945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76086b0-1b59-40a0-92c6-55814cdba9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:46.674945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76086b0-1b59-40a0-92c6-55814cdba9a9 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:46.676290 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:46.681818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656f9e6-5329-4928-83a9-7547b9aacbac None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:46.682234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656f9e6-5329-4928-83a9-7547b9aacbac None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:46.682382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656f9e6-5329-4928-83a9-7547b9aacbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:46.722872 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:46.748836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e656f9e6-5329-4928-83a9-7547b9aacbac None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:46.750446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e656f9e6-5329-4928-83a9-7547b9aacbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:46.845692 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:47.130951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76086b0-1b59-40a0-92c6-55814cdba9a9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:47.132455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e76086b0-1b59-40a0-92c6-55814cdba9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:47.235336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76086b0-1b59-40a0-92c6-55814cdba9a9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:47.266926 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:47.308275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948735-2549-42d6-a906-f582409210df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:47.308869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948735-2549-42d6-a906-f582409210df service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:47.309174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948735-2549-42d6-a906-f582409210df service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:47.309448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948735-2549-42d6-a906-f582409210df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:47.311009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-91948735-2549-42d6-a906-f582409210df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:47.417634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91948735-2549-42d6-a906-f582409210df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:47.418962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91948735-2549-42d6-a906-f582409210df service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:47.436907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 719/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:49.763363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c75eb5-36fd-4587-9399-a8b972dfefae None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:49.763918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c75eb5-36fd-4587-9399-a8b972dfefae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:49.763918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c75eb5-36fd-4587-9399-a8b972dfefae None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:49.765292 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:49.771309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e634f7-62d1-4a57-9c51-2ff007c1f642 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:49.771685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e634f7-62d1-4a57-9c51-2ff007c1f642 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:49.771788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e634f7-62d1-4a57-9c51-2ff007c1f642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:49.838600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b3e634f7-62d1-4a57-9c51-2ff007c1f642 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:49.839729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b3e634f7-62d1-4a57-9c51-2ff007c1f642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:49.859820 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:49.943763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:50.233762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c75eb5-36fd-4587-9399-a8b972dfefae None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:50.236126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45c75eb5-36fd-4587-9399-a8b972dfefae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:50.338516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c75eb5-36fd-4587-9399-a8b972dfefae None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:50.351125 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:50.412596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc6e65-6902-4752-b246-bf521f086ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:50.413228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc6e65-6902-4752-b246-bf521f086ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:50.413508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc6e65-6902-4752-b246-bf521f086ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:50.413778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc6e65-6902-4752-b246-bf521f086ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:50.415375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dafc6e65-6902-4752-b246-bf521f086ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:50.526189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc6e65-6902-4752-b246-bf521f086ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:50.527547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc6e65-6902-4752-b246-bf521f086ca8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:50.545814 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 726/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:53.014508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3dcc-c803-446a-895a-12bef030830a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:53.015088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3dcc-c803-446a-895a-12bef030830a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:53.015088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3dcc-c803-446a-895a-12bef030830a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:53.017089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:53.022456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285c1f-d8ca-45e6-9b6b-4218e41298d3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:53.022860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285c1f-d8ca-45e6-9b6b-4218e41298d3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:53.023316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285c1f-d8ca-45e6-9b6b-4218e41298d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:53.072210 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:53.090111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-28285c1f-d8ca-45e6-9b6b-4218e41298d3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:53.091372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28285c1f-d8ca-45e6-9b6b-4218e41298d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:53.193020 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:53.479266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3dcc-c803-446a-895a-12bef030830a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:53.480814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1dcb3dcc-c803-446a-895a-12bef030830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:53.587145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3dcc-c803-446a-895a-12bef030830a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:53.626463 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:53.660776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46af7c1-c23c-4049-96e9-5e0fbca3a4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:53.661474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46af7c1-c23c-4049-96e9-5e0fbca3a4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:53.661752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46af7c1-c23c-4049-96e9-5e0fbca3a4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:53.662021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46af7c1-c23c-4049-96e9-5e0fbca3a4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:53.663631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e46af7c1-c23c-4049-96e9-5e0fbca3a4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:53.771417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46af7c1-c23c-4049-96e9-5e0fbca3a4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:53.772833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46af7c1-c23c-4049-96e9-5e0fbca3a4c1 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:53.791297 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 722/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:56.072137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfce34-b47a-46b6-9fd2-65ac89101253 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:56.072707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfce34-b47a-46b6-9fd2-65ac89101253 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:56.072707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfce34-b47a-46b6-9fd2-65ac89101253 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:56.074059 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:56.079956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d16f-58b3-47af-8d8d-6159d1e0c73b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:56.080384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d16f-58b3-47af-8d8d-6159d1e0c73b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:56.080506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d16f-58b3-47af-8d8d-6159d1e0c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:56.146324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-67d3d16f-58b3-47af-8d8d-6159d1e0c73b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:56.147523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-67d3d16f-58b3-47af-8d8d-6159d1e0c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:56.168033 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:56.243025 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:56.537126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfce34-b47a-46b6-9fd2-65ac89101253 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:56.538664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e0dfce34-b47a-46b6-9fd2-65ac89101253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:56.641898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfce34-b47a-46b6-9fd2-65ac89101253 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:56.663077 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:56.716560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891d2d2-d544-40de-a6f5-05601098ce29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:56.717195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d2d2-d544-40de-a6f5-05601098ce29 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:56.717479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d2d2-d544-40de-a6f5-05601098ce29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:56.717741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891d2d2-d544-40de-a6f5-05601098ce29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:56.720008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c891d2d2-d544-40de-a6f5-05601098ce29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:56.842526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891d2d2-d544-40de-a6f5-05601098ce29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:56.844516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891d2d2-d544-40de-a6f5-05601098ce29 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:56.863291 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 729/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:59.097337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0bc03-7a49-4eab-8e6b-cd955564ad06 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.097933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0bc03-7a49-4eab-8e6b-cd955564ad06 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.097933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0bc03-7a49-4eab-8e6b-cd955564ad06 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.099205 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:59.104606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29862b-9cf0-4ae2-b784-91d3e74aa973 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.105026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29862b-9cf0-4ae2-b784-91d3e74aa973 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.105163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29862b-9cf0-4ae2-b784-91d3e74aa973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.169030 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:59.172444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0f29862b-9cf0-4ae2-b784-91d3e74aa973 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:59.174097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0f29862b-9cf0-4ae2-b784-91d3e74aa973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:59.271563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:59.559177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0bc03-7a49-4eab-8e6b-cd955564ad06 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:59.560693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-71e0bc03-7a49-4eab-8e6b-cd955564ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:59.663615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0bc03-7a49-4eab-8e6b-cd955564ad06 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:59.712091 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:59.736094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede13da8-3b28-4e18-bdbd-e0ab934e5cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:59.736696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede13da8-3b28-4e18-bdbd-e0ab934e5cea service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:59.737007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede13da8-3b28-4e18-bdbd-e0ab934e5cea service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:59.737309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede13da8-3b28-4e18-bdbd-e0ab934e5cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:59.738909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ede13da8-3b28-4e18-bdbd-e0ab934e5cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:59.848097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede13da8-3b28-4e18-bdbd-e0ab934e5cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:59.849564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede13da8-3b28-4e18-bdbd-e0ab934e5cea service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:59.870737 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 725/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:02.085372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb0f37-8efa-457e-ad18-71fbb2949665 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:02.085904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb0f37-8efa-457e-ad18-71fbb2949665 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:02.085904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb0f37-8efa-457e-ad18-71fbb2949665 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.087167 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:02.092475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d424b7-7f2d-4d13-bc54-a8fa02b6ec04 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:02.092902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d424b7-7f2d-4d13-bc54-a8fa02b6ec04 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:02.093024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d424b7-7f2d-4d13-bc54-a8fa02b6ec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.161619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-21d424b7-7f2d-4d13-bc54-a8fa02b6ec04 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:02.162830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-21d424b7-7f2d-4d13-bc54-a8fa02b6ec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:02.192174 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:02.260616 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:02.543009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb0f37-8efa-457e-ad18-71fbb2949665 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:02.544565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-82cb0f37-8efa-457e-ad18-71fbb2949665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:02.647315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb0f37-8efa-457e-ad18-71fbb2949665 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:02.676533 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:02.721618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad010d5c-41c2-40e8-ac92-dd9f146e989a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:02.722215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010d5c-41c2-40e8-ac92-dd9f146e989a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:02.722490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010d5c-41c2-40e8-ac92-dd9f146e989a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:02.722756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad010d5c-41c2-40e8-ac92-dd9f146e989a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:02.724340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad010d5c-41c2-40e8-ac92-dd9f146e989a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:02.853305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad010d5c-41c2-40e8-ac92-dd9f146e989a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:02.854647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad010d5c-41c2-40e8-ac92-dd9f146e989a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:02.872983 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 732/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:05.082917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292272af-fa38-4e7d-86da-ee76c2392ca1 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.083504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292272af-fa38-4e7d-86da-ee76c2392ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.083504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292272af-fa38-4e7d-86da-ee76c2392ca1 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.084803 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:05.090188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe602f0-638d-4353-8e07-3bf8becb9ea1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.090608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe602f0-638d-4353-8e07-3bf8becb9ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.090735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe602f0-638d-4353-8e07-3bf8becb9ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.160753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-efe602f0-638d-4353-8e07-3bf8becb9ea1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:05.161995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-efe602f0-638d-4353-8e07-3bf8becb9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:05.170240 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:05.257288 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:05.540889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292272af-fa38-4e7d-86da-ee76c2392ca1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:05.542473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-292272af-fa38-4e7d-86da-ee76c2392ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:05.645504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292272af-fa38-4e7d-86da-ee76c2392ca1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:05.700091 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:05.718186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae68637-bd39-4ff2-b55b-2d2f841894fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:05.719312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68637-bd39-4ff2-b55b-2d2f841894fb service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:05.719570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68637-bd39-4ff2-b55b-2d2f841894fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:05.719837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68637-bd39-4ff2-b55b-2d2f841894fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:05.721443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ae68637-bd39-4ff2-b55b-2d2f841894fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:05.830427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae68637-bd39-4ff2-b55b-2d2f841894fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:05.831856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae68637-bd39-4ff2-b55b-2d2f841894fb service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:05.850618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 728/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:08.051546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1cf4b-b8f6-4c50-9f2e-f8a1ec39b3e6 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:08.052063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1cf4b-b8f6-4c50-9f2e-f8a1ec39b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:08.052063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1cf4b-b8f6-4c50-9f2e-f8a1ec39b3e6 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:08.053404 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:08.058674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddcb3e-6fd3-401d-8548-f565508593ec None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:08.059113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddcb3e-6fd3-401d-8548-f565508593ec None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:08.059221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddcb3e-6fd3-401d-8548-f565508593ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:08.124381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1dddcb3e-6fd3-401d-8548-f565508593ec None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:08.126113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1dddcb3e-6fd3-401d-8548-f565508593ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:08.167135 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:08.224540 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:08.512392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1cf4b-b8f6-4c50-9f2e-f8a1ec39b3e6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:08.514027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2fd1cf4b-b8f6-4c50-9f2e-f8a1ec39b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:08.621290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1cf4b-b8f6-4c50-9f2e-f8a1ec39b3e6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:08.774576 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:08.811454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95e1fb-dfc3-4d9e-9dd0-617cab7fbb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:08.812059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95e1fb-dfc3-4d9e-9dd0-617cab7fbb77 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:08.812338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95e1fb-dfc3-4d9e-9dd0-617cab7fbb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:08.812604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95e1fb-dfc3-4d9e-9dd0-617cab7fbb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:08.814238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ab95e1fb-dfc3-4d9e-9dd0-617cab7fbb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:08.919967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95e1fb-dfc3-4d9e-9dd0-617cab7fbb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:08.921410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95e1fb-dfc3-4d9e-9dd0-617cab7fbb77 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:08.939610 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 735/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:11.130749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7401fbb-de67-40cb-9c39-610ff3eb182e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.131435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7401fbb-de67-40cb-9c39-610ff3eb182e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.131435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7401fbb-de67-40cb-9c39-610ff3eb182e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.133048 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:55:11.138571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37bbe-c82b-44a1-a2fe-9fdac2d8ba13 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.139029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37bbe-c82b-44a1-a2fe-9fdac2d8ba13 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.139138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37bbe-c82b-44a1-a2fe-9fdac2d8ba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.204647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-96f37bbe-c82b-44a1-a2fe-9fdac2d8ba13 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:11.205890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96f37bbe-c82b-44a1-a2fe-9fdac2d8ba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.223972 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:11.301798 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:11.587433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7401fbb-de67-40cb-9c39-610ff3eb182e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:11.588988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d7401fbb-de67-40cb-9c39-610ff3eb182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.692592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7401fbb-de67-40cb-9c39-610ff3eb182e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:11.759166 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:11.767437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d408e1-7180-4349-9907-244014b5833c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:11.768041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d408e1-7180-4349-9907-244014b5833c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:11.768315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d408e1-7180-4349-9907-244014b5833c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:11.768580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d408e1-7180-4349-9907-244014b5833c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:11.770196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f5d408e1-7180-4349-9907-244014b5833c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:11.888328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d408e1-7180-4349-9907-244014b5833c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:11.889800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d408e1-7180-4349-9907-244014b5833c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:11.909149 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 731/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:14.100858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85fb7e-25dc-4ec6-ab9f-d5407183d5c1 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.101394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85fb7e-25dc-4ec6-ab9f-d5407183d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.101515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85fb7e-25dc-4ec6-ab9f-d5407183d5c1 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.102811 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:14.108178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4611c-d646-413e-b159-8f84150739a1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.108572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4611c-d646-413e-b159-8f84150739a1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.108733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4611c-d646-413e-b159-8f84150739a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.295224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fbd4611c-d646-413e-b159-8f84150739a1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:14.296960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fbd4611c-d646-413e-b159-8f84150739a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.343826 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:14.391675 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:14.673968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85fb7e-25dc-4ec6-ab9f-d5407183d5c1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:14.675504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6c85fb7e-25dc-4ec6-ab9f-d5407183d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.777994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85fb7e-25dc-4ec6-ab9f-d5407183d5c1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:14.828423 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:14.854209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688a5b2-7e02-4880-8642-5ece01628c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:14.854808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688a5b2-7e02-4880-8642-5ece01628c91 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:14.855085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688a5b2-7e02-4880-8642-5ece01628c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:14.855353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688a5b2-7e02-4880-8642-5ece01628c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:14.856953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d688a5b2-7e02-4880-8642-5ece01628c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:14.966249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688a5b2-7e02-4880-8642-5ece01628c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:14.967687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688a5b2-7e02-4880-8642-5ece01628c91 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:14.985897 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 738/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:24.390074 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=22 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:24.983538 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=66 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:35.231992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551b373-7386-4c97-9f13-e277252ec9d1 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:35.232548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551b373-7386-4c97-9f13-e277252ec9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:35.232548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551b373-7386-4c97-9f13-e277252ec9d1 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:35.234593 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 733/1471] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:35.239869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5be9-1870-43ca-ab56-4e009793cccd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:35.240324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5be9-1870-43ca-ab56-4e009793cccd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:35.240438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5be9-1870-43ca-ab56-4e009793cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:35.307337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1e4e5be9-1870-43ca-ab56-4e009793cccd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:35.308537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1e4e5be9-1870-43ca-ab56-4e009793cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:35.406332 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 739/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:35.713381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df758af-7f2f-456f-bf75-562d92fdbf73 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:35.713669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df758af-7f2f-456f-bf75-562d92fdbf73 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:35.713977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df758af-7f2f-456f-bf75-562d92fdbf73 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:35.715300 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 734/1473] 10.222.0.16 () {54 vars in 966 bytes} [Sun Sep 11 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:55:35.720814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3d9d-2c6f-4cbe-be8b-98ced358847d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:35.721138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3d9d-2c6f-4cbe-be8b-98ced358847d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:35.721418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3d9d-2c6f-4cbe-be8b-98ced358847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:35.797665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ddfe3d9d-2c6f-4cbe-be8b-98ced358847d None None] MFA Rules not processed for user `d7306de1f2fb4ebfb4177d9acfb25fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:35.798796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ddfe3d9d-2c6f-4cbe-be8b-98ced358847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:35.820184 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:35.876795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 740/1474] 10.222.0.16 () {58 vars in 1063 bytes} [Sun Sep 11 00:55:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:35.884502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df758af-7f2f-456f-bf75-562d92fdbf73 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:35.886035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9df758af-7f2f-456f-bf75-562d92fdbf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:35.990294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df758af-7f2f-456f-bf75-562d92fdbf73 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:36.060905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5436e5c-5f0f-4460-8912-c10034532dca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:36.061460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436e5c-5f0f-4460-8912-c10034532dca service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:36.062334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436e5c-5f0f-4460-8912-c10034532dca service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:36.062615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436e5c-5f0f-4460-8912-c10034532dca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:36.064191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5436e5c-5f0f-4460-8912-c10034532dca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:36.118073 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:36.177046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5436e5c-5f0f-4460-8912-c10034532dca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:36.178513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5436e5c-5f0f-4460-8912-c10034532dca service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:36.196900 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 735/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:38.433570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ead3-a0a2-4f5a-b44a-1504a48c67ad None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.434117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ead3-a0a2-4f5a-b44a-1504a48c67ad None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.434117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ead3-a0a2-4f5a-b44a-1504a48c67ad None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.435464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 741/1476] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:38.441437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ff1f-e9bb-42ba-a881-9ca0bd9b3bbd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:38.441879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ff1f-e9bb-42ba-a881-9ca0bd9b3bbd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:38.441997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7ff1f-e9bb-42ba-a881-9ca0bd9b3bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:38.507560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-60d7ff1f-e9bb-42ba-a881-9ca0bd9b3bbd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:38.508756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-60d7ff1f-e9bb-42ba-a881-9ca0bd9b3bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:38.604915 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 736/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:38.880084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03ead3-a0a2-4f5a-b44a-1504a48c67ad None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:38.881662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b03ead3-a0a2-4f5a-b44a-1504a48c67ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:39.006102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03ead3-a0a2-4f5a-b44a-1504a48c67ad None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:39.055188 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:39.098848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f9a5a-f0c5-405a-8624-c01d34e3531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:39.099450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f9a5a-f0c5-405a-8624-c01d34e3531e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:39.099733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f9a5a-f0c5-405a-8624-c01d34e3531e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:39.100006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f9a5a-f0c5-405a-8624-c01d34e3531e admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:39.100639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f9a5a-f0c5-405a-8624-c01d34e3531e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:39.102387 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-0c9f9a5a-f0c5-405a-8624-c01d34e3531e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:55:39.102387 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 00:55:39.102387 n-d-master-1 devstack@keystone.service[81860]: Sep 11 00:55:39.103509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f9a5a-f0c5-405a-8624-c01d34e3531e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:39.122995 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 742/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 11 00:55:38 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:41.315261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320e5f4-31fc-40a8-8b5c-3b7fae89c82a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:41.315933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320e5f4-31fc-40a8-8b5c-3b7fae89c82a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:41.315933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320e5f4-31fc-40a8-8b5c-3b7fae89c82a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:41.317166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 737/1479] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:41.323277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8eb7-9fc8-44ef-899a-ca56e33ef43b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:41.323949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8eb7-9fc8-44ef-899a-ca56e33ef43b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:41.324128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8eb7-9fc8-44ef-899a-ca56e33ef43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:41.408834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-94ae8eb7-9fc8-44ef-899a-ca56e33ef43b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:41.410110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-94ae8eb7-9fc8-44ef-899a-ca56e33ef43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:41.509433 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 743/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:41.816391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320e5f4-31fc-40a8-8b5c-3b7fae89c82a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:41.818014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f320e5f4-31fc-40a8-8b5c-3b7fae89c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:41.828389 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:41.974099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320e5f4-31fc-40a8-8b5c-3b7fae89c82a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:42.055354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:42.087738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456c5e-a1fe-439d-adf4-f27b42e0d8c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:42.088338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456c5e-a1fe-439d-adf4-f27b42e0d8c3 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:42.088610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456c5e-a1fe-439d-adf4-f27b42e0d8c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:42.088873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456c5e-a1fe-439d-adf4-f27b42e0d8c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:42.090474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-67456c5e-a1fe-439d-adf4-f27b42e0d8c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:42.180413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67456c5e-a1fe-439d-adf4-f27b42e0d8c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:42.182027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67456c5e-a1fe-439d-adf4-f27b42e0d8c3 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:42.200753 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 738/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:44.543433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257bfb6-e57f-46c6-ae5c-b86a95515e7b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:44.543880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257bfb6-e57f-46c6-ae5c-b86a95515e7b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:44.544003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257bfb6-e57f-46c6-ae5c-b86a95515e7b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:44.545395 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 744/1482] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:44.551025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985517d-a70e-423b-8fa0-cec2a274e8b2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:44.551445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985517d-a70e-423b-8fa0-cec2a274e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:44.551555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985517d-a70e-423b-8fa0-cec2a274e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:44.615928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0985517d-a70e-423b-8fa0-cec2a274e8b2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:44.617140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0985517d-a70e-423b-8fa0-cec2a274e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:44.662932 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:44.712096 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 739/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:44.996695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257bfb6-e57f-46c6-ae5c-b86a95515e7b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:44.998255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d257bfb6-e57f-46c6-ae5c-b86a95515e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:45.021936 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:45.103667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257bfb6-e57f-46c6-ae5c-b86a95515e7b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:45.178888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6ace2-3293-4cef-be82-45c8afe7886d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:45.179485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ace2-3293-4cef-be82-45c8afe7886d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:45.179760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ace2-3293-4cef-be82-45c8afe7886d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:45.180029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ace2-3293-4cef-be82-45c8afe7886d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:45.181652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-27c6ace2-3293-4cef-be82-45c8afe7886d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:45.256894 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:45.292354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6ace2-3293-4cef-be82-45c8afe7886d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:45.293856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6ace2-3293-4cef-be82-45c8afe7886d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:45.312838 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 745/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:47.520728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12488-4b3a-4f9d-99b9-bc0ff101258e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.521342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12488-4b3a-4f9d-99b9-bc0ff101258e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.521342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12488-4b3a-4f9d-99b9-bc0ff101258e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.522720 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 740/1485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:55:47.528355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106419e0-9337-4c16-83b6-ac30e49813b7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.528815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106419e0-9337-4c16-83b6-ac30e49813b7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.528928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106419e0-9337-4c16-83b6-ac30e49813b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.602049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-106419e0-9337-4c16-83b6-ac30e49813b7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:47.603284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-106419e0-9337-4c16-83b6-ac30e49813b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:47.707354 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 746/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:48.003217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac12488-4b3a-4f9d-99b9-bc0ff101258e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.004772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6ac12488-4b3a-4f9d-99b9-bc0ff101258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:48.106198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac12488-4b3a-4f9d-99b9-bc0ff101258e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.179276 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:48.180766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d0d09-17ab-457f-bbbc-d3ec44159a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.181471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0d09-17ab-457f-bbbc-d3ec44159a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.181933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0d09-17ab-457f-bbbc-d3ec44159a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.182418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d0d09-17ab-457f-bbbc-d3ec44159a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.184240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-979d0d09-17ab-457f-bbbc-d3ec44159a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:48.291901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d0d09-17ab-457f-bbbc-d3ec44159a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.293348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d0d09-17ab-457f-bbbc-d3ec44159a95 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.310738 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 741/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:50.611754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b96ee-4348-4777-9958-61c734b71524 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.612300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b96ee-4348-4777-9958-61c734b71524 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.612300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b96ee-4348-4777-9958-61c734b71524 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.613718 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 747/1488] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:55:50.619039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c4cd-1d55-4d0a-9649-0aba7cc628ed None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:50.619453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c4cd-1d55-4d0a-9649-0aba7cc628ed None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:50.619582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c4cd-1d55-4d0a-9649-0aba7cc628ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:50.686095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-32d4c4cd-1d55-4d0a-9649-0aba7cc628ed None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:50.687836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-32d4c4cd-1d55-4d0a-9649-0aba7cc628ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:50.739269 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:50.784653 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 742/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:51.078618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b96ee-4348-4777-9958-61c734b71524 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:51.080218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d23b96ee-4348-4777-9958-61c734b71524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:51.115966 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:51.183700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b96ee-4348-4777-9958-61c734b71524 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:51.258307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa69be8-3cc9-4cf4-99a3-824655528b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:51.258942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa69be8-3cc9-4cf4-99a3-824655528b4e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:51.259222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa69be8-3cc9-4cf4-99a3-824655528b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:51.259495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa69be8-3cc9-4cf4-99a3-824655528b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:51.261120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9aa69be8-3cc9-4cf4-99a3-824655528b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:51.340063 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:51.369745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa69be8-3cc9-4cf4-99a3-824655528b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:51.371157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa69be8-3cc9-4cf4-99a3-824655528b4e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:51.388760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 748/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:53.733152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8d21-86f1-4bb2-8250-2fa59bc5c2da None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:53.733883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8d21-86f1-4bb2-8250-2fa59bc5c2da None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:53.733883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8d21-86f1-4bb2-8250-2fa59bc5c2da None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:53.735277 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 743/1491] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 11 00:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:55:53.740603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0c40-384f-4d3e-9201-5c637cb6e28d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:53.741026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0c40-384f-4d3e-9201-5c637cb6e28d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:53.741204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0c40-384f-4d3e-9201-5c637cb6e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:53.807578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1f5f0c40-384f-4d3e-9201-5c637cb6e28d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:53.808777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1f5f0c40-384f-4d3e-9201-5c637cb6e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:53.904138 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 749/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 11 00:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:54.205174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8d21-86f1-4bb2-8250-2fa59bc5c2da None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:54.206744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-af3c8d21-86f1-4bb2-8250-2fa59bc5c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:54.309497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8d21-86f1-4bb2-8250-2fa59bc5c2da None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:54.382428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac8db9-1748-46d8-bdf1-33cc542d225c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:54.383027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8db9-1748-46d8-bdf1-33cc542d225c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:54.383308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8db9-1748-46d8-bdf1-33cc542d225c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:54.383578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8db9-1748-46d8-bdf1-33cc542d225c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:54.385191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-49ac8db9-1748-46d8-bdf1-33cc542d225c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:54.393724 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:54.492800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac8db9-1748-46d8-bdf1-33cc542d225c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:54.494240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac8db9-1748-46d8-bdf1-33cc542d225c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:54.512247 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 744/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:03.902636 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=82 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:04.509999 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=50 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:14.134163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:14.134675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:14.134675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:14.210370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:14.211579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:14.306856 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 750/1494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:14.314968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f366391-c863-4702-bb15-244bdc8bfe98 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:14.315505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f366391-c863-4702-bb15-244bdc8bfe98 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:14.315505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f366391-c863-4702-bb15-244bdc8bfe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:14.391960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2f366391-c863-4702-bb15-244bdc8bfe98 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:14.393102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2f366391-c863-4702-bb15-244bdc8bfe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:14.486389 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 745/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:14.491182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:14.492397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:14.504475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84b880-e8be-444e-a13d-e648596e51a3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:14.566134 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:14.599768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:14.600378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:14.600651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:14.601038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:14.601714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:57:14.602020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:14.603021 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:14.603021 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 00:57:14.603021 n-d-master-1 devstack@keystone.service[81860]: Sep 11 00:57:14.603901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:14.615543 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 751/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 00:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:57:14.624502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f366391-c863-4702-bb15-244bdc8bfe98 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:14.633656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f366391-c863-4702-bb15-244bdc8bfe98 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:14.694922 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:14.727934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:14.728524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:14.728794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:14.729071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:14.729704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:14.731400 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:14.731400 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 00:57:14.731400 n-d-master-1 devstack@keystone.service[81859]: Sep 11 00:57:14.732603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:14.788076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 746/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 00:57:14 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:14.792309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:14.793962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:14.828308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d9245-5d59-4071-92b4-81f9ca3bee80 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:14.923194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:14.923796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:14.924072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:14.924337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:14.924967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:14.925993 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:14.925993 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 00:57:14.925993 n-d-master-1 devstack@keystone.service[81860]: Sep 11 00:57:14.927190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:14.970060 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 752/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 00:57:14 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:57:14.974124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:14.975660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:15.037873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b625d-83a7-463d-8d77-faee776b6ce2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:15.122711 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:15.135218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:15.135825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:15.136102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:15.136369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:15.136996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:15.138026 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:15.138026 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 00:57:15.138026 n-d-master-1 devstack@keystone.service[81859]: Sep 11 00:57:15.138936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:15.152492 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 747/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:57:15.156609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:15.158162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:15.169637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1048c1-b30a-4338-875e-701749e7cae7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:15.194944 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:15.266453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205f61-9da6-478b-b5f1-69f702141c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:15.266975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205f61-9da6-478b-b5f1-69f702141c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:15.267249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205f61-9da6-478b-b5f1-69f702141c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:15.267515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205f61-9da6-478b-b5f1-69f702141c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:15.268148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35205f61-9da6-478b-b5f1-69f702141c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:15.269183 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-35205f61-9da6-478b-b5f1-69f702141c8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:15.269183 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 00:57:15.269183 n-d-master-1 devstack@keystone.service[81860]: Sep 11 00:57:15.270141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35205f61-9da6-478b-b5f1-69f702141c8f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:15.283200 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 753/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 00:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:57:15.287364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:15.288874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:15.322450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c27aa-552c-4c11-bc10-99f042245f56 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:15.418939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174af28-a043-40f0-a981-db0991a9ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:15.419593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174af28-a043-40f0-a981-db0991a9ae2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:15.419874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174af28-a043-40f0-a981-db0991a9ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:15.420144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174af28-a043-40f0-a981-db0991a9ae2a admin admin] PATH_INFO: `/v3/projects/238d6aa022664403b74b0ec7c155187e/users/0b8d92d76681428b904d4d1faec6abbd/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:15.443300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174af28-a043-40f0-a981-db0991a9ae2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=238d6aa022664403b74b0ec7c155187e, user_id=0b8d92d76681428b904d4d1faec6abbd, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:15.444324 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-0174af28-a043-40f0-a981-db0991a9ae2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:15.444324 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 00:57:15.444324 n-d-master-1 devstack@keystone.service[81859]: Sep 11 00:57:15.446283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174af28-a043-40f0-a981-db0991a9ae2a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:15.470498 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 748/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 00:57:15 2022] PUT /identity/v3/projects/238d6aa022664403b74b0ec7c155187e/users/0b8d92d76681428b904d4d1faec6abbd/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:15.482608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc34b8a-3ccf-40ce-acc0-0b4e283907e3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:15.483426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc34b8a-3ccf-40ce-acc0-0b4e283907e3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:15.483702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc34b8a-3ccf-40ce-acc0-0b4e283907e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:15.541778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2fc34b8a-3ccf-40ce-acc0-0b4e283907e3 None None] MFA Rules not processed for user `0b8d92d76681428b904d4d1faec6abbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:15.542996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2fc34b8a-3ccf-40ce-acc0-0b4e283907e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:15.621477 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 754/1502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:15.635307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7262-3861-4b1a-b6b6-4c405de60ffb None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:15.635591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7262-3861-4b1a-b6b6-4c405de60ffb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:15.635865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7262-3861-4b1a-b6b6-4c405de60ffb None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:15.637222 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 749/1503] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 11 00:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:57:15.642292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020532-c537-44c1-a7e1-7bafc4def4a7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:15.642575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020532-c537-44c1-a7e1-7bafc4def4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:15.642844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020532-c537-44c1-a7e1-7bafc4def4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:15.678220 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:15.723168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e3020532-c537-44c1-a7e1-7bafc4def4a7 None None] MFA Rules not processed for user `0492b5b414354bce909e395d44d215c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:15.724390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e3020532-c537-44c1-a7e1-7bafc4def4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:15.799389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 755/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:15.806848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7262-3861-4b1a-b6b6-4c405de60ffb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:15.808327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-97ff7262-3861-4b1a-b6b6-4c405de60ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:15.858746 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:15.914003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7262-3861-4b1a-b6b6-4c405de60ffb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:15.986439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:15.987039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:15.987319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:15.987609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:15.989243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:16.090478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:16.091838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:16.095556 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:16.111885 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 750/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:16.157880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629bb4b-f27c-48ee-b7a5-f4ba7f90f6d9 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:16.158295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629bb4b-f27c-48ee-b7a5-f4ba7f90f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:16.158433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629bb4b-f27c-48ee-b7a5-f4ba7f90f6d9 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:16.159771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 756/1506] 10.222.0.16 () {52 vars in 830 bytes} [Sun Sep 11 00:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:57:16.163430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:16.164633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:16.267587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9b976-7c25-4c9c-bb6a-5d4b93290662 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:16.359787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:16.360440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:16.360591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:16.360852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] PATH_INFO: `/v3/users/0b8d92d76681428b904d4d1faec6abbd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:16.373613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8d92d76681428b904d4d1faec6abbd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:16.374878 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:16.374878 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 00:57:16.374878 n-d-master-1 devstack@keystone.service[81859]: Sep 11 00:57:16.376061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:16.386959 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:16.443437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8d92d76681428b904d4d1faec6abbd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:16.443847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8d92d76681428b904d4d1faec6abbd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:16.444364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8d92d76681428b904d4d1faec6abbd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:16.467145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8d92d76681428b904d4d1faec6abbd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:16.481667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8d92d76681428b904d4d1faec6abbd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:16.495370 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 751/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 00:57:16 2022] DELETE /identity/v3/users/0b8d92d76681428b904d4d1faec6abbd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:16.500441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:16.500723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:16.500991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:16.560005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:16.562159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:16.636807 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:16.650197 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 757/1508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:16.660056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:16.661595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:16.761861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8fb0-e7b0-4152-b059-6e5387452475 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:16.819360 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:16.840859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615afb5b-e296-4c10-bc5e-fe459f610138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:16.841501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615afb5b-e296-4c10-bc5e-fe459f610138 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:16.841778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615afb5b-e296-4c10-bc5e-fe459f610138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:16.842046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615afb5b-e296-4c10-bc5e-fe459f610138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:16.843826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-615afb5b-e296-4c10-bc5e-fe459f610138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:16.951123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615afb5b-e296-4c10-bc5e-fe459f610138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:16.952488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615afb5b-e296-4c10-bc5e-fe459f610138 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:16.970868 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 752/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:17.316508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:17.317801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:17.329488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b719f21-dc84-457a-8467-8ec963fed818 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:17.427297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:17.427923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:17.428194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:17.428458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] PATH_INFO: `/v3/projects/238d6aa022664403b74b0ec7c155187e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:17.438341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=238d6aa022664403b74b0ec7c155187e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:17.439349 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:57:17.439349 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 00:57:17.439349 n-d-master-1 devstack@keystone.service[81860]: Sep 11 00:57:17.440535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:17.499368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238d6aa022664403b74b0ec7c155187e', 'request_id': 'req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:17.512645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238d6aa022664403b74b0ec7c155187e', 'request_id': 'req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:17.521724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238d6aa022664403b74b0ec7c155187e', 'request_id': 'req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:17.545029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] The token cache is being invalidate because project 238d6aa022664403b74b0ec7c155187e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:57:17.545347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:17.546579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fa95f227-5e79-42fa-ac1c-db88bd0dc65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:57:17.547725 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 758/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 00:57:17 2022] DELETE /identity/v3/projects/238d6aa022664403b74b0ec7c155187e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:57:26.968589 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=62 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:27.543039 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:39.903374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b4e29-a234-416a-abb3-e42f38666535 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:39.903957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b4e29-a234-416a-abb3-e42f38666535 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:39.903957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b4e29-a234-416a-abb3-e42f38666535 None None] PATH_INFO: `/v3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:39.905130 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 753/1511] 10.222.0.57 () {54 vars in 925 bytes} [Sun Sep 11 01:00:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:00:39.911013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af7ed-4b4c-45c0-9fef-f977fb1c956b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:39.911455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af7ed-4b4c-45c0-9fef-f977fb1c956b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:39.911568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af7ed-4b4c-45c0-9fef-f977fb1c956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:39.995171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f14af7ed-4b4c-45c0-9fef-f977fb1c956b None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:39.996373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f14af7ed-4b4c-45c0-9fef-f977fb1c956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:40.066884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92377b72-fa33-4c19-9929-b0a7d6ed011e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:40.067165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92377b72-fa33-4c19-9929-b0a7d6ed011e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:40.067496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92377b72-fa33-4c19-9929-b0a7d6ed011e None None] PATH_INFO: `/v3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:40.069554 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 754/1512] 10.222.0.52 () {54 vars in 925 bytes} [Sun Sep 11 01:00:40 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:00:40.075984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfc0d-9f1b-4735-ae9b-167af8c26c66 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:40.076262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfc0d-9f1b-4735-ae9b-167af8c26c66 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:40.076536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfc0d-9f1b-4735-ae9b-167af8c26c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:40.096698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b8bdfc0d-9f1b-4735-ae9b-167af8c26c66 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:40.097940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b8bdfc0d-9f1b-4735-ae9b-167af8c26c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:40.110857 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 759/1513] 10.222.0.57 () {58 vars in 1015 bytes} [Sun Sep 11 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:40.111363 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 755/1514] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 11 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:00:48.604881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b738-ac09-4506-9391-fa8d760c830c None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:48.605444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b738-ac09-4506-9391-fa8d760c830c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:48.605444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b738-ac09-4506-9391-fa8d760c830c None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:48.606773 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 760/1515] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 11 01:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:00:48.612956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd4fb-e69c-4960-9ecb-f32f79b15016 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:48.613449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd4fb-e69c-4960-9ecb-f32f79b15016 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:48.613572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd4fb-e69c-4960-9ecb-f32f79b15016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:48.633275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-257fd4fb-e69c-4960-9ecb-f32f79b15016 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:48.634491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-257fd4fb-e69c-4960-9ecb-f32f79b15016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:48.643354 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 756/1516] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:48.650913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9b738-ac09-4506-9391-fa8d760c830c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:48.666503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9b738-ac09-4506-9391-fa8d760c830c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:48.673205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:48.673804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:48.674074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:48.674342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:48.683079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:48.684687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:48.692568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c8d4-5793-41b7-a45a-588ee3123a09 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:48.692850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c8d4-5793-41b7-a45a-588ee3123a09 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:48.693152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c8d4-5793-41b7-a45a-588ee3123a09 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:48.694487 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 757/1517] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 11 01:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:00:48.695778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 761/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:48.699235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d29b3e-6e49-4ceb-bd80-ea17a5779755 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:48.699538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d29b3e-6e49-4ceb-bd80-ea17a5779755 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:48.699811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d29b3e-6e49-4ceb-bd80-ea17a5779755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:48.720444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a3d29b3e-6e49-4ceb-bd80-ea17a5779755 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:00:48.721665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3d29b3e-6e49-4ceb-bd80-ea17a5779755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:00:48.730834 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 758/1519] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:00:48.738963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:00:48.749141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7edd33-686a-478a-a83e-0428d22433a3 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:00:48.754550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0689e-5d61-4ed3-96df-d709e062b7d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:00:48.755124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0689e-5d61-4ed3-96df-d709e062b7d4 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:00:48.755396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0689e-5d61-4ed3-96df-d709e062b7d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:00:48.755663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0689e-5d61-4ed3-96df-d709e062b7d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:00:48.767146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0689e-5d61-4ed3-96df-d709e062b7d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:00:48.769124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0689e-5d61-4ed3-96df-d709e062b7d4 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:00:48.779064 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 762/1520] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:00:58.714953 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=11 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:00:58.774692 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:06.050897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202336-bf5f-48eb-aa05-46f37f17547d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:06.051432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202336-bf5f-48eb-aa05-46f37f17547d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:06.051539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202336-bf5f-48eb-aa05-46f37f17547d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:06.052831 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 759/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 01:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:01:06.057938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6fd43-0f9f-41de-bf09-84b07afc78ab None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:06.058363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6fd43-0f9f-41de-bf09-84b07afc78ab None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:06.058469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6fd43-0f9f-41de-bf09-84b07afc78ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:06.118631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ddb6fd43-0f9f-41de-bf09-84b07afc78ab None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:06.119841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ddb6fd43-0f9f-41de-bf09-84b07afc78ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:06.197119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 763/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:06.350645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17202336-bf5f-48eb-aa05-46f37f17547d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:06.352324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-17202336-bf5f-48eb-aa05-46f37f17547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:06.452464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17202336-bf5f-48eb-aa05-46f37f17547d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:06.458577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d64a5-8d30-42dd-a0ab-db1fe785457a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:06.459168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d64a5-8d30-42dd-a0ab-db1fe785457a service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:06.459445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d64a5-8d30-42dd-a0ab-db1fe785457a service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:06.459715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d64a5-8d30-42dd-a0ab-db1fe785457a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:06.467621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d64a5-8d30-42dd-a0ab-db1fe785457a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:06.469195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d64a5-8d30-42dd-a0ab-db1fe785457a service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:06.478609 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 760/1523] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:07.581608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508371-a9cb-415b-bfc8-7f8f57205a37 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:07.582184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508371-a9cb-415b-bfc8-7f8f57205a37 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:07.582184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508371-a9cb-415b-bfc8-7f8f57205a37 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:07.583495 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 764/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 01:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:01:07.589648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fc6d0-66b0-40aa-9a65-b418e255d38e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:07.590124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fc6d0-66b0-40aa-9a65-b418e255d38e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:07.590228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fc6d0-66b0-40aa-9a65-b418e255d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:07.611294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-143fc6d0-66b0-40aa-9a65-b418e255d38e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:07.612764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-143fc6d0-66b0-40aa-9a65-b418e255d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:07.620707 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 761/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:07.796048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508371-a9cb-415b-bfc8-7f8f57205a37 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:07.810529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508371-a9cb-415b-bfc8-7f8f57205a37 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:07.816560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76333b3e-6462-46fe-8ec5-9fb86e5b2d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:07.817171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333b3e-6462-46fe-8ec5-9fb86e5b2d62 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:07.817444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333b3e-6462-46fe-8ec5-9fb86e5b2d62 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:07.817707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333b3e-6462-46fe-8ec5-9fb86e5b2d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:07.825512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76333b3e-6462-46fe-8ec5-9fb86e5b2d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:07.827066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76333b3e-6462-46fe-8ec5-9fb86e5b2d62 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:07.837415 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 765/1526] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:11.718758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bb84-cd69-42f3-a54f-a15b51321bb5 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:11.719305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bb84-cd69-42f3-a54f-a15b51321bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:11.719305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bb84-cd69-42f3-a54f-a15b51321bb5 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:11.721333 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 762/1527] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 01:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:01:11.726440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8151f-3c29-423d-b4a7-7587b18d677b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:11.726844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8151f-3c29-423d-b4a7-7587b18d677b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:11.726986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8151f-3c29-423d-b4a7-7587b18d677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:11.746809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a0f8151f-3c29-423d-b4a7-7587b18d677b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:11.748010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a0f8151f-3c29-423d-b4a7-7587b18d677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:11.756483 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 766/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:12.047565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7bb84-cd69-42f3-a54f-a15b51321bb5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:12.049842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c3a7bb84-cd69-42f3-a54f-a15b51321bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:12.125832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7bb84-cd69-42f3-a54f-a15b51321bb5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:12.130108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479121fb-83e5-4102-a87d-8467067ff725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:12.130701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479121fb-83e5-4102-a87d-8467067ff725 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:12.130975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479121fb-83e5-4102-a87d-8467067ff725 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:12.131241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479121fb-83e5-4102-a87d-8467067ff725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:12.140149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479121fb-83e5-4102-a87d-8467067ff725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:12.141698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479121fb-83e5-4102-a87d-8467067ff725 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:12.151278 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 763/1529] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:14.320596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693e410-4c89-4066-8d98-e486d279937e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.321140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693e410-4c89-4066-8d98-e486d279937e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.321278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693e410-4c89-4066-8d98-e486d279937e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.322558 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 767/1530] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 01:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:01:14.327879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655e99-9b65-4de6-bbd6-5f402a66a366 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.328292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655e99-9b65-4de6-bbd6-5f402a66a366 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.328422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655e99-9b65-4de6-bbd6-5f402a66a366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.348459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d5655e99-9b65-4de6-bbd6-5f402a66a366 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:14.349668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d5655e99-9b65-4de6-bbd6-5f402a66a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:14.357318 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 764/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:01:14.642727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693e410-4c89-4066-8d98-e486d279937e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:14.653616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693e410-4c89-4066-8d98-e486d279937e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:14.657708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce2e4-bf3a-46b7-8ecc-0ad3cb9dc575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:14.658306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce2e4-bf3a-46b7-8ecc-0ad3cb9dc575 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:14.658579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce2e4-bf3a-46b7-8ecc-0ad3cb9dc575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:14.658843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce2e4-bf3a-46b7-8ecc-0ad3cb9dc575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:14.667622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce2e4-bf3a-46b7-8ecc-0ad3cb9dc575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:14.669022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce2e4-bf3a-46b7-8ecc-0ad3cb9dc575 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:14.678260 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 768/1532] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:24.343185 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:24.674231 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=65 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:03.342684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285addc0-9e7c-4066-8589-3938399a83b7 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:03.343212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285addc0-9e7c-4066-8589-3938399a83b7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:03.343411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285addc0-9e7c-4066-8589-3938399a83b7 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:03.344793 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 765/1533] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:02:03.350673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09383c-24cf-47b4-87b5-ee1ff5650af2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:03.351084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09383c-24cf-47b4-87b5-ee1ff5650af2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:03.351356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09383c-24cf-47b4-87b5-ee1ff5650af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:03.372124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0f09383c-24cf-47b4-87b5-ee1ff5650af2 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:03.373383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0f09383c-24cf-47b4-87b5-ee1ff5650af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:03.382332 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 769/1534] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:02:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:02:13.366734 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:35.606153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f7b0f-6da6-40a4-9420-f9cfc61c4de1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.607153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f7b0f-6da6-40a4-9420-f9cfc61c4de1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.607650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f7b0f-6da6-40a4-9420-f9cfc61c4de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.633973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff9f7b0f-6da6-40a4-9420-f9cfc61c4de1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:35.635194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff9f7b0f-6da6-40a4-9420-f9cfc61c4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:35.648864 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 766/1535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:35.662476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515c205-c53e-460d-a790-7962e82b1428 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.663615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515c205-c53e-460d-a790-7962e82b1428 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.664127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515c205-c53e-460d-a790-7962e82b1428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.698374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6515c205-c53e-460d-a790-7962e82b1428 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:35.699674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6515c205-c53e-460d-a790-7962e82b1428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:35.711469 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 770/1536] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:35.716375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f7b0f-6da6-40a4-9420-f9cfc61c4de1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:35.731266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f7b0f-6da6-40a4-9420-f9cfc61c4de1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:35.739135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:35.739777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.740062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.740331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.740998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:35.741333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:35.742574 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:02:35.742574 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:02:35.742574 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:02:35.743469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a844-be2d-475e-b353-b8046ab6102e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:35.752309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d9c2-b0d7-4f88-bc06-21a6afdbcfba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.752681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d9c2-b0d7-4f88-bc06-21a6afdbcfba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.752880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d9c2-b0d7-4f88-bc06-21a6afdbcfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.776228 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 767/1537] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:35.786379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d09b-bf18-4f17-b274-bd843e7bd52d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.786673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d09b-bf18-4f17-b274-bd843e7bd52d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.786991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d09b-bf18-4f17-b274-bd843e7bd52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.790642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6449d9c2-b0d7-4f88-bc06-21a6afdbcfba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:35.791866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6449d9c2-b0d7-4f88-bc06-21a6afdbcfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:35.819850 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 771/1538] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:02:35.820688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d9c2-b0d7-4f88-bc06-21a6afdbcfba None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:35.835890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d9c2-b0d7-4f88-bc06-21a6afdbcfba None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:35.837515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e872d09b-bf18-4f17-b274-bd843e7bd52d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:35.838734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e872d09b-bf18-4f17-b274-bd843e7bd52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:35.847414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:35.848033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.848311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.848581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.849247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:35.850258 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:02:35.850258 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:02:35.850258 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:02:35.851437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:35.858065 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 768/1539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:35.859272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ef60-20a9-41f2-afa6-5f0abbcb85ee None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.859559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ef60-20a9-41f2-afa6-5f0abbcb85ee None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.859833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ef60-20a9-41f2-afa6-5f0abbcb85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.899729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7357ef60-20a9-41f2-afa6-5f0abbcb85ee None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:35.900968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7357ef60-20a9-41f2-afa6-5f0abbcb85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:35.921594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 769/1540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:35.922885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563367-ef21-4866-92f2-03deb6c0d7ad None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:35.923777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563367-ef21-4866-92f2-03deb6c0d7ad None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:35.924075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7563367-ef21-4866-92f2-03deb6c0d7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:35.941493 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 772/1541] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:35 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:35.943935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:35.966200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e7563367-ef21-4866-92f2-03deb6c0d7ad None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:35.967447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e7563367-ef21-4866-92f2-03deb6c0d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.068549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352276-43ab-4362-aaf5-97bae7d63059 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.073941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.074559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.074855 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 770/1542] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.075070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.075166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.075787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:36.076092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.076270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ff333-f73b-4130-bc87-94d3b1c02e7a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.076555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ff333-f73b-4130-bc87-94d3b1c02e7a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.076824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ff333-f73b-4130-bc87-94d3b1c02e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.077716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.090376 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 773/1543] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:36.091174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.098595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d39ff333-f73b-4130-bc87-94d3b1c02e7a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.100193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d39ff333-f73b-4130-bc87-94d3b1c02e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.100861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244230-4e4a-4a43-b1b9-d8aff80e4d29 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.105950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5a081-0e2c-4d28-b836-47c38778125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.106356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5a081-0e2c-4d28-b836-47c38778125b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.106634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5a081-0e2c-4d28-b836-47c38778125b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.106904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5a081-0e2c-4d28-b836-47c38778125b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.107522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5a081-0e2c-4d28-b836-47c38778125b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.108836 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 771/1544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.109437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5a081-0e2c-4d28-b836-47c38778125b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.110011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3805ba7-952b-4feb-8499-d090a287ca28 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.110280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3805ba7-952b-4feb-8499-d090a287ca28 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.111121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3805ba7-952b-4feb-8499-d090a287ca28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.135333 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 774/1545] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.137036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa0ce-6039-4c57-876b-5f0d50fb573d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.137543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa0ce-6039-4c57-876b-5f0d50fb573d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.137650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e3805ba7-952b-4feb-8499-d090a287ca28 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.138225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa0ce-6039-4c57-876b-5f0d50fb573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.138783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e3805ba7-952b-4feb-8499-d090a287ca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.147558 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 772/1546] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.148742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd16059-9311-4094-acea-a456a41fa339 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.149021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd16059-9311-4094-acea-a456a41fa339 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.149317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd16059-9311-4094-acea-a456a41fa339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.160334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-48efa0ce-6039-4c57-876b-5f0d50fb573d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.161585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-48efa0ce-6039-4c57-876b-5f0d50fb573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.170796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3cd16059-9311-4094-acea-a456a41fa339 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.170962 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 775/1547] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.172211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ebe87-2316-4fbd-9153-2eb7284b0ba7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.172323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3cd16059-9311-4094-acea-a456a41fa339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.172506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ebe87-2316-4fbd-9153-2eb7284b0ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.172771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ebe87-2316-4fbd-9153-2eb7284b0ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.188945 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 773/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.189817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd16059-9311-4094-acea-a456a41fa339 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.193859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-874ebe87-2316-4fbd-9153-2eb7284b0ba7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.195112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-874ebe87-2316-4fbd-9153-2eb7284b0ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.199509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd16059-9311-4094-acea-a456a41fa339 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.205833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 776/1549] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.206656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ebe87-2316-4fbd-9153-2eb7284b0ba7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.206846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b442b9-d2a0-445d-a6f6-ee5ab9eaa111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.207513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b442b9-d2a0-445d-a6f6-ee5ab9eaa111 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.207790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b442b9-d2a0-445d-a6f6-ee5ab9eaa111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.208064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b442b9-d2a0-445d-a6f6-ee5ab9eaa111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.213109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b442b9-d2a0-445d-a6f6-ee5ab9eaa111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:36.213109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b442b9-d2a0-445d-a6f6-ee5ab9eaa111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.213109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b442b9-d2a0-445d-a6f6-ee5ab9eaa111 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.218727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ebe87-2316-4fbd-9153-2eb7284b0ba7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.224406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.225153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.225514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.231770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.231922 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 774/1550] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:36.232018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.232106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc64d8d-24a7-4182-a062-aadfd630b445 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.232106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc64d8d-24a7-4182-a062-aadfd630b445 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.232106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc64d8d-24a7-4182-a062-aadfd630b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.232330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.248518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-adc64d8d-24a7-4182-a062-aadfd630b445 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.249993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-adc64d8d-24a7-4182-a062-aadfd630b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.259216 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 777/1551] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.259790 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 775/1552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.260110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.260966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db633cc-3cb5-432b-a46b-ebc65cc79071 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.261282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db633cc-3cb5-432b-a46b-ebc65cc79071 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.261554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db633cc-3cb5-432b-a46b-ebc65cc79071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.282521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7db633cc-3cb5-432b-a46b-ebc65cc79071 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.284178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7db633cc-3cb5-432b-a46b-ebc65cc79071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.327201 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.330823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c077f51-8106-47bd-af79-e2a5aded31fb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.336739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904d60-486f-490e-9d14-38a95f017948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.337418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904d60-486f-490e-9d14-38a95f017948 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.337751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904d60-486f-490e-9d14-38a95f017948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.338023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904d60-486f-490e-9d14-38a95f017948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.338657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904d60-486f-490e-9d14-38a95f017948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.340271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904d60-486f-490e-9d14-38a95f017948 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.350220 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 776/1553] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.350220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bddb9-2054-405a-a8c0-f02a530fb3b3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.350220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bddb9-2054-405a-a8c0-f02a530fb3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.350220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bddb9-2054-405a-a8c0-f02a530fb3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.351224 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 778/1554] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:36.352475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b0b6c-509e-44bd-8263-ea72d6ed59b9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.352761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b0b6c-509e-44bd-8263-ea72d6ed59b9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.353105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b0b6c-509e-44bd-8263-ea72d6ed59b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.373578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ba6bddb9-2054-405a-a8c0-f02a530fb3b3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.374901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba6bddb9-2054-405a-a8c0-f02a530fb3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.375288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-166b0b6c-509e-44bd-8263-ea72d6ed59b9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.377651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-166b0b6c-509e-44bd-8263-ea72d6ed59b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.383063 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 777/1555] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.384297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487372c-ba22-426b-8bb5-1ed7ceebd892 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.384577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487372c-ba22-426b-8bb5-1ed7ceebd892 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.384847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487372c-ba22-426b-8bb5-1ed7ceebd892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.385694 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 779/1556] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.387867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b0b6c-509e-44bd-8263-ea72d6ed59b9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.399616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b0b6c-509e-44bd-8263-ea72d6ed59b9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.404919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.405555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.405773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1487372c-ba22-426b-8bb5-1ed7ceebd892 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:36.405885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.406100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.406723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.406963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1487372c-ba22-426b-8bb5-1ed7ceebd892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:36.408634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.415284 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 778/1557] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:36.416040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487372c-ba22-426b-8bb5-1ed7ceebd892 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.426090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487372c-ba22-426b-8bb5-1ed7ceebd892 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.431822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.432510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.432871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.433204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.433832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.434842 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:02:36.434842 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:02:36.434842 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:02:36.436038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.437326 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 780/1558] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.438147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.453391 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.462852 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 779/1559] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.463994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.474590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb8fd1-110e-47fb-95b7-01a34891c2e8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.507066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a08a4e-fa00-4440-812a-52b9bfa26ed3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.511757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.512361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.512638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.512907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.513581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:36.513885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.515458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.528018 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 781/1560] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:36.528999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.539792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250cdb-c947-4c97-a9d3-888fb4142d83 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.544431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.545017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.545299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.545432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.545577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.545909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.546192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.546285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.546463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.547116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:36.547419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.547758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.549746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.560220 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 782/1561] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:36.561087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.571080 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 780/1562] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:36.571080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.571323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337bd73-46ec-401e-8428-c2d9b2720ec8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.575773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.575910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1aaaa-bf7b-4c1d-87fa-db98a7c773ca admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.576358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.576630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.576894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.577552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:36.577851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.580023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.581258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.582025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.582753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.583043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.583679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:36.583981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.585554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.598826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 783/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:36.598826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.599323 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 781/1564] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:36.600057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.608665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa056fec-03c3-4900-9287-4d71228c7d89 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.609466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484406ba-d975-443b-8477-b3ecb93876fc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.613946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.614535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.614808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.614894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.615075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.615443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.615705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:36.615811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.615969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.616072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.616612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.617579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.618497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.630228 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 784/1565] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:36.631087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.641166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371f62e-2c12-42bf-bc2e-cf6781985b20 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.647220 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 782/1566] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.647220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.647436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.647436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.647436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.647436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.647935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.649540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.655395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadce2eb-22de-4680-907a-46ef9f7c988a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.660065 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 785/1567] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:36.660172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.660728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.660910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.661001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.661293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.661906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.663780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.670915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6d12-9a83-4a82-95e3-820116dd509d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.676180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.676817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.677112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.677383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] PATH_INFO: `/v3/projects/5eccc5e0efa1480fb72fc956345d6fd9/users/947de767d36347618a06bbcbd0081256/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.695777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 783/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.695967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eccc5e0efa1480fb72fc956345d6fd9, user_id=947de767d36347618a06bbcbd0081256, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.696064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.696146 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:02:36.696146 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:02:36.696146 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:02:36.696146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.710195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 786/1569] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:36 2022] PUT /identity/v3/projects/5eccc5e0efa1480fb72fc956345d6fd9/users/947de767d36347618a06bbcbd0081256/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:36.711040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.759765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a8f8-661d-46b9-bfb8-a612fc432b43 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.764398 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.781124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6361-8bb4-4657-8077-cef507d16515 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.786580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.787277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.787616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.787983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.788635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.790550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.804708 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:36.818540 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 787/1570] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.818787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.819344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.819450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.819668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.819890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.820513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.822949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.853853 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 784/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.853853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.883513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce31c38-86e8-4ef5-bac8-7a28e06bd7e5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.912793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183d367-22e5-4b63-ab61-77aaaaed1656 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:36.917489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.918098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.918380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.918651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.919277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.921196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.941107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:36.941749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:36.942155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:36.942445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:36.943100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:36.944993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:36.952321 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 785/1572] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.952321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:36.975758 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 788/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:36 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:36.976600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.023902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0afd-21a5-4439-a441-7b6a980ad0c1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.040701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b4abf-a340-4f98-9885-d3a937532bf7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.045495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.046125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.046405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.046679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.047314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.049962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.055153 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:37.063195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 789/1574] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.063195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.073680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18700-2745-4d3d-8d51-3438b94b9012 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.078549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.079136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.079913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.080200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.080829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.082485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358720-bae6-4e80-a78b-f3272e2b8791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.082828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.083086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358720-bae6-4e80-a78b-f3272e2b8791 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.083358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358720-bae6-4e80-a78b-f3272e2b8791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.083625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358720-bae6-4e80-a78b-f3272e2b8791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.084255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358720-bae6-4e80-a78b-f3272e2b8791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.085861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358720-bae6-4e80-a78b-f3272e2b8791 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.090881 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:37.099144 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 786/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.101173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4f40-75cf-414c-b344-542dbca903f2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.101668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4f40-75cf-414c-b344-542dbca903f2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.102170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4f40-75cf-414c-b344-542dbca903f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.106989 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 790/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/users => generated 299 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.107926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.118176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030075a3-3af9-4685-b3db-0320f03e7ad2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.123010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.123599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.123877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.124894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.124894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.126856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.133131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-74ca4f40-75cf-414c-b344-542dbca903f2 None None] MFA Rules not processed for user `947de767d36347618a06bbcbd0081256`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:37.134398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-74ca4f40-75cf-414c-b344-542dbca903f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:37.149848 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 791/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.153620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.161376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eefb7-ce20-4fec-84dd-cfe4894bd128 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.167607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.168590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.168870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.169177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.169798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.171712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.196676 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 792/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.196676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.203632 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 787/1579] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:37.203910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8fb33-4ed0-44d2-924c-7308b6514210 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.204646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca4f40-75cf-414c-b344-542dbca903f2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.210807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.211400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.211678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.211948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.212568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.214503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.215256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca4f40-75cf-414c-b344-542dbca903f2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.219781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.221120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.221303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.221570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.222182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.224106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.236972 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 793/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/users => generated 301 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.238380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.249600 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 788/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.249600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.249852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60075887-86ef-4330-a2f5-63a1f754c02e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.253862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.254568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.255045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.255315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] PATH_INFO: `/v3/projects/c669e02a448c460a98d5925386f11286/users/5fb0275e9bc04d3a9bed6b502e68f54f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.259671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ead0-fa0e-4533-8b4a-dac13fa6a513 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.264132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.264710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.264986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.265284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.265907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.268321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.271726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c669e02a448c460a98d5925386f11286, user_id=5fb0275e9bc04d3a9bed6b502e68f54f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.274661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.279330 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 789/1582] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.280189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.288664 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 794/1583] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:37 2022] PUT /identity/v3/projects/c669e02a448c460a98d5925386f11286/users/5fb0275e9bc04d3a9bed6b502e68f54f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:37.289744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.301553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98f77d-15bb-4bae-b322-d1c1fc49a09b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.355434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13bb94-3b5e-48c0-bd6c-ddb4fa601b9d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.359701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.360010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.360314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.361204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.361335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.361484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.361621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.361755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.362354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.362455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.364052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.364144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.374095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 795/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.375605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.375823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 790/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.377049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.386914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0796b42-760f-4c32-91c1-6520aa67d818 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.387060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77adf-0b8e-430a-a327-dc5fed4e3263 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.391593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.392324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.392917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.393233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.393357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.393504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.393596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.393779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.394123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.394415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.395998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.396088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.406188 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 796/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.407113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.418059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9ab36-4dad-4761-99c2-63605efc3683 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.422596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.423979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.424315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.424593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.425278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.428472 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 791/1587] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.428472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.428678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.439435 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 797/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.440363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.450094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b2ca2-deac-4d35-83d1-faca551e6b09 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.466586 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:37.490005 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:37.494971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668a712-399e-4937-9aca-a2e8bb416d5e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.501365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dd12a-102d-4249-ab6f-c2fad5d0649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.502066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dd12a-102d-4249-ab6f-c2fad5d0649e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.502396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dd12a-102d-4249-ab6f-c2fad5d0649e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.502705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dd12a-102d-4249-ab6f-c2fad5d0649e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.503763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dd12a-102d-4249-ab6f-c2fad5d0649e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.505131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dd12a-102d-4249-ab6f-c2fad5d0649e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.511629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.512296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.512574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.512844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] PATH_INFO: `/v3/projects/20d7976f84f34c3d8cf8f41e0aaa052e/users/3d983b1226d14d4582ae7429602bd40a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.519316 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 792/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.520619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ec44-37ed-4c95-9677-29041f7b14a2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.520906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ec44-37ed-4c95-9677-29041f7b14a2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.521215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6ec44-37ed-4c95-9677-29041f7b14a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.533723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d7976f84f34c3d8cf8f41e0aaa052e, user_id=3d983b1226d14d4582ae7429602bd40a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.536545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.550758 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 798/1590] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:37 2022] PUT /identity/v3/projects/20d7976f84f34c3d8cf8f41e0aaa052e/users/3d983b1226d14d4582ae7429602bd40a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:37.551575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.552586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c9f6ec44-37ed-4c95-9677-29041f7b14a2 None None] MFA Rules not processed for user `5fb0275e9bc04d3a9bed6b502e68f54f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:37.553992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c9f6ec44-37ed-4c95-9677-29041f7b14a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:37.623478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408c27b-c024-4ae2-8e72-149781a420a8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.623887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 793/1591] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:37.628127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6ec44-37ed-4c95-9677-29041f7b14a2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.630745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.631356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.631633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.631907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.632546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.634174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.635528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6ec44-37ed-4c95-9677-29041f7b14a2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.640293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.640836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.641163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.641422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.642777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.644541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.645416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 799/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.646384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.654981 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 794/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.655645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.656849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a1c0-6c21-4b4f-8aef-fc72ebb1555a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.662172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.662775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.663050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.663440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.664129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.665284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08455-843f-4f2f-8aed-a4bae9ab38a5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.665855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.670025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.670606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.670883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.671159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.671770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.674501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.676747 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 800/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.677578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.689898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564298bc-acc9-4beb-8ec8-3a2f31a5bbbb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.695499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7937b47-5cdb-4d9c-a71e-dcd36273fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.696089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7937b47-5cdb-4d9c-a71e-dcd36273fb6b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.696367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7937b47-5cdb-4d9c-a71e-dcd36273fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.696637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7937b47-5cdb-4d9c-a71e-dcd36273fb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.697435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7937b47-5cdb-4d9c-a71e-dcd36273fb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.699120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7937b47-5cdb-4d9c-a71e-dcd36273fb6b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.702759 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 795/1595] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/users => generated 300 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.702759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.713125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 801/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.713125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720db7-2891-4374-acd4-7c4364a87b92 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.713125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720db7-2891-4374-acd4-7c4364a87b92 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.713125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720db7-2891-4374-acd4-7c4364a87b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.713539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885b75-8900-4ce8-9c80-3f595ee957e4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.717821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.718401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.718695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.718956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.719587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.721939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.735815 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 796/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:37.735815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.740754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ef720db7-2891-4374-acd4-7c4364a87b92 None None] MFA Rules not processed for user `3d983b1226d14d4582ae7429602bd40a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:37.741992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef720db7-2891-4374-acd4-7c4364a87b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:37.745659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4609c-aedf-40d0-a270-a6307b1c313a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.750321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.751842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.751842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.752225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.752851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.754767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.784935 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 797/1598] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:37.785787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.813209 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 802/1599] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:37.814550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef720db7-2891-4374-acd4-7c4364a87b92 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.824885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef720db7-2891-4374-acd4-7c4364a87b92 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.850430 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:37.852345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d42499-d83e-436a-b84a-b459fc7397a3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.857467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.858169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.858407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.858685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] PATH_INFO: `/v3/projects/f8b88f171d6b4535a1e47d852b09f4b4/users/383e9a9d4d804959a910427cd1665b2c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.861949 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:37.876221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b88f171d6b4535a1e47d852b09f4b4, user_id=383e9a9d4d804959a910427cd1665b2c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.878901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.886412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.887241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.887594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.887929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] PATH_INFO: `/v3/projects/b8e2ecabba564ea9abfe7305239efffc/users/d688a902aa2e45d2bc64380e44d56885/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.892726 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 798/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:37 2022] PUT /identity/v3/projects/f8b88f171d6b4535a1e47d852b09f4b4/users/383e9a9d4d804959a910427cd1665b2c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:37.902307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.903309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e2ecabba564ea9abfe7305239efffc, user_id=d688a902aa2e45d2bc64380e44d56885, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.906049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:37.920079 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 803/1601] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:37 2022] PUT /identity/v3/projects/b8e2ecabba564ea9abfe7305239efffc/users/d688a902aa2e45d2bc64380e44d56885/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:37.920876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:37.966721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1904a-473b-4b5d-a27b-2e4d4994fb34 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.991623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286cb3f-e313-496b-8c5b-39ff900a46a1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:37.996311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:37.996916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:37.997237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:37.997513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:37.998177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:37.999758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.010867 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 804/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:38.011672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.021388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66f63-95d2-4b95-870d-10be15b383e9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.024562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.025264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.025542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.025813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] PATH_INFO: `/v3/projects/bfd3542d6d654484aeb937471a50016a/users/1610001ded8f4c6aae5fbe1190144763/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.026026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.026656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.027190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.027463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] PATH_INFO: `/v3/projects/00a1ba5f5b564118a48c47493c093095/users/0499487f7a3245538923b7e8f397f925/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.042321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd3542d6d654484aeb937471a50016a, user_id=1610001ded8f4c6aae5fbe1190144763, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.042613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a1ba5f5b564118a48c47493c093095, user_id=0499487f7a3245538923b7e8f397f925, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.045030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.045375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.059392 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 805/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:38 2022] PUT /identity/v3/projects/00a1ba5f5b564118a48c47493c093095/users/0499487f7a3245538923b7e8f397f925/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:38.073293 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 799/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:37 2022] PUT /identity/v3/projects/bfd3542d6d654484aeb937471a50016a/users/1610001ded8f4c6aae5fbe1190144763/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:38.073426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.073506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.131973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ff81-eae7-4432-9979-fdf7c938402b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.146298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9252-f485-4888-b473-29388017e6b3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.148438 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:38.151489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.152417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.152693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.152971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] PATH_INFO: `/v3/projects/e830e11f7d4b4d0db2f5035332f510ff/users/4e36fb5445a846dd891913399a320658/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.170727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e830e11f7d4b4d0db2f5035332f510ff, user_id=4e36fb5445a846dd891913399a320658, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.173943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.188839 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 806/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:38 2022] PUT /identity/v3/projects/e830e11f7d4b4d0db2f5035332f510ff/users/4e36fb5445a846dd891913399a320658/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:38.189567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.194819 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:38.203408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f170b-201b-4ac3-841d-70164e7875eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.204143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f170b-201b-4ac3-841d-70164e7875eb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.205735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f170b-201b-4ac3-841d-70164e7875eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.205994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f170b-201b-4ac3-841d-70164e7875eb admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.206637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f170b-201b-4ac3-841d-70164e7875eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.208720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f170b-201b-4ac3-841d-70164e7875eb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.231127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 800/1606] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:38.235247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec163daf-1abd-405f-987e-3383af6edc0a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.236116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec163daf-1abd-405f-987e-3383af6edc0a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.236395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec163daf-1abd-405f-987e-3383af6edc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.255286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a994d46-bbe5-4dca-9ce7-7a3bb3a1caa7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.259865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e9163-27bc-4af3-b022-0e1eea08f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.260465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e9163-27bc-4af3-b022-0e1eea08f1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.260740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e9163-27bc-4af3-b022-0e1eea08f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.261008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e9163-27bc-4af3-b022-0e1eea08f1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.261659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e9163-27bc-4af3-b022-0e1eea08f1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.263539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e9163-27bc-4af3-b022-0e1eea08f1ca admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.263782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ec163daf-1abd-405f-987e-3383af6edc0a None None] MFA Rules not processed for user `383e9a9d4d804959a910427cd1665b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:38.265079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ec163daf-1abd-405f-987e-3383af6edc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:38.291831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 807/1607] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:38.293193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda203c-a4b5-4319-ba88-f764b9482c47 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.293541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda203c-a4b5-4319-ba88-f764b9482c47 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.293879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda203c-a4b5-4319-ba88-f764b9482c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.322549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-afda203c-a4b5-4319-ba88-f764b9482c47 None None] MFA Rules not processed for user `d688a902aa2e45d2bc64380e44d56885`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:38.323844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-afda203c-a4b5-4319-ba88-f764b9482c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:38.336263 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 801/1608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:38.337261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec163daf-1abd-405f-987e-3383af6edc0a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.349785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec163daf-1abd-405f-987e-3383af6edc0a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.401331 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 808/1609] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:38.402860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55ec1-4274-4cc2-96ca-424420599c01 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.403144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55ec1-4274-4cc2-96ca-424420599c01 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.403417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55ec1-4274-4cc2-96ca-424420599c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.409135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3638c3-6098-4213-922e-3b858658fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.409803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3638c3-6098-4213-922e-3b858658fe33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.410081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3638c3-6098-4213-922e-3b858658fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.410354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3638c3-6098-4213-922e-3b858658fe33 admin admin] PATH_INFO: `/v3/projects/11350fc151ba4dda927f133986be6390/users/4881ab9848be49fe904e12dcedadce34/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.424707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3638c3-6098-4213-922e-3b858658fe33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11350fc151ba4dda927f133986be6390, user_id=4881ab9848be49fe904e12dcedadce34, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.427679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3638c3-6098-4213-922e-3b858658fe33 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.431711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-01d55ec1-4274-4cc2-96ca-424420599c01 None None] MFA Rules not processed for user `0499487f7a3245538923b7e8f397f925`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:38.433094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-01d55ec1-4274-4cc2-96ca-424420599c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:38.442707 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 802/1610] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:38 2022] PUT /identity/v3/projects/11350fc151ba4dda927f133986be6390/users/4881ab9848be49fe904e12dcedadce34/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:38.443941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2ed2-7ab5-4f93-bee4-89cb8f844026 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.444224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2ed2-7ab5-4f93-bee4-89cb8f844026 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.444496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2ed2-7ab5-4f93-bee4-89cb8f844026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.472326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-859c2ed2-7ab5-4f93-bee4-89cb8f844026 None None] MFA Rules not processed for user `1610001ded8f4c6aae5fbe1190144763`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:38.473631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-859c2ed2-7ab5-4f93-bee4-89cb8f844026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:38.483766 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:38.501969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 809/1611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:38.503578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c39e-85ab-41e8-a49d-005512683255 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.503880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c39e-85ab-41e8-a49d-005512683255 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.504135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c39e-85ab-41e8-a49d-005512683255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.524471 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:38.540709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2a25c39e-85ab-41e8-a49d-005512683255 None None] MFA Rules not processed for user `4e36fb5445a846dd891913399a320658`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:38.542097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a25c39e-85ab-41e8-a49d-005512683255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:38.553436 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 803/1612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:38.554249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c2ed2-7ab5-4f93-bee4-89cb8f844026 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.607946 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 810/1613] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:38.608800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c39e-85ab-41e8-a49d-005512683255 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.622156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c2ed2-7ab5-4f93-bee4-89cb8f844026 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.626892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.627521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.627768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.628037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.628678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.630363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.640245 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 804/1614] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:38.641373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.652849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0432b6-9b84-485b-98e4-6b738580e69b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.658016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.658601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.658877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.659156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.659767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.661682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.682624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c39e-85ab-41e8-a49d-005512683255 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.689433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.690275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.690561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.690934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.691574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.693555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.705143 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 805/1615] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:38.705143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.722580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 811/1616] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:38.722580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.729953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d6f89-a665-4a2e-896d-b9ebfef71f89 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.768540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90ed5-24cf-48ee-b030-14b7c11a517e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.773149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.773752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.774027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.774345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.775087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.777357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.787992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.788599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.788879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.789188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.789825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.791401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.802410 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 812/1617] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:38.803202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.807638 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 806/1618] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:38.807638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.813250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6c4f7-cd3d-4d89-ab1d-ba8466467b6d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.820809 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:38.834316 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:38.865903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8b3c-140d-4ff2-b038-5a063282c579 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.869666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.870347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.870586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.870899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.879450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.880055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.880341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.880612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.881282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.883164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.911121 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 813/1619] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:38.912000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.931641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.933172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:38.942275 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 807/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:38.943044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:38.954055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37a28-31d9-40c1-8431-d77b8e987a9f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.984284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78545a-d924-4c5d-8dd8-53c20487a0d7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:38.989512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:38.990125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:38.990406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:38.990674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:38.991308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:38.993441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.023480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.024153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.024429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.024683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] PATH_INFO: `/v3/projects/e4448ac63f714f75861c7768304e45fb/users/d70523fc9a194b6dbfc34220831564de/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.029344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 814/1621] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:38 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:39.029344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.044078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4448ac63f714f75861c7768304e45fb, user_id=d70523fc9a194b6dbfc34220831564de, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.046913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.062063 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 808/1622] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:38 2022] PUT /identity/v3/projects/e4448ac63f714f75861c7768304e45fb/users/d70523fc9a194b6dbfc34220831564de/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.062771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.109567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb1c69-2ea7-4aa3-98ab-14cbcb372997 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.117348 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:39.134684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29300-5f47-4d6c-8347-121653857cc2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.139913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.140950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.141258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.141531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.143399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.145027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.158033 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:39.158824 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 809/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:39.159885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.171904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635533-674f-43a7-ad1a-ad6ee94a9bc6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.178299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.179121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.179528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.180008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] PATH_INFO: `/v3/projects/11350fc151ba4dda927f133986be6390/users/4881ab9848be49fe904e12dcedadce34/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.182608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11350fc151ba4dda927f133986be6390, user_id=4881ab9848be49fe904e12dcedadce34, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.185786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.185935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.186419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.186695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.186966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.187618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.191052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.208004 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 810/1624] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/11350fc151ba4dda927f133986be6390/users/4881ab9848be49fe904e12dcedadce34/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.208004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.214262 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 815/1625] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:39 2022] POST /identity/v3/users => generated 306 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:39.214908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.226110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cb9e9-3a36-4fdd-b93a-0bc4120174ad admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.284247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d169c-5693-4f76-ada8-1d66603dbb50 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.289552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.290188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.290461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.290737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.290849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.291484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.291582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.291883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.292227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.292929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.293446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.295016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.319288 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 811/1626] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:39 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:39.320091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.322357 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 816/1627] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:39 2022] POST /identity/v3/users => generated 308 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:39.323172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.331261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614b30e-88ec-42a2-9041-97476187f77b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.334634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc687222-51d1-4e4b-b7d0-875494b1b24e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.336328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831151e3-3ad7-403a-8b36-38fbb0f1b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.337054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831151e3-3ad7-403a-8b36-38fbb0f1b123 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.337398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831151e3-3ad7-403a-8b36-38fbb0f1b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.337749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831151e3-3ad7-403a-8b36-38fbb0f1b123 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.338727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831151e3-3ad7-403a-8b36-38fbb0f1b123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.339601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.340264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.340618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.340951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831151e3-3ad7-403a-8b36-38fbb0f1b123 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.341134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.341755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.343402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.356790 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 817/1628] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:39.357725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.366540 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 812/1629] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:39 2022] POST /identity/v3/users => generated 299 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:39.368050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54705e-1867-435d-a437-300133cac590 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.368184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7928-cbe1-4732-b517-c470cf094ff5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.368363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54705e-1867-435d-a437-300133cac590 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.368686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54705e-1867-435d-a437-300133cac590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.373506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.374236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.374515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.374783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] PATH_INFO: `/v3/projects/60478b46cc0e4ed295535670700a191f/users/b538833da88b4c7e8319c94a8a94aa53/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.391393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60478b46cc0e4ed295535670700a191f, user_id=b538833da88b4c7e8319c94a8a94aa53, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.394392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.398090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fe54705e-1867-435d-a437-300133cac590 None None] MFA Rules not processed for user `4881ab9848be49fe904e12dcedadce34`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:39.399517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fe54705e-1867-435d-a437-300133cac590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.408002 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 818/1630] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/60478b46cc0e4ed295535670700a191f/users/b538833da88b4c7e8319c94a8a94aa53/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.411319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.470290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1d8b-1806-4658-9451-d4faf57f82c8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.475421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.476033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.476309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.476581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.477254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.478972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.479686 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 813/1631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:39.480523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54705e-1867-435d-a437-300133cac590 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.491900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54705e-1867-435d-a437-300133cac590 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.496091 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 819/1632] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:39.496091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.503534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.504188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.504636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.505094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.505310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16752c1-89d7-459e-8f99-03c0d75c5e2b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.506146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.507839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.510465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.512332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.512332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.512332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.512629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.514366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.522487 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 814/1633] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:39.522487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.531371 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 820/1634] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:39.532116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.534080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983104-f815-4b48-9291-b17431cd87d2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.538879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.539497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.539773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.540141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] PATH_INFO: `/v3/users/1610001ded8f4c6aae5fbe1190144763` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.541283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1610001ded8f4c6aae5fbe1190144763)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.543155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6c1e-b477-4458-b6cb-2b69565f4ce0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.543260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.548566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.549239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.549514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.549783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] PATH_INFO: `/v3/projects/e4448ac63f714f75861c7768304e45fb/users/d70523fc9a194b6dbfc34220831564de/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.551681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4448ac63f714f75861c7768304e45fb, user_id=d70523fc9a194b6dbfc34220831564de, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.554312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.557809 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:39.560027 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:39.568161 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 821/1635] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/e4448ac63f714f75861c7768304e45fb/users/d70523fc9a194b6dbfc34220831564de/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.569765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.603672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1610001ded8f4c6aae5fbe1190144763'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:39.604306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1610001ded8f4c6aae5fbe1190144763'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:39.604925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1610001ded8f4c6aae5fbe1190144763'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:39.617678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1610001ded8f4c6aae5fbe1190144763'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:39.624528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1610001ded8f4c6aae5fbe1190144763'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:39.635797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b7e7-0d78-4ff3-aa01-9f6d1c0c700d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.638606 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 815/1636] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:39 2022] DELETE /identity/v3/users/1610001ded8f4c6aae5fbe1190144763 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.639544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.640884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.644029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.644647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.644946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.645284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.645931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.647512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.661667 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 822/1637] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:39.661667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.661667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.674746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a48af-8f90-4667-a7b9-c3f8393dddc9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.708413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b813f0-9b78-4fea-bb5d-ecad8d644c08 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.713466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77afdf-df23-4e27-8420-b52f9a5d2522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.714072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77afdf-df23-4e27-8420-b52f9a5d2522 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.714351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77afdf-df23-4e27-8420-b52f9a5d2522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.714621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77afdf-df23-4e27-8420-b52f9a5d2522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.715257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77afdf-df23-4e27-8420-b52f9a5d2522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.716915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77afdf-df23-4e27-8420-b52f9a5d2522 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.727312 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 816/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:39.728409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbfc4c-0800-4480-807a-fd60691bd1c9 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.728692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbfc4c-0800-4480-807a-fd60691bd1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.728967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbfc4c-0800-4480-807a-fd60691bd1c9 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.730374 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 817/1639] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 01:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:02:39.730906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbfc4c-0800-4480-807a-fd60691bd1c9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.732478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8dcbfc4c-0800-4480-807a-fd60691bd1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.733847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.734627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.734977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.735386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] PATH_INFO: `/v3/projects/de22fe32e0844e72bb21050a685576ed/users/e6273cf4dc1844de9d5a6ba94aca78e8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.748367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbfc4c-0800-4480-807a-fd60691bd1c9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.752097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de22fe32e0844e72bb21050a685576ed, user_id=e6273cf4dc1844de9d5a6ba94aca78e8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.753905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac063b5-f5fa-45e8-baff-4e2d127a46ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.754556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac063b5-f5fa-45e8-baff-4e2d127a46ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.754809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.754907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac063b5-f5fa-45e8-baff-4e2d127a46ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.755098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac063b5-f5fa-45e8-baff-4e2d127a46ed admin admin] PATH_INFO: `/v3/projects/c2295f5b038e473ab35589a6591315a6/users/2c8d7d952fc245a19066d44a76d36005/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.768040 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 823/1640] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/de22fe32e0844e72bb21050a685576ed/users/e6273cf4dc1844de9d5a6ba94aca78e8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.768834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.772317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac063b5-f5fa-45e8-baff-4e2d127a46ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2295f5b038e473ab35589a6591315a6, user_id=2c8d7d952fc245a19066d44a76d36005, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.772448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.775009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac063b5-f5fa-45e8-baff-4e2d127a46ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.788824 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 818/1641] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/c2295f5b038e473ab35589a6591315a6/users/2c8d7d952fc245a19066d44a76d36005/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.790171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07924a-f3d9-4efd-bb94-8a03936b92a4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.790553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07924a-f3d9-4efd-bb94-8a03936b92a4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.790884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07924a-f3d9-4efd-bb94-8a03936b92a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.819329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ce07924a-f3d9-4efd-bb94-8a03936b92a4 None None] MFA Rules not processed for user `d70523fc9a194b6dbfc34220831564de`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:39.820577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ce07924a-f3d9-4efd-bb94-8a03936b92a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.840021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86043cfc-1ec9-4861-bb14-482d1983b825 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.859678 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:39.867876 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:39.892507 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 819/1642] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:39.894204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.894494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.894771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.909791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:39.910423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:39.910683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:39.910956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] PATH_INFO: `/v3/projects/a456c33465654f24b48668bae2a401ed/users/f234e83698c545cdb77a71ee8bb71001/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:39.916108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:39.917363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.926823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 820/1643] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:39.927742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:39.930419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:39.930548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a456c33465654f24b48668bae2a401ed, user_id=f234e83698c545cdb77a71ee8bb71001, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:39.932770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:39.943701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12ecb-a5d4-4ed4-9b90-84dca365556c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:39.947716 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 824/1644] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/a456c33465654f24b48668bae2a401ed/users/f234e83698c545cdb77a71ee8bb71001/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:39.948844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.003230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.003807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.004087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.004360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] PATH_INFO: `/v3/projects/6f7ddcc4ff184d7e8e18c6180a3f5677/users/57751733b0ee4b65870550b25959dd5a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.013668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e453-3dc8-4a57-9e13-9b5ca55db726 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.018422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a12ab7-379d-45e4-b316-ceafa7cc656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.019102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12ab7-379d-45e4-b316-ceafa7cc656a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.019365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12ab7-379d-45e4-b316-ceafa7cc656a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.019467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ddcc4ff184d7e8e18c6180a3f5677, user_id=57751733b0ee4b65870550b25959dd5a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.019771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12ab7-379d-45e4-b316-ceafa7cc656a admin admin] PATH_INFO: `/v3/projects/60478b46cc0e4ed295535670700a191f/users/b538833da88b4c7e8319c94a8a94aa53/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.021714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a12ab7-379d-45e4-b316-ceafa7cc656a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60478b46cc0e4ed295535670700a191f, user_id=b538833da88b4c7e8319c94a8a94aa53, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.022068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.024310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a12ab7-379d-45e4-b316-ceafa7cc656a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.035834 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 825/1645] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/60478b46cc0e4ed295535670700a191f/users/b538833da88b4c7e8319c94a8a94aa53/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:40.036242 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 821/1646] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:39 2022] PUT /identity/v3/projects/6f7ddcc4ff184d7e8e18c6180a3f5677/users/57751733b0ee4b65870550b25959dd5a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:40.037043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.043179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b528c2-93fe-49fb-862b-86bb3a2ad955 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.043715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b528c2-93fe-49fb-862b-86bb3a2ad955 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.044019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b528c2-93fe-49fb-862b-86bb3a2ad955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.083501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-99b528c2-93fe-49fb-862b-86bb3a2ad955 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:40.084726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-99b528c2-93fe-49fb-862b-86bb3a2ad955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.099020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebf760-0aed-4f97-af42-858713d591cb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.154162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 826/1647] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:40.155007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b528c2-93fe-49fb-862b-86bb3a2ad955 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.162059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fe20-9a87-4391-8de5-c1441fcc9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.162748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fe20-9a87-4391-8de5-c1441fcc9059 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.162969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fe20-9a87-4391-8de5-c1441fcc9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.163239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fe20-9a87-4391-8de5-c1441fcc9059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.163942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fe20-9a87-4391-8de5-c1441fcc9059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.165465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b528c2-93fe-49fb-862b-86bb3a2ad955 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.166013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fe20-9a87-4391-8de5-c1441fcc9059 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.170482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.171084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.171367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.171768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.172416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.174293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.176630 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 822/1648] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:40.177875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba39fb-d594-4c79-b423-9b3bc5392bc3 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.178156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba39fb-d594-4c79-b423-9b3bc5392bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.178459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba39fb-d594-4c79-b423-9b3bc5392bc3 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.180051 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 823/1649] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 11 01:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:02:40.180746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba39fb-d594-4c79-b423-9b3bc5392bc3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.182426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-beba39fb-d594-4c79-b423-9b3bc5392bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.189259 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 827/1650] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:40.190093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.193013 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:40.201970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c09ca-b817-46bf-9a41-db4b03c42695 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.207156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.207747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.208249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.208356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.208908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.210503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.212557 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:40.222353 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 828/1651] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:40.223178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.233203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e38ea-63fc-4a25-a430-f790a36adee7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.238208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d88b9d-95e8-470a-a6ed-6875c66ddcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.239307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d88b9d-95e8-470a-a6ed-6875c66ddcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.239589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d88b9d-95e8-470a-a6ed-6875c66ddcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.239916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d88b9d-95e8-470a-a6ed-6875c66ddcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.240707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d88b9d-95e8-470a-a6ed-6875c66ddcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.242297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d88b9d-95e8-470a-a6ed-6875c66ddcb9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.242831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba39fb-d594-4c79-b423-9b3bc5392bc3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.246491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.247086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.247360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.247626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.252812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 829/1652] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:40.254425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424c006-1329-40db-9703-f6744582f2e0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.254649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424c006-1329-40db-9703-f6744582f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.254914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424c006-1329-40db-9703-f6744582f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.257254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.258675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.268957 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 824/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:40.269777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.281376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b108-3219-4773-abf2-e4746ae27736 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.289692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90ca05-cbeb-453f-a4af-45acafccb12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.290019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e424c006-1329-40db-9703-f6744582f2e0 None None] MFA Rules not processed for user `b538833da88b4c7e8319c94a8a94aa53`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:40.290299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ca05-cbeb-453f-a4af-45acafccb12c service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.290576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ca05-cbeb-453f-a4af-45acafccb12c service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.290845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ca05-cbeb-453f-a4af-45acafccb12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.291280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e424c006-1329-40db-9703-f6744582f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.292637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c90ca05-cbeb-453f-a4af-45acafccb12c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.363523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90ca05-cbeb-453f-a4af-45acafccb12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.365180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90ca05-cbeb-453f-a4af-45acafccb12c service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.369791 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 830/1654] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:40.370490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424c006-1329-40db-9703-f6744582f2e0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.384036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424c006-1329-40db-9703-f6744582f2e0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.387371 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 825/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:40.389201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.390305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.390305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.390682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] PATH_INFO: `/v3/projects/de22fe32e0844e72bb21050a685576ed/users/e6273cf4dc1844de9d5a6ba94aca78e8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.393912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de22fe32e0844e72bb21050a685576ed, user_id=e6273cf4dc1844de9d5a6ba94aca78e8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.395312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b988258-be97-44ec-bbbb-8cb5f811e5df None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.395782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b988258-be97-44ec-bbbb-8cb5f811e5df None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.396249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b988258-be97-44ec-bbbb-8cb5f811e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.397164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.409617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 831/1656] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:40 2022] PUT /identity/v3/projects/de22fe32e0844e72bb21050a685576ed/users/e6273cf4dc1844de9d5a6ba94aca78e8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:40.420545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.422800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1b988258-be97-44ec-bbbb-8cb5f811e5df None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:40.424697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b988258-be97-44ec-bbbb-8cb5f811e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.513321 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 826/1657] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:40.514132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b988258-be97-44ec-bbbb-8cb5f811e5df None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.518809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdda46-3f92-4c2c-a4b5-757373298f0a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.531760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.532475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.532828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.533130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] PATH_INFO: `/v3/projects/c2295f5b038e473ab35589a6591315a6/users/2c8d7d952fc245a19066d44a76d36005/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.536792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2295f5b038e473ab35589a6591315a6, user_id=2c8d7d952fc245a19066d44a76d36005, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.538259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b988258-be97-44ec-bbbb-8cb5f811e5df None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.539542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.543845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed054bd-6e5e-4641-ad03-773f7afce604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.544803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed054bd-6e5e-4641-ad03-773f7afce604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.545366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed054bd-6e5e-4641-ad03-773f7afce604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.546011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed054bd-6e5e-4641-ad03-773f7afce604 admin admin] PATH_INFO: `/v3/projects/a456c33465654f24b48668bae2a401ed/users/f234e83698c545cdb77a71ee8bb71001/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.549739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed054bd-6e5e-4641-ad03-773f7afce604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a456c33465654f24b48668bae2a401ed, user_id=f234e83698c545cdb77a71ee8bb71001, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.553011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed054bd-6e5e-4641-ad03-773f7afce604 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.553241 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 832/1658] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:40 2022] PUT /identity/v3/projects/c2295f5b038e473ab35589a6591315a6/users/2c8d7d952fc245a19066d44a76d36005/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:40.554018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.576652 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 827/1659] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:40 2022] PUT /identity/v3/projects/a456c33465654f24b48668bae2a401ed/users/f234e83698c545cdb77a71ee8bb71001/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:40.578239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bbc99-f705-41a5-9dd8-3841a720b5e3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.578618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bbc99-f705-41a5-9dd8-3841a720b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.578958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bbc99-f705-41a5-9dd8-3841a720b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.611903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c99bbc99-f705-41a5-9dd8-3841a720b5e3 None None] MFA Rules not processed for user `e6273cf4dc1844de9d5a6ba94aca78e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:40.613421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c99bbc99-f705-41a5-9dd8-3841a720b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.625122 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:40.650671 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:40.677641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2ad73-ea6a-4d3c-87ae-518815bb2869 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.722414 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 828/1660] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:40.723193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bbc99-f705-41a5-9dd8-3841a720b5e3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.759890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e5cd-9dee-4a2e-9be7-a9deea961a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.760561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e5cd-9dee-4a2e-9be7-a9deea961a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.760847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e5cd-9dee-4a2e-9be7-a9deea961a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.761152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e5cd-9dee-4a2e-9be7-a9deea961a0a admin admin] PATH_INFO: `/v3/projects/6f7ddcc4ff184d7e8e18c6180a3f5677/users/57751733b0ee4b65870550b25959dd5a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.763136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e5cd-9dee-4a2e-9be7-a9deea961a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ddcc4ff184d7e8e18c6180a3f5677, user_id=57751733b0ee4b65870550b25959dd5a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.765890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e5cd-9dee-4a2e-9be7-a9deea961a0a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.777662 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 833/1661] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:40 2022] PUT /identity/v3/projects/6f7ddcc4ff184d7e8e18c6180a3f5677/users/57751733b0ee4b65870550b25959dd5a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:40.778816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70d237-1722-47dd-b243-08799f187c6b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.779110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70d237-1722-47dd-b243-08799f187c6b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.779482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70d237-1722-47dd-b243-08799f187c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.809284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bb70d237-1722-47dd-b243-08799f187c6b None None] MFA Rules not processed for user `2c8d7d952fc245a19066d44a76d36005`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:40.810513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bb70d237-1722-47dd-b243-08799f187c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.824206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bbc99-f705-41a5-9dd8-3841a720b5e3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:40.882501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 834/1662] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:40.883840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ffa2-b9f2-48b0-a68a-6c474837bd0b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.884132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ffa2-b9f2-48b0-a68a-6c474837bd0b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.884408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59ffa2-b9f2-48b0-a68a-6c474837bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.897651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:40.898272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:40.898552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:40.898824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:40.913092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fc59ffa2-b9f2-48b0-a68a-6c474837bd0b None None] MFA Rules not processed for user `f234e83698c545cdb77a71ee8bb71001`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:40.914354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc59ffa2-b9f2-48b0-a68a-6c474837bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.942165 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:40.963046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:40.964676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:40.975050 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 829/1663] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:40.975682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.976981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:40.986158 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 835/1664] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:40.990887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ffa2-b9f2-48b0-a68a-6c474837bd0b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:40.999165 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:41.009238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59ffa2-b9f2-48b0-a68a-6c474837bd0b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.016418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fc3ed-0317-4038-a3f8-ac242386d3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.017272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fc3ed-0317-4038-a3f8-ac242386d3f2 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.017560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fc3ed-0317-4038-a3f8-ac242386d3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.017816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fc3ed-0317-4038-a3f8-ac242386d3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.055502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923abef-8f1b-49b4-a8ae-6efcb4d24752 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.060124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.060751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.061031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.061327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] PATH_INFO: `/v3/projects/bfd3542d6d654484aeb937471a50016a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.062656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd3542d6d654484aeb937471a50016a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.064221 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:02:41.064221 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:02:41.064221 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:02:41.065714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.096666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fc3ed-0317-4038-a3f8-ac242386d3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.098424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fc3ed-0317-4038-a3f8-ac242386d3f2 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.119142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 836/1665] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:41.120630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3fa0-4363-4a84-8e3c-e19fb49a5bc7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.120893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3fa0-4363-4a84-8e3c-e19fb49a5bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.121195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3fa0-4363-4a84-8e3c-e19fb49a5bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.165402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9ccd3fa0-4363-4a84-8e3c-e19fb49a5bc7 None None] MFA Rules not processed for user `57751733b0ee4b65870550b25959dd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:41.165827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd3542d6d654484aeb937471a50016a', 'request_id': 'req-06f1853a-ea22-4a59-b57d-21a36a494044'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:41.166648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9ccd3fa0-4363-4a84-8e3c-e19fb49a5bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.180644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd3542d6d654484aeb937471a50016a', 'request_id': 'req-06f1853a-ea22-4a59-b57d-21a36a494044'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:41.203364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd3542d6d654484aeb937471a50016a', 'request_id': 'req-06f1853a-ea22-4a59-b57d-21a36a494044'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:41.235548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] The token cache is being invalidate because project bfd3542d6d654484aeb937471a50016a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:41.235822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:41.237107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:41.245094 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 830/1666] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:40 2022] DELETE /identity/v3/projects/bfd3542d6d654484aeb937471a50016a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:41.245971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.247690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.287384 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 837/1667] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:41.288937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.289262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.289538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.318060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:41.321011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.347374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1853a-ea22-4a59-b57d-21a36a494044 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.352812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780fc22-e676-45e9-aebf-98174d36183d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.353442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780fc22-e676-45e9-aebf-98174d36183d service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.353725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780fc22-e676-45e9-aebf-98174d36183d service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.353994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780fc22-e676-45e9-aebf-98174d36183d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.355765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3780fc22-e676-45e9-aebf-98174d36183d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.360794 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:41.389475 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 838/1668] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:41.396931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.396931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.410491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75e260-7ba6-49a1-96a8-0b84afa3904f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.416053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.417403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.417687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.417965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.419704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.435677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780fc22-e676-45e9-aebf-98174d36183d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.437351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780fc22-e676-45e9-aebf-98174d36183d service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.442153 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:41.449480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 831/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:41.450986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547930-d651-4dd2-87cc-dcce8c4cc771 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.451277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547930-d651-4dd2-87cc-dcce8c4cc771 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.451551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547930-d651-4dd2-87cc-dcce8c4cc771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.473587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-35547930-d651-4dd2-87cc-dcce8c4cc771 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:41.474812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35547930-d651-4dd2-87cc-dcce8c4cc771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.483149 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 832/1670] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:41.488225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547930-d651-4dd2-87cc-dcce8c4cc771 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.490490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.492421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.502179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547930-d651-4dd2-87cc-dcce8c4cc771 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.504593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 839/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:41.507474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.508153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.508536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.508882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.509626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:41.510038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.511896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.518244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.529583 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 833/1672] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:02:41.530621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a5a85-de1e-4325-b25b-6747c350a4e6 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.531453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.537804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.538437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.538717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.538984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.540791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.544821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273858-ba5a-44e6-a85b-491630993ec0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.551331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.551896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.552175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.552446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.553111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.555703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.601094 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 834/1673] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:41 2022] POST /identity/v3/projects => generated 403 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:41.603592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.622271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.623856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.634755 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 840/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:41.676717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c99b1-6be0-4e5c-b7f1-abc52f208d91 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.682339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.683391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.683668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.684082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.684876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.686809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.700108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.718761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1e1a5-1bbe-475f-a690-41b2499ec6a5 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.738831 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 835/1675] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:41 2022] POST /identity/v3/users => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:02:41.738831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.794511 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:41.799586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.799989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.800177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.800460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.821892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ecddb-c527-4662-b5fa-fced3f9844b7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.828090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.828696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.828975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.829762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.831756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.853901 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:41.867569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.869376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.879375 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 841/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:41.886064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.895448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.897230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.900030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdeb00-79a1-4671-8634-88e66f04cf53 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.904973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.905616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.906254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.906254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.906931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.908620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.917298 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 836/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:41.918002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.926929 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 842/1678] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:41.928330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.929246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3519fa6-073b-4d24-acff-ce3d6784964f service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.935683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10678e-9890-4931-a351-c2f196017270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.936292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10678e-9890-4931-a351-c2f196017270 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.936570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10678e-9890-4931-a351-c2f196017270 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.936836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10678e-9890-4931-a351-c2f196017270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.938651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9e10678e-9890-4931-a351-c2f196017270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:41.939355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56062fa4-9010-482e-8661-6d0a591994b6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.944749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.945398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.945685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.945954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:41.946909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:41.948594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:41.964883 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 843/1679] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:02:41.970717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:41.991175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3228f1-4814-482e-b6d5-d84ae39ec137 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:41.996598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25954cb-36cd-4be8-b9a6-670eeef8319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:41.997476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25954cb-36cd-4be8-b9a6-670eeef8319f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:41.997921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25954cb-36cd-4be8-b9a6-670eeef8319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:41.998566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25954cb-36cd-4be8-b9a6-670eeef8319f admin admin] PATH_INFO: `/v3/projects/8ba5ac645c234659b1657c5202f7bc8b/users/a048a1b75a74409fa68b87726d01d506/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.019025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25954cb-36cd-4be8-b9a6-670eeef8319f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba5ac645c234659b1657c5202f7bc8b, user_id=a048a1b75a74409fa68b87726d01d506, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:42.021957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25954cb-36cd-4be8-b9a6-670eeef8319f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:42.029830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10678e-9890-4931-a351-c2f196017270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:42.031633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10678e-9890-4931-a351-c2f196017270 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:42.049892 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 844/1680] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:41 2022] PUT /identity/v3/projects/8ba5ac645c234659b1657c5202f7bc8b/users/a048a1b75a74409fa68b87726d01d506/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:42.054015 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 837/1681] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:42.055602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.055874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.056145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.097406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:42.099461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.214282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 845/1682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:42.221725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ea69-fa12-442a-a9d5-4fb96f784156 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.222148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ea69-fa12-442a-a9d5-4fb96f784156 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.222276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:42.222609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ea69-fa12-442a-a9d5-4fb96f784156 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.223714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.224151 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 838/1683] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:02:42.231231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.231536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.231811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.263995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:42.265994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.302797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e2d3f-4326-43ae-8cfb-4a083099187e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:42.306582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:42.308429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.308779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.309202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.324187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:42.326641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:42.337192 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 846/1684] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:42.354140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 839/1685] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:02:42.389380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:42.390792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.406854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9b43c-fb64-42e2-988d-206b3fbc563d service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:42.412893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7e09-a4dc-4d49-9280-9dc58e24ab17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:42.413558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7e09-a4dc-4d49-9280-9dc58e24ab17 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.413754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7e09-a4dc-4d49-9280-9dc58e24ab17 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.414024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7e09-a4dc-4d49-9280-9dc58e24ab17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.429965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd7e09-a4dc-4d49-9280-9dc58e24ab17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:42.431571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd7e09-a4dc-4d49-9280-9dc58e24ab17 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:42.446210 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 847/1686] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:42.514530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:42.514530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.536750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf360bb-a91f-4607-930a-eba1348a8f7c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:42.542356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:42.545185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.545185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.545185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] PATH_INFO: `/v3/users/4e36fb5445a846dd891913399a320658` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.545630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e36fb5445a846dd891913399a320658)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:42.548818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:42.566877 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:42.619725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.621001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.621431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.655446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e36fb5445a846dd891913399a320658'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:42.656997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e36fb5445a846dd891913399a320658'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:42.661706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e36fb5445a846dd891913399a320658'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:42.670025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] MFA Rules not processed for user `3d983b1226d14d4582ae7429602bd40a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:42.671888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.681237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e36fb5445a846dd891913399a320658'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:42.692200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c7720e-7364-42e1-9dbe-01defb8fa585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e36fb5445a846dd891913399a320658'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:42.713638 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:42.722368 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 840/1687] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:42 2022] DELETE /identity/v3/users/4e36fb5445a846dd891913399a320658 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:42.728740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:42.729454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:42.729946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:42.775144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:42.776580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.788326 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 848/1688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:02:42.822984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:42.824647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.873443 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 841/1689] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:42.886501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:42.888537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:42.978757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe4f99-073a-4e7d-9897-bc58bab38914 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:43.001613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216b917-01ec-4a26-938a-dac65550b84c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:43.014484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:43.015231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.015383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.015654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.035682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.037194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.052972 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 842/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:02:43.090981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:43.091674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.092288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.092288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.094262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.107974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:43.109502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.127622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ae107-a162-4545-ae2e-121511182259 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:43.132732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:43.133458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.133741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.134016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] PATH_INFO: `/v3/users/0499487f7a3245538923b7e8f397f925` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.135344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0499487f7a3245538923b7e8f397f925)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.138526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.203969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.207751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.210018 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:43.219280 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 849/1691] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:43.221399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:43.222801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.233860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0499487f7a3245538923b7e8f397f925'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.234767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0499487f7a3245538923b7e8f397f925'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.236078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0499487f7a3245538923b7e8f397f925'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.240736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d4a58-a307-4cb9-8c9b-4281310ae5e3 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:43.248064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:43.249150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.249805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.250310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] PATH_INFO: `/v3/users/947de767d36347618a06bbcbd0081256` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.252733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947de767d36347618a06bbcbd0081256)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.254074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0499487f7a3245538923b7e8f397f925'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.254949 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:02:43.254949 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:02:43.254949 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:02:43.257139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.261834 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:43.268319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e9f1d117-c26d-410e-bc27-03fda14647a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0499487f7a3245538923b7e8f397f925'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.294361 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 843/1692] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:43 2022] DELETE /identity/v3/users/0499487f7a3245538923b7e8f397f925 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:02:43.298821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d611b1-f9aa-4110-929d-b26250c512fb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.299197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d611b1-f9aa-4110-929d-b26250c512fb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.299526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d611b1-f9aa-4110-929d-b26250c512fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.333188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e5d611b1-f9aa-4110-929d-b26250c512fb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:43.334997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5d611b1-f9aa-4110-929d-b26250c512fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.363719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947de767d36347618a06bbcbd0081256'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.364406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947de767d36347618a06bbcbd0081256'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.365048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947de767d36347618a06bbcbd0081256'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.380493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947de767d36347618a06bbcbd0081256'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.418644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947de767d36347618a06bbcbd0081256'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.426618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 844/1693] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:43.428185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841836d-ad07-45ab-a485-b24b02321798 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.428571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841836d-ad07-45ab-a485-b24b02321798 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.428853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841836d-ad07-45ab-a485-b24b02321798 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.430647 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 845/1694] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:02:43.437595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.438167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.439042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.461502 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 850/1695] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:43 2022] DELETE /identity/v3/users/947de767d36347618a06bbcbd0081256 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:43.462748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:43.465717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.477918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:43.479412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.568160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b144-fb2a-48b5-8b84-599e3ae92907 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:43.575683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b3a01-7895-4c6f-a143-d384853b0830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:43.576336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3a01-7895-4c6f-a143-d384853b0830 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.576720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3a01-7895-4c6f-a143-d384853b0830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.576974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3a01-7895-4c6f-a143-d384853b0830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.601250 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 846/1696] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:43.602656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:43.604934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.621088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d336236-9196-4ab2-9fbc-f1a865ca58ab None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:43.627785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:43.630045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.630491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.630777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.640090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.662671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b3a01-7895-4c6f-a143-d384853b0830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.664360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b3a01-7895-4c6f-a143-d384853b0830 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.677885 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 851/1697] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:43.679818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.679818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.680051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.702630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:43.703878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.716239 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:43.717888 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 852/1698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:43.718954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:43.721587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.738446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234ddc-f33e-40f2-af71-74ec6552f07f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:43.743520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:43.744160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:43.744439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:43.744722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] PATH_INFO: `/v3/projects/e830e11f7d4b4d0db2f5035332f510ff` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:43.745908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e830e11f7d4b4d0db2f5035332f510ff)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.748174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.753826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:43.755458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:43.771681 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:43.779585 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 847/1699] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:43.780588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:43.782047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.850269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e830e11f7d4b4d0db2f5035332f510ff', 'request_id': 'req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.861822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e830e11f7d4b4d0db2f5035332f510ff', 'request_id': 'req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.883584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e830e11f7d4b4d0db2f5035332f510ff', 'request_id': 'req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.907691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] The token cache is being invalidate because project e830e11f7d4b4d0db2f5035332f510ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:43.908333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.909877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:43.911616 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 853/1700] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:43 2022] DELETE /identity/v3/projects/e830e11f7d4b4d0db2f5035332f510ff => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:43.912565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:43.922289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:43.934872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b0a5d-145a-48fd-bfa3-2514ad0058a9 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:44.062039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:44.065001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:44.065571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:44.066616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:44.070038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:44.079131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8fbf5-8e81-4310-bfe3-9fac56305a8b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:44.091870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:44.091870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:44.091870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:44.091870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:44.097468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:44.216375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:44.216375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:44.221801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:44.223464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:44.242339 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 848/1701] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:44.242565 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 854/1702] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:44.243369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:44.245112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:44.272394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b4a7-71b2-473e-ad4d-fe3a6d5747f0 service glance] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:44.281864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:44.284076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:44.284711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:44.284827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] PATH_INFO: `/v3/users/57751733b0ee4b65870550b25959dd5a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:44.289420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57751733b0ee4b65870550b25959dd5a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:44.292528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:44.308770 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:44.428454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57751733b0ee4b65870550b25959dd5a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:44.429674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57751733b0ee4b65870550b25959dd5a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:44.432846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57751733b0ee4b65870550b25959dd5a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:44.466773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57751733b0ee4b65870550b25959dd5a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:44.499199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57751733b0ee4b65870550b25959dd5a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:44.540947 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 849/1703] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:44 2022] DELETE /identity/v3/users/57751733b0ee4b65870550b25959dd5a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:45.296697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:45.298822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:45.321539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0525a0-fccc-4378-bc66-cd05c5799403 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:45.327097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:45.329811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:45.483843 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:45.492519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:45.494600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:45.494960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:45.495389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] PATH_INFO: `/v3/projects/00a1ba5f5b564118a48c47493c093095` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:45.496732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a1ba5f5b564118a48c47493c093095)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:45.499009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:45.507276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c281c-fc2d-4b06-b882-ff3a071931b7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:45.523604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:45.524639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:45.524917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:45.525218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] PATH_INFO: `/v3/projects/5eccc5e0efa1480fb72fc956345d6fd9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:45.529939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eccc5e0efa1480fb72fc956345d6fd9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:45.532098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:45.578724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a1ba5f5b564118a48c47493c093095', 'request_id': 'req-bf8d0a48-8356-4b46-904b-171f67277a34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.587055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a1ba5f5b564118a48c47493c093095', 'request_id': 'req-bf8d0a48-8356-4b46-904b-171f67277a34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.596066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a1ba5f5b564118a48c47493c093095', 'request_id': 'req-bf8d0a48-8356-4b46-904b-171f67277a34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.611873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] The token cache is being invalidate because project 00a1ba5f5b564118a48c47493c093095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:45.612362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.613203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.615302 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 855/1704] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:45 2022] DELETE /identity/v3/projects/00a1ba5f5b564118a48c47493c093095 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:45.619000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:45.620446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:45.622159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eccc5e0efa1480fb72fc956345d6fd9', 'request_id': 'req-435a02f8-6462-4f1f-aa3e-174d69486ace'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.632871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eccc5e0efa1480fb72fc956345d6fd9', 'request_id': 'req-435a02f8-6462-4f1f-aa3e-174d69486ace'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.639949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eccc5e0efa1480fb72fc956345d6fd9', 'request_id': 'req-435a02f8-6462-4f1f-aa3e-174d69486ace'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.656271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] The token cache is being invalidate because project 5eccc5e0efa1480fb72fc956345d6fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:45.656924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.658244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.660865 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 850/1705] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:45 2022] DELETE /identity/v3/projects/5eccc5e0efa1480fb72fc956345d6fd9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:02:45.662037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:45.664507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:45.697324 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:45.704505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d0a48-8356-4b46-904b-171f67277a34 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:45.759447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a02f8-6462-4f1f-aa3e-174d69486ace admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:45.767718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:45.768503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:45.768886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:45.769297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] PATH_INFO: `/v3/users/5fb0275e9bc04d3a9bed6b502e68f54f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:45.771979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb0275e9bc04d3a9bed6b502e68f54f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:45.772823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:45.773653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:45.773997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:45.774125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:45.774354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:45.776505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:45.792712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:45.794265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:45.819279 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 856/1706] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:45.826508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:45.833642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:45.852341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c873-b2d8-47ed-b1e8-4f346ec54645 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:45.860644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:45.861919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:45.862380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:45.862775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] PATH_INFO: `/v3/users/f234e83698c545cdb77a71ee8bb71001` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:45.864160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f234e83698c545cdb77a71ee8bb71001)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:45.866292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:45.885955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb0275e9bc04d3a9bed6b502e68f54f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.892328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb0275e9bc04d3a9bed6b502e68f54f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.892763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb0275e9bc04d3a9bed6b502e68f54f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.917196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb0275e9bc04d3a9bed6b502e68f54f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.925201 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:45.935235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb0275e9bc04d3a9bed6b502e68f54f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.965125 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 851/1707] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:45 2022] DELETE /identity/v3/users/5fb0275e9bc04d3a9bed6b502e68f54f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:45.966327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:45.970363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:45.993379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f234e83698c545cdb77a71ee8bb71001'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.995542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f234e83698c545cdb77a71ee8bb71001'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:45.998614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f234e83698c545cdb77a71ee8bb71001'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.009402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f234e83698c545cdb77a71ee8bb71001'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.029598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f234e83698c545cdb77a71ee8bb71001'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.062847 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 857/1708] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:45 2022] DELETE /identity/v3/users/f234e83698c545cdb77a71ee8bb71001 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:46.062847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:46.075249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:46.109862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d84fb0-bbb6-4acc-bf39-d05f0afbd2c1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:46.186318 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:46.245007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a6ea7-1d0e-468b-92a3-cd98fd6e11d0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:46.247685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:46.248637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.248877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.249163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] PATH_INFO: `/v3/users/4881ab9848be49fe904e12dcedadce34` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.250363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4881ab9848be49fe904e12dcedadce34)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:46.253678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:46.257215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:46.258359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.258777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.259532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] PATH_INFO: `/v3/projects/6f7ddcc4ff184d7e8e18c6180a3f5677` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.262606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7ddcc4ff184d7e8e18c6180a3f5677)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:46.267242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:46.343430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7ddcc4ff184d7e8e18c6180a3f5677', 'request_id': 'req-89f29c1c-8902-40ab-bf67-419302294efe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.359285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7ddcc4ff184d7e8e18c6180a3f5677', 'request_id': 'req-89f29c1c-8902-40ab-bf67-419302294efe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.372488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7ddcc4ff184d7e8e18c6180a3f5677', 'request_id': 'req-89f29c1c-8902-40ab-bf67-419302294efe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.373166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4881ab9848be49fe904e12dcedadce34'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.377542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4881ab9848be49fe904e12dcedadce34'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.379729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4881ab9848be49fe904e12dcedadce34'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.400581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] The token cache is being invalidate because project 6f7ddcc4ff184d7e8e18c6180a3f5677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:46.400901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.402133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89f29c1c-8902-40ab-bf67-419302294efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.409831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 858/1709] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:46 2022] DELETE /identity/v3/projects/6f7ddcc4ff184d7e8e18c6180a3f5677 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:46.411525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.411819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.412098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.413857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4881ab9848be49fe904e12dcedadce34'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.428508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ee2be0ec-8dad-4ccd-a37a-4d492c613088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4881ab9848be49fe904e12dcedadce34'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:46.443813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:46.445577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:46.456484 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 852/1710] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:45 2022] DELETE /identity/v3/users/4881ab9848be49fe904e12dcedadce34 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:46.458319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa848-d69b-4f37-875b-2c8297819b08 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.458816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa848-d69b-4f37-875b-2c8297819b08 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.459472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa848-d69b-4f37-875b-2c8297819b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.472726 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:46.508229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e96fa848-d69b-4f37-875b-2c8297819b08 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:46.509706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e96fa848-d69b-4f37-875b-2c8297819b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:46.585628 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 859/1711] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:46.601394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:46.606390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:46.690710 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 853/1712] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:46.691977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7054a9-dbae-4ca0-be4f-609d4fff7529 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.692369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7054a9-dbae-4ca0-be4f-609d4fff7529 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.692753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7054a9-dbae-4ca0-be4f-609d4fff7529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.718416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2331e-f8d3-41ef-93be-d613b0eb32e9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:46.720328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cb7054a9-dbae-4ca0-be4f-609d4fff7529 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:46.722369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb7054a9-dbae-4ca0-be4f-609d4fff7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:46.734454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 854/1713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:46.739810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7054a9-dbae-4ca0-be4f-609d4fff7529 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:46.758090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7054a9-dbae-4ca0-be4f-609d4fff7529 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:46.769155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:46.769995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.770379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.770953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.771905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:46.772478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:46.778476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:46.811227 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 855/1714] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:46.812622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:46.822277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:46.885537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca277d-bb9f-41f1-8db0-980901db00f3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:46.899693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:46.900336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.900833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.901089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.915166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:46.916414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:46.916902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:46.917310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] PATH_INFO: `/v3/projects/a456c33465654f24b48668bae2a401ed` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:46.920997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a456c33465654f24b48668bae2a401ed)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:46.921539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:46.927233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:46.930021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:46.955078 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 860/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:46.955951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:46.992573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef817d6c-4931-41cf-880d-1f9443d765ca service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.000586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.003296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.003576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.014976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.015690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.017731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.041772 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:47.059755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a456c33465654f24b48668bae2a401ed', 'request_id': 'req-6ef715ef-8665-471b-a046-96ff2c1d6b30'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.075013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a456c33465654f24b48668bae2a401ed', 'request_id': 'req-6ef715ef-8665-471b-a046-96ff2c1d6b30'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.094090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a456c33465654f24b48668bae2a401ed', 'request_id': 'req-6ef715ef-8665-471b-a046-96ff2c1d6b30'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.103298 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 861/1716] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:46 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:47.107763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.128257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] The token cache is being invalidate because project a456c33465654f24b48668bae2a401ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:47.128705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.130362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6ef715ef-8665-471b-a046-96ff2c1d6b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.139752 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 856/1717] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:46 2022] DELETE /identity/v3/projects/a456c33465654f24b48668bae2a401ed => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:47.145714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.146326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.153014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.197404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:47.199928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.286367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f6d4-d0c3-4f62-a1c5-f4fb332adc7a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.294297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.294990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.295274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.295551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.296255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.302581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.311626 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:47.339757 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 862/1718] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:47 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:47.340856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.343058 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 857/1719] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:47.344070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.346147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.351817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.360867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab24741-2bc4-4d35-b759-ca75dde9f64f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.366677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbe310-4aeb-4027-9dbd-fb393ee72f8c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.366894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d3389-bf2d-4dca-8d1c-826e8b7001e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.367644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d3389-bf2d-4dca-8d1c-826e8b7001e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.368163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d3389-bf2d-4dca-8d1c-826e8b7001e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.368708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d3389-bf2d-4dca-8d1c-826e8b7001e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.369516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d3389-bf2d-4dca-8d1c-826e8b7001e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.371293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d3389-bf2d-4dca-8d1c-826e8b7001e2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.377597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.378263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.378550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.379860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] PATH_INFO: `/v3/projects/11350fc151ba4dda927f133986be6390` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.381532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11350fc151ba4dda927f133986be6390)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.384315 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 858/1720] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:47.385774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a278e0d-74c8-44d3-9c52-a9ed3aeb020b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.386223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a278e0d-74c8-44d3-9c52-a9ed3aeb020b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.386658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a278e0d-74c8-44d3-9c52-a9ed3aeb020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.388176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.412750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0a278e0d-74c8-44d3-9c52-a9ed3aeb020b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:47.415192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0a278e0d-74c8-44d3-9c52-a9ed3aeb020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.424858 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 859/1721] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:47.425682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a278e0d-74c8-44d3-9c52-a9ed3aeb020b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.440088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a278e0d-74c8-44d3-9c52-a9ed3aeb020b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.445740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.446607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.447107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.447569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.448680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.450979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.464244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 860/1722] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:47.465910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.479899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6557e5-b0d9-4587-80e5-bf6cb7c98c8e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.489808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11350fc151ba4dda927f133986be6390', 'request_id': 'req-62018453-d593-46b2-858d-84da84d6de03'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.506921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11350fc151ba4dda927f133986be6390', 'request_id': 'req-62018453-d593-46b2-858d-84da84d6de03'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.534665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11350fc151ba4dda927f133986be6390', 'request_id': 'req-62018453-d593-46b2-858d-84da84d6de03'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.549004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] The token cache is being invalidate because project 11350fc151ba4dda927f133986be6390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:47.549242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.550928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:47.554658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 863/1723] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:47 2022] DELETE /identity/v3/projects/11350fc151ba4dda927f133986be6390 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:47.556751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.560137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.630369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950aca32-da8b-4447-9b76-b97f8094d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.631014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aca32-da8b-4447-9b76-b97f8094d72d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.631292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aca32-da8b-4447-9b76-b97f8094d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.631841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aca32-da8b-4447-9b76-b97f8094d72d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.632221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950aca32-da8b-4447-9b76-b97f8094d72d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:47.632618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950aca32-da8b-4447-9b76-b97f8094d72d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.634170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950aca32-da8b-4447-9b76-b97f8094d72d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.660956 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 861/1724] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:47.660956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.660956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.660956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.667082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62018453-d593-46b2-858d-84da84d6de03 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.682211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df1fa4-fe08-4c1d-b19f-6b93f2b4f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.682967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df1fa4-fe08-4c1d-b19f-6b93f2b4f875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.683255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df1fa4-fe08-4c1d-b19f-6b93f2b4f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.683533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df1fa4-fe08-4c1d-b19f-6b93f2b4f875 admin admin] PATH_INFO: `/v3/projects/70c530b92466422c9b5e5ba80a14bb46/users/79b616f11599433c9c293312458e597f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.701657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:47.703054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.716709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df1fa4-fe08-4c1d-b19f-6b93f2b4f875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c530b92466422c9b5e5ba80a14bb46, user_id=79b616f11599433c9c293312458e597f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.719401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df1fa4-fe08-4c1d-b19f-6b93f2b4f875 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.726665 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 862/1725] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:47.728711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.730459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.769571 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 864/1726] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:47 2022] PUT /identity/v3/projects/70c530b92466422c9b5e5ba80a14bb46/users/79b616f11599433c9c293312458e597f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:47.769571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.769571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.769571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.772343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dec213-f14b-4de4-b821-ce62bc91df4b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.813482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:47.814749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.826357 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:47.899853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e6b28-ac31-4f5e-9eda-abb98c164350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:47.901672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e6b28-ac31-4f5e-9eda-abb98c164350 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:47.903500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e6b28-ac31-4f5e-9eda-abb98c164350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:47.903824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e6b28-ac31-4f5e-9eda-abb98c164350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:47.907047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e6b28-ac31-4f5e-9eda-abb98c164350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:47.911863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e6b28-ac31-4f5e-9eda-abb98c164350 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:47.942116 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:47.973114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 865/1727] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:47.973114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:47.973114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:47.991260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef91a4-56a5-4534-b435-fb7d8bcf9173 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:47.993830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 863/1728] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:47 2022] POST /identity/v3/projects => generated 393 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:48.001969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39823e77-06d6-46dd-b3ae-d8337064fbc1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.002267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39823e77-06d6-46dd-b3ae-d8337064fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.003611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39823e77-06d6-46dd-b3ae-d8337064fbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.099655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-39823e77-06d6-46dd-b3ae-d8337064fbc1 None None] MFA Rules not processed for user `79b616f11599433c9c293312458e597f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:48.101183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-39823e77-06d6-46dd-b3ae-d8337064fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:48.161500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:48.162219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.162434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.162701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] PATH_INFO: `/v3/projects/c669e02a448c460a98d5925386f11286` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.164128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c669e02a448c460a98d5925386f11286)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:48.166064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:48.266302 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 864/1729] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:48.267985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39823e77-06d6-46dd-b3ae-d8337064fbc1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:48.281691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39823e77-06d6-46dd-b3ae-d8337064fbc1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:48.283228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c669e02a448c460a98d5925386f11286', 'request_id': 'req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.294666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c669e02a448c460a98d5925386f11286', 'request_id': 'req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.312341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c669e02a448c460a98d5925386f11286', 'request_id': 'req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.327525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] The token cache is being invalidate because project c669e02a448c460a98d5925386f11286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:48.327959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.328740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.333944 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 866/1730] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:47 2022] DELETE /identity/v3/projects/c669e02a448c460a98d5925386f11286 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:48.335678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:48.337592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:48.435929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccf393-12b8-477d-9d26-a0f4ee4d38dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:48.437842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccf393-12b8-477d-9d26-a0f4ee4d38dd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.438263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccf393-12b8-477d-9d26-a0f4ee4d38dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.439187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccf393-12b8-477d-9d26-a0f4ee4d38dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.440351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccf393-12b8-477d-9d26-a0f4ee4d38dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:48.440801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccf393-12b8-477d-9d26-a0f4ee4d38dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:48.443064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccf393-12b8-477d-9d26-a0f4ee4d38dd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:48.470976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1cec4-55d3-4f63-a05e-76c0401ab87a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:48.476064 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 865/1731] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:48.477675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:48.478309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.478589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.478866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.479821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09681-dc13-480c-a03a-f65782281986 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.479936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:48.480947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09681-dc13-480c-a03a-f65782281986 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.482135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:48.483068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09681-dc13-480c-a03a-f65782281986 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.488588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 866/1732] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:02:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:02:48.490313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e09681-dc13-480c-a03a-f65782281986 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:48.495693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-39e09681-dc13-480c-a03a-f65782281986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:48.524259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e09681-dc13-480c-a03a-f65782281986 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:48.529497 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 867/1733] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:48 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:48.531700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:48.536372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:48.536907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:48.537105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.537368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.537643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.538340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:48.540327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:48.564680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501153-fbd0-483b-95f4-c7a52458e2bb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:48.573672 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 867/1734] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:48 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:48.574567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:48.578335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:48.588152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:48.590784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.591801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.592765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] PATH_INFO: `/v3/users/d70523fc9a194b6dbfc34220831564de` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.596225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70523fc9a194b6dbfc34220831564de)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:48.602876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:48.614260 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:48.625645 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:48.724709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70523fc9a194b6dbfc34220831564de'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.726229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70523fc9a194b6dbfc34220831564de'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.727436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70523fc9a194b6dbfc34220831564de'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.748538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385065a5-28f8-4532-b58e-66c18c4cc47f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:48.750303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70523fc9a194b6dbfc34220831564de'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.761373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:48.762482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.763245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.764061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.764950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:48.767960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:48.776756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b466d612-0711-4b70-a6cc-ff57f07fdf72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70523fc9a194b6dbfc34220831564de'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:48.810730 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 868/1735] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:48 2022] DELETE /identity/v3/users/d70523fc9a194b6dbfc34220831564de => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:48.812163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.812455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.812742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.813032 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 868/1736] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:48 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:48.822460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:48.827166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:48.890524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:48.894337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:48.963790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431fbc4-510a-497c-881d-556402517ca7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:48.978398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:48.979092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:48.979380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:48.979655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:48.980318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:48.984405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.008973 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 869/1737] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:49.011084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.014572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:49.043843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bedc27-a644-43da-8391-f0b41b615f50 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.044630 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 869/1738] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:49.045597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.047327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:49.056044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.057381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.057660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.057931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.058571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.064076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.078023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccbe79-42db-4b28-9bec-839d25cab7ca None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.088433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.089693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.090702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.090959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.092008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.096451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.108607 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 870/1739] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:49 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:49.112222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.136596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1dc76-2db7-4246-8b68-a236376f61f9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.148142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de1752-ea5d-4f26-bd4a-0ad1e043bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.148780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de1752-ea5d-4f26-bd4a-0ad1e043bffe admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.149176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de1752-ea5d-4f26-bd4a-0ad1e043bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.155863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de1752-ea5d-4f26-bd4a-0ad1e043bffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.156872 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 870/1740] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:49 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:49.158739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.158921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de1752-ea5d-4f26-bd4a-0ad1e043bffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.160647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de1752-ea5d-4f26-bd4a-0ad1e043bffe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.161419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:49.175682 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 871/1741] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:49.177335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424287-ff5e-48a1-99d9-ee653714bc97 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.177622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424287-ff5e-48a1-99d9-ee653714bc97 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.177897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424287-ff5e-48a1-99d9-ee653714bc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.302180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096490-ee7c-41a2-8b4e-ad143c24c30a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.307981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.308860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.309418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.309875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.312926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cc424287-ff5e-48a1-99d9-ee653714bc97 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:49.314457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc424287-ff5e-48a1-99d9-ee653714bc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:49.326423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.328156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.343130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 871/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:49.344719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.355199 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:49.362871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bfb05-33df-4e14-874f-47436b4513fe service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.369702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.370413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.370740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.372029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.373644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.376281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.390746 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:49.410949 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 872/1743] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:49.412426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.436673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4364-9da1-4cab-9588-9454a1767dde admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.444911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.446088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.446900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.447378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.448247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.450258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.473742 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 873/1744] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:49.477299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.480860 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 872/1745] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:49.481716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424287-ff5e-48a1-99d9-ee653714bc97 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.496567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424287-ff5e-48a1-99d9-ee653714bc97 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.512058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.513303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.513608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.514262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d2ef2-b418-4213-a7f7-0dc1272858d8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.514363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] PATH_INFO: `/v3/projects/8cb03329f7404a1993e737d7abd5f8a7/users/e2fd70ddbc9145fe98de17079ec889f0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.529903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.530909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.531393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.551695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] PATH_INFO: `/v3/projects/ea0db21c44744d1fb8d015997287ce2f/users/6280a6042ca74d22934754260e5ac47a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.560437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb03329f7404a1993e737d7abd5f8a7, user_id=e2fd70ddbc9145fe98de17079ec889f0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.568947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.581375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0db21c44744d1fb8d015997287ce2f, user_id=6280a6042ca74d22934754260e5ac47a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.585577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.601737 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 873/1746] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:49 2022] PUT /identity/v3/projects/8cb03329f7404a1993e737d7abd5f8a7/users/e2fd70ddbc9145fe98de17079ec889f0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:49.604146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.611534 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 874/1747] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:49 2022] PUT /identity/v3/projects/ea0db21c44744d1fb8d015997287ce2f/users/6280a6042ca74d22934754260e5ac47a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:49.612903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.728137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea294a4-e7ef-40bf-b076-b34666978dfd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.733643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.734283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.734635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.734987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.736322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.738045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.741006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546da4-7c31-493f-8730-e58fa3b5ee8c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.746903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b165-ccdc-479a-a4d8-cbf44684786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.748166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b165-ccdc-479a-a4d8-cbf44684786c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.748729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b165-ccdc-479a-a4d8-cbf44684786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.749182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b165-ccdc-479a-a4d8-cbf44684786c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.750099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b165-ccdc-479a-a4d8-cbf44684786c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.752872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b165-ccdc-479a-a4d8-cbf44684786c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.758231 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 875/1748] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:49.758231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.771876 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 874/1749] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:49.773019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:49.773796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.774345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.774872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.789008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31cdbb-12d7-49c5-aebd-5d3c896415d9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:49.800735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:49.801578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:49.801971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:49.802325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] PATH_INFO: `/v3/projects/e4448ac63f714f75861c7768304e45fb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:49.803627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4448ac63f714f75861c7768304e45fb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:49.805989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:49.834231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] MFA Rules not processed for user `6280a6042ca74d22934754260e5ac47a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:49.835977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:49.881042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4448ac63f714f75861c7768304e45fb', 'request_id': 'req-05f11b3e-598a-4b8f-826d-a9a1e1db7012'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:49.903181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4448ac63f714f75861c7768304e45fb', 'request_id': 'req-05f11b3e-598a-4b8f-826d-a9a1e1db7012'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:49.922852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4448ac63f714f75861c7768304e45fb', 'request_id': 'req-05f11b3e-598a-4b8f-826d-a9a1e1db7012'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:49.942125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] The token cache is being invalidate because project e4448ac63f714f75861c7768304e45fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:49.942730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:49.943833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:49.949402 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 876/1750] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:49 2022] DELETE /identity/v3/projects/e4448ac63f714f75861c7768304e45fb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:49.949402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.949402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:49.956949 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 875/1751] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:49.958925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:49.960569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.026038 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:50.041399 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:50.098679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f11b3e-598a-4b8f-826d-a9a1e1db7012 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:50.113467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:50.117562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.118149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.118877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] PATH_INFO: `/v3/projects/8cb03329f7404a1993e737d7abd5f8a7/users/e2fd70ddbc9145fe98de17079ec889f0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.122078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb03329f7404a1993e737d7abd5f8a7, user_id=e2fd70ddbc9145fe98de17079ec889f0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:50.125211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:50.156529 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 877/1752] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:49 2022] PUT /identity/v3/projects/8cb03329f7404a1993e737d7abd5f8a7/users/e2fd70ddbc9145fe98de17079ec889f0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:50.157792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:50.159792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.194124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c6ea6-753d-4f8f-b778-bce5ffd21f92 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:50.276683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ace2a-9e14-44d7-afea-ad22b7448b02 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:50.281630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de444a-ecd1-4312-a60e-40e97fcc45c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:50.282839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de444a-ecd1-4312-a60e-40e97fcc45c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.283262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de444a-ecd1-4312-a60e-40e97fcc45c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.283606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de444a-ecd1-4312-a60e-40e97fcc45c0 admin admin] PATH_INFO: `/v3/projects/b20f15fb09d04593a6da1ca7e90fe56b/users/b8aed7233823430dbea65bd4d6364a43/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.306950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de444a-ecd1-4312-a60e-40e97fcc45c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20f15fb09d04593a6da1ca7e90fe56b, user_id=b8aed7233823430dbea65bd4d6364a43, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:50.311251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de444a-ecd1-4312-a60e-40e97fcc45c0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:50.336149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 878/1753] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:50 2022] PUT /identity/v3/projects/b20f15fb09d04593a6da1ca7e90fe56b/users/b8aed7233823430dbea65bd4d6364a43/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:50.337477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd224b3-49dc-4fdd-9b8b-2dbc62c9ef68 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.337759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd224b3-49dc-4fdd-9b8b-2dbc62c9ef68 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.338028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd224b3-49dc-4fdd-9b8b-2dbc62c9ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.358152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:50.358784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.359058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.359329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.367431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.383642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bdd224b3-49dc-4fdd-9b8b-2dbc62c9ef68 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:50.385434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bdd224b3-49dc-4fdd-9b8b-2dbc62c9ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.467074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:50.468677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:50.481635 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 876/1754] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:02:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:02:50.482651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:50.483832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.490776 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 879/1755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:50.494713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202a75-77f6-4eb9-8134-570d4125baa4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.495028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202a75-77f6-4eb9-8134-570d4125baa4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.495272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202a75-77f6-4eb9-8134-570d4125baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.505761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c535faa-7f5e-404c-b15b-e7f3fca2aee1 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:50.510779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099587f1-3e1e-405b-aaa0-d4dfbda84c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:50.512983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099587f1-3e1e-405b-aaa0-d4dfbda84c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.512983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099587f1-3e1e-405b-aaa0-d4dfbda84c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.512983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099587f1-3e1e-405b-aaa0-d4dfbda84c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.513642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099587f1-3e1e-405b-aaa0-d4dfbda84c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:50.515554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099587f1-3e1e-405b-aaa0-d4dfbda84c2c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:50.560881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-43202a75-77f6-4eb9-8134-570d4125baa4 None None] MFA Rules not processed for user `e2fd70ddbc9145fe98de17079ec889f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:50.562805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-43202a75-77f6-4eb9-8134-570d4125baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.598719 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 877/1756] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:50 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:50.600519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e4cd-cc40-4ae7-b6d8-94f3dfd184de None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.600848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e4cd-cc40-4ae7-b6d8-94f3dfd184de None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.602154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e4cd-cc40-4ae7-b6d8-94f3dfd184de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.685168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b6a9e4cd-cc40-4ae7-b6d8-94f3dfd184de None None] MFA Rules not processed for user `b8aed7233823430dbea65bd4d6364a43`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:50.686918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b6a9e4cd-cc40-4ae7-b6d8-94f3dfd184de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.723812 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:50.797548 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:50.824362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 880/1757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:50.826140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fc91-b6f4-45c4-9e46-93acef639f22 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.827723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fc91-b6f4-45c4-9e46-93acef639f22 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.828761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fc91-b6f4-45c4-9e46-93acef639f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.850532 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 878/1758] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:50.851910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f6a7-fc5a-4e4e-ba9f-798afc147ec7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:50.852250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f6a7-fc5a-4e4e-ba9f-798afc147ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:50.852587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f6a7-fc5a-4e4e-ba9f-798afc147ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:50.874310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-00a9f6a7-fc5a-4e4e-ba9f-798afc147ec7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:50.876414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-00a9f6a7-fc5a-4e4e-ba9f-798afc147ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.906138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c3f3fc91-b6f4-45c4-9e46-93acef639f22 None None] MFA Rules not processed for user `a048a1b75a74409fa68b87726d01d506`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:50.910281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c3f3fc91-b6f4-45c4-9e46-93acef639f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:50.991815 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 879/1759] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:50.994019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f6a7-fc5a-4e4e-ba9f-798afc147ec7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.020905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f6a7-fc5a-4e4e-ba9f-798afc147ec7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.033194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.033957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.034377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.034884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.038166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.040985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.101423 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 880/1760] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:50 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:51.102331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.103862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 881/1761] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:51.104711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3fc91-b6f4-45c4-9e46-93acef639f22 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.108281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:51.131200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3fc91-b6f4-45c4-9e46-93acef639f22 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.138167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.138750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.139046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.139569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.140096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.142001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.227180 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 882/1762] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:51 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:51.227180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.310769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0eb70-83c7-4e5e-979d-754ab44ad89a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.365897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84aa309-ae13-40b9-974d-ae60f226c43e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.374234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.375096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.375376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.375651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.376400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:51.376794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.378362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.400561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 883/1763] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:51.401542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.413589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58904db8-f1a0-4d9d-8a89-e5578825cb47 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.425880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.426578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.426881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.427165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.427824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.429915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.460286 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 884/1764] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:51.460286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.461982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:51.475321 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:51.484908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce126dd-36e9-47ff-b771-778fadafb0e9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.493042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.493893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.493893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.494180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.494898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.496860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.514190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.517942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.518337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.518473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.555058 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 885/1765] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:51 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:51.555058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.565734 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:51.635954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.639082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.664374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054d4d3-2c55-418f-a30d-fec84f336a1f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.667036 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 881/1766] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:51.668054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.671828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece7934-6b09-41c2-a04d-b5ec7c00ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.672491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece7934-6b09-41c2-a04d-b5ec7c00ca72 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.672844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece7934-6b09-41c2-a04d-b5ec7c00ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.673337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece7934-6b09-41c2-a04d-b5ec7c00ca72 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.674357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece7934-6b09-41c2-a04d-b5ec7c00ca72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.676809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece7934-6b09-41c2-a04d-b5ec7c00ca72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.707417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af879e29-4686-4b8a-9ffb-ff9498748a8d service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.727179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.727797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.728081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.728413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.728998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.730958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.731626 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 886/1767] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:51 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:51.734613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2e0b5-7767-4e9a-a2e3-dceeb427ef95 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.735775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2e0b5-7767-4e9a-a2e3-dceeb427ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.736301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2e0b5-7767-4e9a-a2e3-dceeb427ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.792200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eff2e0b5-7767-4e9a-a2e3-dceeb427ef95 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:51.804572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eff2e0b5-7767-4e9a-a2e3-dceeb427ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:51.805717 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 882/1768] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:51 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:51.809692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.907923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a681dd-022b-40e8-aa31-6a5df88ec8d4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.914905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:51.915560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:51.915837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:51.916123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] PATH_INFO: `/v3/projects/eee61c1bffb04a4cbe59eda14646e76d/users/bf61b4de638142378f39af46db9089ab/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:51.934437 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 887/1769] 10.222.0.57 () {58 vars in 1015 bytes} [Sun Sep 11 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:51.934648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee61c1bffb04a4cbe59eda14646e76d, user_id=bf61b4de638142378f39af46db9089ab, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:51.935743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2e0b5-7767-4e9a-a2e3-dceeb427ef95 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:51.939147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:51.962545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2e0b5-7767-4e9a-a2e3-dceeb427ef95 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:51.967381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 883/1770] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:51 2022] PUT /identity/v3/projects/eee61c1bffb04a4cbe59eda14646e76d/users/bf61b4de638142378f39af46db9089ab/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:51.973022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.057992 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:52.090095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00d54-1545-483c-8999-e83203732002 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.096100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.096806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.097122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.097781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.098618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.100739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.125168 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 884/1771] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:52.125168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.126566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:52.148586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.149587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.149587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.149779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.150415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.152669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.229966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 888/1772] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:51 2022] POST /identity/v3/users => generated 307 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:52.236769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.245369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86417b2-7c4c-4c7d-859a-eb726ab677ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.251632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.252230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.252510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.252776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.254286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.256513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.296370 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 889/1773] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:52 2022] POST /identity/v3/users => generated 290 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:52.297138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bc894-0851-4243-b571-eedd758be54e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.299199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.314098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.315445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.317029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.322409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.327585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7e8f1-5624-43a2-9e7b-51807f4c4f11 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.331170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:52.343501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.345148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.345148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.359143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.359909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.364399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.378855 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:52.402699 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 890/1774] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:52.403764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.423109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736264e-18f3-4dab-b670-58e16cbc587c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.428802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.429680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.430064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.430443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] PATH_INFO: `/v3/projects/5cf0a0fe79b94ffe8c0b8352a9c45532/users/a0381164aef342caa988ee85575f53bf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.449105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf0a0fe79b94ffe8c0b8352a9c45532, user_id=a0381164aef342caa988ee85575f53bf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.451938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.464549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.466695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.476593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 891/1775] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:52 2022] PUT /identity/v3/projects/5cf0a0fe79b94ffe8c0b8352a9c45532/users/a0381164aef342caa988ee85575f53bf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:52.476593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.487642 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 885/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:52.490446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.515043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a383-b67e-410c-b0fc-5a7b6d351ab4 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.619157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b551-d57e-41c6-aa8b-f0f4e31a5366 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.644815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.644815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.644815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.645166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.645894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.647679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.664302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.668194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 892/1777] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:52.671526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.671864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.672142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.672980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.673984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.675918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.698934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356d48-95dc-4845-85e1-1f6a72b4374a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.700427 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 886/1778] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:52.702082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.714887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.714887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.714887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.714887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] PATH_INFO: `/v3/projects/eee61c1bffb04a4cbe59eda14646e76d/users/bf61b4de638142378f39af46db9089ab/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.716942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee61c1bffb04a4cbe59eda14646e76d, user_id=bf61b4de638142378f39af46db9089ab, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.719239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.726692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320cdc8-6c1d-42ca-b5f0-760a7c9efdce admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.734143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.734759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.735198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.736046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.736792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.738443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.757721 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 893/1779] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:52 2022] PUT /identity/v3/projects/eee61c1bffb04a4cbe59eda14646e76d/users/bf61b4de638142378f39af46db9089ab/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:52.758848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.779991 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 887/1780] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:52.779991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.797693 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:52.803187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b0e1b-819a-482c-ad36-9ecd99a70bb1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.903610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231539-1f0d-454c-af61-4921cb8a4cd7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:52.915521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.915521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.915521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.915521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] PATH_INFO: `/v3/projects/84b14f91357b4808a704c2f9f7ed9357/users/3cf494a62bef4afeb18b89a1fced37df/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.927218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8321a-7365-4160-82be-72f08a7bf175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:52.927839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8321a-7365-4160-82be-72f08a7bf175 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.928116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8321a-7365-4160-82be-72f08a7bf175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.928387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8321a-7365-4160-82be-72f08a7bf175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.929046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8321a-7365-4160-82be-72f08a7bf175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.930626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8321a-7365-4160-82be-72f08a7bf175 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.944230 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 888/1781] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:52.945709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189348-d564-4c71-9a27-4ec4ac84f0c0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:52.945831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b14f91357b4808a704c2f9f7ed9357, user_id=3cf494a62bef4afeb18b89a1fced37df, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:52.946075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189348-d564-4c71-9a27-4ec4ac84f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:52.946423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189348-d564-4c71-9a27-4ec4ac84f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:52.949104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:52.972472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 894/1782] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:52 2022] PUT /identity/v3/projects/84b14f91357b4808a704c2f9f7ed9357/users/3cf494a62bef4afeb18b89a1fced37df/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:52.972472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:52.983538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff189348-d564-4c71-9a27-4ec4ac84f0c0 None None] MFA Rules not processed for user `bf61b4de638142378f39af46db9089ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:52.986599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff189348-d564-4c71-9a27-4ec4ac84f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:53.040670 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:53.081134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9b981-4c8f-4017-a09a-2d09dacca39e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:53.087111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:53.088022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.088413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.088906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] PATH_INFO: `/v3/projects/5cf0a0fe79b94ffe8c0b8352a9c45532/users/a0381164aef342caa988ee85575f53bf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.097679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf0a0fe79b94ffe8c0b8352a9c45532, user_id=a0381164aef342caa988ee85575f53bf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:53.102419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:53.122061 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 895/1783] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:52 2022] PUT /identity/v3/projects/5cf0a0fe79b94ffe8c0b8352a9c45532/users/a0381164aef342caa988ee85575f53bf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:53.123279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:53.139485 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 889/1784] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:53.140650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff189348-d564-4c71-9a27-4ec4ac84f0c0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:53.156880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff189348-d564-4c71-9a27-4ec4ac84f0c0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:53.260095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:53.261036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.261455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.261790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.262674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:53.264732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:53.268701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3388d-1e97-481b-afdb-1f2e52aab9eb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:53.288267 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 890/1785] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:53.289241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:53.290852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b468527-ec38-46fa-ba26-345e25399377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:53.291705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468527-ec38-46fa-ba26-345e25399377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.291992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468527-ec38-46fa-ba26-345e25399377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.292435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468527-ec38-46fa-ba26-345e25399377 admin admin] PATH_INFO: `/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c/users/c99ea843ce3b41ce9de44d7d40ef3e32/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.315057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a681490-5846-45b3-9710-a5f654e8d92d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:53.327770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:53.330616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b468527-ec38-46fa-ba26-345e25399377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51702bd0e9e04d13a3597eff9b0b3d9c, user_id=c99ea843ce3b41ce9de44d7d40ef3e32, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:53.331015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.331951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.332234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] PATH_INFO: `/v3/users/79b616f11599433c9c293312458e597f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.335524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b468527-ec38-46fa-ba26-345e25399377 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:53.336416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b616f11599433c9c293312458e597f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:53.340248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:53.369392 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 896/1786] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:53 2022] PUT /identity/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c/users/c99ea843ce3b41ce9de44d7d40ef3e32/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:53.370988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.371298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.371555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.404471 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:53.426755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] MFA Rules not processed for user `a0381164aef342caa988ee85575f53bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:53.428334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:53.465817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b616f11599433c9c293312458e597f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.468242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b616f11599433c9c293312458e597f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.470015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b616f11599433c9c293312458e597f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.508034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b616f11599433c9c293312458e597f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.538700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b616f11599433c9c293312458e597f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.567174 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 891/1787] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:53 2022] DELETE /identity/v3/users/79b616f11599433c9c293312458e597f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:53.568085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:53.569699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:53.580008 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 897/1788] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:53.580008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:53.581039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:53.680632 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:53.696199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8822b16-5aa1-43e6-8859-df29a2e66747 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:53.704511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:53.704511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.704815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.704987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] PATH_INFO: `/v3/users/6280a6042ca74d22934754260e5ac47a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.707723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6280a6042ca74d22934754260e5ac47a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:53.710871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:53.716312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb12b-1b8d-49bb-acaa-69556ad3655e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:53.723102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a2c7b-5d4d-4b5f-8042-0cf2098b21ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:53.723796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2c7b-5d4d-4b5f-8042-0cf2098b21ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.724070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2c7b-5d4d-4b5f-8042-0cf2098b21ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.724368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2c7b-5d4d-4b5f-8042-0cf2098b21ac admin admin] PATH_INFO: `/v3/projects/84b14f91357b4808a704c2f9f7ed9357/users/3cf494a62bef4afeb18b89a1fced37df/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.726536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2c7b-5d4d-4b5f-8042-0cf2098b21ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b14f91357b4808a704c2f9f7ed9357, user_id=3cf494a62bef4afeb18b89a1fced37df, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:53.743311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2c7b-5d4d-4b5f-8042-0cf2098b21ac admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:53.772214 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 898/1789] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:53 2022] PUT /identity/v3/projects/84b14f91357b4808a704c2f9f7ed9357/users/3cf494a62bef4afeb18b89a1fced37df/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:53.774122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a20b5-d68d-4580-8d38-e2bca1e948ba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.774440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a20b5-d68d-4580-8d38-e2bca1e948ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.774821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a20b5-d68d-4580-8d38-e2bca1e948ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.811037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a89a20b5-d68d-4580-8d38-e2bca1e948ba None None] MFA Rules not processed for user `c99ea843ce3b41ce9de44d7d40ef3e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:53.812624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a89a20b5-d68d-4580-8d38-e2bca1e948ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:53.824182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6280a6042ca74d22934754260e5ac47a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.826142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6280a6042ca74d22934754260e5ac47a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.827572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6280a6042ca74d22934754260e5ac47a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.878515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6280a6042ca74d22934754260e5ac47a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.897974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6280a6042ca74d22934754260e5ac47a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:53.937607 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 899/1790] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:53.937607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:53.940451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:53.943098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:53.943706 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 892/1791] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:53 2022] DELETE /identity/v3/users/6280a6042ca74d22934754260e5ac47a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:53.944942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:53.951942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:53.978384 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:53.996719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:53.998001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.135055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3ab1-b344-4b27-af44-1a58743bf993 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.151272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.152142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 900/1792] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:54.153368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.156253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.156625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.156828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.158432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.168599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.188829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d28c1e-db7f-4b1b-b4c1-cdc4de92c123 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.209947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290c70a-4e5a-4d57-a45d-c1323eb14667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.210781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c70a-4e5a-4d57-a45d-c1323eb14667 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.211172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c70a-4e5a-4d57-a45d-c1323eb14667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.211584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c70a-4e5a-4d57-a45d-c1323eb14667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.212479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290c70a-4e5a-4d57-a45d-c1323eb14667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.216058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290c70a-4e5a-4d57-a45d-c1323eb14667 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.270758 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 901/1793] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:54 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:54.273300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1e445-8073-45ed-9c30-dab6e1b18c67 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.273700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1e445-8073-45ed-9c30-dab6e1b18c67 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.274079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1e445-8073-45ed-9c30-dab6e1b18c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.299966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.301734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.303457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-00d1e445-8073-45ed-9c30-dab6e1b18c67 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:54.304825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-00d1e445-8073-45ed-9c30-dab6e1b18c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.322769 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 893/1794] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:54.323938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.325407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.389224 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:54.445897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d983c7-bffb-4dd1-bdb3-f82694c03085 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.458731 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 902/1795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:54.461016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1e445-8073-45ed-9c30-dab6e1b18c67 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.494801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1e445-8073-45ed-9c30-dab6e1b18c67 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.519727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.521385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.522258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.522768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.524198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.527680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.554062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.554828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.555110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.555454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.582794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.584179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.614666 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 894/1796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:54.614666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.616086 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 903/1797] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:02:54 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:02:54.619702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.623894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.637591 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:54.649633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283b62-8f07-4198-82c9-ee97e194f615 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.661769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.662665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.663158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.663835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.704159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.706151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.754941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 904/1798] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:54.762131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.776293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfe61e-e921-4370-b878-8e4f69e1fc90 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.807056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd965-8b28-4dd6-8c0b-a69d02c940c7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.810041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.810675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.810956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.811231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.811897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.823428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.826621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.828461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.828792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.829116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.836982 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 905/1799] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:02:54.842073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.851742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:54.856244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f57b71-db80-4f50-aded-e249241004bf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:54.873352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:54.876753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:54.876753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:54.876753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] PATH_INFO: `/v3/projects/093e30980d814d30add65c8193aab299/users/e3b03824042d4f07a245435cbc85aedb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:54.904452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093e30980d814d30add65c8193aab299, user_id=e3b03824042d4f07a245435cbc85aedb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.908174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.940282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:54.942078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:54.944112 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 906/1800] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:54 2022] PUT /identity/v3/projects/093e30980d814d30add65c8193aab299/users/e3b03824042d4f07a245435cbc85aedb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:54.948241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:54.972705 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 895/1801] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:55.081380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316458-60e9-488a-b969-85beabbb1bc1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:55.090828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e1a66-3047-4f24-af66-a65e47548d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:55.091540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e1a66-3047-4f24-af66-a65e47548d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:55.091918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e1a66-3047-4f24-af66-a65e47548d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:55.092293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e1a66-3047-4f24-af66-a65e47548d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:55.093210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e1a66-3047-4f24-af66-a65e47548d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:55.095457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e1a66-3047-4f24-af66-a65e47548d96 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:55.115257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 907/1802] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:02:55.119995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:55.136482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22604a-01a5-47df-96b1-0e88c9c458d8 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:55.149613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:55.150392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:55.150677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:55.151112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] PATH_INFO: `/v3/projects/093e30980d814d30add65c8193aab299/users/e3b03824042d4f07a245435cbc85aedb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:55.153692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093e30980d814d30add65c8193aab299, user_id=e3b03824042d4f07a245435cbc85aedb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:55.157428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:55.185251 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 896/1803] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:02:55 2022] PUT /identity/v3/projects/093e30980d814d30add65c8193aab299/users/e3b03824042d4f07a245435cbc85aedb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:02:55.190380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9cb91-144a-4426-a5a7-c8542bde3362 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:55.190950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9cb91-144a-4426-a5a7-c8542bde3362 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:55.191386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9cb91-144a-4426-a5a7-c8542bde3362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:55.246903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79f9cb91-144a-4426-a5a7-c8542bde3362 None None] MFA Rules not processed for user `e3b03824042d4f07a245435cbc85aedb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:55.248770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79f9cb91-144a-4426-a5a7-c8542bde3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:55.350167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:55.352407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:55.381549 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:55.388513 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 908/1804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:55.400564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9cb91-144a-4426-a5a7-c8542bde3362 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:55.500168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95288499-d12f-410c-9675-57eac81f1f45 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:55.518328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:55.519803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:55.520290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:55.520986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] PATH_INFO: `/v3/users/b8aed7233823430dbea65bd4d6364a43` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:55.523248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8aed7233823430dbea65bd4d6364a43)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:55.531138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:55.590639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9cb91-144a-4426-a5a7-c8542bde3362 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:55.603244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994a49-00e3-47d7-ab3e-8f33de9f1ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:55.603718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994a49-00e3-47d7-ab3e-8f33de9f1ede service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:55.604002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994a49-00e3-47d7-ab3e-8f33de9f1ede service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:55.604271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994a49-00e3-47d7-ab3e-8f33de9f1ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:55.604990 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:55.629851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994a49-00e3-47d7-ab3e-8f33de9f1ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:55.633978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994a49-00e3-47d7-ab3e-8f33de9f1ede service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:55.645910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8aed7233823430dbea65bd4d6364a43'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:55.647159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8aed7233823430dbea65bd4d6364a43'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:55.647860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8aed7233823430dbea65bd4d6364a43'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:55.656591 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 909/1805] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:02:55.664695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8aed7233823430dbea65bd4d6364a43'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:55.674689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-73fe79dc-e2b7-4025-9c0e-321f55938afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8aed7233823430dbea65bd4d6364a43'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:55.704970 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 897/1806] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:55 2022] DELETE /identity/v3/users/b8aed7233823430dbea65bd4d6364a43 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:55.709706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:55.710380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:55.710380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:55.737152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:55.738460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:55.738460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:55.739992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:55.741647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:55.745046 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 898/1807] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:02:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:02:55.751824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:02:55.759215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:55.867771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 910/1808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:55.890252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:55.893458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.026265 n-d-master-1 devstack@keystone.service[81859]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 11 01:02:56.026265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:56.030668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.087266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db55f-f57e-43b9-aa6b-ff522965b5a4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:56.103464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:56.104604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:56.106456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:56.107006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:56.150452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:56.159153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:56.209991 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 911/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:56.211183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:56.227970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0173f-e139-484c-85c9-52f21c042af5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:56.228680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a483fd4-e64e-4442-b2f1-72ed572b73a2 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:56.247386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:56.251192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:56.251387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:56.251663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:56.253889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3b03824042d4f07a245435cbc85aedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '093e30980d814d30add65c8193aab299', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:56.257668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:56.259872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:56.259994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.261448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] PATH_INFO: `/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:56.263955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] RBAC: Authorizing `identity:get_project(project_id=51702bd0e9e04d13a3597eff9b0b3d9c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:56.268620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:56.274447 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 899/1810] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:02:55 2022] GET /identity/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c => generated 379 bytes in 524 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:56.316281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:56.334021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:56.336942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:56.339002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.367342 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 912/1811] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:56.382690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3f43-2c0c-4be7-b613-b965c6392332 tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:56.415030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:56.419000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:56.427082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:56.427367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:56.434522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.545852 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:56.581728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:56.583534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:56.621878 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 900/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:56.644719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:56.646262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.712506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb5651-701c-47b4-83a2-5fc9bf58ff0c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:56.728320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:56.730244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.741540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:56.752798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deac47-d13c-4e8e-b51e-43252e5cb392 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:56.755298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:56.756441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:56.758076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] PATH_INFO: `/v3/projects/ea0db21c44744d1fb8d015997287ce2f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:56.759869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:56.760725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:56.761269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:56.761789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] PATH_INFO: `/v3/projects/70c530b92466422c9b5e5ba80a14bb46` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:56.763395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c530b92466422c9b5e5ba80a14bb46)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:56.763743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0db21c44744d1fb8d015997287ce2f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:56.766531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:56.771280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:56.806518 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:56.883612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c530b92466422c9b5e5ba80a14bb46', 'request_id': 'req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:56.898652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c530b92466422c9b5e5ba80a14bb46', 'request_id': 'req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:56.911288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c530b92466422c9b5e5ba80a14bb46', 'request_id': 'req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:56.942087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] The token cache is being invalidate because project 70c530b92466422c9b5e5ba80a14bb46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:56.942087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:56.942087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-48f6d7d0-13cf-4cbf-b82a-436d919bf6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:56.942087 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 901/1813] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:56 2022] DELETE /identity/v3/projects/70c530b92466422c9b5e5ba80a14bb46 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:02:56.942799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181f836-893b-418f-bee9-df0b9d7b56c2 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:56.957894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0db21c44744d1fb8d015997287ce2f', 'request_id': 'req-2edbdbca-a695-40b0-9468-3467ea666c49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:56.958107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181f836-893b-418f-bee9-df0b9d7b56c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:56.958329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181f836-893b-418f-bee9-df0b9d7b56c2 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:56.963212 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 902/1814] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:02:56 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:02:56.964179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181f836-893b-418f-bee9-df0b9d7b56c2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:56.967185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a181f836-893b-418f-bee9-df0b9d7b56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:56.983705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0db21c44744d1fb8d015997287ce2f', 'request_id': 'req-2edbdbca-a695-40b0-9468-3467ea666c49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.005600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0db21c44744d1fb8d015997287ce2f', 'request_id': 'req-2edbdbca-a695-40b0-9468-3467ea666c49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.061547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] The token cache is being invalidate because project ea0db21c44744d1fb8d015997287ce2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:57.063425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.066362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.076543 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 913/1815] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:56 2022] DELETE /identity/v3/projects/ea0db21c44744d1fb8d015997287ce2f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:57.078031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:02:57.086267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:57.118707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181f836-893b-418f-bee9-df0b9d7b56c2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:57.130946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:57.131867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:57.132286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:57.132717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] PATH_INFO: `/v3/users/e2fd70ddbc9145fe98de17079ec889f0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:57.137314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fd70ddbc9145fe98de17079ec889f0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:57.139501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:57.238585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fd70ddbc9145fe98de17079ec889f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.239567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fd70ddbc9145fe98de17079ec889f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.240358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fd70ddbc9145fe98de17079ec889f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.277762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fd70ddbc9145fe98de17079ec889f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.280354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:57.287823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fd70ddbc9145fe98de17079ec889f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.312828 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 903/1816] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:56 2022] DELETE /identity/v3/users/e2fd70ddbc9145fe98de17079ec889f0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:57.314806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:57.319016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:57.345497 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 11 01:02:57.348850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:57.352216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:57.479172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fd197-1230-48af-8874-10448705498e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:57.486024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:57.486975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:57.487389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:57.487933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] PATH_INFO: `/v3/users/bf61b4de638142378f39af46db9089ab` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:57.489548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf61b4de638142378f39af46db9089ab)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:57.492621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:57.538562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdbca-a695-40b0-9468-3467ea666c49 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:57.659062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf61b4de638142378f39af46db9089ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.660631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf61b4de638142378f39af46db9089ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.664811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf61b4de638142378f39af46db9089ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.673343 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:57.717698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf61b4de638142378f39af46db9089ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.748591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf61b4de638142378f39af46db9089ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:57.770949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3b03824042d4f07a245435cbc85aedb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '093e30980d814d30add65c8193aab299', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:57.778282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:57.781246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:57.781566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] PATH_INFO: `/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:57.788335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] RBAC: Authorizing `identity:get_project(project_id=51702bd0e9e04d13a3597eff9b0b3d9c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:57.794227 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 904/1817] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:57 2022] DELETE /identity/v3/users/bf61b4de638142378f39af46db9089ab => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:57.802185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:57.805592 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 914/1818] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:02:57 2022] GET /identity/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c => generated 379 bytes in 731 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:58.583204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:58.585016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:58.753774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:58.755827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:58.783877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3cd35-0ff1-4c4a-aaf2-6d4a971d717c tempest-FlavorsAccessTestJSON-763348224 tempest-FlavorsAccessTestJSON-763348224-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:58.786771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979b27c-62a4-4b5a-9938-708a96c9eddc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:58.800086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:58.800295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:58.800723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:58.800821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] PATH_INFO: `/v3/users/c99ea843ce3b41ce9de44d7d40ef3e32` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:58.804981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:58.806079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:58.806612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:58.807157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] PATH_INFO: `/v3/projects/8cb03329f7404a1993e737d7abd5f8a7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:58.808811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99ea843ce3b41ce9de44d7d40ef3e32)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:58.809242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb03329f7404a1993e737d7abd5f8a7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:58.811367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:58.812440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:58.835912 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:58.961723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99ea843ce3b41ce9de44d7d40ef3e32'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:58.962411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99ea843ce3b41ce9de44d7d40ef3e32'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:58.966624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99ea843ce3b41ce9de44d7d40ef3e32'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:58.994837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb03329f7404a1993e737d7abd5f8a7', 'request_id': 'req-d0f4c912-7cb1-449e-8928-6258399acb7c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.009966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99ea843ce3b41ce9de44d7d40ef3e32'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.019201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb03329f7404a1993e737d7abd5f8a7', 'request_id': 'req-d0f4c912-7cb1-449e-8928-6258399acb7c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.035984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb03329f7404a1993e737d7abd5f8a7', 'request_id': 'req-d0f4c912-7cb1-449e-8928-6258399acb7c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.050866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eeaea08c-6c40-42f7-bea8-801ca64ccb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99ea843ce3b41ce9de44d7d40ef3e32'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.070955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] The token cache is being invalidate because project 8cb03329f7404a1993e737d7abd5f8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:59.071668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.073264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0f4c912-7cb1-449e-8928-6258399acb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.075566 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 915/1819] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:58 2022] DELETE /identity/v3/projects/8cb03329f7404a1993e737d7abd5f8a7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:02:59.084356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b1ff-b202-4d25-8837-04de593d941d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.085099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b1ff-b202-4d25-8837-04de593d941d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.085569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b1ff-b202-4d25-8837-04de593d941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.087345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 905/1820] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:02:58 2022] DELETE /identity/v3/users/c99ea843ce3b41ce9de44d7d40ef3e32 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:59.092472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a668c-f4f0-4fc0-9ac4-10859df90a5d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.092757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a668c-f4f0-4fc0-9ac4-10859df90a5d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.093108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a668c-f4f0-4fc0-9ac4-10859df90a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.137825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-32d6b1ff-b202-4d25-8837-04de593d941d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:59.140549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-32d6b1ff-b202-4d25-8837-04de593d941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.143129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-111a668c-f4f0-4fc0-9ac4-10859df90a5d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:59.144364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-111a668c-f4f0-4fc0-9ac4-10859df90a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.321257 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 906/1821] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:59.341141 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 916/1822] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:59.354210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.355394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.356624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.395555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edc92-62ff-49c7-ade4-26394c178306 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.395555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edc92-62ff-49c7-ade4-26394c178306 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.395971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10edc92-62ff-49c7-ade4-26394c178306 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.400239 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 917/1823] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:02:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:02:59.430800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:59.433871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.459551 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 907/1824] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:59.468888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edc92-62ff-49c7-ade4-26394c178306 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:59.504902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10edc92-62ff-49c7-ade4-26394c178306 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:59.521796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:59.522954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:59.523295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.524100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.524976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.525630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.527565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:02:59.528222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:59.530815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:59.555652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ccc32-4f86-469a-9369-f990be4aba63 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:59.559682 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 918/1825] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:02:59.560726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:59.562640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:59.564430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.564525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.564630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.564891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] PATH_INFO: `/v3/projects/b20f15fb09d04593a6da1ca7e90fe56b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.568593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20f15fb09d04593a6da1ca7e90fe56b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:59.570600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:59.677108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20f15fb09d04593a6da1ca7e90fe56b', 'request_id': 'req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.699460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fc0a0-271a-4d92-b6d0-5a912fca99f1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:59.699891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20f15fb09d04593a6da1ca7e90fe56b', 'request_id': 'req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.708974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20f15fb09d04593a6da1ca7e90fe56b', 'request_id': 'req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.710588 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:59.759583 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:59.765873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] The token cache is being invalidate because project b20f15fb09d04593a6da1ca7e90fe56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:02:59.766392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.767384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b8bc1a6-3d73-4d81-b4e7-ec2d49ce187f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:02:59.775009 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 908/1826] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:59 2022] DELETE /identity/v3/projects/b20f15fb09d04593a6da1ca7e90fe56b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:02:59.778196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.779323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.780054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.813947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:59.815418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.826534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:59.828341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:59.830881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:59.831454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:59.834356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.965407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:59.968111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:59.974832 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 909/1827] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:59.975803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:59.977362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:59.989954 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 919/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:59.991436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:59.993746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.012086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb8803-8c51-4905-885c-5480ff94f939 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.018875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a9a34-6010-40ef-9bc1-4f7f5741d50d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.023734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:00.024397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.024680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.024958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] PATH_INFO: `/v3/projects/eee61c1bffb04a4cbe59eda14646e76d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.029897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee61c1bffb04a4cbe59eda14646e76d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:00.032326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:00.033019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.033336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.033613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.033723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:00.034256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:00.039172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:00.113093 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 910/1829] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:02:59 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:00.115023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:00.117512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.164616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee61c1bffb04a4cbe59eda14646e76d', 'request_id': 'req-d0704f6d-8772-4575-a066-3a5b1a86ace2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.185633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee61c1bffb04a4cbe59eda14646e76d', 'request_id': 'req-d0704f6d-8772-4575-a066-3a5b1a86ace2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.210491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee61c1bffb04a4cbe59eda14646e76d', 'request_id': 'req-d0704f6d-8772-4575-a066-3a5b1a86ace2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.233349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] The token cache is being invalidate because project eee61c1bffb04a4cbe59eda14646e76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:00.237149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.239181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.242462 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 920/1830] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:02:59 2022] DELETE /identity/v3/projects/eee61c1bffb04a4cbe59eda14646e76d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:00.244787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:00.247361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.262198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3ddb1-1659-4fbc-8d02-3bc1314ddab2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.376315 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:00.380599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:00.381324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.381606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.381880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] PATH_INFO: `/v3/users/a0381164aef342caa988ee85575f53bf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.386184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0381164aef342caa988ee85575f53bf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:00.388218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:00.449320 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:00.463393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0704f6d-8772-4575-a066-3a5b1a86ace2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.486793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:00.488758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.489368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.489997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.493662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.504998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0381164aef342caa988ee85575f53bf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.505703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0381164aef342caa988ee85575f53bf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.506733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0381164aef342caa988ee85575f53bf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.524097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:00.532853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:00.541485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0381164aef342caa988ee85575f53bf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.552739 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 921/1831] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:00.553761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:00.555165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.555715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4235f9ab-eb14-45a9-9da1-afb4c1aacf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0381164aef342caa988ee85575f53bf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.571010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e312b-f806-4277-a9a4-4efff3262a19 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.576873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:00.577613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.577908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.578184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.579520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:00.581655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:00.586344 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 911/1832] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:00 2022] DELETE /identity/v3/users/a0381164aef342caa988ee85575f53bf => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:00.589860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.590167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.590544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.625185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:00.627723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.634629 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 922/1833] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:00 2022] POST /identity/v3/users => generated 292 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:00.635767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:00.639758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.677025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202299b-eecc-4391-b0c8-b9f99de5c2d3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.762909 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 912/1834] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:00.768253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:00.770208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.794102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34324a-d947-4a4f-9828-0e47a5513213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:00.794945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34324a-d947-4a4f-9828-0e47a5513213 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.795240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34324a-d947-4a4f-9828-0e47a5513213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.795579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34324a-d947-4a4f-9828-0e47a5513213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.796256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34324a-d947-4a4f-9828-0e47a5513213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:00.798270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84211a6a-6367-4734-88bb-6a9045e2c0db None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.799153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34324a-d947-4a4f-9828-0e47a5513213 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:00.808790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:00.810762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.811207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.811496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] PATH_INFO: `/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.814494 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 923/1835] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:00.815869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b904-c38e-4d12-b353-636a98c82a1d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:00.816163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b904-c38e-4d12-b353-636a98c82a1d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:00.816446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b904-c38e-4d12-b353-636a98c82a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:00.821915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=51702bd0e9e04d13a3597eff9b0b3d9c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:00.823839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:00.856838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b6f0b904-c38e-4d12-b353-636a98c82a1d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:00.858661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b6f0b904-c38e-4d12-b353-636a98c82a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:00.872716 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 924/1836] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:00.879238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0b904-c38e-4d12-b353-636a98c82a1d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:00.895875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0b904-c38e-4d12-b353-636a98c82a1d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:00.897352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51702bd0e9e04d13a3597eff9b0b3d9c', 'request_id': 'req-23c8b23a-538b-4f92-9484-e963e4a2c90b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.913629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51702bd0e9e04d13a3597eff9b0b3d9c', 'request_id': 'req-23c8b23a-538b-4f92-9484-e963e4a2c90b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.923600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51702bd0e9e04d13a3597eff9b0b3d9c', 'request_id': 'req-23c8b23a-538b-4f92-9484-e963e4a2c90b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.951136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] The token cache is being invalidate because project 51702bd0e9e04d13a3597eff9b0b3d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:00.951530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.952487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:00.958083 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 913/1837] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:00 2022] DELETE /identity/v3/projects/51702bd0e9e04d13a3597eff9b0b3d9c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:00.959352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:00.961020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.014454 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:01.078036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:01.080274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.080622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.080846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.081550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:01.090562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:01.105705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8b23a-538b-4f92-9484-e963e4a2c90b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:01.113766 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 925/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:01.113766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:01.126017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.127569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:01.129362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.130643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.132900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.133825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:01.134147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:01.137932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:01.154820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5e9c4-746f-41cc-b0de-094600418975 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:01.165293 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 914/1839] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:01.166020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:01.167010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:01.167665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.167942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.168302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] PATH_INFO: `/v3/users/e3b03824042d4f07a245435cbc85aedb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.169781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b03824042d4f07a245435cbc85aedb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:01.171473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.174957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:01.200045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c593893-b7ee-4881-b7c7-d80db7584aca admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:01.221130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:01.221934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.222135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.222397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] PATH_INFO: `/v3/projects/65eac10062574a0a9635bf305b6bdd0c/users/56132cfce82c4941bc369a4f2d9b7536/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.237519 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:01.248621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65eac10062574a0a9635bf305b6bdd0c, user_id=56132cfce82c4941bc369a4f2d9b7536, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:01.259838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:01.272901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b03824042d4f07a245435cbc85aedb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.273752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b03824042d4f07a245435cbc85aedb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.274542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b03824042d4f07a245435cbc85aedb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.284650 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 915/1840] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:01 2022] PUT /identity/v3/projects/65eac10062574a0a9635bf305b6bdd0c/users/56132cfce82c4941bc369a4f2d9b7536/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:01.285508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:01.291536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b03824042d4f07a245435cbc85aedb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.295215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.322927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b03824042d4f07a245435cbc85aedb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.351434 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 926/1841] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:01 2022] DELETE /identity/v3/users/e3b03824042d4f07a245435cbc85aedb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:01.352547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:01.355360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.445180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e4eb-ad4d-4158-ab2d-4d90ed3d5334 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:01.491637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d15c-2e63-42cc-97cf-6240cb1ad0ce admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:01.505617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:01.506273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.506552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.506823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] PATH_INFO: `/v3/projects/5cf0a0fe79b94ffe8c0b8352a9c45532` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.509033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf0a0fe79b94ffe8c0b8352a9c45532)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:01.520014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:01.586582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee06e-6629-4b98-936a-ada670ec583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:01.587261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee06e-6629-4b98-936a-ada670ec583a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.587656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee06e-6629-4b98-936a-ada670ec583a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.588084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee06e-6629-4b98-936a-ada670ec583a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.588505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbee06e-6629-4b98-936a-ada670ec583a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:01.590539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbee06e-6629-4b98-936a-ada670ec583a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:01.627818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf0a0fe79b94ffe8c0b8352a9c45532', 'request_id': 'req-493d78ab-bc08-4155-ae95-c10d63b5ab3f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.636525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf0a0fe79b94ffe8c0b8352a9c45532', 'request_id': 'req-493d78ab-bc08-4155-ae95-c10d63b5ab3f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.650960 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 916/1842] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:01 2022] POST /identity/v3/projects => generated 391 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:01.653090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c69b-2758-4cba-a08c-34c3f46fa9e5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.653432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c69b-2758-4cba-a08c-34c3f46fa9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.653708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c69b-2758-4cba-a08c-34c3f46fa9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.665528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf0a0fe79b94ffe8c0b8352a9c45532', 'request_id': 'req-493d78ab-bc08-4155-ae95-c10d63b5ab3f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.685739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] The token cache is being invalidate because project 5cf0a0fe79b94ffe8c0b8352a9c45532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:01.686080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.689305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:01.692009 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 927/1843] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:01 2022] DELETE /identity/v3/projects/5cf0a0fe79b94ffe8c0b8352a9c45532 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:01.692896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:01.694712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.722121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4e01c69b-2758-4cba-a08c-34c3f46fa9e5 None None] MFA Rules not processed for user `56132cfce82c4941bc369a4f2d9b7536`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:01.725180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4e01c69b-2758-4cba-a08c-34c3f46fa9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.748603 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:01.793830 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:01.844002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d78ab-bc08-4155-ae95-c10d63b5ab3f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:01.883058 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 917/1844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:01.883058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.883058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.883058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.923780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:01.925051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:01.980722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:01.981228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:01.981605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:01.981951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:01.982700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:01.986156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.038299 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 928/1845] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:01 2022] POST /identity/v3/users => generated 296 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:02.039441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.044017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:02.066981 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 918/1846] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:02.068333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.069945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:02.071266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad994962-ae6e-4721-9cc1-88a407bf91f1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.083730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3868e-e066-4cc2-ad3b-f4683c31b122 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.085945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.086583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.086867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.087148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.087804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.089895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.090454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.091278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.091850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.092286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] PATH_INFO: `/v3/projects/093e30980d814d30add65c8193aab299` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.093534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093e30980d814d30add65c8193aab299)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.096096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.164614 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 929/1847] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:02.165889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.182326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093e30980d814d30add65c8193aab299', 'request_id': 'req-40d1834c-480e-4584-9e18-ce7dc9777003'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:02.195074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093e30980d814d30add65c8193aab299', 'request_id': 'req-40d1834c-480e-4584-9e18-ce7dc9777003'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:02.212593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093e30980d814d30add65c8193aab299', 'request_id': 'req-40d1834c-480e-4584-9e18-ce7dc9777003'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:02.237095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] The token cache is being invalidate because project 093e30980d814d30add65c8193aab299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:02.237615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:02.239134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40d1834c-480e-4584-9e18-ce7dc9777003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:02.247670 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 919/1848] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:02 2022] DELETE /identity/v3/projects/093e30980d814d30add65c8193aab299 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:02.249850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fbde-b4db-4bd0-9621-a68600f4c307 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.253421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fbde-b4db-4bd0-9621-a68600f4c307 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.254170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29fbde-b4db-4bd0-9621-a68600f4c307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.301523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d2ba2-f036-4af4-998c-cdd5ff81a836 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.307695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.308584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.308875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.311868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.311868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.311868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.314299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1b29fbde-b4db-4bd0-9621-a68600f4c307 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:02.318489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b29fbde-b4db-4bd0-9621-a68600f4c307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:02.325978 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 930/1849] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:02.325978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.327962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:02.338286 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 920/1850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:02.339801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0996-5db6-4625-8c2d-dfe3034a3a27 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.340247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0996-5db6-4625-8c2d-dfe3034a3a27 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.340647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc0996-5db6-4625-8c2d-dfe3034a3a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.347772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f4085-cf21-48d7-b064-b7ddcfe356d6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.353411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.354172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.354558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.354936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.355679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.358078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.389680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-24bc0996-5db6-4625-8c2d-dfe3034a3a27 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:02.390912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-24bc0996-5db6-4625-8c2d-dfe3034a3a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:02.392165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 931/1851] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:02.393788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.396072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:02.405902 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 921/1852] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:02.414613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc0996-5db6-4625-8c2d-dfe3034a3a27 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.415129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962fa6-a24c-4f30-8e78-7614dfbd44b9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.421611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.423261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.424047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.424471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.425259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.427964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc0996-5db6-4625-8c2d-dfe3034a3a27 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.428125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.434949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b260a2f-ecbe-45c5-94dd-e48e5a2830e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.435573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260a2f-ecbe-45c5-94dd-e48e5a2830e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.436071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260a2f-ecbe-45c5-94dd-e48e5a2830e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.437747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260a2f-ecbe-45c5-94dd-e48e5a2830e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.439402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b260a2f-ecbe-45c5-94dd-e48e5a2830e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:02.439402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b260a2f-ecbe-45c5-94dd-e48e5a2830e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.441918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b260a2f-ecbe-45c5-94dd-e48e5a2830e4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.446952 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 932/1853] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:02.448319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.460062 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 922/1854] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:02.461410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ced3-3b17-4219-865a-a1f7e3e196c6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.461697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ced3-3b17-4219-865a-a1f7e3e196c6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.461975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ced3-3b17-4219-865a-a1f7e3e196c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.484104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd9a37-07d8-44fa-8f8e-357c732f363e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.484337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1b06ced3-3b17-4219-865a-a1f7e3e196c6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:02.486276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b06ced3-3b17-4219-865a-a1f7e3e196c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:02.497620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.499096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.499545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.500242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.500358 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 923/1855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:02.501249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.501752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ced3-3b17-4219-865a-a1f7e3e196c6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.503350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.516442 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:02.522148 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 933/1856] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:02.523464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.530141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ced3-3b17-4219-865a-a1f7e3e196c6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.540922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d0c-9db7-4f80-bf52-db9010995a41 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.550347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.551603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.552462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.553376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.554576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.555735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.558765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.559158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.560635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] PATH_INFO: `/v3/projects/82574a33ef764f27905a4393b793bd24/users/94cf6c390fed43c4baec31f9f6b988ee/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.562129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.576623 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:02.600294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82574a33ef764f27905a4393b793bd24, user_id=94cf6c390fed43c4baec31f9f6b988ee, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.606506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.639046 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 924/1857] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:02 2022] PUT /identity/v3/projects/82574a33ef764f27905a4393b793bd24/users/94cf6c390fed43c4baec31f9f6b988ee/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:02.639046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.647946 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 934/1858] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:02.648908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.740365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f9aeb-8705-4512-9dd3-39a10b85c27d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.765007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de9f1-8545-4080-b147-0d2b5d390657 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.770986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d514707-267a-408a-94af-e3c847fcf3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.771479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514707-267a-408a-94af-e3c847fcf3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.771759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514707-267a-408a-94af-e3c847fcf3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.772034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514707-267a-408a-94af-e3c847fcf3bd admin admin] PATH_INFO: `/v3/projects/0c221128bfc142af895eab7363bf30b1/users/07216064ec164f39a5c2c5d97942db80/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.798924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d514707-267a-408a-94af-e3c847fcf3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c221128bfc142af895eab7363bf30b1, user_id=07216064ec164f39a5c2c5d97942db80, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.810078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d514707-267a-408a-94af-e3c847fcf3bd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.831752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:02.832674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.832962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.833665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.834489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:02.834805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:02.840095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:02.846881 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 935/1859] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:02 2022] PUT /identity/v3/projects/0c221128bfc142af895eab7363bf30b1/users/07216064ec164f39a5c2c5d97942db80/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:02.849229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ded9d7-92b5-4af7-8ba8-f3c8ceb56452 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:02.849852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ded9d7-92b5-4af7-8ba8-f3c8ceb56452 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:02.850265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ded9d7-92b5-4af7-8ba8-f3c8ceb56452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:02.868167 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 925/1860] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:02.869016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:02.890052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33dea4-36a5-4b42-a426-6202bfc46a9f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:02.908035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-42ded9d7-92b5-4af7-8ba8-f3c8ceb56452 None None] MFA Rules not processed for user `94cf6c390fed43c4baec31f9f6b988ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:02.909240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-42ded9d7-92b5-4af7-8ba8-f3c8ceb56452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:03.009992 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 936/1861] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:03.010872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ded9d7-92b5-4af7-8ba8-f3c8ceb56452 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.038553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.039514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.039514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.040186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.040992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.042906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.091076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 926/1862] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:02 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:03.092290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.114687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5e4a4-d6e1-44f9-a791-dce2cc0dc68e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.123890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.124920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.130323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.130981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.134934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.137650 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:03.139524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.153034 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:03.156188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ded9d7-92b5-4af7-8ba8-f3c8ceb56452 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.171265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.172872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.173477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.174003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.175972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.178404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.192781 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 937/1863] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:03.193711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.198682 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 927/1864] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:03 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:03.199800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.210363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1782e-719e-47d1-8701-9f27303f9de8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.308486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.308486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.308486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.308939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.309403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.311300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.311783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04bd7-e53b-4b09-af72-750aeb3a781a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.317730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.318592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.319102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.319379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.320211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.323095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.335719 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 928/1865] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:03.336594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.348734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944448c6-1d44-4e7d-8228-549ed96ebe7d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.351292 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 938/1866] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:03 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:03.352584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.357373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.358047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.358323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.358593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] PATH_INFO: `/v3/projects/0c221128bfc142af895eab7363bf30b1/users/07216064ec164f39a5c2c5d97942db80/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.360772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c221128bfc142af895eab7363bf30b1, user_id=07216064ec164f39a5c2c5d97942db80, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.363624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.377435 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 929/1867] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:03 2022] PUT /identity/v3/projects/0c221128bfc142af895eab7363bf30b1/users/07216064ec164f39a5c2c5d97942db80/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:03.378214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.498522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb5dcf-d86a-4fb3-a0e8-a947615127ff admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.504474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b430a-b863-4930-aa5a-6d093ebd135d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.522434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63770f1-c511-47c8-a1dc-a680811b5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.523377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.523588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63770f1-c511-47c8-a1dc-a680811b5cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.523926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63770f1-c511-47c8-a1dc-a680811b5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.524204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63770f1-c511-47c8-a1dc-a680811b5cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.524658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.524922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63770f1-c511-47c8-a1dc-a680811b5cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.525298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.525767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.526647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.527792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63770f1-c511-47c8-a1dc-a680811b5cf4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.529391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.555173 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 930/1868] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:03.556080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.567949 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 939/1869] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:03 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:03.569433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50a6e7-840e-42f8-ab8d-07c8eba50028 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.569861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50a6e7-840e-42f8-ab8d-07c8eba50028 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.570209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50a6e7-840e-42f8-ab8d-07c8eba50028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.571682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb63e1e-21aa-4722-9251-ee2ea90e8741 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.576582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.577351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.577767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.578045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.579528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.581526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.611414 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 931/1870] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:03 2022] POST /identity/v3/users => generated 302 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:03.612412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.615657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5c50a6e7-840e-42f8-ab8d-07c8eba50028 None None] MFA Rules not processed for user `07216064ec164f39a5c2c5d97942db80`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:03.616961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5c50a6e7-840e-42f8-ab8d-07c8eba50028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:03.627503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016789d6-f6ef-4ecb-aece-514d11c49807 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.633805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.635027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.635313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.635590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] PATH_INFO: `/v3/projects/b0c9fae150e14c59a3d27f969c600056/users/89700c91d2b5415a9bfb6d4fa59e0982/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.654847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c9fae150e14c59a3d27f969c600056, user_id=89700c91d2b5415a9bfb6d4fa59e0982, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.658041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.678143 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 932/1871] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:03 2022] PUT /identity/v3/projects/b0c9fae150e14c59a3d27f969c600056/users/89700c91d2b5415a9bfb6d4fa59e0982/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:03.679167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.715179 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:03.721982 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:03.746331 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 940/1872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:03.748303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50a6e7-840e-42f8-ab8d-07c8eba50028 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.760788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50a6e7-840e-42f8-ab8d-07c8eba50028 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.765923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940c7dd-f94a-45b5-9f30-995ab435e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.767820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c7dd-f94a-45b5-9f30-995ab435e01f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.768108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c7dd-f94a-45b5-9f30-995ab435e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.768527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875bdd-e672-44a7-bcb4-f33ddc3eacb0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.769335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c7dd-f94a-45b5-9f30-995ab435e01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.770235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940c7dd-f94a-45b5-9f30-995ab435e01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.772030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940c7dd-f94a-45b5-9f30-995ab435e01f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.774853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.775845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.776217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.776618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.778765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.780768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:03.788455 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 941/1873] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:03.788455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7f82-263c-449b-8fee-109dbb8c6b77 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.788455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7f82-263c-449b-8fee-109dbb8c6b77 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.788455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7f82-263c-449b-8fee-109dbb8c6b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.794701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 933/1874] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:03.795316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.799134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:03.832071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e7da7f82-263c-449b-8fee-109dbb8c6b77 None None] MFA Rules not processed for user `89700c91d2b5415a9bfb6d4fa59e0982`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:03.833375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7da7f82-263c-449b-8fee-109dbb8c6b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:03.900345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f4a51-114f-4e72-ac25-a44cc2f0b19e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.915251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.916746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.917656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.918536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.933826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 942/1875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:03.933826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7f82-263c-449b-8fee-109dbb8c6b77 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:03.951115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7f82-263c-449b-8fee-109dbb8c6b77 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:03.958103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:03.958798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:03.959078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:03.959358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] PATH_INFO: `/v3/projects/faf1d4626c9a45f1a27c4d2103e5f97e/users/eb708f87a80040b1a48e5458e18d8a57/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:03.980235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf1d4626c9a45f1a27c4d2103e5f97e, user_id=eb708f87a80040b1a48e5458e18d8a57, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:03.983947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.023001 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 943/1876] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:03 2022] PUT /identity/v3/projects/faf1d4626c9a45f1a27c4d2103e5f97e/users/eb708f87a80040b1a48e5458e18d8a57/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:04.025770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.084786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.088786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.109186 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 934/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:04.111682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.138468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16241fed-a2d6-443a-a117-bc19f2271b2d service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.283786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265a767-4b75-4e96-ba13-5da7dc91e19a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.287313 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:04.294391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.296673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.296959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.297776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.298926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.301376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.312356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.313250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.313539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.313817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.314458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.319736 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 944/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:04.321204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.323649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.334483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037985a-f3a0-4ecf-a3b9-e401f341f643 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.340551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.340993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.341317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.341588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.342254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.346398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.373642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 945/1879] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:04.374512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.402813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bbce8-7231-4e22-bb09-fc7066821eb0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.403642 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 935/1880] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:04 2022] POST /identity/v3/projects => generated 373 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:04.404495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.451145 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:04.495505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.496161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.496436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.496707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] PATH_INFO: `/v3/projects/d61d362d78674fbe8e9e829d4c78783f/users/9d7750e12a4e45fd99f218eb936a9eb2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.508062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9bf29-c1b5-4cbd-b6a2-51f2449fee7a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.517793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213fe99-03ab-4c9c-b3b8-36c490cd3b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.518483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213fe99-03ab-4c9c-b3b8-36c490cd3b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.518759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213fe99-03ab-4c9c-b3b8-36c490cd3b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.519146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213fe99-03ab-4c9c-b3b8-36c490cd3b0f admin admin] PATH_INFO: `/v3/projects/faf1d4626c9a45f1a27c4d2103e5f97e/users/eb708f87a80040b1a48e5458e18d8a57/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.520130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61d362d78674fbe8e9e829d4c78783f, user_id=9d7750e12a4e45fd99f218eb936a9eb2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.521355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213fe99-03ab-4c9c-b3b8-36c490cd3b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf1d4626c9a45f1a27c4d2103e5f97e, user_id=eb708f87a80040b1a48e5458e18d8a57, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.523152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.524414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213fe99-03ab-4c9c-b3b8-36c490cd3b0f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.542261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 936/1881] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:04 2022] PUT /identity/v3/projects/faf1d4626c9a45f1a27c4d2103e5f97e/users/eb708f87a80040b1a48e5458e18d8a57/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:04.543647 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 946/1882] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:04 2022] PUT /identity/v3/projects/d61d362d78674fbe8e9e829d4c78783f/users/9d7750e12a4e45fd99f218eb936a9eb2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:04.544554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.553895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159a16-10eb-440c-aad8-b06c956e2765 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.554535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159a16-10eb-440c-aad8-b06c956e2765 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.554826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159a16-10eb-440c-aad8-b06c956e2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.596001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3a159a16-10eb-440c-aad8-b06c956e2765 None None] MFA Rules not processed for user `3cf494a62bef4afeb18b89a1fced37df`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:04.597375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3a159a16-10eb-440c-aad8-b06c956e2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:04.619248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f91d-0d7f-4ba8-8401-4a153063d55d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.624911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.626196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.626950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.626950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.627563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.630075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.659205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 947/1883] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:04 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:04.659205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.668067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61622352-cbed-4a21-9f35-80957f923940 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.673597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.674212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.674513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.674786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] PATH_INFO: `/v3/users/56132cfce82c4941bc369a4f2d9b7536` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.675931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56132cfce82c4941bc369a4f2d9b7536)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.677909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.693647 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 937/1884] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:04.695116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.695505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.695877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.726901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] MFA Rules not processed for user `eb708f87a80040b1a48e5458e18d8a57`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:04.728138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:04.733497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56132cfce82c4941bc369a4f2d9b7536'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:04.734380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56132cfce82c4941bc369a4f2d9b7536'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:04.735709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56132cfce82c4941bc369a4f2d9b7536'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:04.743507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56132cfce82c4941bc369a4f2d9b7536'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:04.762075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35f7a511-6d0a-4373-a9b5-fdab59c4120e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56132cfce82c4941bc369a4f2d9b7536'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:04.776658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 948/1885] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:04 2022] DELETE /identity/v3/users/56132cfce82c4941bc369a4f2d9b7536 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:04.778343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.778946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.778946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.784241 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:04.807387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] MFA Rules not processed for user `9d7750e12a4e45fd99f218eb936a9eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:04.808606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:04.810166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 938/1886] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:04.810928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.812169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:04.815393 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:04.830865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db517f4-8215-4307-920a-d237e3fa1a1b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:04.880007 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 949/1887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:04.880993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.882588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:04.897422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f648b-5158-4fdd-878c-24dfb54dcb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:04.898056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f648b-5158-4fdd-878c-24dfb54dcb0f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.898334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f648b-5158-4fdd-878c-24dfb54dcb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.898632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f648b-5158-4fdd-878c-24dfb54dcb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.899263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f648b-5158-4fdd-878c-24dfb54dcb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:04.900883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f648b-5158-4fdd-878c-24dfb54dcb0f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:04.916641 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 939/1888] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:04.917998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511698af-b471-463a-98d5-8a8a500d493f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:04.918199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511698af-b471-463a-98d5-8a8a500d493f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:04.918475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511698af-b471-463a-98d5-8a8a500d493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:04.956317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-511698af-b471-463a-98d5-8a8a500d493f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:04.958021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-511698af-b471-463a-98d5-8a8a500d493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:04.981458 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 940/1889] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:04.982853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511698af-b471-463a-98d5-8a8a500d493f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:04.984641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-511698af-b471-463a-98d5-8a8a500d493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.035370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5750878-a6bc-47d3-ac56-c5b61c88259b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.041217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.041823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.042100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.042498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.044215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.087986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511698af-b471-463a-98d5-8a8a500d493f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.093686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.094345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.094631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.094904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.104072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.105700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.116333 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 950/1890] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:05.117188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.118498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.133218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a413a-0ff2-4fda-b58e-752c863050ac service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.138083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.138699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.138981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.139290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.139898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.141938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.171461 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 951/1891] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:05 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:05.173787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.173961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.175915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.189425 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 941/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:05.190191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.191533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.198060 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:05.206042 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:05.255291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080982bb-cb4f-4def-8574-914376d02809 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.256707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7982a-4b04-4695-9f12-096cb12804fe service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.260893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.263474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.263764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.264102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] PATH_INFO: `/v3/projects/de6beb0045614935943ec3ee2d699b03/users/6d2d3505e36f43ca9f6195725b21a057/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.285976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6beb0045614935943ec3ee2d699b03, user_id=6d2d3505e36f43ca9f6195725b21a057, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.289019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.307058 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 952/1893] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:05 2022] PUT /identity/v3/projects/de6beb0045614935943ec3ee2d699b03/users/6d2d3505e36f43ca9f6195725b21a057/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:05.307941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.326661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.327275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.327551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.327824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.338586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.340103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.351317 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 942/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:05.353723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.364640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37718fd-cd48-4dde-9d2d-04cc66acc3e1 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.450592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.451445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.451797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.452237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.453221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.455970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.470500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ea7d5-3619-4f41-b2a1-8490a852ae7a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.485421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.486367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.487808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.488095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.494320 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 943/1895] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:05 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:05.494470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.498340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.519648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c807c-0ee5-41e2-af19-543123c6ba84 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.535189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.535327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.535514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.535778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.536430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.538733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.551024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 944/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:05.552040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.554506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.585172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdd862-b852-4e73-a40c-2ddd4fa9d3ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.598384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.599097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.599466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.599801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] PATH_INFO: `/v3/users/94cf6c390fed43c4baec31f9f6b988ee` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.601237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94cf6c390fed43c4baec31f9f6b988ee)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.603163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.630004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.634020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.650141 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 953/1897] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:05 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:05.650906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.667439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63656-6d8f-4b9e-a77f-f3f5445b3be3 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.675555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.676584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.677410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.678011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.679730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.681841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.688823 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:05.702519 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 954/1898] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:05.702519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.709291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94cf6c390fed43c4baec31f9f6b988ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:05.711893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94cf6c390fed43c4baec31f9f6b988ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:05.714202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94cf6c390fed43c4baec31f9f6b988ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:05.728891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666851-b34e-473b-b954-30cecd14710e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.736265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:05.737302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.737734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.738169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] PATH_INFO: `/v3/projects/de6beb0045614935943ec3ee2d699b03/users/6d2d3505e36f43ca9f6195725b21a057/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.740394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6beb0045614935943ec3ee2d699b03, user_id=6d2d3505e36f43ca9f6195725b21a057, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:05.742077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94cf6c390fed43c4baec31f9f6b988ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:05.745923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:05.758406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-80154deb-6a93-4e04-b009-a5c2eabac4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94cf6c390fed43c4baec31f9f6b988ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:05.764645 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 955/1899] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:05 2022] PUT /identity/v3/projects/de6beb0045614935943ec3ee2d699b03/users/6d2d3505e36f43ca9f6195725b21a057/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:05.766750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:05.768894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.788244 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:05.810463 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 945/1900] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:05 2022] DELETE /identity/v3/users/94cf6c390fed43c4baec31f9f6b988ee => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:05.818832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee8174-0b3f-4dda-a42e-019bca624c13 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.819181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee8174-0b3f-4dda-a42e-019bca624c13 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.819458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee8174-0b3f-4dda-a42e-019bca624c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.860920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3eee8174-0b3f-4dda-a42e-019bca624c13 None None] MFA Rules not processed for user `6d2d3505e36f43ca9f6195725b21a057`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:05.862320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3eee8174-0b3f-4dda-a42e-019bca624c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:05.901307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebf09e-bc06-4375-a643-cefdcfd7d3f0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:05.962928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 946/1901] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:05.970340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:05.970629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:05.970905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:05.999498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:06.000879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.012871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:06.013727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.016823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.017245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] PATH_INFO: `/v3/projects/d70214af27a24390a55dd263126bf113/users/bc2812bc79b347189191efc3ed30fdf0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.039276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70214af27a24390a55dd263126bf113, user_id=bc2812bc79b347189191efc3ed30fdf0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:06.044868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:06.065379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 956/1902] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:05 2022] PUT /identity/v3/projects/d70214af27a24390a55dd263126bf113/users/bc2812bc79b347189191efc3ed30fdf0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:06.067105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:06.070805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.085097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 947/1903] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:06.086360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:06.087874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.165044 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:06.201509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6598c5-775e-4cfd-a007-480012c53865 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:06.208172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:06.209471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.210420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.210772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] PATH_INFO: `/v3/projects/65eac10062574a0a9635bf305b6bdd0c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.213465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65eac10062574a0a9635bf305b6bdd0c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:06.215598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:06.230629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4462c45-2e24-45c6-92ab-19b2a4224834 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:06.340001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:06.340682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.340964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.341263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.346632 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:06.356313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65eac10062574a0a9635bf305b6bdd0c', 'request_id': 'req-1c5473c5-7714-4071-a15b-79a0c626476e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.379264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65eac10062574a0a9635bf305b6bdd0c', 'request_id': 'req-1c5473c5-7714-4071-a15b-79a0c626476e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.404010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65eac10062574a0a9635bf305b6bdd0c', 'request_id': 'req-1c5473c5-7714-4071-a15b-79a0c626476e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.424990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] The token cache is being invalidate because project 65eac10062574a0a9635bf305b6bdd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:06.425294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.426394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.428642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 957/1904] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:06 2022] DELETE /identity/v3/projects/65eac10062574a0a9635bf305b6bdd0c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:06.429282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:06.435400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.443848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:06.446005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:06.462845 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 948/1905] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:06.463975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:06.466470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.570259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd0218-5561-45f8-8df8-b9d0982e70fe service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:06.615369 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:06.629655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5473c5-7714-4071-a15b-79a0c626476e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:06.648842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:06.650179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.650659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.651183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.652389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:06.654530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:06.655352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.655829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.657018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:06.659080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.662065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.680762 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 958/1906] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:06.680762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:06.682242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.695877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:06.697599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:06.698938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a72db-4a9b-49af-aa4d-5a8e7b606361 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:06.705768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:06.706759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.707181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.707743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] PATH_INFO: `/v3/users/07216064ec164f39a5c2c5d97942db80` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.709159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07216064ec164f39a5c2c5d97942db80)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:06.712577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:06.722695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 949/1907] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:06.726313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:06.747498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f0bfa-4065-4ef7-b5e7-b18aa6a292ed service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:06.768225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b7a23-8693-4324-9e8f-958acd5450ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:06.769284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b7a23-8693-4324-9e8f-958acd5450ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.770190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b7a23-8693-4324-9e8f-958acd5450ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.770190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b7a23-8693-4324-9e8f-958acd5450ca admin admin] PATH_INFO: `/v3/projects/d70214af27a24390a55dd263126bf113/users/bc2812bc79b347189191efc3ed30fdf0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.775559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b7a23-8693-4324-9e8f-958acd5450ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70214af27a24390a55dd263126bf113, user_id=bc2812bc79b347189191efc3ed30fdf0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:06.779367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b7a23-8693-4324-9e8f-958acd5450ca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:06.808229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 950/1908] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:06 2022] PUT /identity/v3/projects/d70214af27a24390a55dd263126bf113/users/bc2812bc79b347189191efc3ed30fdf0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:06.808446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07216064ec164f39a5c2c5d97942db80'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.809571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07216064ec164f39a5c2c5d97942db80'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.810004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:06.810293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:06.810456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07216064ec164f39a5c2c5d97942db80'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.810577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:06.821546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07216064ec164f39a5c2c5d97942db80'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.843801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07216064ec164f39a5c2c5d97942db80'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:06.874589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 959/1909] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:06 2022] DELETE /identity/v3/users/07216064ec164f39a5c2c5d97942db80 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:06.883951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] MFA Rules not processed for user `bc2812bc79b347189191efc3ed30fdf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:06.886256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:06.994568 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 951/1910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:07.011978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:07.014146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:07.097642 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:07.169583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315dcb-ae6a-41f0-a269-9377b59ff46b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:07.191096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:07.192084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:07.192670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:07.194128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:07.208642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:07.210976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:07.228397 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 960/1911] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:07.273398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:07.276009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:07.312021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea7944-eec6-465d-82a7-b6625c094a2d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:07.321896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:07.322796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:07.323242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:07.323652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:07.325879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:07.401675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:07.403376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:07.406368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:07.410233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:07.426474 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 952/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:07.557088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:07.559308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:07.572971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa3604-5327-4e78-8b0f-91a7cc0832ec service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:07.579454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865799-42ac-435d-888a-145581192107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:07.580063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865799-42ac-435d-888a-145581192107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:07.580257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865799-42ac-435d-888a-145581192107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:07.580532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865799-42ac-435d-888a-145581192107 admin admin] PATH_INFO: `/v3/projects/82574a33ef764f27905a4393b793bd24` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:07.582783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865799-42ac-435d-888a-145581192107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82574a33ef764f27905a4393b793bd24)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:07.593521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865799-42ac-435d-888a-145581192107 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:07.608338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417007f-1834-48d0-a929-167adac6e58a service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:07.632239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:07.636883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:07.637293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:07.637583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] PATH_INFO: `/v3/projects/0c221128bfc142af895eab7363bf30b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:07.642844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c221128bfc142af895eab7363bf30b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:07.652386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:07.709341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-13865799-42ac-435d-888a-145581192107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82574a33ef764f27905a4393b793bd24', 'request_id': 'req-13865799-42ac-435d-888a-145581192107'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.718361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-13865799-42ac-435d-888a-145581192107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82574a33ef764f27905a4393b793bd24', 'request_id': 'req-13865799-42ac-435d-888a-145581192107'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.729508 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:07.738668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-13865799-42ac-435d-888a-145581192107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82574a33ef764f27905a4393b793bd24', 'request_id': 'req-13865799-42ac-435d-888a-145581192107'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.759525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c221128bfc142af895eab7363bf30b1', 'request_id': 'req-aafe2834-2f60-406e-8473-7f51ed236753'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.770188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c221128bfc142af895eab7363bf30b1', 'request_id': 'req-aafe2834-2f60-406e-8473-7f51ed236753'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.777595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-13865799-42ac-435d-888a-145581192107 admin admin] The token cache is being invalidate because project 82574a33ef764f27905a4393b793bd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:07.778837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-13865799-42ac-435d-888a-145581192107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.780864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-13865799-42ac-435d-888a-145581192107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.787487 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 961/1913] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:07 2022] DELETE /identity/v3/projects/82574a33ef764f27905a4393b793bd24 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:07.790453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c221128bfc142af895eab7363bf30b1', 'request_id': 'req-aafe2834-2f60-406e-8473-7f51ed236753'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.791600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865799-42ac-435d-888a-145581192107 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:07.795007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-13865799-42ac-435d-888a-145581192107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:07.817506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] The token cache is being invalidate because project 0c221128bfc142af895eab7363bf30b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:07.817857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.819259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:07.824719 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 953/1914] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:07 2022] DELETE /identity/v3/projects/0c221128bfc142af895eab7363bf30b1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:07.825082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:07.827035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:07.893460 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:07.897359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865799-42ac-435d-888a-145581192107 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:07.936158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2834-2f60-406e-8473-7f51ed236753 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:07.944089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:07.944746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:07.945130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:07.945406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] PATH_INFO: `/v3/users/9d7750e12a4e45fd99f218eb936a9eb2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:07.946619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7750e12a4e45fd99f218eb936a9eb2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:07.948562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:07.982561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:07.983423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:07.984158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:07.984158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] PATH_INFO: `/v3/users/eb708f87a80040b1a48e5458e18d8a57` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:07.985867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb708f87a80040b1a48e5458e18d8a57)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:07.988308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:08.032897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7750e12a4e45fd99f218eb936a9eb2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.034555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7750e12a4e45fd99f218eb936a9eb2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.035509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7750e12a4e45fd99f218eb936a9eb2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.051271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7750e12a4e45fd99f218eb936a9eb2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.060677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f5afeaa0-0d70-4e77-bb79-dd78a8bd2a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7750e12a4e45fd99f218eb936a9eb2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.062917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb708f87a80040b1a48e5458e18d8a57'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.065906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb708f87a80040b1a48e5458e18d8a57'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.067904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb708f87a80040b1a48e5458e18d8a57'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.076645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb708f87a80040b1a48e5458e18d8a57'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.081803 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 954/1915] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:07 2022] DELETE /identity/v3/users/9d7750e12a4e45fd99f218eb936a9eb2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:08.084343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dba18b-14d0-4b08-bbc2-ab391a79145e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.084853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dba18b-14d0-4b08-bbc2-ab391a79145e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.085215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dba18b-14d0-4b08-bbc2-ab391a79145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.091996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a526a9fe-5503-4203-a712-9a7db703d7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb708f87a80040b1a48e5458e18d8a57'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:08.114985 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 962/1916] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:07 2022] DELETE /identity/v3/users/eb708f87a80040b1a48e5458e18d8a57 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:08.114985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.114985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.114985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.116527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d4dba18b-14d0-4b08-bbc2-ab391a79145e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:08.117092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d4dba18b-14d0-4b08-bbc2-ab391a79145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:08.150043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:08.153294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:08.230188 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:08.284245 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 955/1917] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:08.292397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926943-e28f-443a-a343-3104fdec8515 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.292689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926943-e28f-443a-a343-3104fdec8515 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.292938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926943-e28f-443a-a343-3104fdec8515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.353284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f7926943-e28f-443a-a343-3104fdec8515 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:08.354612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f7926943-e28f-443a-a343-3104fdec8515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:08.382264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 956/1918] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:08.383429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7926943-e28f-443a-a343-3104fdec8515 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:08.394576 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 963/1919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:08.401152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7926943-e28f-443a-a343-3104fdec8515 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:08.409936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:08.411349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:08.411478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:08.411995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.412274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.412544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.417723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:08.418044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:08.419860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:08.445254 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 957/1920] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:08.449710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:08.463599 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:08.471857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c249cd-ca16-4015-a5f2-00648cb47a25 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:08.481413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:08.482640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.483217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.484477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.487530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:08.493812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:08.515135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72ffc-cc09-42ff-a990-78bee873ec13 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:08.538812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:08.539642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.540110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.540769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.555803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:08.558459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:08.575208 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 964/1921] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:08.583336 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 958/1922] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:08 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:08.586288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:08.611747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4594e-cc4c-48ad-894b-8ec47b444987 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:08.713032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:08.714293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.715291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.716064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.716985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:08.720832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:08.787108 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 965/1923] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:08 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:08.787347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:08.802571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64789b-306c-44f5-8144-da70f932417d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:08.812682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d1c47-8487-4318-b071-1587b0f5cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:08.813831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1c47-8487-4318-b071-1587b0f5cdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.813953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1c47-8487-4318-b071-1587b0f5cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.814415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1c47-8487-4318-b071-1587b0f5cdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.815086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d1c47-8487-4318-b071-1587b0f5cdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:08.817587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d1c47-8487-4318-b071-1587b0f5cdb8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:08.866694 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 959/1924] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:08.867651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:08.885669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4e91c-832f-4df6-8caa-dfdbea7f356d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:08.897154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6619-c807-43bf-a3da-a662c3f41f92 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.897484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6619-c807-43bf-a3da-a662c3f41f92 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.897860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6619-c807-43bf-a3da-a662c3f41f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.909013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:08.911228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.912250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.913775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.916237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:08.923772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:08.925165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-952e6619-c807-43bf-a3da-a662c3f41f92 None None] MFA Rules not processed for user `a048a1b75a74409fa68b87726d01d506`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:08.927622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-952e6619-c807-43bf-a3da-a662c3f41f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:08.943919 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 966/1925] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:08.943919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:08.945395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:08.963856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7be8d4-1606-4c62-9775-14c3f101ba3b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:08.970978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:08.971880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:08.972298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:08.972632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] PATH_INFO: `/v3/projects/faf1d4626c9a45f1a27c4d2103e5f97e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:08.982397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf1d4626c9a45f1a27c4d2103e5f97e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:08.984518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.055332 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 960/1926] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:09.057488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e6619-c807-43bf-a3da-a662c3f41f92 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.088450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf1d4626c9a45f1a27c4d2103e5f97e', 'request_id': 'req-beecc67b-420d-4490-b791-d1bb731ca5f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.099853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf1d4626c9a45f1a27c4d2103e5f97e', 'request_id': 'req-beecc67b-420d-4490-b791-d1bb731ca5f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.102056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e6619-c807-43bf-a3da-a662c3f41f92 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.123377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf1d4626c9a45f1a27c4d2103e5f97e', 'request_id': 'req-beecc67b-420d-4490-b791-d1bb731ca5f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.139837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] The token cache is being invalidate because project faf1d4626c9a45f1a27c4d2103e5f97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:09.140149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.140780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.143113 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 967/1927] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:08 2022] DELETE /identity/v3/projects/faf1d4626c9a45f1a27c4d2103e5f97e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:09.143955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.145330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.207699 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:09.225268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371719f-0eaf-4864-8eba-41bcd30b39fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.226073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371719f-0eaf-4864-8eba-41bcd30b39fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.226418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371719f-0eaf-4864-8eba-41bcd30b39fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.227083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371719f-0eaf-4864-8eba-41bcd30b39fa admin admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060/users/81ccf484fd634aef9256f5af3c5fcdcf/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.245764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371719f-0eaf-4864-8eba-41bcd30b39fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf36a9526e55469dba6f70ba6d2f9060, user_id=81ccf484fd634aef9256f5af3c5fcdcf, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.246620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc67b-420d-4490-b791-d1bb731ca5f3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.248758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371719f-0eaf-4864-8eba-41bcd30b39fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.252984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.254782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.255130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.255493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] PATH_INFO: `/v3/projects/d61d362d78674fbe8e9e829d4c78783f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.256869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61d362d78674fbe8e9e829d4c78783f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.259188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.265420 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 961/1928] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:09 2022] PUT /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060/users/81ccf484fd634aef9256f5af3c5fcdcf/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:09.266951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656349-47b4-424c-9b03-bb128184b3f4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.267167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656349-47b4-424c-9b03-bb128184b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.267447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656349-47b4-424c-9b03-bb128184b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.290001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-72656349-47b4-424c-9b03-bb128184b3f4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:09.291251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-72656349-47b4-424c-9b03-bb128184b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.307332 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:09.338894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61d362d78674fbe8e9e829d4c78783f', 'request_id': 'req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.346804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61d362d78674fbe8e9e829d4c78783f', 'request_id': 'req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.366572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61d362d78674fbe8e9e829d4c78783f', 'request_id': 'req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.377861 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 962/1929] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:09.379306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.379595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.379867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.387766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] The token cache is being invalidate because project d61d362d78674fbe8e9e829d4c78783f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:09.388420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.389256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58886e4c-9d24-416a-ae4c-16e8ff1a9f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.395412 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 968/1930] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:09 2022] DELETE /identity/v3/projects/d61d362d78674fbe8e9e829d4c78783f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:09.396606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.396900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.397259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.413525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] MFA Rules not processed for user `81ccf484fd634aef9256f5af3c5fcdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:09.414777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.419244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:09.420552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.494417 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 963/1931] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:09.498838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.504209 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 969/1932] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:09.505216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.505415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.509632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.536372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ac9f-67df-4903-8690-99b5ece27f6f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.538312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d1e1c-9735-43d9-891f-e813597803fc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.541290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.541929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.542210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.542473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] PATH_INFO: `/v3/users/bc2812bc79b347189191efc3ed30fdf0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.543631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2812bc79b347189191efc3ed30fdf0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.544158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.544778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.545074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.545354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.545551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.545994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.549573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.607655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2812bc79b347189191efc3ed30fdf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.608238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2812bc79b347189191efc3ed30fdf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.608860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2812bc79b347189191efc3ed30fdf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.613526 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 970/1933] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:09.615854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.618260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.624741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2812bc79b347189191efc3ed30fdf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.635191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2812bc79b347189191efc3ed30fdf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:09.664573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 964/1934] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:09 2022] DELETE /identity/v3/users/bc2812bc79b347189191efc3ed30fdf0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:09.667772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.667772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.697403 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:09.699585 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:09.738643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550b98c-7a6d-424b-9fee-578d182a35ff admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.756744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c23e8-755d-4efe-b9d4-102f1ed3d4d0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.762466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474966ef-54bd-4deb-8095-5ee5b5f47ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.763100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474966ef-54bd-4deb-8095-5ee5b5f47ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.763370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474966ef-54bd-4deb-8095-5ee5b5f47ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.763639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474966ef-54bd-4deb-8095-5ee5b5f47ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.765419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474966ef-54bd-4deb-8095-5ee5b5f47ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.767636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474966ef-54bd-4deb-8095-5ee5b5f47ebb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.798638 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 965/1935] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:09.799975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c4df-6ec9-4451-8f5e-9813d78436d8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.800263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c4df-6ec9-4451-8f5e-9813d78436d8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.800542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c4df-6ec9-4451-8f5e-9813d78436d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.822994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8fd7c4df-6ec9-4451-8f5e-9813d78436d8 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:09.824535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8fd7c4df-6ec9-4451-8f5e-9813d78436d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.826135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.826751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.827028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.827303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.827973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:09.828387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.831338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.847788 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 971/1936] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:09.850336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.867387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19468a1c-a8fe-4574-bf04-ee6994e6ff58 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.872723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.873413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.873690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.873889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.874537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.876883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.887682 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 972/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:09.892485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.899475 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 966/1938] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:09.900301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c4df-6ec9-4451-8f5e-9813d78436d8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.907782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f664b-847e-4823-8ff0-9eb13595c098 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.913677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.914527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.915013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.915357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.916070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.917262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c4df-6ec9-4451-8f5e-9813d78436d8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:09.918493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.923069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:09.924114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:09.924823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:09.925309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] PATH_INFO: `/v3/projects/58343bad37d94e1f83d480ecfcd013d1/users/3f1bb964d8474a77aa5ef3ef083c3067/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:09.949876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58343bad37d94e1f83d480ecfcd013d1, user_id=3f1bb964d8474a77aa5ef3ef083c3067, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:09.952687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:09.956347 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 973/1939] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:09.956347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:09.957663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:09.971504 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 967/1940] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:09 2022] PUT /identity/v3/projects/58343bad37d94e1f83d480ecfcd013d1/users/3f1bb964d8474a77aa5ef3ef083c3067/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:09.972875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.029717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad8959-ccbc-4f73-99fb-1c74d43229c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.051110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8a45b-612d-4667-9353-103b5cb0d43e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.055935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.056555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.056818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.057113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.057754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.059669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.082790 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 968/1941] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:09 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:10.083772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.094823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d5eb-5ea7-4651-906a-ef51cbf8c78f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.096513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.097537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.098109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.098706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.099952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.100574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.100856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.101160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.101882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.103412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.109699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.111459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.115031 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 969/1942] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:10.116109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.128141 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 974/1943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:10.128825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.132977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0faa-7cd2-4d16-9092-3f9491fab787 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.143318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.144036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.144346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.144623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.145334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.146920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.157497 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:10.163029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d14a6-fa1e-4109-b5d6-7204f14f5a6a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.163225 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 970/1944] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:10.164205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.169636 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:10.175376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.176979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.177870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.178077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798b4a-0c50-4db1-9f16-f7d96dbd4c8a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.178748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] PATH_INFO: `/v3/projects/58343bad37d94e1f83d480ecfcd013d1/users/3f1bb964d8474a77aa5ef3ef083c3067/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.182508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58343bad37d94e1f83d480ecfcd013d1, user_id=3f1bb964d8474a77aa5ef3ef083c3067, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.185134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.185773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.186821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.187264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.187535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.194924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.197011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.200555 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 975/1945] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:10 2022] PUT /identity/v3/projects/58343bad37d94e1f83d480ecfcd013d1/users/3f1bb964d8474a77aa5ef3ef083c3067/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:10.201467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.208315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:10.209107 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 971/1946] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:10.214327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.230685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d13a-6a26-478a-99cf-3149bcbe0bd5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.308467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bfc3f-7385-4aec-b26e-4d4de738fc38 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.310110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b97af3-7dff-468a-b78f-b7958005220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.310912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b97af3-7dff-468a-b78f-b7958005220f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.311301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b97af3-7dff-468a-b78f-b7958005220f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.311663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b97af3-7dff-468a-b78f-b7958005220f admin admin] PATH_INFO: `/v3/projects/ef737ac8a8e7477683e91f0461f6cbe4/users/bee952042a44490aba79e8f6d177ae6a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.313715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.314091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.314433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.314713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] PATH_INFO: `/v3/projects/d70214af27a24390a55dd263126bf113` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.315920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70214af27a24390a55dd263126bf113)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.318194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.331368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b97af3-7dff-468a-b78f-b7958005220f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef737ac8a8e7477683e91f0461f6cbe4, user_id=bee952042a44490aba79e8f6d177ae6a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.334237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b97af3-7dff-468a-b78f-b7958005220f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.359342 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 972/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:10 2022] PUT /identity/v3/projects/ef737ac8a8e7477683e91f0461f6cbe4/users/bee952042a44490aba79e8f6d177ae6a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:10.362573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0027295-ee5a-48ad-8d16-d130640c4bf3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.362865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0027295-ee5a-48ad-8d16-d130640c4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.363140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0027295-ee5a-48ad-8d16-d130640c4bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.388565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70214af27a24390a55dd263126bf113', 'request_id': 'req-35a382de-aa52-41c2-88c8-ae4c1f0631d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:10.397209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70214af27a24390a55dd263126bf113', 'request_id': 'req-35a382de-aa52-41c2-88c8-ae4c1f0631d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:10.403880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a0027295-ee5a-48ad-8d16-d130640c4bf3 None None] MFA Rules not processed for user `3f1bb964d8474a77aa5ef3ef083c3067`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:10.405216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a0027295-ee5a-48ad-8d16-d130640c4bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:10.409722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70214af27a24390a55dd263126bf113', 'request_id': 'req-35a382de-aa52-41c2-88c8-ae4c1f0631d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:10.431596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] The token cache is being invalidate because project d70214af27a24390a55dd263126bf113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:10.432165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:10.433054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-35a382de-aa52-41c2-88c8-ae4c1f0631d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:10.435789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 976/1948] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:10 2022] DELETE /identity/v3/projects/d70214af27a24390a55dd263126bf113 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:10.440029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.440029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.440029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.478828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] MFA Rules not processed for user `bee952042a44490aba79e8f6d177ae6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:10.480158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:10.518600 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 973/1949] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:10.520565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff30df-a140-4719-a217-694884296e20 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.524218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff30df-a140-4719-a217-694884296e20 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.524459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff30df-a140-4719-a217-694884296e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.568307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5fff30df-a140-4719-a217-694884296e20 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:10.570311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5fff30df-a140-4719-a217-694884296e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:10.577446 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 977/1950] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:10.578813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.581000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:10.597792 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:10.643082 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:10.655289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 974/1951] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:10.656833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff30df-a140-4719-a217-694884296e20 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.659423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5fff30df-a140-4719-a217-694884296e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:10.675453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff30df-a140-4719-a217-694884296e20 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.682252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024554-97c0-47fb-a198-d68c42761906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.683115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024554-97c0-47fb-a198-d68c42761906 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.683558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024554-97c0-47fb-a198-d68c42761906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.684000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024554-97c0-47fb-a198-d68c42761906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.684772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024554-97c0-47fb-a198-d68c42761906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.688809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024554-97c0-47fb-a198-d68c42761906 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.733751 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 975/1952] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:10.735752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4441b-049d-4976-9bb5-f11a98b80c87 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.736740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4441b-049d-4976-9bb5-f11a98b80c87 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.737021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4441b-049d-4976-9bb5-f11a98b80c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.762896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-99d4441b-049d-4976-9bb5-f11a98b80c87 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:10.764629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-99d4441b-049d-4976-9bb5-f11a98b80c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:10.768771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ede978-c19c-4bec-88a4-d13d07ade587 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.851690 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 976/1953] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:10.851690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4441b-049d-4976-9bb5-f11a98b80c87 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.861707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4441b-049d-4976-9bb5-f11a98b80c87 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.865706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878d2f-0d01-4ab7-84eb-5a1ad3126a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.866561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6fdb1-61de-4afd-b4ed-cb2b10dfe57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.867358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6fdb1-61de-4afd-b4ed-cb2b10dfe57e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.867620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6fdb1-61de-4afd-b4ed-cb2b10dfe57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.867889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6fdb1-61de-4afd-b4ed-cb2b10dfe57e admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.868195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878d2f-0d01-4ab7-84eb-5a1ad3126a1a service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.868523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6fdb1-61de-4afd-b4ed-cb2b10dfe57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.868624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878d2f-0d01-4ab7-84eb-5a1ad3126a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.868999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878d2f-0d01-4ab7-84eb-5a1ad3126a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.870808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6fdb1-61de-4afd-b4ed-cb2b10dfe57e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.895111 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 977/1954] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/users => generated 299 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:10.896609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065b27-2274-45dd-85fd-ef7094d679d9 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.897402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065b27-2274-45dd-85fd-ef7094d679d9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.897818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065b27-2274-45dd-85fd-ef7094d679d9 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.900036 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 978/1955] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:10.900876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065b27-2274-45dd-85fd-ef7094d679d9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.915357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065b27-2274-45dd-85fd-ef7094d679d9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.920301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.921012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.921511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.921908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.923271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:10.923661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.925429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.944141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 979/1956] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:10.951447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878d2f-0d01-4ab7-84eb-5a1ad3126a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.954729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878d2f-0d01-4ab7-84eb-5a1ad3126a1a service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.955216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:10.966850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a94009-69f3-4327-9063-215ac049800d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:10.972450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:10.973097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.973439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.973647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.974293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:10.975907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:10.977329 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 978/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:10.979254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1a488-62e2-43f0-8b4e-d6c34b813eaa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:10.979466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1a488-62e2-43f0-8b4e-d6c34b813eaa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:10.979803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1a488-62e2-43f0-8b4e-d6c34b813eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:10.990285 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 980/1958] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:10.991284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.002290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a18f3-1df9-4383-8b3e-79522b02a899 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.005897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b2d1a488-62e2-43f0-8b4e-d6c34b813eaa None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:11.007137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b2d1a488-62e2-43f0-8b4e-d6c34b813eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:11.007290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd18ea-81dd-45df-a839-1e3dfb7c01ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.008002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd18ea-81dd-45df-a839-1e3dfb7c01ba admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.008345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd18ea-81dd-45df-a839-1e3dfb7c01ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.008693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd18ea-81dd-45df-a839-1e3dfb7c01ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.009421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd18ea-81dd-45df-a839-1e3dfb7c01ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.011381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd18ea-81dd-45df-a839-1e3dfb7c01ba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.018810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 979/1959] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:11.020013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1a488-62e2-43f0-8b4e-d6c34b813eaa None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.038673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1a488-62e2-43f0-8b4e-d6c34b813eaa None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.043782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.044477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.044752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.045019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] PATH_INFO: `/v3/projects/4270397f603342f49658f44054759f80/users/71b078d6e78e428f8567e7b099015048/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.049182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 981/1960] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:10 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:11.049182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ef334-1f1e-497b-9fdb-7d1f10c29818 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.049182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ef334-1f1e-497b-9fdb-7d1f10c29818 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.049182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ef334-1f1e-497b-9fdb-7d1f10c29818 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.049885 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 982/1961] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:11.050595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ef334-1f1e-497b-9fdb-7d1f10c29818 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.053819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-351ef334-1f1e-497b-9fdb-7d1f10c29818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:11.068692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] RBAC: Authorizing `identity:create_grant(project_id=4270397f603342f49658f44054759f80, user_id=71b078d6e78e428f8567e7b099015048, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.071511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.089174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 980/1962] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:11 2022] PUT /identity/v3/projects/4270397f603342f49658f44054759f80/users/71b078d6e78e428f8567e7b099015048/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:11.089883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.104024 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:11.155556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ef334-1f1e-497b-9fdb-7d1f10c29818 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.164454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2464f9-a7eb-46f2-9257-2179f63ffead admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.167734 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:11.169890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.170501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.170782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.171041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.171680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.173727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.199971 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 981/1963] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:11 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:11.199971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:11.235807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.236788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.237278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.237653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.249095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.250989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.262807 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 983/1964] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:11.263825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.275875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd809d0-54a2-4363-93c4-0ca583c810a1 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.286074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.286748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.287078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.287356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.288023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.289720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.295771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.316569 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 984/1965] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:11.316569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.334178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979c89-b522-442f-9ab6-352a8acd3770 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.340844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.341596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.341963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.342325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.343301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.346358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.363343 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 985/1966] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:11.363343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.372023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063d9c-9725-4c30-b93d-7259d88dc4b5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.377420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.378094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.378649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.378929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] PATH_INFO: `/v3/projects/4270397f603342f49658f44054759f80/users/71b078d6e78e428f8567e7b099015048/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.381990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4270397f603342f49658f44054759f80, user_id=71b078d6e78e428f8567e7b099015048, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.383677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.411818 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 986/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:11 2022] PUT /identity/v3/projects/4270397f603342f49658f44054759f80/users/71b078d6e78e428f8567e7b099015048/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:11.412528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.438982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c247f0-7d88-496e-8791-d34b74dd5a5a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.507556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e35e1-69d3-4abc-bded-b429d04a510d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.514691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6017a7-0a77-44ab-b1da-e2b3abeb05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.517607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6017a7-0a77-44ab-b1da-e2b3abeb05e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.517973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6017a7-0a77-44ab-b1da-e2b3abeb05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.518324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6017a7-0a77-44ab-b1da-e2b3abeb05e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.519815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6017a7-0a77-44ab-b1da-e2b3abeb05e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.522775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6017a7-0a77-44ab-b1da-e2b3abeb05e5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.536756 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:11.553942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 987/1968] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:11.555893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.556367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.556851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.560964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.561993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.562380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.563582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.565987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.568280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.572149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 982/1969] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:11 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:11.573489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.589437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece1a69-2624-47f6-87e8-a175a6c496a7 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.602634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e8f1-35be-4683-b2e7-32c612788008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.603396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e8f1-35be-4683-b2e7-32c612788008 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.603751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e8f1-35be-4683-b2e7-32c612788008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.604076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e8f1-35be-4683-b2e7-32c612788008 admin admin] PATH_INFO: `/v3/projects/5d7d93249042418a953a35b80b87983d/users/28d40069fd9f4b279c42d90185aac26f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.608084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] MFA Rules not processed for user `71b078d6e78e428f8567e7b099015048`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:11.609420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:11.626713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e8f1-35be-4683-b2e7-32c612788008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7d93249042418a953a35b80b87983d, user_id=28d40069fd9f4b279c42d90185aac26f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.630741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e8f1-35be-4683-b2e7-32c612788008 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.647756 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 983/1970] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:11 2022] PUT /identity/v3/projects/5d7d93249042418a953a35b80b87983d/users/28d40069fd9f4b279c42d90185aac26f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:11.649032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc4e8-f4b2-4753-bab3-299ad2614953 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.649346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc4e8-f4b2-4753-bab3-299ad2614953 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.649611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc4e8-f4b2-4753-bab3-299ad2614953 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.650849 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 984/1971] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:11.662367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd813a-0cc2-4b16-96db-1bf86db77c5a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.662545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd813a-0cc2-4b16-96db-1bf86db77c5a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.662823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd813a-0cc2-4b16-96db-1bf86db77c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.683015 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:11.702542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b6cd813a-0cc2-4b16-96db-1bf86db77c5a None None] MFA Rules not processed for user `28d40069fd9f4b279c42d90185aac26f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:11.704945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b6cd813a-0cc2-4b16-96db-1bf86db77c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:11.711835 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 988/1972] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:11.712466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:11.800112 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 985/1973] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:11.800983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd813a-0cc2-4b16-96db-1bf86db77c5a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.826421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.837462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5088f0-4da7-4896-8df6-f64614c257f7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.896906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd813a-0cc2-4b16-96db-1bf86db77c5a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.899073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.899703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.899978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.900297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.901445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.903757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.903960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c8cd3-ed91-473e-af5c-a8d106093f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.904566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c8cd3-ed91-473e-af5c-a8d106093f98 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.905035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c8cd3-ed91-473e-af5c-a8d106093f98 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.905578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c8cd3-ed91-473e-af5c-a8d106093f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.905700 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 989/1974] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:11 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:11.906166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:11.966301 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:11.984531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cfd9b-4ef3-4d2a-9e01-092a12663555 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:11.989832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c8cd3-ed91-473e-af5c-a8d106093f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.991940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c8cd3-ed91-473e-af5c-a8d106093f98 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:11.992455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:11.993212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:11.993485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:11.993774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:11.994391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:11.996560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.019015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 986/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:12.058775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662302e4-a25c-4bd2-8abb-79c2c60e472c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.059131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662302e4-a25c-4bd2-8abb-79c2c60e472c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.059511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662302e4-a25c-4bd2-8abb-79c2c60e472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.063795 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 990/1976] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:11 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:12.065465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.082815 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:12.089908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-662302e4-a25c-4bd2-8abb-79c2c60e472c None None] MFA Rules not processed for user `81ccf484fd634aef9256f5af3c5fcdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:12.093286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-662302e4-a25c-4bd2-8abb-79c2c60e472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:12.177354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a384-da86-48c8-8275-662e1978a40a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.183267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.184080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.184534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.184854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.185800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.187996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.188702 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 987/1977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:12.200046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662302e4-a25c-4bd2-8abb-79c2c60e472c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.215322 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 991/1978] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:12 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:12.220583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.230856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65226673-0603-4b6b-8375-7e8dfe799269 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.238296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.239270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.239270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.239459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.240304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.245147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.265038 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 992/1979] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:12.270482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.283289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd21bbc-3e10-45c9-ac50-58ca5343c12e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.288673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.289377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.289656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.289926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] PATH_INFO: `/v3/projects/e3f11a8552d144e694a3079968084b74/users/393c7cbd4c384e5782b981f6e871057a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.302660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662302e4-a25c-4bd2-8abb-79c2c60e472c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.306429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f11a8552d144e694a3079968084b74, user_id=393c7cbd4c384e5782b981f6e871057a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.309316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.314206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.314852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.315086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.315347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.319461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:12.324201 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 993/1980] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:12 2022] PUT /identity/v3/projects/e3f11a8552d144e694a3079968084b74/users/393c7cbd4c384e5782b981f6e871057a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:12.328221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.339386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.341846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.354606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 988/1981] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:12.432837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ca60a-4477-480e-bd43-a6f4deea1a76 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.439552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8b6b7-c59c-4897-8eda-ca324e14109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.440203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b6b7-c59c-4897-8eda-ca324e14109e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.440588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b6b7-c59c-4897-8eda-ca324e14109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.440862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b6b7-c59c-4897-8eda-ca324e14109e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.441652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8b6b7-c59c-4897-8eda-ca324e14109e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.443381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8b6b7-c59c-4897-8eda-ca324e14109e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.455653 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 994/1982] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:03:12.461999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.490978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365b790-975d-428f-a91f-6a5ab702b702 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.508257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.509808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.510276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.511061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] PATH_INFO: `/v3/projects/e3f11a8552d144e694a3079968084b74/users/393c7cbd4c384e5782b981f6e871057a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.514046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f11a8552d144e694a3079968084b74, user_id=393c7cbd4c384e5782b981f6e871057a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.517396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.537600 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 989/1983] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:12 2022] PUT /identity/v3/projects/e3f11a8552d144e694a3079968084b74/users/393c7cbd4c384e5782b981f6e871057a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:12.542770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9070-31b2-467e-bf2c-3f821f6f02d1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.543060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9070-31b2-467e-bf2c-3f821f6f02d1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.543334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9070-31b2-467e-bf2c-3f821f6f02d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.581809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e54f9070-31b2-467e-bf2c-3f821f6f02d1 None None] MFA Rules not processed for user `393c7cbd4c384e5782b981f6e871057a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:12.583088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e54f9070-31b2-467e-bf2c-3f821f6f02d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:12.701098 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:12.713051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.770369 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 995/1984] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:12.811794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9070-31b2-467e-bf2c-3f821f6f02d1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.845304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea002320-c106-4e52-bce1-790318036e79 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.850708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.851346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.851621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.851888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] PATH_INFO: `/v3/users/bee952042a44490aba79e8f6d177ae6a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.853036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee952042a44490aba79e8f6d177ae6a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.855039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.856931 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:12.905288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9070-31b2-467e-bf2c-3f821f6f02d1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:12.912178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb46fa0-03a7-4288-b140-09c954269039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:12.913329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46fa0-03a7-4288-b140-09c954269039 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.913831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46fa0-03a7-4288-b140-09c954269039 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.914325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46fa0-03a7-4288-b140-09c954269039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.927081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee952042a44490aba79e8f6d177ae6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:12.927748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee952042a44490aba79e8f6d177ae6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:12.928408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee952042a44490aba79e8f6d177ae6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:12.930178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb46fa0-03a7-4288-b140-09c954269039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:12.931837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb46fa0-03a7-4288-b140-09c954269039 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:12.935891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee952042a44490aba79e8f6d177ae6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:12.943496 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 996/1985] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:03:12.944605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.945001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.945393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:12.946925 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 997/1986] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:12.952069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:12.954778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:12.963856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1df91ca3-450e-4b38-a5ee-b4726f1a17f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee952042a44490aba79e8f6d177ae6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:12.983447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:12.985490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:12.988147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 990/1987] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:12 2022] DELETE /identity/v3/users/bee952042a44490aba79e8f6d177ae6a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:12.992956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:12.993404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:12.993808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.045146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:13.046364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:13.105336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb0d99-5705-42d9-b4a9-931a609ac84f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:13.174681 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 991/1988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:13.190101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:13.192089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:13.196578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f431a4f-73b8-4617-b259-e173f3be5ba5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:13.199020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431a4f-73b8-4617-b259-e173f3be5ba5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.199380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431a4f-73b8-4617-b259-e173f3be5ba5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.200761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431a4f-73b8-4617-b259-e173f3be5ba5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.202905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f431a4f-73b8-4617-b259-e173f3be5ba5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:13.205174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f431a4f-73b8-4617-b259-e173f3be5ba5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:13.218077 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 998/1989] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:12 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:03:13.294200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc48a98-7e70-4127-8b2b-e5b0172db2cf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:13.300402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:13.301295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.301437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.301709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.323119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:13.324700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:13.337447 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 992/1990] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:03:13.366690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6012268-5ada-4492-90c3-18b3de838e7a None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.367060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6012268-5ada-4492-90c3-18b3de838e7a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.367506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6012268-5ada-4492-90c3-18b3de838e7a None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.372918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 999/1991] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:13.376107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:13.416694 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:13.497818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:13.518528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0fa8-629a-45c5-9bca-cbaf71d6d462 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:13.523529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:13.524461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.524744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.525015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.527211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:13.529535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:13.532118 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 993/1992] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:13 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:13.597593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25774-c3a4-4d69-9514-d40566eaf57e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.597877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25774-c3a4-4d69-9514-d40566eaf57e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.598152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25774-c3a4-4d69-9514-d40566eaf57e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.599574 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1000/1993] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:13.604602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:13.621008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:13.633618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed26c3c-8783-40c4-8733-7fd8e7317a5c tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:13.638943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:13.639740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.640217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.640564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.643412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:13.645547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:13.649273 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 994/1994] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:13 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:13.671793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d25774-c3a4-4d69-9514-d40566eaf57e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:13.675473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42d25774-c3a4-4d69-9514-d40566eaf57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:13.694185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d25774-c3a4-4d69-9514-d40566eaf57e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:13.709709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:13.710960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.711370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.711726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] PATH_INFO: `/v3/users/28d40069fd9f4b279c42d90185aac26f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.713376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d40069fd9f4b279c42d90185aac26f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:13.716733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:13.727345 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:13.728227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:13.730135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:13.758406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672926a-47b7-4e20-a177-c84d6df695b5 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:13.766254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:13.767203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.767533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.767816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] PATH_INFO: `/v3/projects/ef737ac8a8e7477683e91f0461f6cbe4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.769180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef737ac8a8e7477683e91f0461f6cbe4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:13.771324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:13.801478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d40069fd9f4b279c42d90185aac26f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.802292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d40069fd9f4b279c42d90185aac26f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.802938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d40069fd9f4b279c42d90185aac26f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.820503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d40069fd9f4b279c42d90185aac26f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.827928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec755a5f-b982-4ab3-9a03-d829450e66d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d40069fd9f4b279c42d90185aac26f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.832829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef737ac8a8e7477683e91f0461f6cbe4', 'request_id': 'req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.840407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef737ac8a8e7477683e91f0461f6cbe4', 'request_id': 'req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.844649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1001/1995] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:13 2022] DELETE /identity/v3/users/28d40069fd9f4b279c42d90185aac26f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:13.846821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.847239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.847503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.851823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef737ac8a8e7477683e91f0461f6cbe4', 'request_id': 'req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.865494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] The token cache is being invalidate because project ef737ac8a8e7477683e91f0461f6cbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:13.865783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.866766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec9e6d97-6d2e-432f-a176-43976d8ee1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:13.868571 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 995/1996] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:13 2022] DELETE /identity/v3/projects/ef737ac8a8e7477683e91f0461f6cbe4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:13.869192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] MFA Rules not processed for user `81ccf484fd634aef9256f5af3c5fcdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:13.869963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:13.870253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:13.873132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:13.873291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:13.891312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:13.892551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:13.953108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1002/1997] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:13.953108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:13.953108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:13.985254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 996/1998] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:13.996938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:13.998478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:14.069119 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:14.077833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c1a52-b2be-409a-a16f-a75dfce4e6a2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:14.084430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:14.085449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:14.085800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:14.086290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] PATH_INFO: `/v3/users/71b078d6e78e428f8567e7b099015048` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:14.087638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b078d6e78e428f8567e7b099015048)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:14.090096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:14.141736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0269e-4636-44ae-80b8-584167f6d7f6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:14.145809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d255c8-61e9-44b1-aaab-ce7df3ca2d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:14.146612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d255c8-61e9-44b1-aaab-ce7df3ca2d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:14.146870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d255c8-61e9-44b1-aaab-ce7df3ca2d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:14.147236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d255c8-61e9-44b1-aaab-ce7df3ca2d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:14.163471 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:14.166712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d255c8-61e9-44b1-aaab-ce7df3ca2d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:14.169622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d255c8-61e9-44b1-aaab-ce7df3ca2d81 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:14.185469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b078d6e78e428f8567e7b099015048'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.186399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b078d6e78e428f8567e7b099015048'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.188752 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 997/1999] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:14.188880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b078d6e78e428f8567e7b099015048'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.205227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b078d6e78e428f8567e7b099015048'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.214074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b078d6e78e428f8567e7b099015048'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.231518 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1003/2000] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:13 2022] DELETE /identity/v3/users/71b078d6e78e428f8567e7b099015048 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:14.484389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f92a3-325a-4be8-83cb-89ff04a81876 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:14.485651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f92a3-325a-4be8-83cb-89ff04a81876 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:14.485870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f92a3-325a-4be8-83cb-89ff04a81876 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:14.487612 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 998/2001] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:03:14.495932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:14.497629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:14.614076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:14.615453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:14.696238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a1f00-c858-48f4-9a5a-6ecd4ee20a78 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:14.700798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:14.701641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:14.701955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:14.702226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:14.703983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:14.706537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:14.708843 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1004/2002] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:14 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:14.763034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f92a3-325a-4be8-83cb-89ff04a81876 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:14.766139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7b3f92a3-325a-4be8-83cb-89ff04a81876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:14.772559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:14.774518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:14.864127 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:14.889764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad08819-3d65-450c-87a8-d798c4076ddd tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:14.894337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f92a3-325a-4be8-83cb-89ff04a81876 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:14.895862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:14.896687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:14.896977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:14.897284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] PATH_INFO: `/v3/projects/5d7d93249042418a953a35b80b87983d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:14.899827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7d93249042418a953a35b80b87983d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:14.900444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:14.901137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:14.901421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:14.901693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] PATH_INFO: `/v3/projects/4270397f603342f49658f44054759f80` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:14.901797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:14.903316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4270397f603342f49658f44054759f80)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:14.905382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:14.961419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7d93249042418a953a35b80b87983d', 'request_id': 'req-c194592f-82e9-4ebd-a570-afb21e8af24b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.967655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4270397f603342f49658f44054759f80', 'request_id': 'req-c80a034d-84c0-455b-9c4a-7334eb07e035'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.972903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7d93249042418a953a35b80b87983d', 'request_id': 'req-c194592f-82e9-4ebd-a570-afb21e8af24b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.975743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4270397f603342f49658f44054759f80', 'request_id': 'req-c80a034d-84c0-455b-9c4a-7334eb07e035'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.979587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7d93249042418a953a35b80b87983d', 'request_id': 'req-c194592f-82e9-4ebd-a570-afb21e8af24b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.985541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4270397f603342f49658f44054759f80', 'request_id': 'req-c80a034d-84c0-455b-9c4a-7334eb07e035'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.993502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] The token cache is being invalidate because project 5d7d93249042418a953a35b80b87983d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:14.994009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.995193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c194592f-82e9-4ebd-a570-afb21e8af24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.996251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] The token cache is being invalidate because project 4270397f603342f49658f44054759f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:14.996461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:14.996999 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1005/2003] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:14 2022] DELETE /identity/v3/projects/5d7d93249042418a953a35b80b87983d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:14.998090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b57854-5d35-46e7-b4e1-f8cfe58d240e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:14.998370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b57854-5d35-46e7-b4e1-f8cfe58d240e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.000199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c80a034d-84c0-455b-9c4a-7334eb07e035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.000338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b57854-5d35-46e7-b4e1-f8cfe58d240e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.001649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1006/2004] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:15.005374 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 999/2005] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:14 2022] DELETE /identity/v3/projects/4270397f603342f49658f44054759f80 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:15.005515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b57854-5d35-46e7-b4e1-f8cfe58d240e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.005515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a9b57854-5d35-46e7-b4e1-f8cfe58d240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.006900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.007190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.007530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.030079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:15.032395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.086518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b57854-5d35-46e7-b4e1-f8cfe58d240e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.090696 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:15.091509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.092100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.092333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.092595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] PATH_INFO: `/v3/users/393c7cbd4c384e5782b981f6e871057a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.094834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=393c7cbd4c384e5782b981f6e871057a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.096796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.103464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1000/2006] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:15.104267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:15.105855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.168259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393c7cbd4c384e5782b981f6e871057a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.169046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393c7cbd4c384e5782b981f6e871057a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.169752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393c7cbd4c384e5782b981f6e871057a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.187331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393c7cbd4c384e5782b981f6e871057a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.195704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88aa16ae-1b3a-4aa2-8e9e-bfea248d10d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393c7cbd4c384e5782b981f6e871057a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.197356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.198550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.199406 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:15.214557 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1007/2007] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:15 2022] DELETE /identity/v3/users/393c7cbd4c384e5782b981f6e871057a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:15.216395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e722-029f-4587-aaa1-cd9a617d3d4f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.216635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e722-029f-4587-aaa1-cd9a617d3d4f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.216978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e722-029f-4587-aaa1-cd9a617d3d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.241878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-74c6e722-029f-4587-aaa1-cd9a617d3d4f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:15.243106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-74c6e722-029f-4587-aaa1-cd9a617d3d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.289574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439f09-18ce-456c-bed6-aa6140406f80 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.336907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1008/2008] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:15.340134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6e722-029f-4587-aaa1-cd9a617d3d4f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.358013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6e722-029f-4587-aaa1-cd9a617d3d4f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.370141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.371405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.371843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.372667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.373717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:15.374287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.376626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.395663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a043ee-f018-439e-af4d-dd538e329598 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.397313 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1009/2009] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:15.397409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a043ee-f018-439e-af4d-dd538e329598 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.397409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a043ee-f018-439e-af4d-dd538e329598 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.397409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a043ee-f018-439e-af4d-dd538e329598 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.398451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a043ee-f018-439e-af4d-dd538e329598 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.399929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.401031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a043ee-f018-439e-af4d-dd538e329598 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.403167 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1001/2010] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:15 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:15.430716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba06cc-1bba-444d-9f3b-bbb8e1b89a72 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.452985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.455443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.456106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.456660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.457946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.462659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.474078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.474757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.475361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.478149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1002/2011] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:15.487044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:15.488686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.519202 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1010/2012] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:15 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:15.526273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.590267 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:15.684457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.687141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.703876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e098a6-ec9f-4952-bd15-fbaea9d00541 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.708928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052deb1d-309c-46a4-8954-9ac1b99b549d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.718066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.720185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.720682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.721266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.723242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.727905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.775163 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1011/2013] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:15 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:15.775670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.778371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:15.806630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6a971-dfc9-4fd2-a09a-6728b1be0190 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.811893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.812536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.813902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.813902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] PATH_INFO: `/v3/projects/e3f11a8552d144e694a3079968084b74` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.814896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f11a8552d144e694a3079968084b74)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.815880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.816731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.816880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.817303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.819389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.821278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.823538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.825721 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1003/2014] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:15 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:03:15.826637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.842655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8e7c-72b6-476e-b2ea-054409648702 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.850844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:15.851568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.851914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.852192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.853045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:15.854717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:15.869310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1004/2015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:15.872857 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:15.876923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f11a8552d144e694a3079968084b74', 'request_id': 'req-eb876a75-c5e2-4290-920a-87383fac983b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.877957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:15.884550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f11a8552d144e694a3079968084b74', 'request_id': 'req-eb876a75-c5e2-4290-920a-87383fac983b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.896048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f11a8552d144e694a3079968084b74', 'request_id': 'req-eb876a75-c5e2-4290-920a-87383fac983b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.896427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4f27f-5a25-4d4c-abd6-53787118e25e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:15.915252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] The token cache is being invalidate because project e3f11a8552d144e694a3079968084b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:15.915778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.919017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eb876a75-c5e2-4290-920a-87383fac983b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:15.921495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1012/2016] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:15 2022] DELETE /identity/v3/projects/e3f11a8552d144e694a3079968084b74 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:15.927040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:15.927406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:15.927794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:15.959983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:15.959983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:16.004507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccac6ed-9c5c-41a6-9cc4-86a098757316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.005040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccac6ed-9c5c-41a6-9cc4-86a098757316 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.005346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccac6ed-9c5c-41a6-9cc4-86a098757316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.005619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccac6ed-9c5c-41a6-9cc4-86a098757316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.006343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccac6ed-9c5c-41a6-9cc4-86a098757316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.009688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccac6ed-9c5c-41a6-9cc4-86a098757316 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.026124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1005/2017] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:16.026124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8576f-3dd5-40df-8fd3-ded7bcabc014 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.026124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8576f-3dd5-40df-8fd3-ded7bcabc014 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.026124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8576f-3dd5-40df-8fd3-ded7bcabc014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.038136 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1013/2018] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:16.039529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.041045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:16.047735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f8c8576f-3dd5-40df-8fd3-ded7bcabc014 None None] MFA Rules not processed for user `81ccf484fd634aef9256f5af3c5fcdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:16.049142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f8c8576f-3dd5-40df-8fd3-ded7bcabc014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:16.057408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a393d-18f8-42c9-8cb3-aa42d71bf10d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.065238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e5be-8d65-4b0c-9251-3e5582cf962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.065954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e5be-8d65-4b0c-9251-3e5582cf962b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.066233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e5be-8d65-4b0c-9251-3e5582cf962b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.066508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e5be-8d65-4b0c-9251-3e5582cf962b admin admin] PATH_INFO: `/v3/projects/28938b8a17634c2e80b1815138c2d33c/users/c5b530242b564a56b55d4b9f49066232/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.084718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e5be-8d65-4b0c-9251-3e5582cf962b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28938b8a17634c2e80b1815138c2d33c, user_id=c5b530242b564a56b55d4b9f49066232, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.087473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e5be-8d65-4b0c-9251-3e5582cf962b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.119267 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1014/2019] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:16 2022] PUT /identity/v3/projects/28938b8a17634c2e80b1815138c2d33c/users/c5b530242b564a56b55d4b9f49066232/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:16.119267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5fbac-72b0-45f2-abee-d4605ae6ae5d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.119267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5fbac-72b0-45f2-abee-d4605ae6ae5d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.119267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5fbac-72b0-45f2-abee-d4605ae6ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.145280 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1006/2020] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:16.146705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f574b-d56b-4c8d-baf9-05a7c2f53042 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.146995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f574b-d56b-4c8d-baf9-05a7c2f53042 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.147273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f574b-d56b-4c8d-baf9-05a7c2f53042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.149277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5eb5fbac-72b0-45f2-abee-d4605ae6ae5d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:16.165401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5eb5fbac-72b0-45f2-abee-d4605ae6ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:16.190555 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:16.204289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-350f574b-d56b-4c8d-baf9-05a7c2f53042 None None] MFA Rules not processed for user `c5b530242b564a56b55d4b9f49066232`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:16.206014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-350f574b-d56b-4c8d-baf9-05a7c2f53042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:16.291588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1015/2021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:16.296775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5fbac-72b0-45f2-abee-d4605ae6ae5d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.307547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5fbac-72b0-45f2-abee-d4605ae6ae5d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.310379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1007/2022] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:16.315536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f574b-d56b-4c8d-baf9-05a7c2f53042 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.316203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.316905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.317400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.317673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.318493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:16.318844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.320451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.331645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f574b-d56b-4c8d-baf9-05a7c2f53042 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.338027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.338747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.339089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.339628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.340278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.343578 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1016/2023] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:16.345692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.350371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.375002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25437d-d20f-4b1d-a3aa-f66aa745dcf3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.385171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.385930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.386261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.386651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.388797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.391309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.404718 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1008/2024] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:16.405981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.441133 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1017/2025] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/projects => generated 409 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:16.443419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.477143 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:16.507854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddffa2f-89c1-448f-b1bd-81ec94bde1cc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.571333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec85e2-61e6-472c-99ac-7f6621731f0d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.581366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.582423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.582935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.583881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.584898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.587723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.608648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.610069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.610577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.610913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.612484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.617734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.622823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1018/2026] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/users => generated 305 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:16.624175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.637635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c618d7-bc48-4b27-8abe-465eddb5a712 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.650998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.651631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.652225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.652509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.653356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.655679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.667406 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1009/2027] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:16.671703 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1019/2028] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:16.672557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.673805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.686746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8fb32-6888-48ca-8bd2-767ca9947faf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.687488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d22be-d9d2-4461-8a5b-f603f0d18732 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.692528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.693393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.693673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.693936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.694510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.694635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.695242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.695566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.695890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.696723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.699532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.701353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.716462 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1020/2029] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:16.720348 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1010/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:16.720484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.721706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.731167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd445bf-e70a-406b-a199-e8fc02877809 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.733629 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:16.738448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6314c5-abd1-4d1a-a181-9e7c8b672e90 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.740246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.741044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.741403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.741805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] PATH_INFO: `/v3/projects/918470d4bcca47a7bac477b0b4cfbe56/users/9d857558e84e4572ba784f68feff9923/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.749890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda18f-eb7c-467e-b94f-eca8503d567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.751923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda18f-eb7c-467e-b94f-eca8503d567c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.752271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda18f-eb7c-467e-b94f-eca8503d567c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.752610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda18f-eb7c-467e-b94f-eca8503d567c admin admin] PATH_INFO: `/v3/projects/b1f522fa76fd4ecca08ba1229592396d/users/677582494cbf49e5b430af8d3b52e0a7/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.769189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=918470d4bcca47a7bac477b0b4cfbe56, user_id=9d857558e84e4572ba784f68feff9923, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.771787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.771974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda18f-eb7c-467e-b94f-eca8503d567c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f522fa76fd4ecca08ba1229592396d, user_id=677582494cbf49e5b430af8d3b52e0a7, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.775456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda18f-eb7c-467e-b94f-eca8503d567c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.796073 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1011/2031] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:16 2022] PUT /identity/v3/projects/b1f522fa76fd4ecca08ba1229592396d/users/677582494cbf49e5b430af8d3b52e0a7/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:16.797703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2d98-7492-4a61-b3c2-6a018a04c174 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.797985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2d98-7492-4a61-b3c2-6a018a04c174 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.798415 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1021/2032] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:16 2022] PUT /identity/v3/projects/918470d4bcca47a7bac477b0b4cfbe56/users/9d857558e84e4572ba784f68feff9923/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:16.799489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2d98-7492-4a61-b3c2-6a018a04c174 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.799877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.800952 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1012/2033] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:16.811336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cdfb8-9023-4d7b-a59f-09ef7b45671d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.811644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cdfb8-9023-4d7b-a59f-09ef7b45671d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.811896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cdfb8-9023-4d7b-a59f-09ef7b45671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.847349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4b9cdfb8-9023-4d7b-a59f-09ef7b45671d None None] MFA Rules not processed for user `9d857558e84e4572ba784f68feff9923`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:16.848587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b9cdfb8-9023-4d7b-a59f-09ef7b45671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:16.889534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8e44f-73fb-43b4-8fa1-93e712f9c89d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.897562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.897753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.900837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.901191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.901890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.903759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.916065 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1022/2034] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:16.917241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:03:16.919456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:16.960345 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1013/2035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:16.961635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cdfb8-9023-4d7b-a59f-09ef7b45671d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:16.974652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cdfb8-9023-4d7b-a59f-09ef7b45671d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:16.980836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:16.981594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:16.981955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:16.982226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] PATH_INFO: `/v3/projects/b1f522fa76fd4ecca08ba1229592396d/users/677582494cbf49e5b430af8d3b52e0a7/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:16.986123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f522fa76fd4ecca08ba1229592396d, user_id=677582494cbf49e5b430af8d3b52e0a7, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:16.990736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:16.993921 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:17.021343 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1014/2036] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:16 2022] PUT /identity/v3/projects/b1f522fa76fd4ecca08ba1229592396d/users/677582494cbf49e5b430af8d3b52e0a7/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:17.021343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.038187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.039766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.120785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2702fc-f20d-4b96-a79e-4664f1b6a067 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.122581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f7ee-23a3-4541-ad50-d16d9203fa7e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.130083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2761-6271-4e84-9c35-9c8a0cf73aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.130996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2761-6271-4e84-9c35-9c8a0cf73aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.131279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2761-6271-4e84-9c35-9c8a0cf73aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.131555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2761-6271-4e84-9c35-9c8a0cf73aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.132199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2761-6271-4e84-9c35-9c8a0cf73aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.134226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2761-6271-4e84-9c35-9c8a0cf73aa4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.167253 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1015/2037] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:17 2022] POST /identity/v3/projects => generated 409 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:17.167253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df41c88-1754-4460-b183-7722994a3bbd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.167253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df41c88-1754-4460-b183-7722994a3bbd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.167253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df41c88-1754-4460-b183-7722994a3bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.196856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f1bb964d8474a77aa5ef3ef083c3067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58343bad37d94e1f83d480ecfcd013d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.197573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.200419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.200552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0df41c88-1754-4460-b183-7722994a3bbd None None] MFA Rules not processed for user `677582494cbf49e5b430af8d3b52e0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:17.200633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.200718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0df41c88-1754-4460-b183-7722994a3bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.200791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.201475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.203664 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1023/2038] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:03:16 2022] GET /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 383 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:17.204741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.217157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f47bdb-7719-4d2d-b5b0-5cc228a64270 tempest-QuotasAdminNegativeTest-13394895 tempest-QuotasAdminNegativeTest-13394895-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.244339 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:17.311445 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1016/2039] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:17.311881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.311881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.311881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.312474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.313100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.313199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb834b1-4a40-4b60-b8fd-ad1e2c47bca2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.315952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb834b1-4a40-4b60-b8fd-ad1e2c47bca2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.315952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb834b1-4a40-4b60-b8fd-ad1e2c47bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.317392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.343157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3cb834b1-4a40-4b60-b8fd-ad1e2c47bca2 None None] MFA Rules not processed for user `c5b530242b564a56b55d4b9f49066232`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:17.345127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3cb834b1-4a40-4b60-b8fd-ad1e2c47bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.345869 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1024/2040] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:17 2022] POST /identity/v3/users => generated 311 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:17.346670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.348306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.363147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3e88-63ff-45c3-9973-4c15ad81a509 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.368258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.368971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.369422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.369700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] PATH_INFO: `/v3/users/81ccf484fd634aef9256f5af3c5fcdcf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.370874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ccf484fd634aef9256f5af3c5fcdcf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.373038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.398553 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:17.413275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1017/2041] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:17.414791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb834b1-4a40-4b60-b8fd-ad1e2c47bca2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.426758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb834b1-4a40-4b60-b8fd-ad1e2c47bca2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.432154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.432746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ccf484fd634aef9256f5af3c5fcdcf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:17.432876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.433289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.433588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.433795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ccf484fd634aef9256f5af3c5fcdcf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:17.434223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.434632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ccf484fd634aef9256f5af3c5fcdcf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:17.435838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.446989 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1018/2042] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:17.447785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.449582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.450596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ccf484fd634aef9256f5af3c5fcdcf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:17.458216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ccf484fd634aef9256f5af3c5fcdcf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:17.472061 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1025/2043] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:17 2022] DELETE /identity/v3/users/81ccf484fd634aef9256f5af3c5fcdcf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:17.472838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.474213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.526912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d993-44a8-4cdf-8714-d69efe8467a7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.542603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2291bd-ef05-4106-9005-bb3626d00c8d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.548242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c21b0-083f-491f-9fdf-0daf92a45ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.548901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c21b0-083f-491f-9fdf-0daf92a45ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.549213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c21b0-083f-491f-9fdf-0daf92a45ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.549491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c21b0-083f-491f-9fdf-0daf92a45ae1 admin admin] PATH_INFO: `/v3/projects/e8de3bdfe9bd48b8a3da4afa63ff59a8/users/7d35217b6474400dbb0e01598018f5a9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.565566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c21b0-083f-491f-9fdf-0daf92a45ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8de3bdfe9bd48b8a3da4afa63ff59a8, user_id=7d35217b6474400dbb0e01598018f5a9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.568429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c21b0-083f-491f-9fdf-0daf92a45ae1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.582087 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1026/2044] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:17 2022] PUT /identity/v3/projects/e8de3bdfe9bd48b8a3da4afa63ff59a8/users/7d35217b6474400dbb0e01598018f5a9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:17.582848 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:17.583583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b77b0-dbfc-40f4-9668-1bc79f867f06 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.584030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b77b0-dbfc-40f4-9668-1bc79f867f06 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.584218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b77b0-dbfc-40f4-9668-1bc79f867f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.596798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.597442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.597717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.597987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.599733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.604028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bd1b77b0-dbfc-40f4-9668-1bc79f867f06 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:17.605415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd1b77b0-dbfc-40f4-9668-1bc79f867f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.661055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.663132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.667939 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1027/2045] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:17.668655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b77b0-dbfc-40f4-9668-1bc79f867f06 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.675654 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1019/2046] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:17.678066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b77b0-dbfc-40f4-9668-1bc79f867f06 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.678634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.679963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.683231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.683554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.683833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.684102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.684742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.686354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.700693 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1028/2047] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:17.701761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.714979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287325-c6e4-40a2-ac1b-f19001fa8680 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.721092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bad75-dbd3-4d54-bcd0-75598e8fc43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.721932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bad75-dbd3-4d54-bcd0-75598e8fc43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.722212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bad75-dbd3-4d54-bcd0-75598e8fc43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.722489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bad75-dbd3-4d54-bcd0-75598e8fc43e admin admin] PATH_INFO: `/v3/projects/e8de3bdfe9bd48b8a3da4afa63ff59a8/users/7d35217b6474400dbb0e01598018f5a9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.724582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bad75-dbd3-4d54-bcd0-75598e8fc43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8de3bdfe9bd48b8a3da4afa63ff59a8, user_id=7d35217b6474400dbb0e01598018f5a9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.727461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bad75-dbd3-4d54-bcd0-75598e8fc43e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.734153 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:17.740408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1029/2048] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:17 2022] PUT /identity/v3/projects/e8de3bdfe9bd48b8a3da4afa63ff59a8/users/7d35217b6474400dbb0e01598018f5a9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:17.746806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc84061-3690-485e-a248-4dc6f1ab359c service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.750970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.751263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.751535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.784459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] MFA Rules not processed for user `7d35217b6474400dbb0e01598018f5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:17.785889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.801441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.802128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.802447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.802784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.865825 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1030/2049] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:17.869992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.871405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.877228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:17.878777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:17.882842 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1020/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:03:17.955853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e15ed-469d-43fb-9c95-d389c99643c6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:17.961451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:17.962077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:17.962375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:17.962633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:17.972247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:17.973886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:17.983988 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1031/2051] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:03:18.288190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:18.294534 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:18.303469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250b388-2740-4513-8458-75aeb9be734c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:18.311100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:18.311724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:18.312021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:18.312371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:18.314983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:18.390278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:18.392737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:18.405962 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1021/2052] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:18.580389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:18.592086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55bc01-5e7a-4d38-8f23-e8edfdad13a7 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:18.597972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:18.598828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:18.599255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:18.599676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] PATH_INFO: `/v3/users/9d857558e84e4572ba784f68feff9923` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:18.602583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d857558e84e4572ba784f68feff9923)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:18.604664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:18.637446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:18.639551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:18.658443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8346296-142b-4478-9331-6bdae10f9952 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:18.665982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:18.667123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:18.668067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:18.669260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] PATH_INFO: `/v3/projects/cf36a9526e55469dba6f70ba6d2f9060` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:18.673023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf36a9526e55469dba6f70ba6d2f9060)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:18.683415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d857558e84e4572ba784f68feff9923'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.684620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d857558e84e4572ba784f68feff9923'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.685871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d857558e84e4572ba784f68feff9923'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.692874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:18.707495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d857558e84e4572ba784f68feff9923'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.708775 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:18.718451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-737fc625-b56c-4da7-8a3a-4a32c37755ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d857558e84e4572ba784f68feff9923'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.736774 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1032/2053] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:18 2022] DELETE /identity/v3/users/9d857558e84e4572ba784f68feff9923 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:18.742436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:18.742962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:18.743586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:18.766850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf36a9526e55469dba6f70ba6d2f9060', 'request_id': 'req-fb1eeabc-f733-4325-b160-9073abc38dd7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.768840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:18.771507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:18.775406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf36a9526e55469dba6f70ba6d2f9060', 'request_id': 'req-fb1eeabc-f733-4325-b160-9073abc38dd7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.785246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf36a9526e55469dba6f70ba6d2f9060', 'request_id': 'req-fb1eeabc-f733-4325-b160-9073abc38dd7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.801875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] The token cache is being invalidate because project cf36a9526e55469dba6f70ba6d2f9060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:18.802183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.803279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:18.805366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1022/2054] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:18 2022] DELETE /identity/v3/projects/cf36a9526e55469dba6f70ba6d2f9060 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:18.809025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:18.810814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:18.874935 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1033/2055] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:18.887072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:18.888904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:18.931319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eeabc-f733-4325-b160-9073abc38dd7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:18.936697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:18.937793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:18.938073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:18.938490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] PATH_INFO: `/v3/users/3f1bb964d8474a77aa5ef3ef083c3067` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:18.939741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1bb964d8474a77aa5ef3ef083c3067)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:18.941904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:18.963789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c6bac-3515-406c-86ef-8a608134ab9b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:18.970100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:18.970649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:18.970928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:18.971196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:18.981386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:18.983469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:18.996646 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1034/2056] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:18.996842 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:19.046524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1bb964d8474a77aa5ef3ef083c3067'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.047444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1bb964d8474a77aa5ef3ef083c3067'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.048082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1bb964d8474a77aa5ef3ef083c3067'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.058783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1bb964d8474a77aa5ef3ef083c3067'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.075643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1bb964d8474a77aa5ef3ef083c3067'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.099899 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1023/2057] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:18 2022] DELETE /identity/v3/users/3f1bb964d8474a77aa5ef3ef083c3067 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:19.686283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:19.688448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:19.712122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341defbb-e5eb-42d5-a89f-867be573e729 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:19.764747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:19.767346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:19.803516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:19.804511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:19.804657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:19.804804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] PATH_INFO: `/v3/projects/918470d4bcca47a7bac477b0b4cfbe56` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:19.806601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918470d4bcca47a7bac477b0b4cfbe56)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:19.810519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:19.856003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0560a95-30c7-4a9c-9d10-82ea4983006f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:19.857129 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:19.863007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:19.863733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:19.864077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:19.864456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] PATH_INFO: `/v3/projects/58343bad37d94e1f83d480ecfcd013d1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:19.865694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58343bad37d94e1f83d480ecfcd013d1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:19.867821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:19.900707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918470d4bcca47a7bac477b0b4cfbe56', 'request_id': 'req-b2b14422-e221-443e-b3b6-d50687058849'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.913612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918470d4bcca47a7bac477b0b4cfbe56', 'request_id': 'req-b2b14422-e221-443e-b3b6-d50687058849'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.931419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918470d4bcca47a7bac477b0b4cfbe56', 'request_id': 'req-b2b14422-e221-443e-b3b6-d50687058849'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.945636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58343bad37d94e1f83d480ecfcd013d1', 'request_id': 'req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.959754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58343bad37d94e1f83d480ecfcd013d1', 'request_id': 'req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.966412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] The token cache is being invalidate because project 918470d4bcca47a7bac477b0b4cfbe56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:19.966915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.969380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:19.973211 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1035/2058] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:19 2022] DELETE /identity/v3/projects/918470d4bcca47a7bac477b0b4cfbe56 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:19.976911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:19.978499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:19.986268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58343bad37d94e1f83d480ecfcd013d1', 'request_id': 'req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.006878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] The token cache is being invalidate because project 58343bad37d94e1f83d480ecfcd013d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:20.007186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.007915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b30dc2d5-bee9-4efb-a25a-1fde23e1af0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.010113 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1024/2059] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:19 2022] DELETE /identity/v3/projects/58343bad37d94e1f83d480ecfcd013d1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:20.017615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a4d5e-2afc-4994-88fe-ec2589c55f72 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.017966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a4d5e-2afc-4994-88fe-ec2589c55f72 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.018306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a4d5e-2afc-4994-88fe-ec2589c55f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.038835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-341a4d5e-2afc-4994-88fe-ec2589c55f72 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:20.040501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-341a4d5e-2afc-4994-88fe-ec2589c55f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:20.061981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14422-e221-443e-b3b6-d50687058849 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.072881 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:20.108240 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1025/2060] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:20.116634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9692a-79c5-445f-9cf1-637dec34d1fd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.116920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9692a-79c5-445f-9cf1-637dec34d1fd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.117229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9692a-79c5-445f-9cf1-637dec34d1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.120796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.121458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.121739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.122058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] PATH_INFO: `/v3/users/7d35217b6474400dbb0e01598018f5a9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.123204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d35217b6474400dbb0e01598018f5a9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.126269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.136130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e9b9692a-79c5-445f-9cf1-637dec34d1fd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:20.137364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e9b9692a-79c5-445f-9cf1-637dec34d1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:20.147534 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1026/2061] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:20.151578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9692a-79c5-445f-9cf1-637dec34d1fd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.164071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9692a-79c5-445f-9cf1-637dec34d1fd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.169458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.170056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.170358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.170624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.171314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:20.171545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.173279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.184930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d35217b6474400dbb0e01598018f5a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.185639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d35217b6474400dbb0e01598018f5a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.186265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d35217b6474400dbb0e01598018f5a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.186367 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1027/2062] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:20.191191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.192865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:20.198643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d35217b6474400dbb0e01598018f5a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.199802 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:20.206942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce6a97-2212-48b2-8f7d-14182444d877 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.209347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d35217b6474400dbb0e01598018f5a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.211913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.212599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.212880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.213178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.213890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.216125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.223245 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1036/2063] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:19 2022] DELETE /identity/v3/users/7d35217b6474400dbb0e01598018f5a9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:20.244486 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1028/2064] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:20 2022] POST /identity/v3/projects => generated 401 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:20.248673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.325911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef52f06-e092-4dd6-be4d-bb482e4b8e03 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.395946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.396704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.396989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.397307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.397949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.400088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.430787 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1037/2065] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:20 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:20.435272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.450968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8827293-2814-4176-a15d-4001d9b69676 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.459904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.460728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.461254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.461643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.462493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.464417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.476373 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1029/2066] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:20.480587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.493465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fc52c-2250-486f-aeaf-1c934f52a6ec admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.499448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8990ab-3ade-4e46-9e45-7b4df4dd92ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.500629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8990ab-3ade-4e46-9e45-7b4df4dd92ab admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.500914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8990ab-3ade-4e46-9e45-7b4df4dd92ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.501214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8990ab-3ade-4e46-9e45-7b4df4dd92ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.501922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8990ab-3ade-4e46-9e45-7b4df4dd92ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.503523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8990ab-3ade-4e46-9e45-7b4df4dd92ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.515887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1038/2067] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:03:20.520645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.538701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dab38e-508c-400d-815a-94909e87f9bf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.548479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.549270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.549589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.549915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] PATH_INFO: `/v3/projects/e4436b87f22f46c4828883c42ec2a11e/users/595eb86c446a4cfdb2f60fa049da2254/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.570208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4436b87f22f46c4828883c42ec2a11e, user_id=595eb86c446a4cfdb2f60fa049da2254, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.573525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.601003 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1030/2068] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:20 2022] PUT /identity/v3/projects/e4436b87f22f46c4828883c42ec2a11e/users/595eb86c446a4cfdb2f60fa049da2254/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:20.606221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.606587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.606816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.634405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:20.636321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:20.679300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.693201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:20.765112 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1039/2069] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:20.775235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:20.777259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:20.790114 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:20.827292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6275f-3813-4d53-b090-00f003edb86f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.834837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.835672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.836200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.836680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] PATH_INFO: `/v3/projects/e8de3bdfe9bd48b8a3da4afa63ff59a8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.838068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8de3bdfe9bd48b8a3da4afa63ff59a8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.840667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.856565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbf183-63f9-4ac4-9ef8-da2bc7c8e55b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:20.862422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b48f1c-7d5f-4890-860d-80ec4c69ec60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:20.863267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48f1c-7d5f-4890-860d-80ec4c69ec60 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.864382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48f1c-7d5f-4890-860d-80ec4c69ec60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.864382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48f1c-7d5f-4890-860d-80ec4c69ec60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.876015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b48f1c-7d5f-4890-860d-80ec4c69ec60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:20.877773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b48f1c-7d5f-4890-860d-80ec4c69ec60 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:20.888918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1040/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:20.904417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8de3bdfe9bd48b8a3da4afa63ff59a8', 'request_id': 'req-e69b583c-498c-47a1-9289-25740bc0d115'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.912833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8de3bdfe9bd48b8a3da4afa63ff59a8', 'request_id': 'req-e69b583c-498c-47a1-9289-25740bc0d115'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.917861 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:20.923979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8de3bdfe9bd48b8a3da4afa63ff59a8', 'request_id': 'req-e69b583c-498c-47a1-9289-25740bc0d115'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.960251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] The token cache is being invalidate because project e8de3bdfe9bd48b8a3da4afa63ff59a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:20.961003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.961812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e69b583c-498c-47a1-9289-25740bc0d115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:20.963984 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1031/2071] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:20 2022] DELETE /identity/v3/projects/e8de3bdfe9bd48b8a3da4afa63ff59a8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:20.970592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca1cf0-8c60-4686-9a1d-39fa1f01694a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:20.970961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca1cf0-8c60-4686-9a1d-39fa1f01694a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:20.971328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca1cf0-8c60-4686-9a1d-39fa1f01694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:20.995711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-baca1cf0-8c60-4686-9a1d-39fa1f01694a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:20.996938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-baca1cf0-8c60-4686-9a1d-39fa1f01694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:21.086002 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1041/2072] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:21.094177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c247e3-a6c8-4d52-96d3-eda86c232970 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.094925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c247e3-a6c8-4d52-96d3-eda86c232970 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.094925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c247e3-a6c8-4d52-96d3-eda86c232970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.120192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-65c247e3-a6c8-4d52-96d3-eda86c232970 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:21.121852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-65c247e3-a6c8-4d52-96d3-eda86c232970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:21.135605 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1032/2073] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:21.137827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca1cf0-8c60-4686-9a1d-39fa1f01694a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.153479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca1cf0-8c60-4686-9a1d-39fa1f01694a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.160879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.161924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.162496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.162928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.164208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:21.164523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:21.166259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:21.182284 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1042/2074] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:21.188539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c247e3-a6c8-4d52-96d3-eda86c232970 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.202629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c247e3-a6c8-4d52-96d3-eda86c232970 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.210352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.210973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.211257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.211696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.212372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:21.215543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:21.257237 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1033/2075] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:21 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:21.262203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.274042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd79f1a-a950-4102-b9f3-59e48608385f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.378139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.379644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.379923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.380363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.381016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:21.383697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:21.421211 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1043/2076] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:21 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:21.425231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.442980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606efed-8fb2-4baa-a03a-0556e24dfca1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.451756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.452627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.453040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.453678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.454665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:21.456624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:21.469450 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1034/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:21.473205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.485959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c38d6-4361-411a-b353-df01efc3fa1c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.492526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2114-3708-40d3-ac84-9ab4df3eaa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.494531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2114-3708-40d3-ac84-9ab4df3eaa01 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.494916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2114-3708-40d3-ac84-9ab4df3eaa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.495296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2114-3708-40d3-ac84-9ab4df3eaa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.496058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2114-3708-40d3-ac84-9ab4df3eaa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:21.498791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2114-3708-40d3-ac84-9ab4df3eaa01 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:21.518191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.519402 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1044/2078] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:21.535526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916a3cd-85d9-4272-b759-f722d67118ab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.541336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.542116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.542408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.542684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] PATH_INFO: `/v3/projects/731a310f1e1f4e6a9df50eea1e053259/users/92d56e7f729243e386f7ce8080cf864e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.563124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=731a310f1e1f4e6a9df50eea1e053259, user_id=92d56e7f729243e386f7ce8080cf864e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:21.566159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:21.590253 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1035/2079] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:21 2022] PUT /identity/v3/projects/731a310f1e1f4e6a9df50eea1e053259/users/92d56e7f729243e386f7ce8080cf864e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:21.596558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050765dd-ab99-43a1-b894-d0c500ef8205 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.597100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050765dd-ab99-43a1-b894-d0c500ef8205 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.597385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050765dd-ab99-43a1-b894-d0c500ef8205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.642099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-050765dd-ab99-43a1-b894-d0c500ef8205 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:21.644848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-050765dd-ab99-43a1-b894-d0c500ef8205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:21.677119 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:21.787133 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1045/2080] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:21.809477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:21.811833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:21.932577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef026-081d-43c7-9191-86285fa51000 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.934117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef026-081d-43c7-9191-86285fa51000 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.935322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef026-081d-43c7-9191-86285fa51000 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.938134 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1046/2081] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:03:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:21.944439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776e7f-fe75-4dbd-be43-2af3e77153ad None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.944856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776e7f-fe75-4dbd-be43-2af3e77153ad None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.945543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776e7f-fe75-4dbd-be43-2af3e77153ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:21.975500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7b8c2-6100-4f48-918e-4671cc5099ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:21.985442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b2776e7f-fe75-4dbd-be43-2af3e77153ad None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:21.987057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:21.988962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:21.989984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b2776e7f-fe75-4dbd-be43-2af3e77153ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:21.990373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:21.992020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:22.017588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:22.019762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:22.057127 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1036/2082] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:22.139264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1047/2083] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:22.171394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:22.175513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:22.176714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:22.177509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:22.179107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:22.230315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7d0d-40f3-4e65-bb14-27d2965a688b service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:22.240568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:22.246923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:22.247683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:22.257010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:22.257798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:22.258276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:22.268945 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1048/2084] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 11 01:03:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:22.280020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:22.282583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:22.295694 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1037/2085] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:22.316218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:22.318146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:22.334323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8f458-4b82-4ccb-a7b9-41d1b1d3e0a4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:22.356413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6543b4-02b3-4e99-8d62-2f8006da9743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:22.358393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6543b4-02b3-4e99-8d62-2f8006da9743 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:22.360361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6543b4-02b3-4e99-8d62-2f8006da9743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:22.364287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6543b4-02b3-4e99-8d62-2f8006da9743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:22.380588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6543b4-02b3-4e99-8d62-2f8006da9743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:22.382686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6543b4-02b3-4e99-8d62-2f8006da9743 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:22.405379 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1049/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:25.845363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:25.845980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:25.872036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb95aae-d1c3-4e36-8157-c156ec701c7c service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:25.886151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:25.886817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:25.893749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:25.895275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] PATH_INFO: `/v3/users/d688a902aa2e45d2bc64380e44d56885` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:25.898965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d688a902aa2e45d2bc64380e44d56885)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:25.904629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:26.024392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd688a902aa2e45d2bc64380e44d56885'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.025376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd688a902aa2e45d2bc64380e44d56885'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.036042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd688a902aa2e45d2bc64380e44d56885'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.044990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd688a902aa2e45d2bc64380e44d56885'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.054743 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:26.060799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd688a902aa2e45d2bc64380e44d56885'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.087298 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1038/2087] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:25 2022] DELETE /identity/v3/users/d688a902aa2e45d2bc64380e44d56885 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:26.088971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:26.089681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:26.089681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:26.130250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:26.131831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:26.283590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1050/2088] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:26.342038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:26.343720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:26.483488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e20b6-0e21-4b8a-87d2-d6ddbe1f18bc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:26.494732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:26.496086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:26.496580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:26.496871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:26.519005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:26.521950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:26.552032 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1039/2089] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:26.553461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:26.560194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:26.595358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:26.595584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7696dd6-fc71-4e2f-a43c-d105ccb3f82c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:26.597990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:26.616924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:26.617781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:26.618071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:26.618442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] PATH_INFO: `/v3/users/89700c91d2b5415a9bfb6d4fa59e0982` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:26.619867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89700c91d2b5415a9bfb6d4fa59e0982)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:26.626168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b45bc-519f-422e-99f5-ebd2b89b5462 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:26.638327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:26.638871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:26.642270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:26.642681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:26.646412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] PATH_INFO: `/v3/users/3d983b1226d14d4582ae7429602bd40a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:26.648508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d983b1226d14d4582ae7429602bd40a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:26.654512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:26.754449 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:26.774422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89700c91d2b5415a9bfb6d4fa59e0982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.782055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89700c91d2b5415a9bfb6d4fa59e0982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.782780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89700c91d2b5415a9bfb6d4fa59e0982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.798868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d983b1226d14d4582ae7429602bd40a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.799868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d983b1226d14d4582ae7429602bd40a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.801400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d983b1226d14d4582ae7429602bd40a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.814262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89700c91d2b5415a9bfb6d4fa59e0982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.824611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d983b1226d14d4582ae7429602bd40a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.839923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-88b6264d-bac3-42ac-a28c-26cacbec4e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89700c91d2b5415a9bfb6d4fa59e0982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.867687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dbf08557-fd88-489a-9ba5-d926bba6ca2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d983b1226d14d4582ae7429602bd40a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:26.872552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1051/2090] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:26 2022] DELETE /identity/v3/users/89700c91d2b5415a9bfb6d4fa59e0982 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:26.878693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:26.878984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:26.879263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:26.911341 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1040/2091] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:26 2022] DELETE /identity/v3/users/3d983b1226d14d4582ae7429602bd40a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:26.911341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:26.911341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:26.911341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:26.946445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:26.947701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:26.973781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:26.975155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:27.083760 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1052/2092] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:27.092426 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:27.112476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1041/2093] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:27.343435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:27.345376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:27.403295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:27.405658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:27.501444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35784421-8c34-4398-9d07-98db26f4c1dc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:27.510608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:27.517082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:27.517082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:27.517082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:27.517082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:27.586768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bd5c1-2174-4f49-a8bb-014c9c71df88 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:27.597025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:27.598036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:27.598480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:27.598905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:27.624032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:27.627767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:27.638175 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:27.642704 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1042/2094] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:27.643767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:27.653411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4828f7-9ecb-491c-9358-3ea0ffe1ad7d service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:27.660914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:27.662766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:27.663119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:27.663455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:27.675367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:27.677530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:27.688805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:27.690540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:27.702534 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1053/2095] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:27.704121 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1043/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:28.388165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:28.391003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:28.460921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2eb58-5e86-4d13-add1-0b9e8ab6fe81 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:28.471698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:28.472818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:28.473491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:28.473994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] PATH_INFO: `/v3/projects/b8e2ecabba564ea9abfe7305239efffc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:28.478493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e2ecabba564ea9abfe7305239efffc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:28.482076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:28.566253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:28.567805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:28.584693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278ea71-571b-4e0b-bcb0-f968e47729a1 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:28.614054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:28.614844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:28.615210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:28.615483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] PATH_INFO: `/v3/projects/20d7976f84f34c3d8cf8f41e0aaa052e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:28.622262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d7976f84f34c3d8cf8f41e0aaa052e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:28.627878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:28.720440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e2ecabba564ea9abfe7305239efffc', 'request_id': 'req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.741374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e2ecabba564ea9abfe7305239efffc', 'request_id': 'req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.765111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e2ecabba564ea9abfe7305239efffc', 'request_id': 'req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.799344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d7976f84f34c3d8cf8f41e0aaa052e', 'request_id': 'req-f3f41422-3d5a-4cf9-8daf-525867135e38'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.807115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] The token cache is being invalidate because project b8e2ecabba564ea9abfe7305239efffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:28.807421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.810317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.815838 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1054/2097] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:28 2022] DELETE /identity/v3/projects/b8e2ecabba564ea9abfe7305239efffc => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:28.820823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:28.832325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:28.841564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d7976f84f34c3d8cf8f41e0aaa052e', 'request_id': 'req-f3f41422-3d5a-4cf9-8daf-525867135e38'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.868869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d7976f84f34c3d8cf8f41e0aaa052e', 'request_id': 'req-f3f41422-3d5a-4cf9-8daf-525867135e38'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.931319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] The token cache is being invalidate because project 20d7976f84f34c3d8cf8f41e0aaa052e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:28.935758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.938776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:28.943743 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1044/2098] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:28 2022] DELETE /identity/v3/projects/20d7976f84f34c3d8cf8f41e0aaa052e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:28.953922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:28.960448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:29.060882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2c58-0e68-4e56-b0f0-9ed81e95f3ce admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:29.259648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:29.259946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f41422-3d5a-4cf9-8daf-525867135e38 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:29.260655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:29.260890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:29.261197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] PATH_INFO: `/v3/users/2c8d7d952fc245a19066d44a76d36005` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:29.263116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8d7d952fc245a19066d44a76d36005)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:29.268532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:29.297574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:29.298240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:29.298522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:29.301090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] PATH_INFO: `/v3/users/b538833da88b4c7e8319c94a8a94aa53` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:29.304051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b538833da88b4c7e8319c94a8a94aa53)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:29.305985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:29.313193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:29.371458 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:29.397314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8d7d952fc245a19066d44a76d36005'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.398294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8d7d952fc245a19066d44a76d36005'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.399762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8d7d952fc245a19066d44a76d36005'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.442458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8d7d952fc245a19066d44a76d36005'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.456701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b538833da88b4c7e8319c94a8a94aa53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.458925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b538833da88b4c7e8319c94a8a94aa53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.459888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c150c04a-08d1-4f8d-87c3-68d88a133c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8d7d952fc245a19066d44a76d36005'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.460339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b538833da88b4c7e8319c94a8a94aa53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.477386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b538833da88b4c7e8319c94a8a94aa53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.492936 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1055/2099] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:28 2022] DELETE /identity/v3/users/2c8d7d952fc245a19066d44a76d36005 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:29.503320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b538833da88b4c7e8319c94a8a94aa53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:29.528164 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1045/2100] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:28 2022] DELETE /identity/v3/users/b538833da88b4c7e8319c94a8a94aa53 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:30.266686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:30.267712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:30.268096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:30.344716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] MFA Rules not processed for user `595eb86c446a4cfdb2f60fa049da2254`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:30.346550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:30.444824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:30.446564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:30.511621 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1056/2101] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:30.513731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:30.515323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:30.595047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135dc5b-d42b-42c1-ad8e-8a5ec16df501 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:30.608593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:30.608593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:30.608593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:30.608593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] PATH_INFO: `/v3/projects/b0c9fae150e14c59a3d27f969c600056` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:30.609779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c9fae150e14c59a3d27f969c600056)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:30.612114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:30.705414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c9fae150e14c59a3d27f969c600056', 'request_id': 'req-6941ac42-72e0-40cb-afc0-81a849d07e05'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:30.713111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c9fae150e14c59a3d27f969c600056', 'request_id': 'req-6941ac42-72e0-40cb-afc0-81a849d07e05'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:30.726069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c9fae150e14c59a3d27f969c600056', 'request_id': 'req-6941ac42-72e0-40cb-afc0-81a849d07e05'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:30.741687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] The token cache is being invalidate because project b0c9fae150e14c59a3d27f969c600056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:30.742311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:30.743606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:30.746609 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1046/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:30 2022] DELETE /identity/v3/projects/b0c9fae150e14c59a3d27f969c600056 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:30.748382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:30.755774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:30.761357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e99a6-8d8f-4fc1-b326-25c5e59d0178 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:30.800220 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:30.820318 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:30.872773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ac42-72e0-40cb-afc0-81a849d07e05 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:30.881241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:30.883299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:30.883500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:30.883769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] PATH_INFO: `/v3/users/383e9a9d4d804959a910427cd1665b2c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:30.887505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383e9a9d4d804959a910427cd1665b2c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:30.897041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:30.914045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:30.914665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:30.915022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:30.915296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:30.917495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.006850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383e9a9d4d804959a910427cd1665b2c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.008439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383e9a9d4d804959a910427cd1665b2c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.013564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383e9a9d4d804959a910427cd1665b2c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.023116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383e9a9d4d804959a910427cd1665b2c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.040698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383e9a9d4d804959a910427cd1665b2c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.058580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1047/2103] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:30 2022] DELETE /identity/v3/users/383e9a9d4d804959a910427cd1665b2c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:31.061501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:31.061590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:31.061685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.063860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:31.088030 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1057/2104] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:31.090343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:31.093594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.129322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7addb-1647-4957-8fa4-8b9fb69eb6f5 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:31.152756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4114-f8bf-4ab5-9356-e7b6cf452984 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:31.159547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:31.160269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:31.160665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:31.161002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] PATH_INFO: `/v3/users/6d2d3505e36f43ca9f6195725b21a057` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:31.163095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2d3505e36f43ca9f6195725b21a057)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:31.168022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:31.232473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:31.233339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:31.233621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:31.234047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] PATH_INFO: `/v3/projects/60478b46cc0e4ed295535670700a191f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:31.237989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60478b46cc0e4ed295535670700a191f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:31.241384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:31.256342 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:31.270529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2d3505e36f43ca9f6195725b21a057'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.273779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2d3505e36f43ca9f6195725b21a057'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.278032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2d3505e36f43ca9f6195725b21a057'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.317314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2d3505e36f43ca9f6195725b21a057'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.338325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60478b46cc0e4ed295535670700a191f', 'request_id': 'req-b16e74e5-13a5-4469-a387-598f1c7dd929'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.347260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60478b46cc0e4ed295535670700a191f', 'request_id': 'req-b16e74e5-13a5-4469-a387-598f1c7dd929'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.350072 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:31.356014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60478b46cc0e4ed295535670700a191f', 'request_id': 'req-b16e74e5-13a5-4469-a387-598f1c7dd929'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.370971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e37295fd-1054-4991-8d9f-dfea81e60764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2d3505e36f43ca9f6195725b21a057'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.381415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] The token cache is being invalidate because project 60478b46cc0e4ed295535670700a191f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:31.381823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.382701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.384868 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1058/2105] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:31 2022] DELETE /identity/v3/projects/60478b46cc0e4ed295535670700a191f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:31.385672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:31.387198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.409390 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1048/2106] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:31 2022] DELETE /identity/v3/users/6d2d3505e36f43ca9f6195725b21a057 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:31.414406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01a9d-2e29-4b1f-94a5-2c1f1e1d0997 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:31.414705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01a9d-2e29-4b1f-94a5-2c1f1e1d0997 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:31.414986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01a9d-2e29-4b1f-94a5-2c1f1e1d0997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:31.457206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5ed01a9d-2e29-4b1f-94a5-2c1f1e1d0997 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:31.459038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ed01a9d-2e29-4b1f-94a5-2c1f1e1d0997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.517440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e74e5-13a5-4469-a387-598f1c7dd929 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:31.615311 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1049/2107] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:31.617496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432dc7-9755-4803-a622-f78283136af0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:31.620172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432dc7-9755-4803-a622-f78283136af0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:31.621632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432dc7-9755-4803-a622-f78283136af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:31.667556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-be432dc7-9755-4803-a622-f78283136af0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:31.672640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-be432dc7-9755-4803-a622-f78283136af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.693955 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1050/2108] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:31.695179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432dc7-9755-4803-a622-f78283136af0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:31.704367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-be432dc7-9755-4803-a622-f78283136af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.705446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:31.706385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:31.706522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:31.706708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] PATH_INFO: `/v3/projects/c2295f5b038e473ab35589a6591315a6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:31.707902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2295f5b038e473ab35589a6591315a6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:31.710003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:31.793638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2295f5b038e473ab35589a6591315a6', 'request_id': 'req-b4b8de0e-eb79-43de-9942-b6cad227e957'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.802479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2295f5b038e473ab35589a6591315a6', 'request_id': 'req-b4b8de0e-eb79-43de-9942-b6cad227e957'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.827282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2295f5b038e473ab35589a6591315a6', 'request_id': 'req-b4b8de0e-eb79-43de-9942-b6cad227e957'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.850404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432dc7-9755-4803-a622-f78283136af0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:31.856943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] The token cache is being invalidate because project c2295f5b038e473ab35589a6591315a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:31.857668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.860957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4b8de0e-eb79-43de-9942-b6cad227e957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:31.863381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1059/2109] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:31 2022] DELETE /identity/v3/projects/c2295f5b038e473ab35589a6591315a6 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:31.865461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850859c7-604b-412f-a530-a95b98f385d1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:31.865973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850859c7-604b-412f-a530-a95b98f385d1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:31.866747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850859c7-604b-412f-a530-a95b98f385d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:31.929397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-850859c7-604b-412f-a530-a95b98f385d1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:31.930650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-850859c7-604b-412f-a530-a95b98f385d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.964991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:31.965671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:31.965952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:31.966225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:31.971656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:31.985267 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:32.050110 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:32.096978 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1060/2110] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:32.098775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e59695-c8ac-4877-bd8e-550330b2e9c2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.100211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e59695-c8ac-4877-bd8e-550330b2e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.100728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e59695-c8ac-4877-bd8e-550330b2e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.115288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.116845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.128319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-44e59695-c8ac-4877-bd8e-550330b2e9c2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:32.129926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-44e59695-c8ac-4877-bd8e-550330b2e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:32.136627 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1051/2111] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:32.137887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.144446 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1061/2112] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:32.153530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69d88-d9c9-4676-b2e3-b48c8c79e6c0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.153840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69d88-d9c9-4676-b2e3-b48c8c79e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.154072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca69d88-d9c9-4676-b2e3-b48c8c79e6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.164175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd0cca-4a8b-4ab3-8e03-575a4d8d2f3a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.184911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.185770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.186138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.186416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.187866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:32.191167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-eca69d88-d9c9-4676-b2e3-b48c8c79e6c0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:32.192397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-eca69d88-d9c9-4676-b2e3-b48c8c79e6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:32.193459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.195373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.203282 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1062/2113] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:32.208965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca69d88-d9c9-4676-b2e3-b48c8c79e6c0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.222437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca69d88-d9c9-4676-b2e3-b48c8c79e6c0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.226583 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1052/2114] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:32.231514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.232537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.233530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.233890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.234739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.236186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:32.236568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.238353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.260218 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1063/2115] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:32.261617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.263970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31d5d3-ebf5-411d-a648-10f18aaa8864 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.279465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.282305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.282599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.283857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.284537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.285763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c195c3-8c61-41b2-9997-54287f847039 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.291755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.302181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.303024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.303282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.303560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.304211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.307959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.361759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1053/2116] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:32.372069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.384992 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1064/2117] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:32.389172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.517951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891024fc-6c9c-497c-8f08-902664b07ded admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.523652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.524432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.524715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.524989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.525786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.528123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.561596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9924578-1395-47c8-96d7-944e805292b2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.566241 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1065/2118] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:32.571260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.577007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.579890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.580371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.581468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.583098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.590220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.604436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49106528-7491-4aa9-a98f-f4e3bdd1930f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.616298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.621682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.622048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.622291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.622901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.631419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.665424 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1054/2119] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:32.668127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1066/2120] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:32.670107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.682057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.696204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc384d7b-f6dd-4de6-852c-1e2b649d525e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.711930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.713371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.713728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.714549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.716256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.722054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.722588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5325c-9e1d-48fc-bd30-8e2e61935b7b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.743597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.744202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.744480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.744750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.745486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.751123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.751862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1055/2121] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:32.755670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.775342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93605b-210b-4527-b8e9-0b1e2cfc8061 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.784808 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1067/2122] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:32.789962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.790192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.790786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.791064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.792573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.792573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.793598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.821163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1056/2123] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:32.825160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:32.826233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15447b11-21da-4f06-8320-d9df6f79d122 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.841936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c5b13-7342-454c-8087-dd3bd163be40 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:32.842909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea748-14c9-41dd-88c4-f7ebc7275699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.844879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea748-14c9-41dd-88c4-f7ebc7275699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.845582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea748-14c9-41dd-88c4-f7ebc7275699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.846059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea748-14c9-41dd-88c4-f7ebc7275699 admin admin] PATH_INFO: `/v3/projects/efa1d1d8d8b34ffaa4db7962eb48d90e/users/dab5c7e91efd4eb693a6127918cab0f7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.861985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93e980-9f34-4b26-b729-12ca42969242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:32.862675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e980-9f34-4b26-b729-12ca42969242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.862953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e980-9f34-4b26-b729-12ca42969242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.863225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e980-9f34-4b26-b729-12ca42969242 admin admin] PATH_INFO: `/v3/projects/29c587c4aba443d3b2d1bc4895baea64/users/60ce2a11f47e4e92a51293aca8878034/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.892036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93e980-9f34-4b26-b729-12ca42969242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c587c4aba443d3b2d1bc4895baea64, user_id=60ce2a11f47e4e92a51293aca8878034, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.893928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ea748-14c9-41dd-88c4-f7ebc7275699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa1d1d8d8b34ffaa4db7962eb48d90e, user_id=dab5c7e91efd4eb693a6127918cab0f7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:32.894811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93e980-9f34-4b26-b729-12ca42969242 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.900204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ea748-14c9-41dd-88c4-f7ebc7275699 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:32.923115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1057/2124] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:32 2022] PUT /identity/v3/projects/29c587c4aba443d3b2d1bc4895baea64/users/60ce2a11f47e4e92a51293aca8878034/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:32.933652 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1068/2125] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:32 2022] PUT /identity/v3/projects/efa1d1d8d8b34ffaa4db7962eb48d90e/users/dab5c7e91efd4eb693a6127918cab0f7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:32.934508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700157-0018-4196-a768-1c3b1469be91 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.935019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700157-0018-4196-a768-1c3b1469be91 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.935268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700157-0018-4196-a768-1c3b1469be91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.946417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:32.946806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:32.947746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:32.991747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-67700157-0018-4196-a768-1c3b1469be91 None None] MFA Rules not processed for user `60ce2a11f47e4e92a51293aca8878034`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:32.993157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67700157-0018-4196-a768-1c3b1469be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.003042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] MFA Rules not processed for user `dab5c7e91efd4eb693a6127918cab0f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:33.004536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.026519 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:33.033166 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:33.141184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1058/2126] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:33.141184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67700157-0018-4196-a768-1c3b1469be91 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:33.142805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67700157-0018-4196-a768-1c3b1469be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.189407 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1069/2127] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:33.190463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:33.195787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.250705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67700157-0018-4196-a768-1c3b1469be91 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:33.265240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:33.267846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:33.268730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:33.269249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] PATH_INFO: `/v3/projects/de6beb0045614935943ec3ee2d699b03` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:33.270655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6beb0045614935943ec3ee2d699b03)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:33.275797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:33.277990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee4cd3-f304-4577-9185-85ceb2b8abc9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:33.291426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:33.292432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:33.292924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:33.293387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] PATH_INFO: `/v3/projects/f8b88f171d6b4535a1e47d852b09f4b4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:33.294978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b88f171d6b4535a1e47d852b09f4b4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:33.298335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:33.377361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6beb0045614935943ec3ee2d699b03', 'request_id': 'req-8be5bb0c-f3da-4d19-882e-f118c1204335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.387146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6beb0045614935943ec3ee2d699b03', 'request_id': 'req-8be5bb0c-f3da-4d19-882e-f118c1204335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.399782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6beb0045614935943ec3ee2d699b03', 'request_id': 'req-8be5bb0c-f3da-4d19-882e-f118c1204335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.406997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b88f171d6b4535a1e47d852b09f4b4', 'request_id': 'req-ef0e5901-7050-41e8-988f-ffddee494e1b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.420852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b88f171d6b4535a1e47d852b09f4b4', 'request_id': 'req-ef0e5901-7050-41e8-988f-ffddee494e1b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.426894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] The token cache is being invalidate because project de6beb0045614935943ec3ee2d699b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:33.427190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.427870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.429722 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1059/2128] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:33 2022] DELETE /identity/v3/projects/de6beb0045614935943ec3ee2d699b03 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:33.430513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:33.431841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.439646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b88f171d6b4535a1e47d852b09f4b4', 'request_id': 'req-ef0e5901-7050-41e8-988f-ffddee494e1b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.461961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] The token cache is being invalidate because project f8b88f171d6b4535a1e47d852b09f4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:33.462259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.464035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:33.466379 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1070/2129] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:33 2022] DELETE /identity/v3/projects/f8b88f171d6b4535a1e47d852b09f4b4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:33.472870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:33.476519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.533253 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:33.560157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5bb0c-f3da-4d19-882e-f118c1204335 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:33.614714 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:33.668795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e5901-7050-41e8-988f-ffddee494e1b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:33.682908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110eb606-f0b6-4239-94be-11a79a2dc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:33.683377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eb606-f0b6-4239-94be-11a79a2dc0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:33.683656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eb606-f0b6-4239-94be-11a79a2dc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:33.683976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110eb606-f0b6-4239-94be-11a79a2dc0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:33.684572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eb606-f0b6-4239-94be-11a79a2dc0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:33.689390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110eb606-f0b6-4239-94be-11a79a2dc0d3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:33.764148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:33.764874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:33.765092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:33.765527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:33.766320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:33.768313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:33.790485 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1071/2130] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:33 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:33.791952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b77a0-d5e8-44d5-ad06-1557e2eb61c2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:33.792290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b77a0-d5e8-44d5-ad06-1557e2eb61c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:33.792568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b77a0-d5e8-44d5-ad06-1557e2eb61c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:33.829802 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1060/2131] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:33 2022] POST /identity/v3/projects => generated 385 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:33.830759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:33.834700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-983b77a0-d5e8-44d5-ad06-1557e2eb61c2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:33.835910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-983b77a0-d5e8-44d5-ad06-1557e2eb61c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.837467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:33.955818 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1072/2132] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:33.956880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b77a0-d5e8-44d5-ad06-1557e2eb61c2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:33.969609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b77a0-d5e8-44d5-ad06-1557e2eb61c2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:33.975959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:33.976593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:33.976874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:33.977179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:33.977826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:33.980020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.038083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9eaab-5099-41c8-96d6-45ad0061cbb1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.044465 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1073/2133] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:33 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:34.047357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.051471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:34.066613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.067365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.068299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.068299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] PATH_INFO: `/v3/users/e6273cf4dc1844de9d5a6ba94aca78e8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.069344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6273cf4dc1844de9d5a6ba94aca78e8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.073251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.126970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f28625-6627-4beb-a3ee-bd9f9808429d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.141598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c657b-af47-47ce-8c52-34bf04afb360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.144991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c657b-af47-47ce-8c52-34bf04afb360 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.145430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c657b-af47-47ce-8c52-34bf04afb360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.145714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c657b-af47-47ce-8c52-34bf04afb360 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.147251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c657b-af47-47ce-8c52-34bf04afb360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.149623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c657b-af47-47ce-8c52-34bf04afb360 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.236645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6273cf4dc1844de9d5a6ba94aca78e8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:34.237745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6273cf4dc1844de9d5a6ba94aca78e8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:34.238209 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1074/2134] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:34 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:34.239399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6273cf4dc1844de9d5a6ba94aca78e8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:34.241284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.241574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.241872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.259382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6273cf4dc1844de9d5a6ba94aca78e8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:34.290976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6273cf4dc1844de9d5a6ba94aca78e8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:34.293911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:34.298253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:34.323383 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:34.338652 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1061/2135] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:33 2022] DELETE /identity/v3/users/e6273cf4dc1844de9d5a6ba94aca78e8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:34.338652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.338962 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1075/2136] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:34.339064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.342459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:34.345022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:34.372340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb3ec-90f3-4921-9e10-9946c58526d9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.497483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf4072-f143-46a3-8282-e10ddbd04cc2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.514695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.515933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.516284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.516515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.518332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.518332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.518525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.518840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.519397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.520287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.523892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.525320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.561875 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1062/2137] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:34.565342 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1076/2138] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:34.570781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.571174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.589922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511b3b-70f4-4981-a254-865a760a0e2c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.594206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf954db-3729-4b98-8f81-a5c057fb51c2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.599881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.600544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.600828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.601131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.602594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:34.603187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.604048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.604166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.604683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.605760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.607465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] PATH_INFO: `/v3/projects/4c7768f0581846c4aa30af918a3702ec/users/dafbf5b7c9a94a1badf6b148e59d2583/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.626265 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1063/2139] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:34.627485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.638833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7768f0581846c4aa30af918a3702ec, user_id=dafbf5b7c9a94a1badf6b148e59d2583, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.642271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.643129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9006a-7015-4514-acd3-09aff4734b15 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.653314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.654516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.654978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.656048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] PATH_INFO: `/v3/projects/b0d367b1ba7c4aa59d7adb487d4f56ef/users/f504ceea0eab4699aa8b045e04c3a882/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.658963 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:34.669104 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1077/2140] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:34 2022] PUT /identity/v3/projects/4c7768f0581846c4aa30af918a3702ec/users/dafbf5b7c9a94a1badf6b148e59d2583/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:34.676882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.682414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d367b1ba7c4aa59d7adb487d4f56ef, user_id=f504ceea0eab4699aa8b045e04c3a882, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.688908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.716145 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1064/2141] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:34 2022] PUT /identity/v3/projects/b0d367b1ba7c4aa59d7adb487d4f56ef/users/f504ceea0eab4699aa8b045e04c3a882/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:34.717100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.804179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615cb9a-f7ce-4fc7-893d-8eb463576323 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.886861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b530f-2659-47e0-9819-c4d5dc2ccd79 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.894134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.895364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.895836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.896429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.897478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.899919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.913561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1065/2142] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:34.918938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:34.931887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d2672-3eac-4906-a2fd-7be1a8b47a30 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:34.942477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.943902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.945952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.946421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.947278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.950507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7a24-8467-455f-87c5-22b710395663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:34.952068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.954082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7a24-8467-455f-87c5-22b710395663 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:34.954701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7a24-8467-455f-87c5-22b710395663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:34.956595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7a24-8467-455f-87c5-22b710395663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:34.957521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e7a24-8467-455f-87c5-22b710395663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:34.962541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e7a24-8467-455f-87c5-22b710395663 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:34.982571 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1066/2143] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:34.983676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:35.003850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332328e1-f068-48c1-8eba-bf9b6e718419 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:35.011079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:35.012470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:35.012981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:35.013441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] PATH_INFO: `/v3/projects/4c7768f0581846c4aa30af918a3702ec/users/dafbf5b7c9a94a1badf6b148e59d2583/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:35.016508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7768f0581846c4aa30af918a3702ec, user_id=dafbf5b7c9a94a1badf6b148e59d2583, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:35.019496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:35.039790 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1067/2144] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:34 2022] PUT /identity/v3/projects/4c7768f0581846c4aa30af918a3702ec/users/dafbf5b7c9a94a1badf6b148e59d2583/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:35.050479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:35.051243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1078/2145] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:34 2022] POST /identity/v3/projects => generated 395 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:35.053075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ba51-d659-482d-939c-f56d2bd30d51 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:35.053669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ba51-d659-482d-939c-f56d2bd30d51 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:35.054675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ba51-d659-482d-939c-f56d2bd30d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:35.127707 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:35.137893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9b13ba51-d659-482d-939c-f56d2bd30d51 None None] MFA Rules not processed for user `dafbf5b7c9a94a1badf6b148e59d2583`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:35.139673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9b13ba51-d659-482d-939c-f56d2bd30d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:35.212700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c7d39-e670-47ea-926a-47c2d43f8798 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:35.369152 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1079/2146] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:35.369152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13ba51-d659-482d-939c-f56d2bd30d51 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:35.409543 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:35.489910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:35.490884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:35.491319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:35.491732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] PATH_INFO: `/v3/projects/b0d367b1ba7c4aa59d7adb487d4f56ef/users/f504ceea0eab4699aa8b045e04c3a882/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:35.494046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d367b1ba7c4aa59d7adb487d4f56ef, user_id=f504ceea0eab4699aa8b045e04c3a882, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:35.496887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:35.524681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13ba51-d659-482d-939c-f56d2bd30d51 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:35.525779 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1068/2147] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:35 2022] PUT /identity/v3/projects/b0d367b1ba7c4aa59d7adb487d4f56ef/users/f504ceea0eab4699aa8b045e04c3a882/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:35.539204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:35.543102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:35.686328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:35.688079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:35.688494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:35.688871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:35.689691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:35.692144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:35.700522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5d9a8-2213-42c2-8dc7-d4ff3b9e5a35 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:35.714943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639568bb-d82b-4d76-9d68-3975ff96ea81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:35.715632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639568bb-d82b-4d76-9d68-3975ff96ea81 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:35.716853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639568bb-d82b-4d76-9d68-3975ff96ea81 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:35.717259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639568bb-d82b-4d76-9d68-3975ff96ea81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:35.743186 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1080/2148] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:35 2022] POST /identity/v3/users => generated 298 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:35.744648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:35.750469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:35.800688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea066490-a96b-45f7-bf25-e40aba678e4b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:35.821452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:35.824430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:35.825220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:35.825570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] PATH_INFO: `/v3/projects/de22fe32e0844e72bb21050a685576ed` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:35.827034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de22fe32e0844e72bb21050a685576ed)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:35.830724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:35.915503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639568bb-d82b-4d76-9d68-3975ff96ea81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:35.918159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639568bb-d82b-4d76-9d68-3975ff96ea81 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:35.959982 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1069/2149] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:35.961495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b3952-975c-45c0-9532-315e32b84ba6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:35.963005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b3952-975c-45c0-9532-315e32b84ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:35.963688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b3952-975c-45c0-9532-315e32b84ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:35.965736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de22fe32e0844e72bb21050a685576ed', 'request_id': 'req-47ef6bc9-2890-4d9b-9da8-90c937da6d12'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:35.990158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de22fe32e0844e72bb21050a685576ed', 'request_id': 'req-47ef6bc9-2890-4d9b-9da8-90c937da6d12'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:35.994660 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:36.019887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de22fe32e0844e72bb21050a685576ed', 'request_id': 'req-47ef6bc9-2890-4d9b-9da8-90c937da6d12'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:36.068630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] The token cache is being invalidate because project de22fe32e0844e72bb21050a685576ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:36.068930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:36.073699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:36.080129 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1081/2150] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:35 2022] DELETE /identity/v3/projects/de22fe32e0844e72bb21050a685576ed => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:36.081991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:36.095470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6a7b3952-975c-45c0-9532-315e32b84ba6 None None] MFA Rules not processed for user `f504ceea0eab4699aa8b045e04c3a882`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:36.096812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a7b3952-975c-45c0-9532-315e32b84ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:36.103867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:36.250521 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:36.281465 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1070/2151] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:36.281465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017d13-48e5-487f-b89d-90c1e1f7a754 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.281465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017d13-48e5-487f-b89d-90c1e1f7a754 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.281465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017d13-48e5-487f-b89d-90c1e1f7a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.314859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef6bc9-2890-4d9b-9da8-90c937da6d12 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:36.324069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5f017d13-48e5-487f-b89d-90c1e1f7a754 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:36.325347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5f017d13-48e5-487f-b89d-90c1e1f7a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:36.325860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa8cda-985f-44a5-8b49-ac1e5396e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:36.326811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa8cda-985f-44a5-8b49-ac1e5396e0bf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.327319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa8cda-985f-44a5-8b49-ac1e5396e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.328105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa8cda-985f-44a5-8b49-ac1e5396e0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.329086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa8cda-985f-44a5-8b49-ac1e5396e0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:36.332017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa8cda-985f-44a5-8b49-ac1e5396e0bf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:36.358949 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1082/2152] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:36.358949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547119-9e2f-4423-b3d9-eed9cfd00cda None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.358949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547119-9e2f-4423-b3d9-eed9cfd00cda None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.358949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547119-9e2f-4423-b3d9-eed9cfd00cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.363608 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1071/2153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:36.364723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017d13-48e5-487f-b89d-90c1e1f7a754 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:36.376808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017d13-48e5-487f-b89d-90c1e1f7a754 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:36.383546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8208d-ec71-40c1-afea-9e7c4450b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:36.384460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8208d-ec71-40c1-afea-9e7c4450b821 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.384887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8208d-ec71-40c1-afea-9e7c4450b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.385397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8208d-ec71-40c1-afea-9e7c4450b821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.386414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8208d-ec71-40c1-afea-9e7c4450b821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:36.388200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8208d-ec71-40c1-afea-9e7c4450b821 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:36.389592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a0547119-9e2f-4423-b3d9-eed9cfd00cda None None] MFA Rules not processed for user `60ce2a11f47e4e92a51293aca8878034`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:36.394261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a0547119-9e2f-4423-b3d9-eed9cfd00cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:36.415528 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1072/2154] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:36.417480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54806ee-2032-44a8-a744-e8dffb831cc7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.417959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54806ee-2032-44a8-a744-e8dffb831cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.452227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54806ee-2032-44a8-a744-e8dffb831cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.505759 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1083/2155] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:36.514720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547119-9e2f-4423-b3d9-eed9cfd00cda None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:36.537341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547119-9e2f-4423-b3d9-eed9cfd00cda None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:36.560757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b54806ee-2032-44a8-a744-e8dffb831cc7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:36.565145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b54806ee-2032-44a8-a744-e8dffb831cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:36.567729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:36.568480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.568826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.569192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] PATH_INFO: `/v3/projects/db5f307682ee47e2880cc5abbe949a58/users/fb2fa7cdc77043e2b9295424759e9863/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.591460 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1073/2156] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:36.596980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54806ee-2032-44a8-a744-e8dffb831cc7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:36.606331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5f307682ee47e2880cc5abbe949a58, user_id=fb2fa7cdc77043e2b9295424759e9863, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:36.611357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:36.633441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54806ee-2032-44a8-a744-e8dffb831cc7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:36.650059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c83d4-b686-492f-abf7-7733e79e666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:36.650686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c83d4-b686-492f-abf7-7733e79e666f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.650962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c83d4-b686-492f-abf7-7733e79e666f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.651234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c83d4-b686-492f-abf7-7733e79e666f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.651881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c83d4-b686-492f-abf7-7733e79e666f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:36.652438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c83d4-b686-492f-abf7-7733e79e666f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:36.654061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c83d4-b686-492f-abf7-7733e79e666f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:36.671117 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1084/2157] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:36 2022] PUT /identity/v3/projects/db5f307682ee47e2880cc5abbe949a58/users/fb2fa7cdc77043e2b9295424759e9863/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:36.672918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:36.680358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:36.690878 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1074/2158] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:36.692368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965eb3-130a-443d-98dd-ef96d9fd10c1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.692646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965eb3-130a-443d-98dd-ef96d9fd10c1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.692917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965eb3-130a-443d-98dd-ef96d9fd10c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.753429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a9965eb3-130a-443d-98dd-ef96d9fd10c1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:36.754677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a9965eb3-130a-443d-98dd-ef96d9fd10c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:36.910076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b633ca-088a-4377-a838-79684d724473 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:36.912362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1075/2159] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:36.913302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965eb3-130a-443d-98dd-ef96d9fd10c1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:36.924932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965eb3-130a-443d-98dd-ef96d9fd10c1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:36.930108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:36.931488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.931866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.932244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.933483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:36.935674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:36.941239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:36.941239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:36.941239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:36.941239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:36.944113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:37.003600 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1076/2160] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:36 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:37.004573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.007247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:37.059358 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:37.087617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.089263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.101883 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:37.106029 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1085/2161] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:37.106879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.130979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfaa9f-2432-4102-a798-1006b8aa95ca service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:37.138474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f35ad-701f-4351-a4eb-7781a393cf93 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:37.146784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:37.147423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.147707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.147985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.252063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:37.252695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.252999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.253286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.253978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.255863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.309639 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1086/2162] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:37 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:37.313680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.325210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.326964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.333128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5c932-0a08-47ad-88d7-fcfe14815f49 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:37.345045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:37.345327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.345414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.346421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.347378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.348740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.354495 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1077/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:37.369022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.369598 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1087/2164] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:37.381234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1108-a626-4ed7-b204-477720e8e3d9 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:37.386522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f9e8a-38ab-4034-b5e6-d23d6016e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:37.388210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f9e8a-38ab-4034-b5e6-d23d6016e914 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.388497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f9e8a-38ab-4034-b5e6-d23d6016e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.388770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f9e8a-38ab-4034-b5e6-d23d6016e914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.389514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f9e8a-38ab-4034-b5e6-d23d6016e914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.391334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f9e8a-38ab-4034-b5e6-d23d6016e914 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.405464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1078/2165] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:03:37.410053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.422920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ca5b6-fbab-4566-881c-f49b47680075 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:37.430438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:37.431722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.431836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.432218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] PATH_INFO: `/v3/projects/905a304d4e634d43819866c84a9ceb2e/users/c59cb0a3576a46dc970e12a875e43cce/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.458861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905a304d4e634d43819866c84a9ceb2e, user_id=c59cb0a3576a46dc970e12a875e43cce, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.461651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.499863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57f76-e5fd-49bc-8a24-099c62a1d939 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.500330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57f76-e5fd-49bc-8a24-099c62a1d939 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.500614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57f76-e5fd-49bc-8a24-099c62a1d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.505679 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1088/2166] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:37 2022] PUT /identity/v3/projects/905a304d4e634d43819866c84a9ceb2e/users/c59cb0a3576a46dc970e12a875e43cce/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:37.532589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.534619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:37.583330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a3e57f76-e5fd-49bc-8a24-099c62a1d939 None None] MFA Rules not processed for user `c59cb0a3576a46dc970e12a875e43cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:37.584618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a3e57f76-e5fd-49bc-8a24-099c62a1d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:37.682583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114809-e417-4652-bbae-4ab7b8c9b694 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:37.694343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:37.695261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.695862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.697507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.700566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:37.726642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1079/2167] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:37.732075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57f76-e5fd-49bc-8a24-099c62a1d939 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.810264 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:37.850482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.852390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.857958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57f76-e5fd-49bc-8a24-099c62a1d939 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:37.867700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:37.868763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:37.869151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:37.869890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:37.870716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:37.874105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:37.882061 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:37.883012 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1089/2168] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:03:37.981552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:37.983305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:37.988672 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1080/2169] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:37 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:37.989868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:38.037429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856bb1-32a1-4133-881d-c0a3cd81765c service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:38.215619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:38.216302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.216580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.216849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] PATH_INFO: `/v3/users/dab5c7e91efd4eb693a6127918cab0f7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.224931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229adbac-2b98-4f1e-9200-e86985c1b426 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:38.227489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab5c7e91efd4eb693a6127918cab0f7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:38.234738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:38.240385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:38.242034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.248647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.249160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.250592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:38.256170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:38.334099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1081/2170] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:37 2022] POST /identity/v3/users => generated 292 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:38.339621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:38.354623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab5c7e91efd4eb693a6127918cab0f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:38.355399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab5c7e91efd4eb693a6127918cab0f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:38.355990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab5c7e91efd4eb693a6127918cab0f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:38.372418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab5c7e91efd4eb693a6127918cab0f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:38.373183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e79f4-a90d-462e-b0fb-f5d9e5f645d9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:38.382099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:38.382982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.383449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.383964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.384895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:38.386702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:38.397766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8bd5052c-965f-410f-a176-48d4ce197f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab5c7e91efd4eb693a6127918cab0f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:38.413161 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1082/2171] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:38.414713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:38.418014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:38.426659 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1090/2172] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:37 2022] DELETE /identity/v3/users/dab5c7e91efd4eb693a6127918cab0f7 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:38.432953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.433895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.434513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.440656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696788-9be2-4664-9523-b5b60af9f255 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:38.474923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:38.476560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:38.539852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:38.547614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.547614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.547905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] PATH_INFO: `/v3/projects/24d21e67a43e4b2d9dda633229f85f36/users/ebbbb69b5bb046e395390c72403eecea/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.557458 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:38.581157 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1091/2173] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:38.598794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d21e67a43e4b2d9dda633229f85f36, user_id=ebbbb69b5bb046e395390c72403eecea, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:38.603610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:38.623181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:38.625103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:38.632624 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1083/2174] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:38 2022] PUT /identity/v3/projects/24d21e67a43e4b2d9dda633229f85f36/users/ebbbb69b5bb046e395390c72403eecea/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:38.634177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:38.745279 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:38.798216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eefa34-fcaf-43d1-814c-3f7c819f30f8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:38.802415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283c1d-d437-46d7-bc9f-f606d30c18ad None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:38.831919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:38.832616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.832990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.833196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.833908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:38.837997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:38.871669 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1084/2175] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:38.872897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:38.886995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b187cb-a7a7-4efa-8267-da7b5883e686 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:38.895250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243f94a-55e1-414e-b259-955f8366a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:38.897354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243f94a-55e1-414e-b259-955f8366a82a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.898359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243f94a-55e1-414e-b259-955f8366a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.898965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243f94a-55e1-414e-b259-955f8366a82a admin admin] PATH_INFO: `/v3/projects/24d21e67a43e4b2d9dda633229f85f36/users/ebbbb69b5bb046e395390c72403eecea/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.907069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243f94a-55e1-414e-b259-955f8366a82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d21e67a43e4b2d9dda633229f85f36, user_id=ebbbb69b5bb046e395390c72403eecea, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:38.913336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243f94a-55e1-414e-b259-955f8366a82a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:38.942648 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1085/2176] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:38 2022] PUT /identity/v3/projects/24d21e67a43e4b2d9dda633229f85f36/users/ebbbb69b5bb046e395390c72403eecea/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:38.944326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a396f-88b2-4b9f-bde1-cd38b36d0255 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.944714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a396f-88b2-4b9f-bde1-cd38b36d0255 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.945213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a396f-88b2-4b9f-bde1-cd38b36d0255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:38.987469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c27a396f-88b2-4b9f-bde1-cd38b36d0255 None None] MFA Rules not processed for user `ebbbb69b5bb046e395390c72403eecea`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:38.988986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c27a396f-88b2-4b9f-bde1-cd38b36d0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:38.989587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:38.989954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:38.990044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:38.990291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:39.017249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:39.018696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:39.038385 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1092/2177] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:39.090017 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1086/2178] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:39.103517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:39.104930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:39.258653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155847f-a1a9-4c75-a724-b7d01106ec93 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:39.399758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d22f-cf54-43bc-8bac-acdc73ae3334 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:39.400250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d22f-cf54-43bc-8bac-acdc73ae3334 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:39.400537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3d22f-cf54-43bc-8bac-acdc73ae3334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:39.462615 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:39.493617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1ca3d22f-cf54-43bc-8bac-acdc73ae3334 None None] MFA Rules not processed for user `92d56e7f729243e386f7ce8080cf864e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:39.494876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1ca3d22f-cf54-43bc-8bac-acdc73ae3334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:39.509128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:39.509772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:39.516199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:39.516199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:39.536894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:39.542355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:39.570714 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1093/2179] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:39.629600 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1087/2180] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:39.634061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:39.636245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:39.760815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d22f-cf54-43bc-8bac-acdc73ae3334 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:39.792234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91ef4-58b4-4c69-9350-5e93f73adec5 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:39.809479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:39.811489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:39.811784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:39.812202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:39.816127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:39.820494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:39.861924 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:39.892637 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1094/2181] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:39 2022] POST /identity/v3/projects => generated 371 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:39.897540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:39.899646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3d22f-cf54-43bc-8bac-acdc73ae3334 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:40.040190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:40.040983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.041311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.041581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] PATH_INFO: `/v3/users/c59cb0a3576a46dc970e12a875e43cce` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.048665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59cb0a3576a46dc970e12a875e43cce)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:40.051036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:40.070171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8f23-11e7-48fb-b85b-e28139d5ce4b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:40.076138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:40.076946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.078558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.079190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.079942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:40.082538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:40.118997 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1095/2182] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:39 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:40.121326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:40.137303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fae61-625c-44f1-bba0-64f1446547e9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:40.137958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59cb0a3576a46dc970e12a875e43cce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:40.139134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59cb0a3576a46dc970e12a875e43cce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:40.139832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59cb0a3576a46dc970e12a875e43cce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:40.147289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:40.148255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.148598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.149429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.150502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:40.153200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:40.154195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59cb0a3576a46dc970e12a875e43cce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:40.172105 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1096/2183] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:40.173571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:40.176760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:40.181608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4646598b-f1c4-420b-8fc9-107a4c7f36c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59cb0a3576a46dc970e12a875e43cce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:40.206435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1502001-8ea4-4d00-945a-f285863a1f15 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:40.222020 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1088/2184] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:39 2022] DELETE /identity/v3/users/c59cb0a3576a46dc970e12a875e43cce => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:40.223471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.223766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.224076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.225443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:40.226602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.226888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.227170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] PATH_INFO: `/v3/projects/2aa8ab9fc4c24171895aeb3367d1be07/users/31366108b1714a61891a680ea35dcc2e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.274013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa8ab9fc4c24171895aeb3367d1be07, user_id=31366108b1714a61891a680ea35dcc2e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:40.278284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:40.279713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:40.283686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:40.331928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1097/2185] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:40 2022] PUT /identity/v3/projects/2aa8ab9fc4c24171895aeb3367d1be07/users/31366108b1714a61891a680ea35dcc2e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:40.339326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:40.450438 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:40.499115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1089/2186] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:40.585881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:40.587873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:40.614473 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:40.648949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901a207-6db2-4dea-a97f-14c604b00e69 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:40.654967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:40.655874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.656162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.656736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.657474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:40.659848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:40.673200 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1098/2187] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:40.677750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:40.701572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba877fd-45e8-4bf1-bcfe-28335ef25bc8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:40.708460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c7bb-f418-4cea-895d-b7c87e2a7566 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:40.709183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:40.710314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.711062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.714890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] PATH_INFO: `/v3/projects/2aa8ab9fc4c24171895aeb3367d1be07/users/31366108b1714a61891a680ea35dcc2e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.724490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa8ab9fc4c24171895aeb3367d1be07, user_id=31366108b1714a61891a680ea35dcc2e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:40.733493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:40.758225 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1099/2188] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:40 2022] PUT /identity/v3/projects/2aa8ab9fc4c24171895aeb3367d1be07/users/31366108b1714a61891a680ea35dcc2e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:40.837302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:40.838312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:40.838964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:40.839917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:40.883500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:40.887574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:40.920004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1090/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:03:42.058984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:42.061361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:42.277660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29291e6-b1f7-4b51-a96d-cd86b29df86d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:42.294954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:42.295368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:42.298164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:42.298426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] PATH_INFO: `/v3/projects/efa1d1d8d8b34ffaa4db7962eb48d90e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:42.302316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa1d1d8d8b34ffaa4db7962eb48d90e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:42.309133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:42.386687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa1d1d8d8b34ffaa4db7962eb48d90e', 'request_id': 'req-958d26d6-f18a-4cd6-8633-2177e85b91d1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.394115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa1d1d8d8b34ffaa4db7962eb48d90e', 'request_id': 'req-958d26d6-f18a-4cd6-8633-2177e85b91d1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.403148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa1d1d8d8b34ffaa4db7962eb48d90e', 'request_id': 'req-958d26d6-f18a-4cd6-8633-2177e85b91d1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.447110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] The token cache is being invalidate because project efa1d1d8d8b34ffaa4db7962eb48d90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:42.447450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.448282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-958d26d6-f18a-4cd6-8633-2177e85b91d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.450495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1100/2190] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:42 2022] DELETE /identity/v3/projects/efa1d1d8d8b34ffaa4db7962eb48d90e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:42.455225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:42.475822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accab719-b499-41c2-a819-452a55b1b894 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:42.669975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:42.670484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:42.670773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:42.671052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] PATH_INFO: `/v3/users/dafbf5b7c9a94a1badf6b148e59d2583` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:42.678044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=dafbf5b7c9a94a1badf6b148e59d2583)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:42.688378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:42.815520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dafbf5b7c9a94a1badf6b148e59d2583'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.817014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dafbf5b7c9a94a1badf6b148e59d2583'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.819516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dafbf5b7c9a94a1badf6b148e59d2583'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.852354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dafbf5b7c9a94a1badf6b148e59d2583'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.876111 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:42.877151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8673d75c-f2c4-4585-8542-e33597cb28ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dafbf5b7c9a94a1badf6b148e59d2583'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:42.917795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1091/2191] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:42 2022] DELETE /identity/v3/users/dafbf5b7c9a94a1badf6b148e59d2583 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:44.642581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce9dc-4c33-4b84-9510-8677ed6c11e1 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:44.643237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce9dc-4c33-4b84-9510-8677ed6c11e1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:44.643237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce9dc-4c33-4b84-9510-8677ed6c11e1 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:44.644471 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1101/2192] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:44.684178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:44.684701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:44.684896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:44.716337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:44.720789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:44.834362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1092/2193] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:44.867040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce9dc-4c33-4b84-9510-8677ed6c11e1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:44.869326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b7cce9dc-4c33-4b84-9510-8677ed6c11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:44.878742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:44.881146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:44.967127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce9dc-4c33-4b84-9510-8677ed6c11e1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:45.022072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:45.022886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:45.023337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:45.026566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:45.039702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:45.041363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:45.054863 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1102/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:45.055999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:45.057961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:45.073913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb64ac-00ba-4ef7-a116-685f9b4b45c4 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:45.080929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:45.081689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d6eb-b136-460f-a85f-9a398931a266 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:45.081906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:45.082796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:45.083437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] PATH_INFO: `/v3/projects/905a304d4e634d43819866c84a9ceb2e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:45.084783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=905a304d4e634d43819866c84a9ceb2e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:45.086712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:45.099588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:45.100424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:45.100705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:45.100973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] PATH_INFO: `/v3/users/595eb86c446a4cfdb2f60fa049da2254` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:45.102189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=595eb86c446a4cfdb2f60fa049da2254)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:45.104098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:45.113241 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:45.200418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905a304d4e634d43819866c84a9ceb2e', 'request_id': 'req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.203812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595eb86c446a4cfdb2f60fa049da2254'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.205408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595eb86c446a4cfdb2f60fa049da2254'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.207178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595eb86c446a4cfdb2f60fa049da2254'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.217616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905a304d4e634d43819866c84a9ceb2e', 'request_id': 'req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.230413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595eb86c446a4cfdb2f60fa049da2254'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.232257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905a304d4e634d43819866c84a9ceb2e', 'request_id': 'req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.257660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] The token cache is being invalidate because project 905a304d4e634d43819866c84a9ceb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:45.258424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595eb86c446a4cfdb2f60fa049da2254'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.261622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.263230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.271071 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1103/2195] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:45 2022] DELETE /identity/v3/projects/905a304d4e634d43819866c84a9ceb2e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:45.272249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:45.274170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:45.289196 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1093/2196] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:44 2022] DELETE /identity/v3/users/595eb86c446a4cfdb2f60fa049da2254 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:45.381804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:45.386400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:45.398627 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:45.417238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5de3-ef06-4eca-88f5-c0cab48aa2d0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:45.538557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab82c8-4556-4b98-882b-ad1a15bd3f9e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:45.541903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:45.542568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:45.542853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:45.543243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] PATH_INFO: `/v3/users/ebbbb69b5bb046e395390c72403eecea` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:45.544702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbbb69b5bb046e395390c72403eecea)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:45.553956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:45.562699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:45.572001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:45.572441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:45.572725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] PATH_INFO: `/v3/projects/4c7768f0581846c4aa30af918a3702ec` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:45.575135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7768f0581846c4aa30af918a3702ec)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:45.580631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:45.680267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbbb69b5bb046e395390c72403eecea'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.682258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbbb69b5bb046e395390c72403eecea'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.683394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbbb69b5bb046e395390c72403eecea'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.688277 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:45.726527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbbb69b5bb046e395390c72403eecea'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.737702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-29c60a11-5b56-477b-a53e-9326bacf9041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbbb69b5bb046e395390c72403eecea'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.764024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7768f0581846c4aa30af918a3702ec', 'request_id': 'req-b267a015-e2dd-405e-917c-ff3118e5e8f7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.772705 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1104/2197] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:45 2022] DELETE /identity/v3/users/ebbbb69b5bb046e395390c72403eecea => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:45.781924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7768f0581846c4aa30af918a3702ec', 'request_id': 'req-b267a015-e2dd-405e-917c-ff3118e5e8f7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.798811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7768f0581846c4aa30af918a3702ec', 'request_id': 'req-b267a015-e2dd-405e-917c-ff3118e5e8f7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.826679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] The token cache is being invalidate because project 4c7768f0581846c4aa30af918a3702ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:45.827071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.829423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:45.837661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1094/2198] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:45 2022] DELETE /identity/v3/projects/4c7768f0581846c4aa30af918a3702ec => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:45.840229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98dac4-a72c-4a41-a018-1ec2bd5a6cc5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:45.840524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98dac4-a72c-4a41-a018-1ec2bd5a6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:45.840877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98dac4-a72c-4a41-a018-1ec2bd5a6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:45.910496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9e98dac4-a72c-4a41-a018-1ec2bd5a6cc5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:45.911644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9e98dac4-a72c-4a41-a018-1ec2bd5a6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:45.919786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:45.923225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:46.058310 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1105/2199] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:46.059856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b058be-e1f3-4456-b201-12a36cb2af5e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.060144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b058be-e1f3-4456-b201-12a36cb2af5e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.060412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b058be-e1f3-4456-b201-12a36cb2af5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.092430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-50b058be-e1f3-4456-b201-12a36cb2af5e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:46.099463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-50b058be-e1f3-4456-b201-12a36cb2af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:46.121629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1106/2200] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:46.122583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b058be-e1f3-4456-b201-12a36cb2af5e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:46.128671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a015-e2dd-405e-917c-ff3118e5e8f7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.137169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b058be-e1f3-4456-b201-12a36cb2af5e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.145807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.146502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.146733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.147110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.147478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] PATH_INFO: `/v3/users/c5b530242b564a56b55d4b9f49066232` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.148873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.149335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.149622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.150316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:46.152717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:46.155417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:46.161444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b530242b564a56b55d4b9f49066232)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:46.170387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:46.187977 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1107/2201] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:46.199263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:46.258244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0544adb-95c0-4f48-a948-2de0311a7399 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.266504 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:46.275311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.276650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.277584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.278598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.279457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:46.282418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:46.297476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b530242b564a56b55d4b9f49066232'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:46.298262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b530242b564a56b55d4b9f49066232'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:46.298902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b530242b564a56b55d4b9f49066232'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:46.318233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b530242b564a56b55d4b9f49066232'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:46.333267 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1108/2202] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:46 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:46.336496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:46.342552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:46.345215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f895140-38b3-4ea5-8eba-363f0f63705b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b530242b564a56b55d4b9f49066232'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:46.371075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1095/2203] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:45 2022] DELETE /identity/v3/users/c5b530242b564a56b55d4b9f49066232 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:46.375631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c2570-e495-45f5-9f04-397297e40ec1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.375903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c2570-e495-45f5-9f04-397297e40ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.376260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c2570-e495-45f5-9f04-397297e40ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.424515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d78c2570-e495-45f5-9f04-397297e40ec1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:46.434707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d78c2570-e495-45f5-9f04-397297e40ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:46.454833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760014d-9062-4989-a9eb-48961caa4085 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.509731 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:46.575274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.576130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.576411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.576681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.580371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:46.583386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:46.601495 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1096/2204] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:46.623566 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1109/2205] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:46 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:46.625507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c2570-e495-45f5-9f04-397297e40ec1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:46.639567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c2570-e495-45f5-9f04-397297e40ec1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.646201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.646640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.646926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.647202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.648424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:46.650294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:46.664535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:46.666868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:46.670803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1097/2206] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:46.672856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:46.689694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354806c-4f10-41c5-9575-f43a8f3c5977 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.697475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.699440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.699846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.700259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.701380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:46.703722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:46.724444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1098/2207] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:03:46.726679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:46.744305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea83b2e-3004-4913-89f3-d890288a7cd6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.751165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c39374-f01e-4f1c-93a3-3ae6eb21a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.751966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c39374-f01e-4f1c-93a3-3ae6eb21a9be admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.752323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c39374-f01e-4f1c-93a3-3ae6eb21a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.752686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c39374-f01e-4f1c-93a3-3ae6eb21a9be admin admin] PATH_INFO: `/v3/projects/2c2eb5c0d4ea4c029a753a6e42a139e7/users/51d78a7c9f864115ac02046fa5d313eb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.778918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c39374-f01e-4f1c-93a3-3ae6eb21a9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2eb5c0d4ea4c029a753a6e42a139e7, user_id=51d78a7c9f864115ac02046fa5d313eb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:46.783153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c39374-f01e-4f1c-93a3-3ae6eb21a9be admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:46.799995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a703a3-919d-438c-859e-057c1e5e03ed admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:46.817111 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1099/2208] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:46 2022] PUT /identity/v3/projects/2c2eb5c0d4ea4c029a753a6e42a139e7/users/51d78a7c9f864115ac02046fa5d313eb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:46.824921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.825225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.825584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.876708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] MFA Rules not processed for user `51d78a7c9f864115ac02046fa5d313eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:46.880604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:46.908606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:46.909276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:46.909727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:46.910007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:46.990565 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:47.005300 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1100/2209] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:47.005300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.005846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:47.015767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.017313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.025560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7bdd9-196e-4392-ab00-7b8ca04fbcac None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.029243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1110/2210] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:47.030098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.035721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.036793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.037091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.038018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] PATH_INFO: `/v3/projects/e4436b87f22f46c4828883c42ec2a11e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.039992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4436b87f22f46c4828883c42ec2a11e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.054370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.055526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39276-96f1-4eb3-bcf1-80e70f53c42a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.062552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.063184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.063462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.063734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.064879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.067381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.128713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4436b87f22f46c4828883c42ec2a11e', 'request_id': 'req-3ea188d2-b85f-44fc-836b-bf867037f606'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:47.130441 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1111/2211] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:47 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:47.135526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.147177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4436b87f22f46c4828883c42ec2a11e', 'request_id': 'req-3ea188d2-b85f-44fc-836b-bf867037f606'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:47.147749 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:47.161820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4436b87f22f46c4828883c42ec2a11e', 'request_id': 'req-3ea188d2-b85f-44fc-836b-bf867037f606'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:47.187705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] The token cache is being invalidate because project e4436b87f22f46c4828883c42ec2a11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:47.187705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:47.190269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3ea188d2-b85f-44fc-836b-bf867037f606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:47.194203 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1101/2212] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:47 2022] DELETE /identity/v3/projects/e4436b87f22f46c4828883c42ec2a11e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:47.199622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e791e4-4ae9-4edb-b18b-c576371d9b12 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.202959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e791e4-4ae9-4edb-b18b-c576371d9b12 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.203995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e791e4-4ae9-4edb-b18b-c576371d9b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.269871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-94e791e4-4ae9-4edb-b18b-c576371d9b12 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:47.271199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-94e791e4-4ae9-4edb-b18b-c576371d9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:47.273699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16a715-cbbf-4437-afb2-0ad9362014c7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.287738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.289356 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1102/2213] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:47.289480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.291181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.292053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.293323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.298409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6a21-2133-421b-926b-daf2d145b2f1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.298697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6a21-2133-421b-926b-daf2d145b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.298976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6a21-2133-421b-926b-daf2d145b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.300842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.334181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ef4e6a21-2133-421b-926b-daf2d145b2f1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:47.336931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef4e6a21-2133-421b-926b-daf2d145b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:47.358542 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1112/2214] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:47 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:47.362365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.365326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:47.375326 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1103/2215] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:47.376262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e6a21-2133-421b-926b-daf2d145b2f1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.389094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e04231-ac22-4bf5-9cac-403cbf0d9ae8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.393896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e6a21-2133-421b-926b-daf2d145b2f1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.395915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.396827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.397268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.397638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.398389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.400593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.413503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.414236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.415487 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1113/2216] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:03:47.415836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.416186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.416865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:47.417274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.419055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.419444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.435089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ef07-d25e-4d98-93dd-0cddb9d27faf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.442935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.443773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.444424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.444804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] PATH_INFO: `/v3/projects/96fb7dda97704bdfa9a35532ffe5594c/users/8958142504364d99acd792cc8c4472e5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.451385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1104/2217] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:47.456126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.466073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fb7dda97704bdfa9a35532ffe5594c, user_id=8958142504364d99acd792cc8c4472e5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.469760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.480385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cbf3-265d-4b80-b7aa-d87c4d5e39eb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.496644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1114/2218] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:47 2022] PUT /identity/v3/projects/96fb7dda97704bdfa9a35532ffe5594c/users/8958142504364d99acd792cc8c4472e5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:47.503939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.613079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.613485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.613731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.614004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.614639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.623848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.628853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64413fc0-3433-4a22-ae85-a94a97d470e5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.639063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.639727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.640550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.640995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.642744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.644365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.691024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1115/2219] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:47.693599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.709393 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1105/2220] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:47 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:47.710452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.736624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ccc39-84eb-48bc-8d80-23189450c541 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.885923 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:47.902924 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:47.923598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:47.924897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:47.925256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:47.925544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] PATH_INFO: `/v3/projects/96fb7dda97704bdfa9a35532ffe5594c/users/8958142504364d99acd792cc8c4472e5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:47.933018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fb7dda97704bdfa9a35532ffe5594c, user_id=8958142504364d99acd792cc8c4472e5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:47.936462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:47.972437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdf19-c1bb-4a25-b261-3ded5178e0c6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:47.978492 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1116/2221] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:47 2022] PUT /identity/v3/projects/96fb7dda97704bdfa9a35532ffe5594c/users/8958142504364d99acd792cc8c4472e5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:47.979369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:47.986051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:48.196643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03b014-6840-4517-bd92-bdcc044c6d50 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:48.206810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf8f79-67ad-4b04-ba3b-f7467e583eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:48.207863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8f79-67ad-4b04-ba3b-f7467e583eff admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.208511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8f79-67ad-4b04-ba3b-f7467e583eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.208912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8f79-67ad-4b04-ba3b-f7467e583eff admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.209873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf8f79-67ad-4b04-ba3b-f7467e583eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:48.212375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf8f79-67ad-4b04-ba3b-f7467e583eff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:48.221080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:48.222013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.222463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.222888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] PATH_INFO: `/v3/projects/24d21e67a43e4b2d9dda633229f85f36` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.227440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d21e67a43e4b2d9dda633229f85f36)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:48.231738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:48.275093 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1106/2222] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:47 2022] POST /identity/v3/users => generated 292 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:48.276974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfd0cb-eba8-47b4-a8ba-097cb4fc275b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.279647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfd0cb-eba8-47b4-a8ba-097cb4fc275b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.279937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfd0cb-eba8-47b4-a8ba-097cb4fc275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.352760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d21e67a43e4b2d9dda633229f85f36', 'request_id': 'req-b05bb91d-2b55-4b18-b583-7d5e90f645a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.356707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-94dfd0cb-eba8-47b4-a8ba-097cb4fc275b None None] MFA Rules not processed for user `8958142504364d99acd792cc8c4472e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:48.361109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d21e67a43e4b2d9dda633229f85f36', 'request_id': 'req-b05bb91d-2b55-4b18-b583-7d5e90f645a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.363046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-94dfd0cb-eba8-47b4-a8ba-097cb4fc275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:48.370162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d21e67a43e4b2d9dda633229f85f36', 'request_id': 'req-b05bb91d-2b55-4b18-b583-7d5e90f645a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.392964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] The token cache is being invalidate because project 24d21e67a43e4b2d9dda633229f85f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:48.393588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.394487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.408807 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1117/2223] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:47 2022] DELETE /identity/v3/projects/24d21e67a43e4b2d9dda633229f85f36 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:48.412573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:48.429358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:48.546536 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1107/2224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:48.548115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.548512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.548884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.600007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:48.601526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:48.624726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb91d-2b55-4b18-b583-7d5e90f645a2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:48.640523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a40107-595c-45a8-bd60-aa8733f58509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:48.642185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40107-595c-45a8-bd60-aa8733f58509 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.642500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40107-595c-45a8-bd60-aa8733f58509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.642782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a40107-595c-45a8-bd60-aa8733f58509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.645079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a40107-595c-45a8-bd60-aa8733f58509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:48.648897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a40107-595c-45a8-bd60-aa8733f58509 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:48.653751 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1108/2225] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:48.654996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:48.669910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:48.680071 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1118/2226] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:48.681111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0f66-5c8a-4701-b047-4d3d03c463e1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.681556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0f66-5c8a-4701-b047-4d3d03c463e1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.681847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0f66-5c8a-4701-b047-4d3d03c463e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.695410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20095-132d-4a86-9500-43d4f44afe1d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:48.709448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:48.711282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.711677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.712442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] PATH_INFO: `/v3/projects/28938b8a17634c2e80b1815138c2d33c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.713920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28938b8a17634c2e80b1815138c2d33c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:48.715927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:48.739277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-402d0f66-5c8a-4701-b047-4d3d03c463e1 None None] MFA Rules not processed for user `51d78a7c9f864115ac02046fa5d313eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:48.743631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-402d0f66-5c8a-4701-b047-4d3d03c463e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:48.781702 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:48.832833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28938b8a17634c2e80b1815138c2d33c', 'request_id': 'req-33636081-4ab1-4fb6-b043-7489c4b18545'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.834131 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:48.841184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28938b8a17634c2e80b1815138c2d33c', 'request_id': 'req-33636081-4ab1-4fb6-b043-7489c4b18545'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.863769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28938b8a17634c2e80b1815138c2d33c', 'request_id': 'req-33636081-4ab1-4fb6-b043-7489c4b18545'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.882960 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1119/2227] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:48.884399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:48.884676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:48.884947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:48.888859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] The token cache is being invalidate because project 28938b8a17634c2e80b1815138c2d33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:48.889330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.890728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:48.896904 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1109/2228] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:48 2022] DELETE /identity/v3/projects/28938b8a17634c2e80b1815138c2d33c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:48.898055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:48.899785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:48.955538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:48.956791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.059399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33636081-4ab1-4fb6-b043-7489c4b18545 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:49.076697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aa604-9c10-4260-82ff-5928e917c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:49.077998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aa604-9c10-4260-82ff-5928e917c0bd admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.078296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aa604-9c10-4260-82ff-5928e917c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.078565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aa604-9c10-4260-82ff-5928e917c0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.079228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aa604-9c10-4260-82ff-5928e917c0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:49.080823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aa604-9c10-4260-82ff-5928e917c0bd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:49.111263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1110/2229] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:49.111263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dde4a0-fedf-4767-a73a-ecfc9a7d329b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.111263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dde4a0-fedf-4767-a73a-ecfc9a7d329b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.111263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dde4a0-fedf-4767-a73a-ecfc9a7d329b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.113668 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1111/2230] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:03:49.114062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dde4a0-fedf-4767-a73a-ecfc9a7d329b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:49.118196 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1120/2231] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:49.118196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:49.121452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-90dde4a0-fedf-4767-a73a-ecfc9a7d329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.121590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.167583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dde4a0-fedf-4767-a73a-ecfc9a7d329b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:49.180753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:49.181440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.181732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.182191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] PATH_INFO: `/v3/users/677582494cbf49e5b430af8d3b52e0a7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.183636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677582494cbf49e5b430af8d3b52e0a7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:49.189691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:49.285997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677582494cbf49e5b430af8d3b52e0a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:49.286205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677582494cbf49e5b430af8d3b52e0a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:49.286805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677582494cbf49e5b430af8d3b52e0a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:49.293634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d207d0-bd3f-41ba-8da5-59a765bc8433 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:49.303264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677582494cbf49e5b430af8d3b52e0a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:49.309546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:49.313089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.313478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.313821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.318178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.334108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677582494cbf49e5b430af8d3b52e0a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:49.366103 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1112/2232] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:49 2022] DELETE /identity/v3/users/677582494cbf49e5b430af8d3b52e0a7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:49.368648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:49.372740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.502004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:49.504119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:49.517433 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:49.520181 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:49.530708 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1121/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:49.532053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:49.537810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.558755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fb7b-85da-48f5-9127-7eaa90d37063 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:49.572915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48211107-98fe-49ee-b505-cf86f3c9a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:49.574021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211107-98fe-49ee-b505-cf86f3c9a6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.574021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211107-98fe-49ee-b505-cf86f3c9a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.574168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211107-98fe-49ee-b505-cf86f3c9a6a3 admin admin] PATH_INFO: `/v3/projects/ce78854e690745178d7c32b71b8e4e34/users/7984044d7dde41f393cb9b74dddcaba4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.585039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292e74-0a85-4a91-9e87-3249c6253545 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:49.602884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043dea2-220c-4a55-8d0d-45c111fe802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:49.604384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043dea2-220c-4a55-8d0d-45c111fe802d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.610407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48211107-98fe-49ee-b505-cf86f3c9a6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce78854e690745178d7c32b71b8e4e34, user_id=7984044d7dde41f393cb9b74dddcaba4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:49.610632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043dea2-220c-4a55-8d0d-45c111fe802d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.613088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48211107-98fe-49ee-b505-cf86f3c9a6a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:49.613465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043dea2-220c-4a55-8d0d-45c111fe802d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.614398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043dea2-220c-4a55-8d0d-45c111fe802d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:49.614859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043dea2-220c-4a55-8d0d-45c111fe802d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:49.616840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043dea2-220c-4a55-8d0d-45c111fe802d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:49.642889 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1113/2234] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:49 2022] PUT /identity/v3/projects/ce78854e690745178d7c32b71b8e4e34/users/7984044d7dde41f393cb9b74dddcaba4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:49.644327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398455-0c92-4c3f-8d3a-12de124ffbab None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.644619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398455-0c92-4c3f-8d3a-12de124ffbab None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.644921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398455-0c92-4c3f-8d3a-12de124ffbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.675738 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1122/2235] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:49.678079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90477ac-37ae-4a4a-b351-90d2a0b72ae7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.678358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90477ac-37ae-4a4a-b351-90d2a0b72ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.678642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90477ac-37ae-4a4a-b351-90d2a0b72ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.698758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bf398455-0c92-4c3f-8d3a-12de124ffbab None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:49.702063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bf398455-0c92-4c3f-8d3a-12de124ffbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.744043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f90477ac-37ae-4a4a-b351-90d2a0b72ae7 None None] MFA Rules not processed for user `7984044d7dde41f393cb9b74dddcaba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:49.745419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f90477ac-37ae-4a4a-b351-90d2a0b72ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.859866 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1114/2236] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:03:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:49.861897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398455-0c92-4c3f-8d3a-12de124ffbab None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:49.885890 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1123/2237] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:49.898148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dcd00-476c-48fd-945a-478f5bbbce9a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:49.898568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dcd00-476c-48fd-945a-478f5bbbce9a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:49.899273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dcd00-476c-48fd-945a-478f5bbbce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:49.924551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff3dcd00-476c-48fd-945a-478f5bbbce9a None None] MFA Rules not processed for user `7984044d7dde41f393cb9b74dddcaba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:49.926247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff3dcd00-476c-48fd-945a-478f5bbbce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:49.935375 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1124/2238] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:50.001882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398455-0c92-4c3f-8d3a-12de124ffbab None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:50.007484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:50.008118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:50.008402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:50.008674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:50.009344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:50.011259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:50.075128 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1115/2239] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:49 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:50.080555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dcd00-476c-48fd-945a-478f5bbbce9a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:50.107290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dcd00-476c-48fd-945a-478f5bbbce9a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:50.314866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:50.315948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:50.316484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:50.316947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:50.318104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:50.321017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:50.381089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1125/2240] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:50 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:50.385891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:50.403537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceab4b-4f38-4409-bd87-61ee84e716b0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:50.410064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:50.410827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:50.411273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:50.411623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:50.412640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:50.414614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:50.448258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:50.450513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:50.461975 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1116/2241] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:03:50.466471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:50.502803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87beda98-9ab9-4beb-9f3d-b34cdeeaf588 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:50.525026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:50.526358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:50.526795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:50.527740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:50.532082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:50.535420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:50.577119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1117/2242] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:50.583824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:50.599094 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:50.612566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3d17a-3958-45a8-8bc5-c2095525c0ce admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:50.628804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8f16-5580-44bb-b01f-3572b769ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:50.629566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8f16-5580-44bb-b01f-3572b769ae23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:50.631537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8f16-5580-44bb-b01f-3572b769ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:50.631918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8f16-5580-44bb-b01f-3572b769ae23 admin admin] PATH_INFO: `/v3/projects/91f1f43892f5490a81c55b2753f52eab/users/b5d1d00492474d8680944cdb284ba701/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:50.633663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc240434-0c07-4b9b-8584-86e6e2a47d2f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:50.647028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:50.647665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:50.647948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:50.648223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:50.671158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e8f16-5580-44bb-b01f-3572b769ae23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f1f43892f5490a81c55b2753f52eab, user_id=b5d1d00492474d8680944cdb284ba701, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:50.677995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e8f16-5580-44bb-b01f-3572b769ae23 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:50.696563 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:50.723453 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1118/2243] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:50 2022] PUT /identity/v3/projects/91f1f43892f5490a81c55b2753f52eab/users/b5d1d00492474d8680944cdb284ba701/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:50.737456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86a36-683e-47da-8de9-c3cc63777849 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:50.737768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86a36-683e-47da-8de9-c3cc63777849 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:50.738440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86a36-683e-47da-8de9-c3cc63777849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:50.774932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:50.776558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:50.795320 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1126/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:50.826710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-42e86a36-683e-47da-8de9-c3cc63777849 None None] MFA Rules not processed for user `b5d1d00492474d8680944cdb284ba701`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:50.830871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-42e86a36-683e-47da-8de9-c3cc63777849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:50.941374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:50.945523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:51.001439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b396-2fab-48f3-a74c-9fdb219aab7b service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.009600 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1119/2245] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:51.011199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e86a36-683e-47da-8de9-c3cc63777849 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:51.140905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.140905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.140905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.141643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] PATH_INFO: `/v3/projects/b1f522fa76fd4ecca08ba1229592396d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.143863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f522fa76fd4ecca08ba1229592396d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.146770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.230771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e86a36-683e-47da-8de9-c3cc63777849 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.245378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f522fa76fd4ecca08ba1229592396d', 'request_id': 'req-757b8c73-7535-423f-9ed7-41c44fe968bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:51.253874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f522fa76fd4ecca08ba1229592396d', 'request_id': 'req-757b8c73-7535-423f-9ed7-41c44fe968bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:51.262430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f522fa76fd4ecca08ba1229592396d', 'request_id': 'req-757b8c73-7535-423f-9ed7-41c44fe968bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:51.286880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] The token cache is being invalidate because project b1f522fa76fd4ecca08ba1229592396d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:51.287992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:51.289553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:51.293739 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1127/2246] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:50 2022] DELETE /identity/v3/projects/b1f522fa76fd4ecca08ba1229592396d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:51.294723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:51.300586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:51.350732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5840b-e3ed-4ad9-b120-b91e7f41aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.357589 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:51.368589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5840b-e3ed-4ad9-b120-b91e7f41aff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.380221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5840b-e3ed-4ad9-b120-b91e7f41aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.380644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5840b-e3ed-4ad9-b120-b91e7f41aff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.383923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5840b-e3ed-4ad9-b120-b91e7f41aff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.392177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5840b-e3ed-4ad9-b120-b91e7f41aff3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.455568 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1120/2247] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:51 2022] POST /identity/v3/projects => generated 381 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:51.456991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.457404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.458035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.469997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8c73-7535-423f-9ed7-41c44fe968bd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.494534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:51.501204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:51.544048 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:51.628503 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1121/2248] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:51.629608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:51.631019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:51.648107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374231-b3f7-48b5-83d8-670fe231efdb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.661792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e7e59-80cb-4772-8719-c1e239d4f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.664453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e7e59-80cb-4772-8719-c1e239d4f6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.664950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e7e59-80cb-4772-8719-c1e239d4f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.666114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e7e59-80cb-4772-8719-c1e239d4f6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.667713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e7e59-80cb-4772-8719-c1e239d4f6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.673674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e7e59-80cb-4772-8719-c1e239d4f6f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.692355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.693856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.694279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.694777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.699365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:51.730671 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1122/2249] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:51 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:51.730671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6808bc-dc02-4452-87d1-0de438eef929 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.730671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6808bc-dc02-4452-87d1-0de438eef929 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.730986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6808bc-dc02-4452-87d1-0de438eef929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.735877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.738588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.762577 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1128/2250] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:51.763897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:51.783067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ce6808bc-dc02-4452-87d1-0de438eef929 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:51.786876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ce6808bc-dc02-4452-87d1-0de438eef929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:51.806519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01479-a242-43dd-ad17-defe03afa94d service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.817825 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1123/2251] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:51.822161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6808bc-dc02-4452-87d1-0de438eef929 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:51.823016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.823740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.823948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.824215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.825254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.828677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.835849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6808bc-dc02-4452-87d1-0de438eef929 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.842664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.843657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.844326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.844491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.845427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:51.845806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.847958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.855433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1129/2252] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:51.860253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:51.865559 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1124/2253] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:51.870202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:51.879829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767527-8736-4b16-af71-439378588e7f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.885698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e902a-af89-440d-902c-1b9e81378e06 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:51.886868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.887568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.887970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.888250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] PATH_INFO: `/v3/projects/7e915233ffc7423ea487920a4f681b02/users/4d47883c6e6a46b9b21d4acf72149261/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.893800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:51.894682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:51.895098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:51.895461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:51.896548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.899398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.938252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e915233ffc7423ea487920a4f681b02, user_id=4d47883c6e6a46b9b21d4acf72149261, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:51.940827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:51.993410 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1125/2254] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:51 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:51.997532 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1130/2255] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:51 2022] PUT /identity/v3/projects/7e915233ffc7423ea487920a4f681b02/users/4d47883c6e6a46b9b21d4acf72149261/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:51.999873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:52.007240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:52.185762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9126-e730-4917-a922-762c7e46a8a6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:52.248605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e7d4-a691-4fd2-b598-0eeb27d707c7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:52.271278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:52.272028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:52.272217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:52.272549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:52.273309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:52.275771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:52.302453 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1131/2256] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:52.303714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:52.305526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:52.306153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:52.306456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:52.306724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:52.307355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:52.310194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:52.328379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89d30e-9c5d-4c10-96f2-b6e9da3697bd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:52.334645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86f5d-0cc9-44e2-ab79-61d1e358896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:52.335401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86f5d-0cc9-44e2-ab79-61d1e358896d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:52.335730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86f5d-0cc9-44e2-ab79-61d1e358896d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:52.336036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86f5d-0cc9-44e2-ab79-61d1e358896d admin admin] PATH_INFO: `/v3/projects/7e915233ffc7423ea487920a4f681b02/users/4d47883c6e6a46b9b21d4acf72149261/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:52.347982 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:52.351844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86f5d-0cc9-44e2-ab79-61d1e358896d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e915233ffc7423ea487920a4f681b02, user_id=4d47883c6e6a46b9b21d4acf72149261, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:52.354711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86f5d-0cc9-44e2-ab79-61d1e358896d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:52.357551 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1126/2257] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:51 2022] POST /identity/v3/users => generated 291 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:52.376972 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:52.377548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:52.397708 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1132/2258] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:52 2022] PUT /identity/v3/projects/7e915233ffc7423ea487920a4f681b02/users/4d47883c6e6a46b9b21d4acf72149261/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:03:52.399436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724814b-3505-442d-b9b6-00b790b8ac1b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:52.399730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724814b-3505-442d-b9b6-00b790b8ac1b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:52.400001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724814b-3505-442d-b9b6-00b790b8ac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:52.446820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797af09-fa1f-4a39-a268-2a34198d0f5c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:52.460751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c724814b-3505-442d-b9b6-00b790b8ac1b None None] MFA Rules not processed for user `4d47883c6e6a46b9b21d4acf72149261`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:52.463191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c724814b-3505-442d-b9b6-00b790b8ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:52.708756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:52.709341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:52.709626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:52.714426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:52.715403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:52.722999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:52.752078 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1133/2259] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:03:52.753763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724814b-3505-442d-b9b6-00b790b8ac1b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:52.757934 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1127/2260] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:52.762491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:52.792074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c3b8b-a2e2-4668-baf2-2867698c81c3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:52.808976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:52.809676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:52.809957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:52.810290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:52.811020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:52.816861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:52.855887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1128/2261] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:52.860643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:52.886286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2ed07-4dc4-4e87-bc09-4f1f1c46e698 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:52.899414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc951dfd-7e98-499f-98cb-6fe43ed99876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:52.901484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951dfd-7e98-499f-98cb-6fe43ed99876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:52.901777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951dfd-7e98-499f-98cb-6fe43ed99876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:52.902057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951dfd-7e98-499f-98cb-6fe43ed99876 admin admin] PATH_INFO: `/v3/projects/779105b1442046df876206475707ff8f/users/7aa53bfd731c433d93e308a56839a106/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:52.961918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc951dfd-7e98-499f-98cb-6fe43ed99876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779105b1442046df876206475707ff8f, user_id=7aa53bfd731c433d93e308a56839a106, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:52.976511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc951dfd-7e98-499f-98cb-6fe43ed99876 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:53.028679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1129/2262] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:52 2022] PUT /identity/v3/projects/779105b1442046df876206475707ff8f/users/7aa53bfd731c433d93e308a56839a106/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:53.030994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:53.035149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:53.035522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:53.043498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724814b-3505-442d-b9b6-00b790b8ac1b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:53.120260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:53.121531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:53.283234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:53.284064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:53.284394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:53.284685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:53.292448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:53.326955 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1130/2263] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:53.336041 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:53.339606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:53.342574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:53.443770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:53.447112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:53.490283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1134/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:53.497309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:53.501794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987d05d-242f-4e23-b6bc-aafd9cac9c51 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:53.522899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddee6-6be0-41f6-b4fe-27e467f29a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:53.524129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddee6-6be0-41f6-b4fe-27e467f29a74 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:53.524699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddee6-6be0-41f6-b4fe-27e467f29a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:53.525240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddee6-6be0-41f6-b4fe-27e467f29a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:53.540647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3fcdd-b151-4841-a69d-3e135776d770 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:53.551801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddee6-6be0-41f6-b4fe-27e467f29a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:53.555584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddee6-6be0-41f6-b4fe-27e467f29a74 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:53.567782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:53.572818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:53.574124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1131/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:53.578414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:53.578888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] PATH_INFO: `/v3/users/b5d1d00492474d8680944cdb284ba701` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:53.582636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d1d00492474d8680944cdb284ba701)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:53.587028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:53.714237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d1d00492474d8680944cdb284ba701'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:53.727564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d1d00492474d8680944cdb284ba701'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:53.729630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d1d00492474d8680944cdb284ba701'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:53.770332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d1d00492474d8680944cdb284ba701'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:53.783915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d1d00492474d8680944cdb284ba701'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:53.833045 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1135/2266] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:53 2022] DELETE /identity/v3/users/b5d1d00492474d8680944cdb284ba701 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:53.838084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c93f83-cd6a-4efb-9672-a7f2053e4d11 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:53.838783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c93f83-cd6a-4efb-9672-a7f2053e4d11 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:53.839290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c93f83-cd6a-4efb-9672-a7f2053e4d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:53.849771 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:53.879868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c8c93f83-cd6a-4efb-9672-a7f2053e4d11 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:53.881238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8c93f83-cd6a-4efb-9672-a7f2053e4d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:53.970311 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1132/2267] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:53.994950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:53.997445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:54.112726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2055f-7f84-4dba-a3c0-925e69368ef9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:54.119760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:54.121151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:54.121652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:54.122174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:54.149529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:54.151708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:54.166056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1136/2268] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:03:55.049702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c53b-8f9b-4d8b-b636-38f09bd2d596 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:55.050138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c53b-8f9b-4d8b-b636-38f09bd2d596 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:55.050310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c53b-8f9b-4d8b-b636-38f09bd2d596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:55.118467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3006c53b-8f9b-4d8b-b636-38f09bd2d596 None None] MFA Rules not processed for user `fb2fa7cdc77043e2b9295424759e9863`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:55.120001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3006c53b-8f9b-4d8b-b636-38f09bd2d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:55.277452 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1133/2269] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:55.279031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:55.281083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:55.312467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e27b5-02e7-40eb-a9d7-b1fbdf3bfc7f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:55.320657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:55.321323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:55.321600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:55.322066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:55.322971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:55.329389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:55.384546 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1137/2270] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:55 2022] POST /identity/v3/projects => generated 397 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:55.392307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c53b-8f9b-4d8b-b636-38f09bd2d596 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:55.423202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c53b-8f9b-4d8b-b636-38f09bd2d596 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:55.611331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:55.612299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:55.612854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:55.613602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:55.633576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:55.641488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:55.700404 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1134/2271] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:55 2022] POST /identity/v3/users => generated 305 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:55.704972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:55.716017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bac3e-9d94-47b6-b71f-47c3c497d569 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:55.722615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:55.723797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:55.724263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:55.724749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:55.725706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:55.727593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:55.741626 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1138/2272] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:55.745361 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:55.747737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:55.770773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b319-646f-439a-a920-9f256e69fa7f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:55.778192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:55.779415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:55.779717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:55.779960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] PATH_INFO: `/v3/projects/1311a4a380124572a4e273bad5b395b2/users/eef984c7dd754336a2afbcc77f5deddb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:55.804930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1311a4a380124572a4e273bad5b395b2, user_id=eef984c7dd754336a2afbcc77f5deddb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:55.808673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:55.821706 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:55.839183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1135/2273] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:55 2022] PUT /identity/v3/projects/1311a4a380124572a4e273bad5b395b2/users/eef984c7dd754336a2afbcc77f5deddb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:55.840466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:55.855285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530eaf89-46e5-4725-8599-f38721c5ebf2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:55.912431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:55.914389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:55.981721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:55.982661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:55.983013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:55.983286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:55.984746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:55.986739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:56.022904 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1139/2274] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:56.025607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:56.043833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2769d-67e6-415c-be0f-b985708c7f3b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:56.051043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:56.051803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:56.052227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:56.052501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] PATH_INFO: `/v3/projects/1311a4a380124572a4e273bad5b395b2/users/eef984c7dd754336a2afbcc77f5deddb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:56.057022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1311a4a380124572a4e273bad5b395b2, user_id=eef984c7dd754336a2afbcc77f5deddb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:56.066696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:56.100894 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1140/2275] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:56 2022] PUT /identity/v3/projects/1311a4a380124572a4e273bad5b395b2/users/eef984c7dd754336a2afbcc77f5deddb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:56.103904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48138b-2b3d-455e-9971-9f5aeaa2d2a5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:56.246666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:56.247827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:56.247827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:56.248224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] PATH_INFO: `/v3/projects/91f1f43892f5490a81c55b2753f52eab` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:56.252734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f1f43892f5490a81c55b2753f52eab)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:56.256056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:56.371514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f1f43892f5490a81c55b2753f52eab', 'request_id': 'req-b93b4f1c-7887-4092-938a-2c766ba5d1cf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.384995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f1f43892f5490a81c55b2753f52eab', 'request_id': 'req-b93b4f1c-7887-4092-938a-2c766ba5d1cf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.397599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f1f43892f5490a81c55b2753f52eab', 'request_id': 'req-b93b4f1c-7887-4092-938a-2c766ba5d1cf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.414196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] The token cache is being invalidate because project 91f1f43892f5490a81c55b2753f52eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:56.414646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.415596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.420278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1136/2276] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:55 2022] DELETE /identity/v3/projects/91f1f43892f5490a81c55b2753f52eab => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:56.422879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:56.424735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:56.451341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b6689-359f-48d0-9933-ece946366f89 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:56.582446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:56.583240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:56.583524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:56.583800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] PATH_INFO: `/v3/users/4d47883c6e6a46b9b21d4acf72149261` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:56.584963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d47883c6e6a46b9b21d4acf72149261)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:56.602112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:56.705381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d47883c6e6a46b9b21d4acf72149261'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.706256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d47883c6e6a46b9b21d4acf72149261'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.707333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d47883c6e6a46b9b21d4acf72149261'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.739547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d47883c6e6a46b9b21d4acf72149261'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.769422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55f43cad-11b5-4df4-b6d0-efb237ab361a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d47883c6e6a46b9b21d4acf72149261'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:56.800518 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1141/2277] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:03:56 2022] DELETE /identity/v3/users/4d47883c6e6a46b9b21d4acf72149261 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:59.018338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:59.029587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4f1c-7887-4092-938a-2c766ba5d1cf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:59.072072 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:59.106714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:59.107836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.108400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.108836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] PATH_INFO: `/v3/projects/7e915233ffc7423ea487920a4f681b02` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.110329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e915233ffc7423ea487920a4f681b02)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:59.115167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:59.199414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e915233ffc7423ea487920a4f681b02', 'request_id': 'req-75c10ab5-2c14-4723-b762-57e1d6062530'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:59.209588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e915233ffc7423ea487920a4f681b02', 'request_id': 'req-75c10ab5-2c14-4723-b762-57e1d6062530'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:59.223168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e915233ffc7423ea487920a4f681b02', 'request_id': 'req-75c10ab5-2c14-4723-b762-57e1d6062530'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:59.244791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] The token cache is being invalidate because project 7e915233ffc7423ea487920a4f681b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:03:59.245539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:59.247104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75c10ab5-2c14-4723-b762-57e1d6062530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:03:59.249573 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1137/2278] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:03:59 2022] DELETE /identity/v3/projects/7e915233ffc7423ea487920a4f681b02 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:03:59.254418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49418-5bd5-4212-9067-1e7a98bd515c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.255314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49418-5bd5-4212-9067-1e7a98bd515c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.255754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49418-5bd5-4212-9067-1e7a98bd515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.274751 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:03:59.292251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fdc49418-5bd5-4212-9067-1e7a98bd515c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:59.294475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fdc49418-5bd5-4212-9067-1e7a98bd515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:59.397138 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1142/2279] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:59.402704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4003f8-57c6-4975-b587-79c7de31b368 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.403212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4003f8-57c6-4975-b587-79c7de31b368 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.404285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4003f8-57c6-4975-b587-79c7de31b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.438433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4a4003f8-57c6-4975-b587-79c7de31b368 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:03:59.440880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4a4003f8-57c6-4975-b587-79c7de31b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:03:59.453235 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1138/2280] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:03:59.457089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc49418-5bd5-4212-9067-1e7a98bd515c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:59.470172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc49418-5bd5-4212-9067-1e7a98bd515c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:59.476956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:59.477870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.478311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.478859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.480009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:03:59.480481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:59.482340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:59.558444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4003f8-57c6-4975-b587-79c7de31b368 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:59.574860 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1143/2281] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:03:59.581359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4003f8-57c6-4975-b587-79c7de31b368 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:59.590312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:59.590935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.591214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.591490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.594484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:59.596500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:59.665324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1139/2282] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:03:59 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:03:59.669132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:59.694880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d142d71-175e-4026-b5ea-b461ce3801f1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:59.785370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:59.786074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.786479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.786856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.787619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:59.790676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:59.848510 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1144/2283] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:03:59 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:03:59.849728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:59.863416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378992e-db6a-499f-b993-d3fbab91f478 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:59.875607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:59.876241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.876522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.876798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.877477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:59.879072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:59.917219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:59.918350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1140/2284] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:59.934369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896e73-7c49-4323-8cdc-15e2eac864fc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:59.940119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398b57-e433-4e4f-b51e-efffc39aee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:59.941115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398b57-e433-4e4f-b51e-efffc39aee31 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:03:59.941590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398b57-e433-4e4f-b51e-efffc39aee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:03:59.942461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398b57-e433-4e4f-b51e-efffc39aee31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:03:59.943205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35398b57-e433-4e4f-b51e-efffc39aee31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:03:59.945038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35398b57-e433-4e4f-b51e-efffc39aee31 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:03:59.959550 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1145/2285] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:03:59.964716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:03:59.984521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b4c73-85e3-4a3c-81dc-24320f08ab38 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:03:59.999073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2080ec-9172-473f-b496-442f95e5101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:03:59.999930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2080ec-9172-473f-b496-442f95e5101d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:00.000218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2080ec-9172-473f-b496-442f95e5101d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:00.000497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2080ec-9172-473f-b496-442f95e5101d admin admin] PATH_INFO: `/v3/projects/7d94f2caa67245c5a883f128bbb2d0b3/users/24c5a9a930bb4c8096c474a6d26cf321/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:00.014434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafab37-becc-489c-bc1b-7948ef4f483c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:00.015497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafab37-becc-489c-bc1b-7948ef4f483c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:00.015937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafab37-becc-489c-bc1b-7948ef4f483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:00.063378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-deafab37-becc-489c-bc1b-7948ef4f483c None None] MFA Rules not processed for user `31366108b1714a61891a680ea35dcc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:00.066117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-deafab37-becc-489c-bc1b-7948ef4f483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.087449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2080ec-9172-473f-b496-442f95e5101d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d94f2caa67245c5a883f128bbb2d0b3, user_id=24c5a9a930bb4c8096c474a6d26cf321, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:00.091355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2080ec-9172-473f-b496-442f95e5101d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:00.120395 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1141/2286] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:03:59 2022] PUT /identity/v3/projects/7d94f2caa67245c5a883f128bbb2d0b3/users/24c5a9a930bb4c8096c474a6d26cf321/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:00.132564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:00.133904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:00.134415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:00.158296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:00.160228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.260387 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:00.290946 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1146/2287] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:00.301763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:00.302235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:00.302557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:00.325792 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1142/2288] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:00.345378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:00.347130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.370646 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:00.390283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] MFA Rules not processed for user `92d56e7f729243e386f7ce8080cf864e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:00.396062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.524554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb11b-0a44-43db-9ff2-d5f2fc354bb3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:00.547145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:00.550254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:00.550549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:00.550899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:00.579378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:00.580823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:00.609357 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1147/2289] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:00.618408 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1143/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:00.620714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:00.622638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.893614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b974-50ae-4371-9af2-c4fb30243494 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:00.913450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e49351-4394-4e7b-80a6-98502ecb5a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:00.914467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e49351-4394-4e7b-80a6-98502ecb5a6a service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:00.914988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e49351-4394-4e7b-80a6-98502ecb5a6a service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:00.916853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e49351-4394-4e7b-80a6-98502ecb5a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:00.924766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-58e49351-4394-4e7b-80a6-98502ecb5a6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:00.963301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e49351-4394-4e7b-80a6-98502ecb5a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:00.970475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e49351-4394-4e7b-80a6-98502ecb5a6a service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:01.009252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1148/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:04.868427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:04.870545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:04.888476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49191bf-f44a-463d-a0ae-64ffa2eecbd7 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:04.900082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96d7e-a673-4965-b583-2d010a44a3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:04.900897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96d7e-a673-4965-b583-2d010a44a3e3 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:04.901360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96d7e-a673-4965-b583-2d010a44a3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:04.901777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96d7e-a673-4965-b583-2d010a44a3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:04.906821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-21e96d7e-a673-4965-b583-2d010a44a3e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:05.003982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e96d7e-a673-4965-b583-2d010a44a3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:05.006605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e96d7e-a673-4965-b583-2d010a44a3e3 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:05.019198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1144/2292] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:05.139109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df7bf2-73a3-4191-b71b-876ff59b3e4c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:05.140313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df7bf2-73a3-4191-b71b-876ff59b3e4c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:05.140819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df7bf2-73a3-4191-b71b-876ff59b3e4c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:05.142883 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1149/2293] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:04:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:04:05.149338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbdb2-eb38-402b-8bb3-5d7fa8edb210 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:05.150115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbdb2-eb38-402b-8bb3-5d7fa8edb210 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:05.150398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbdb2-eb38-402b-8bb3-5d7fa8edb210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:05.181720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e50dbdb2-eb38-402b-8bb3-5d7fa8edb210 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:05.183195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e50dbdb2-eb38-402b-8bb3-5d7fa8edb210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:05.193737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1145/2294] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:04:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:05.236529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df7bf2-73a3-4191-b71b-876ff59b3e4c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:05.268488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df7bf2-73a3-4191-b71b-876ff59b3e4c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:05.276657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935a539-3837-4a73-b299-75d944691679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:05.277954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a539-3837-4a73-b299-75d944691679 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:05.278495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a539-3837-4a73-b299-75d944691679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:05.279112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a539-3837-4a73-b299-75d944691679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:05.289363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935a539-3837-4a73-b299-75d944691679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:05.291406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935a539-3837-4a73-b299-75d944691679 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:05.302997 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1150/2295] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:06.659749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419117a3-688d-467e-ae34-efc4a1492ff8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:06.660382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419117a3-688d-467e-ae34-efc4a1492ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:06.660382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419117a3-688d-467e-ae34-efc4a1492ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:06.705593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-419117a3-688d-467e-ae34-efc4a1492ff8 None None] MFA Rules not processed for user `60ce2a11f47e4e92a51293aca8878034`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:06.707100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-419117a3-688d-467e-ae34-efc4a1492ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:06.799010 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1146/2296] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:09.883820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81ecf-1047-4bc7-8bad-4fb48702e48e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:09.884671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81ecf-1047-4bc7-8bad-4fb48702e48e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:09.885161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81ecf-1047-4bc7-8bad-4fb48702e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:09.930381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a5e81ecf-1047-4bc7-8bad-4fb48702e48e None None] MFA Rules not processed for user `24c5a9a930bb4c8096c474a6d26cf321`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:09.931621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a5e81ecf-1047-4bc7-8bad-4fb48702e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:10.027681 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:10.036985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419117a3-688d-467e-ae34-efc4a1492ff8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:10.041373 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1151/2297] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:10.050456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419117a3-688d-467e-ae34-efc4a1492ff8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:10.056417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:10.057288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:10.057720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:10.058140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:10.058946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:10.061641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:10.103733 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1147/2298] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:04:10 2022] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:04:10.108434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e81ecf-1047-4bc7-8bad-4fb48702e48e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:10.124536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e81ecf-1047-4bc7-8bad-4fb48702e48e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:10.232778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:10.234414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:10.234802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:10.235364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:10.236083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:10.239450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:10.286852 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1152/2299] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:04:10 2022] POST /identity/v3/users => generated 309 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:10.289890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:10.305324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8347622-0429-4317-91e7-bc6b4628f17c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:10.311454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:10.312840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:10.313205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:10.313559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:10.314384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:10.316041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:10.333483 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1148/2300] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:04:10.337583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:10.363509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb387-370b-46d7-b3c0-d9bd2e8113b0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:10.377199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:10.378190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:10.378772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:10.379296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] PATH_INFO: `/v3/projects/7217972748044384bfbfccbcbaef67e4/users/b1e3bdd47b4c430fb3896705d8828a26/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:10.407126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7217972748044384bfbfccbcbaef67e4, user_id=b1e3bdd47b4c430fb3896705d8828a26, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:10.411906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:10.437418 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1153/2301] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:04:10 2022] PUT /identity/v3/projects/7217972748044384bfbfccbcbaef67e4/users/b1e3bdd47b4c430fb3896705d8828a26/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:10.441658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:10.461612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce96a1-4fa8-495c-a68e-7d162c859fee admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:10.490992 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:10.624120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7756cc-c549-4da9-8abe-62286c09007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:10.625596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7756cc-c549-4da9-8abe-62286c09007c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:10.626078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7756cc-c549-4da9-8abe-62286c09007c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:10.626499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7756cc-c549-4da9-8abe-62286c09007c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:10.627298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7756cc-c549-4da9-8abe-62286c09007c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:10.629195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7756cc-c549-4da9-8abe-62286c09007c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:10.656866 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1149/2302] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:04:10.661191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:10.675724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d598429-64a2-42f8-8a23-bca525719ae6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:10.689714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:10.690588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:10.690886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:10.701633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] PATH_INFO: `/v3/projects/7217972748044384bfbfccbcbaef67e4/users/b1e3bdd47b4c430fb3896705d8828a26/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:10.712114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7217972748044384bfbfccbcbaef67e4, user_id=b1e3bdd47b4c430fb3896705d8828a26, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:10.719589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:10.768750 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1154/2303] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:04:10 2022] PUT /identity/v3/projects/7217972748044384bfbfccbcbaef67e4/users/b1e3bdd47b4c430fb3896705d8828a26/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:04:12.604283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451baf-05aa-4d72-840a-9a064f0016aa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:12.605088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451baf-05aa-4d72-840a-9a064f0016aa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:12.605531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451baf-05aa-4d72-840a-9a064f0016aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:12.657113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-65451baf-05aa-4d72-840a-9a064f0016aa None None] MFA Rules not processed for user `7aa53bfd731c433d93e308a56839a106`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:12.658614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-65451baf-05aa-4d72-840a-9a064f0016aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:12.804447 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1150/2304] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:12.806094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:12.808639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:12.923815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacfb0f-04da-4fc8-948a-e6dd18b4350c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:12.930791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:12.931990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:12.932279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:12.932611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:12.933917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:12.937180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:13.018786 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1155/2305] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:04:12 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:13.023061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65451baf-05aa-4d72-840a-9a064f0016aa None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:13.050089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65451baf-05aa-4d72-840a-9a064f0016aa None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:13.178113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:13.178899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:13.179336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:13.179716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:13.181633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:13.183414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:13.224361 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1151/2306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:04:13 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:13.224692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:13.236566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db8c9d-976d-41b8-8ccb-a438a7ec2a2c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:13.256323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:13.256539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:13.256746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:13.257033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:13.257834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:13.259784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:13.287525 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1156/2307] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:04:13.292069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:13.308378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad4c64-3e4e-4e21-b2d7-85bd5e5ad9e5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:13.323114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:13.323951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:13.324339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:13.324720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] PATH_INFO: `/v3/projects/ca4568f10cd74fb59e1de26df0110ff9/users/b72b1a062e2e48798d29ea165e2c20a3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:13.350671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4568f10cd74fb59e1de26df0110ff9, user_id=b72b1a062e2e48798d29ea165e2c20a3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:13.354688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:13.368589 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:13.383062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:13.383833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1152/2308] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:04:13 2022] PUT /identity/v3/projects/ca4568f10cd74fb59e1de26df0110ff9/users/b72b1a062e2e48798d29ea165e2c20a3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:13.396491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8017a-82d4-46b7-a544-b370bedd2a6c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:13.445979 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:13.523322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:13.523958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:13.524229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:13.524504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:13.525200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:13.549575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:13.574009 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1157/2309] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:04:13.576899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:13.594831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813349e3-bafd-4501-b74c-283fefa71811 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:13.606632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c70773-6630-491a-861d-a2f92095ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:13.614617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c70773-6630-491a-861d-a2f92095ae63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:13.615950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c70773-6630-491a-861d-a2f92095ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:13.617881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c70773-6630-491a-861d-a2f92095ae63 admin admin] PATH_INFO: `/v3/projects/ca4568f10cd74fb59e1de26df0110ff9/users/b72b1a062e2e48798d29ea165e2c20a3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:13.621437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c70773-6630-491a-861d-a2f92095ae63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4568f10cd74fb59e1de26df0110ff9, user_id=b72b1a062e2e48798d29ea165e2c20a3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:13.625136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c70773-6630-491a-861d-a2f92095ae63 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:13.645278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1153/2310] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:04:13 2022] PUT /identity/v3/projects/ca4568f10cd74fb59e1de26df0110ff9/users/b72b1a062e2e48798d29ea165e2c20a3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:16.749217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:16.853976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453709e-ccd6-4a30-a6cd-ddc3ce0083b9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:16.951033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3103-773d-4373-a44c-32a791972d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:16.951840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3103-773d-4373-a44c-32a791972d53 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:16.952124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3103-773d-4373-a44c-32a791972d53 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:16.952390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3103-773d-4373-a44c-32a791972d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:16.954465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-76ef3103-773d-4373-a44c-32a791972d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:17.068272 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:17.074004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3103-773d-4373-a44c-32a791972d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:17.078134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3103-773d-4373-a44c-32a791972d53 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:17.126736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1158/2311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:17.294189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4fd6-4cbe-44b0-8776-f08eda794db6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:17.295582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4fd6-4cbe-44b0-8776-f08eda794db6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:17.296047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4fd6-4cbe-44b0-8776-f08eda794db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:17.344455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1cfe4fd6-4cbe-44b0-8776-f08eda794db6 None None] MFA Rules not processed for user `eef984c7dd754336a2afbcc77f5deddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:17.346556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1cfe4fd6-4cbe-44b0-8776-f08eda794db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:17.495195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1154/2312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:17.506318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6f10-8163-495a-aeca-c01d614b0fc4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:17.506683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6f10-8163-495a-aeca-c01d614b0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:17.507030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6f10-8163-495a-aeca-c01d614b0fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:17.534593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d01d6f10-8163-495a-aeca-c01d614b0fc4 None None] MFA Rules not processed for user `fb2fa7cdc77043e2b9295424759e9863`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:17.535903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d01d6f10-8163-495a-aeca-c01d614b0fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:17.656143 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1159/2313] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:18.372119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4fd6-4cbe-44b0-8776-f08eda794db6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:18.388436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4fd6-4cbe-44b0-8776-f08eda794db6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:18.395066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e9397-9e8b-4193-9cf2-9566401cd5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:18.395943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9397-9e8b-4193-9cf2-9566401cd5a8 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:18.396460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9397-9e8b-4193-9cf2-9566401cd5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:18.397147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9397-9e8b-4193-9cf2-9566401cd5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:18.399250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1a9e9397-9e8b-4193-9cf2-9566401cd5a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:18.415062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e9397-9e8b-4193-9cf2-9566401cd5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:18.417553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e9397-9e8b-4193-9cf2-9566401cd5a8 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:18.443214 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1155/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:19.191095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df6ec-e262-4aad-9e12-ad4244f45120 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:19.191893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df6ec-e262-4aad-9e12-ad4244f45120 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:19.192264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df6ec-e262-4aad-9e12-ad4244f45120 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:19.194110 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1160/2315] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:04:19.205400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:19.206097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:19.206695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:19.247777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:19.250098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:19.376697 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1156/2316] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:04:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:19.401895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817df6ec-e262-4aad-9e12-ad4244f45120 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:19.405162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-817df6ec-e262-4aad-9e12-ad4244f45120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:19.435785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817df6ec-e262-4aad-9e12-ad4244f45120 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:19.440092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015a754-a8ac-41df-8e41-63fabb62eb5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:19.440821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a754-a8ac-41df-8e41-63fabb62eb5c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:19.440977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a754-a8ac-41df-8e41-63fabb62eb5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:19.441383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015a754-a8ac-41df-8e41-63fabb62eb5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:19.457498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015a754-a8ac-41df-8e41-63fabb62eb5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:19.458963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015a754-a8ac-41df-8e41-63fabb62eb5c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:19.480828 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1161/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:04:19.653329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:19.655366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:19.813360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e1ce9-55c4-408f-bd1f-759b5ca91713 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:19.819417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c4ad2-c7e9-4320-b47d-97839d13737d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:19.820279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c4ad2-c7e9-4320-b47d-97839d13737d service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:19.821794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c4ad2-c7e9-4320-b47d-97839d13737d service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:19.822568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c4ad2-c7e9-4320-b47d-97839d13737d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:19.826535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f37c4ad2-c7e9-4320-b47d-97839d13737d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:19.846794 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:19.852445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c4ad2-c7e9-4320-b47d-97839d13737d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:19.854528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c4ad2-c7e9-4320-b47d-97839d13737d service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:19.869224 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1157/2318] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:20.162818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9198b-e9a9-433e-910a-688e805ccd54 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:20.163613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9198b-e9a9-433e-910a-688e805ccd54 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:20.164237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9198b-e9a9-433e-910a-688e805ccd54 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:20.167575 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1162/2319] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:04:20 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:04:20.173153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8593e-bff3-41d2-a5f7-7a18c9f4f8c7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:20.173440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8593e-bff3-41d2-a5f7-7a18c9f4f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:20.173714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8593e-bff3-41d2-a5f7-7a18c9f4f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:20.208841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f3f8593e-bff3-41d2-a5f7-7a18c9f4f8c7 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:20.210757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f3f8593e-bff3-41d2-a5f7-7a18c9f4f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:20.227423 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1158/2320] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:20.291147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9198b-e9a9-433e-910a-688e805ccd54 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:20.309973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9198b-e9a9-433e-910a-688e805ccd54 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:20.319668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:20.320346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:20.320626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:20.320948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:20.353956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:20.355414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:20.386410 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1163/2321] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:22.272915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133687c8-9122-459e-bd26-759c36fae8d9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:22.278658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133687c8-9122-459e-bd26-759c36fae8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:22.279132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133687c8-9122-459e-bd26-759c36fae8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:22.364548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-133687c8-9122-459e-bd26-759c36fae8d9 None None] MFA Rules not processed for user `b1e3bdd47b4c430fb3896705d8828a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:22.369450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-133687c8-9122-459e-bd26-759c36fae8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:22.593736 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1159/2322] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:30.292069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:30.309676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8df1-2187-4cc9-b3e1-3d2aeb330f8c service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:30.323011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:30.323946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:30.327077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:30.327743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:30.490655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218037-16d6-4b7d-a745-a639d1243823 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:30.491228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218037-16d6-4b7d-a745-a639d1243823 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:30.491506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218037-16d6-4b7d-a745-a639d1243823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:30.504306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:30.509079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:30.553453 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1164/2323] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:30.584712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2a218037-16d6-4b7d-a745-a639d1243823 None None] MFA Rules not processed for user `b72b1a062e2e48798d29ea165e2c20a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:30.588931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a218037-16d6-4b7d-a745-a639d1243823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:30.784198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1160/2324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:30.799677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:30.801544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:30.923038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fd25d-4b58-4f15-b658-a79582419bd9 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:30.933568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81cc00-74df-44f6-a53b-dd0645d62d18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:30.934207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cc00-74df-44f6-a53b-dd0645d62d18 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:30.934490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cc00-74df-44f6-a53b-dd0645d62d18 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:30.934842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cc00-74df-44f6-a53b-dd0645d62d18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:30.946922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81cc00-74df-44f6-a53b-dd0645d62d18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:30.949251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81cc00-74df-44f6-a53b-dd0645d62d18 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:30.964696 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1165/2325] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:33.357485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6add-0b04-4906-937e-7b17e6ebc10b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:33.360243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6add-0b04-4906-937e-7b17e6ebc10b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:33.360243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6add-0b04-4906-937e-7b17e6ebc10b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:33.362015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1161/2326] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:04:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:04:33.385536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970b106-b48e-4e86-839b-f8c305f8bcac None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:33.386413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970b106-b48e-4e86-839b-f8c305f8bcac None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:33.386893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970b106-b48e-4e86-839b-f8c305f8bcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:33.487766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f970b106-b48e-4e86-839b-f8c305f8bcac None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:33.489308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f970b106-b48e-4e86-839b-f8c305f8bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:33.505887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1166/2327] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:33.587198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6add-0b04-4906-937e-7b17e6ebc10b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:33.633865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6add-0b04-4906-937e-7b17e6ebc10b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:33.714845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:33.719912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:33.721803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:33.722434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:33.749963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:33.771111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:33.824603 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1162/2328] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:35.250902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af603c-7b66-4a6e-949f-fa2693e50ae1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:35.251416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af603c-7b66-4a6e-949f-fa2693e50ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:35.251698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af603c-7b66-4a6e-949f-fa2693e50ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:35.270458 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:35.291660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b1af603c-7b66-4a6e-949f-fa2693e50ae1 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:35.293911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b1af603c-7b66-4a6e-949f-fa2693e50ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:35.306452 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1167/2329] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:35.322074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:35.339390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6823d8-81f6-4341-8558-ebd9924b1a97 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:35.351277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:35.354841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:35.357185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:35.357740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:35.394331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:35.399551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:35.432311 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1163/2330] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:35.691167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c5a8-e687-4577-bd41-9499c6a9eec3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:35.691747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c5a8-e687-4577-bd41-9499c6a9eec3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:35.692495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27c5a8-e687-4577-bd41-9499c6a9eec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:35.729955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3d27c5a8-e687-4577-bd41-9499c6a9eec3 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:35.731272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d27c5a8-e687-4577-bd41-9499c6a9eec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:35.906940 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1168/2331] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:35.959693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:35.964862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:36.039777 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:36.140142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcce97-b5d6-465a-b842-3a1c20bb9781 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:36.153430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c5de4-7d4d-4568-9b5a-f62a7a862a02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:36.154528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c5de4-7d4d-4568-9b5a-f62a7a862a02 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:36.155159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c5de4-7d4d-4568-9b5a-f62a7a862a02 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:36.155159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c5de4-7d4d-4568-9b5a-f62a7a862a02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:36.173948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c5de4-7d4d-4568-9b5a-f62a7a862a02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:36.177646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c5de4-7d4d-4568-9b5a-f62a7a862a02 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:36.226510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1164/2332] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:04:44.134380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27c5a8-e687-4577-bd41-9499c6a9eec3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:44.346897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27c5a8-e687-4577-bd41-9499c6a9eec3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:44.353882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:44.354825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:44.355340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:44.356752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] PATH_INFO: `/v3/users/24c5a9a930bb4c8096c474a6d26cf321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:44.359025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c5a9a930bb4c8096c474a6d26cf321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:44.362197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:44.561166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c5a9a930bb4c8096c474a6d26cf321'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:44.562832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c5a9a930bb4c8096c474a6d26cf321'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:44.563923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c5a9a930bb4c8096c474a6d26cf321'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:44.583209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c5a9a930bb4c8096c474a6d26cf321'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:44.595811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c5a9a930bb4c8096c474a6d26cf321'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:44.647493 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1169/2333] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:04:44 2022] DELETE /identity/v3/users/24c5a9a930bb4c8096c474a6d26cf321 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:45.120970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:45.122054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:45.123371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:45.199247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:45.202085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:45.207593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:45.209028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:45.255298 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:45.325883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f684-34f1-4808-a5d0-f585585e2d29 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:45.331462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:45.332111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:45.332382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:45.332818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] PATH_INFO: `/v3/projects/7d94f2caa67245c5a883f128bbb2d0b3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:45.334205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d94f2caa67245c5a883f128bbb2d0b3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:45.336126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:45.358189 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1165/2334] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:45.372242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:45.376325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:45.420456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d94f2caa67245c5a883f128bbb2d0b3', 'request_id': 'req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.436410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d94f2caa67245c5a883f128bbb2d0b3', 'request_id': 'req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.447083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d94f2caa67245c5a883f128bbb2d0b3', 'request_id': 'req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.480927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] The token cache is being invalidate because project 7d94f2caa67245c5a883f128bbb2d0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:04:45.483202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.485351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.491199 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1170/2335] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:04:45 2022] DELETE /identity/v3/projects/7d94f2caa67245c5a883f128bbb2d0b3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:45.515233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:45.521114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:45.652854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad1f8f-146c-4b02-89cc-0a03f538ba29 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:45.729045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd1f8d-fa5d-43b2-910f-7fc1ad343f1e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:45.744823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:45.747898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:45.749697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:45.751068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] PATH_INFO: `/v3/users/b1e3bdd47b4c430fb3896705d8828a26` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:45.754315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e3bdd47b4c430fb3896705d8828a26)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:45.761917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:45.852934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379747b-6f65-453f-8260-089ca89cd7e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:45.854255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379747b-6f65-453f-8260-089ca89cd7e6 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:45.854724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379747b-6f65-453f-8260-089ca89cd7e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:45.855014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379747b-6f65-453f-8260-089ca89cd7e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:45.873360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2379747b-6f65-453f-8260-089ca89cd7e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:45.896291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e3bdd47b4c430fb3896705d8828a26'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.897464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e3bdd47b4c430fb3896705d8828a26'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.899071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e3bdd47b4c430fb3896705d8828a26'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.907544 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:45.912145 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:45.953034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e3bdd47b4c430fb3896705d8828a26'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:45.983827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e3bdd47b4c430fb3896705d8828a26'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:46.040015 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1171/2336] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:04:45 2022] DELETE /identity/v3/users/b1e3bdd47b4c430fb3896705d8828a26 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:46.117386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379747b-6f65-453f-8260-089ca89cd7e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:46.120308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379747b-6f65-453f-8260-089ca89cd7e6 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:46.166709 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1166/2337] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:04:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:04:46.785810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:46.789013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:47.017275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4237b-2aec-4ec6-a0da-8524dc21a48d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:47.024160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:47.025474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:47.025752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:47.026021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] PATH_INFO: `/v3/projects/7217972748044384bfbfccbcbaef67e4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:47.028527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7217972748044384bfbfccbcbaef67e4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:47.035897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:47.210925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7217972748044384bfbfccbcbaef67e4', 'request_id': 'req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:47.221849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7217972748044384bfbfccbcbaef67e4', 'request_id': 'req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:47.234175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7217972748044384bfbfccbcbaef67e4', 'request_id': 'req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:47.291487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] The token cache is being invalidate because project 7217972748044384bfbfccbcbaef67e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:04:47.292034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:47.293492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c8aacd06-b1a6-4633-9ea4-e84c91ff7890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:47.295942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1172/2338] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:04:46 2022] DELETE /identity/v3/projects/7217972748044384bfbfccbcbaef67e4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:47.301920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316da0b-0ca3-438e-9655-2cc6bd1a92fb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:47.302897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316da0b-0ca3-438e-9655-2cc6bd1a92fb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:47.303429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316da0b-0ca3-438e-9655-2cc6bd1a92fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:47.345029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a316da0b-0ca3-438e-9655-2cc6bd1a92fb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:47.348528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a316da0b-0ca3-438e-9655-2cc6bd1a92fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:47.495789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1167/2339] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:47.504983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:47.504983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:47.505512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:47.539900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:47.542955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:47.578946 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1173/2340] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:47.583295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316da0b-0ca3-438e-9655-2cc6bd1a92fb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:47.603328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:47.606642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:47.621511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316da0b-0ca3-438e-9655-2cc6bd1a92fb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:47.650195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:47.651792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:47.655052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:47.655522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:47.656403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:04:47.657339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:47.659674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:47.695831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1168/2341] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:04:47.699768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:47.720539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4883d-54f1-42fa-8dbc-0ad264bed672 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:47.738874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:47.740237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:47.742430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:47.743096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:47.744111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:47.746348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:47.773927 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:47.828422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1169/2342] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:04:47 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:47.833574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:47.845767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281b127-86cf-4e36-a856-43142c0ebb02 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:48.015264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7805b6-f666-46ee-96df-f92d92958f34 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:48.021960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:48.023504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.024690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.026124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.031187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:48.032833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:48.033762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.034419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.035457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.036330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:48.041606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:48.102435 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1170/2343] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:04:47 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:48.107007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:48.134016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9b9d-71d2-4235-ad8d-5a266dab4217 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:48.156081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:48.157190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.158174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.158819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.159927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:48.164335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:48.168855 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:48.198391 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1171/2344] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:04:48.203953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:48.230572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7810afe-90a7-412d-a025-26114dcfb586 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:48.231989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:48.235394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:48.245388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aa696-e320-49ac-b9c8-bc9989f4b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:48.246168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aa696-e320-49ac-b9c8-bc9989f4b574 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.248227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aa696-e320-49ac-b9c8-bc9989f4b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.249079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aa696-e320-49ac-b9c8-bc9989f4b574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.250886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aa696-e320-49ac-b9c8-bc9989f4b574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:48.258316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aa696-e320-49ac-b9c8-bc9989f4b574 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:48.267829 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1174/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:48.279054 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1172/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:04:48.282999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:48.301253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346cde2-0b8f-432f-804b-d4a18c459f38 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:48.314808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:48.315551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.315900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.316248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] PATH_INFO: `/v3/projects/feae46c5b38f41eeac7271450461f5bf/users/95ac2f141e404f1cabdb767e4107aa3d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.342404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] RBAC: Authorizing `identity:create_grant(project_id=feae46c5b38f41eeac7271450461f5bf, user_id=95ac2f141e404f1cabdb767e4107aa3d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:48.347146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:48.376620 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1175/2347] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:04:48 2022] PUT /identity/v3/projects/feae46c5b38f41eeac7271450461f5bf/users/95ac2f141e404f1cabdb767e4107aa3d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:48.387686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e495-6f69-47a5-93fc-7e6da5bae849 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.390838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e495-6f69-47a5-93fc-7e6da5bae849 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.391285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e495-6f69-47a5-93fc-7e6da5bae849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.444595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ebb9e495-6f69-47a5-93fc-7e6da5bae849 None None] MFA Rules not processed for user `95ac2f141e404f1cabdb767e4107aa3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:48.445872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ebb9e495-6f69-47a5-93fc-7e6da5bae849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:48.656910 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1173/2348] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:48.664651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:48.804272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d32b8-7fa3-49a0-848d-21d85a4b790c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:48.821336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:48.821996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.822275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.822546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.823261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:48.825205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:48.839758 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:48.900989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1176/2349] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:04:48 2022] POST /identity/v3/projects => generated 393 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:48.905915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e495-6f69-47a5-93fc-7e6da5bae849 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:48.928328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e495-6f69-47a5-93fc-7e6da5bae849 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:49.061842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:49.064322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:49.064663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:49.065003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:49.069838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:49.071845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:49.142740 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1174/2350] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:04:48 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:49.145698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:49.182720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25000b5d-cbab-4914-863a-48c011e84405 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:49.205573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:49.206491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:49.206979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:49.207712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:49.209700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:49.219172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:49.242555 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1177/2351] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:04:49.246522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:49.272586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceca53-2e53-48af-a3ff-8f68884cd9e2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:49.292256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:49.293196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:49.293735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:49.294137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] PATH_INFO: `/v3/projects/4f7f85885acd4d55bbc5a1592937b53a/users/3e936f78cc5649ccac04523d6c379283/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:49.354777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7f85885acd4d55bbc5a1592937b53a, user_id=3e936f78cc5649ccac04523d6c379283, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:49.368466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:49.402026 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1175/2352] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:04:49 2022] PUT /identity/v3/projects/4f7f85885acd4d55bbc5a1592937b53a/users/3e936f78cc5649ccac04523d6c379283/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:49.406246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:49.420060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c57fbc-f5b3-41dc-974b-e40b9e88c254 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:49.531071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52c829-a8b6-43a4-917b-46b81dc0f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:49.532155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52c829-a8b6-43a4-917b-46b81dc0f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:49.532595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52c829-a8b6-43a4-917b-46b81dc0f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:49.533025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52c829-a8b6-43a4-917b-46b81dc0f2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:49.535168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52c829-a8b6-43a4-917b-46b81dc0f2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:49.536968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52c829-a8b6-43a4-917b-46b81dc0f2d7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:49.558845 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1178/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:04:49.571683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:49.589464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c6df5-e4a0-4d8d-ba8c-638455f0280e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:49.702174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72e730-dc31-4f19-8951-846c0a46e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:49.703032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72e730-dc31-4f19-8951-846c0a46e43d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:49.703410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72e730-dc31-4f19-8951-846c0a46e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:49.703781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72e730-dc31-4f19-8951-846c0a46e43d admin admin] PATH_INFO: `/v3/projects/4f7f85885acd4d55bbc5a1592937b53a/users/3e936f78cc5649ccac04523d6c379283/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:49.711201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72e730-dc31-4f19-8951-846c0a46e43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7f85885acd4d55bbc5a1592937b53a, user_id=3e936f78cc5649ccac04523d6c379283, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:49.721568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72e730-dc31-4f19-8951-846c0a46e43d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:49.783906 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1176/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:04:49 2022] PUT /identity/v3/projects/4f7f85885acd4d55bbc5a1592937b53a/users/3e936f78cc5649ccac04523d6c379283/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:49.792138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672360a-04f5-4099-ba6b-4fcdd3f3bb03 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:49.792691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672360a-04f5-4099-ba6b-4fcdd3f3bb03 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:49.794134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672360a-04f5-4099-ba6b-4fcdd3f3bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:49.849501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6672360a-04f5-4099-ba6b-4fcdd3f3bb03 None None] MFA Rules not processed for user `3e936f78cc5649ccac04523d6c379283`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:49.852040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6672360a-04f5-4099-ba6b-4fcdd3f3bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:50.025926 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1179/2355] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:50.037023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:50.037935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:50.038422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:50.078699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] MFA Rules not processed for user `95ac2f141e404f1cabdb767e4107aa3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:50.080368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:50.118699 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:50.171535 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1177/2356] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:51.141420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672360a-04f5-4099-ba6b-4fcdd3f3bb03 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:51.210119 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:51.235830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672360a-04f5-4099-ba6b-4fcdd3f3bb03 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:51.242451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b016-94c0-4bcb-bfb1-94f0d98821d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:51.243207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b016-94c0-4bcb-bfb1-94f0d98821d5 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:51.243558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b016-94c0-4bcb-bfb1-94f0d98821d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:51.243838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b016-94c0-4bcb-bfb1-94f0d98821d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:51.254059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5b016-94c0-4bcb-bfb1-94f0d98821d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:51.255892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5b016-94c0-4bcb-bfb1-94f0d98821d5 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:51.272739 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1180/2357] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:56.775644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:56.777242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:56.860103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5f57e-9c21-4155-b36f-94cb9f8da123 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:56.867932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:56.868884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:56.869199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:56.869476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] PATH_INFO: `/v3/users/60ce2a11f47e4e92a51293aca8878034` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:56.870653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ce2a11f47e4e92a51293aca8878034)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:56.873241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:56.953938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ce2a11f47e4e92a51293aca8878034'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:56.954796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ce2a11f47e4e92a51293aca8878034'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:56.955410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ce2a11f47e4e92a51293aca8878034'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:56.965604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ce2a11f47e4e92a51293aca8878034'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:56.983241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ce2a11f47e4e92a51293aca8878034'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:57.007233 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1178/2358] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:04:56 2022] DELETE /identity/v3/users/60ce2a11f47e4e92a51293aca8878034 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:57.010027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:57.011487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:57.011968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:57.056341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:57.065346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:57.217206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:57.219570 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1181/2359] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:57.220131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:57.345850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacf9c3-be3b-457e-90a9-30afda6fb8c5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:57.368091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:57.368939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:57.374088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:57.375616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:57.387172 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:57.395281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:57.398638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:57.425754 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1179/2360] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:58.008887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:58.010491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:58.061371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe0ff-ed88-4014-bb07-5aab591a68d1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:58.076518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:58.079040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:58.079731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:58.080652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] PATH_INFO: `/v3/projects/29c587c4aba443d3b2d1bc4895baea64` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:58.083792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c587c4aba443d3b2d1bc4895baea64)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:58.089027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:58.209422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c587c4aba443d3b2d1bc4895baea64', 'request_id': 'req-15eb951e-8976-41bb-8d44-03bb25f0652e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.218754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c587c4aba443d3b2d1bc4895baea64', 'request_id': 'req-15eb951e-8976-41bb-8d44-03bb25f0652e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.229074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c587c4aba443d3b2d1bc4895baea64', 'request_id': 'req-15eb951e-8976-41bb-8d44-03bb25f0652e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.272568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] The token cache is being invalidate because project 29c587c4aba443d3b2d1bc4895baea64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:04:58.274302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.276904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15eb951e-8976-41bb-8d44-03bb25f0652e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.281671 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1182/2361] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:04:58 2022] DELETE /identity/v3/projects/29c587c4aba443d3b2d1bc4895baea64 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:58.285432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:58.299816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b621-1d5a-4616-8e92-b26095fb022a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:58.548062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:58.551410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:58.552695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:58.554085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] PATH_INFO: `/v3/users/f504ceea0eab4699aa8b045e04c3a882` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:58.569437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f504ceea0eab4699aa8b045e04c3a882)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:58.571713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:58.686879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f504ceea0eab4699aa8b045e04c3a882'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.687973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f504ceea0eab4699aa8b045e04c3a882'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.688922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f504ceea0eab4699aa8b045e04c3a882'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.700446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f504ceea0eab4699aa8b045e04c3a882'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.714767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f504ceea0eab4699aa8b045e04c3a882'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:58.737200 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1180/2362] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:04:58 2022] DELETE /identity/v3/users/f504ceea0eab4699aa8b045e04c3a882 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:59.076641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:59.082383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:59.082960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:59.132516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:59.135351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:59.196115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:59.197869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:59.308105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f8ba-c7fc-48bd-8e8c-d436b6159c9a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:59.327313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:59.327313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:59.327313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:59.327313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] PATH_INFO: `/v3/projects/b0d367b1ba7c4aa59d7adb487d4f56ef` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:59.327734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1183/2363] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:59.328596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d367b1ba7c4aa59d7adb487d4f56ef)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:59.332225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:59.373863 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:59.384115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:59.385783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:59.412907 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:59.434639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d367b1ba7c4aa59d7adb487d4f56ef', 'request_id': 'req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:59.449155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d367b1ba7c4aa59d7adb487d4f56ef', 'request_id': 'req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:59.469743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d367b1ba7c4aa59d7adb487d4f56ef', 'request_id': 'req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:59.485417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] The token cache is being invalidate because project b0d367b1ba7c4aa59d7adb487d4f56ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:04:59.486012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:59.492119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40e0772d-b2bb-4e56-a132-4a7ae387c2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:59.494337 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1181/2364] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:04:59 2022] DELETE /identity/v3/projects/b0d367b1ba7c4aa59d7adb487d4f56ef => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:59.500379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909455-b450-45ef-b58c-b866feb00011 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:59.500986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909455-b450-45ef-b58c-b866feb00011 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:59.501433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35909455-b450-45ef-b58c-b866feb00011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:59.518634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dde6b-0a77-40eb-95a2-768ca4e60804 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:59.570840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-35909455-b450-45ef-b58c-b866feb00011 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:59.572122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35909455-b450-45ef-b58c-b866feb00011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:59.630365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:59.631224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:59.631523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:59.631903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:59.635777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:59.741670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:59.745638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:59.752469 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1182/2365] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:59.759258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886dbb-8515-44ad-b250-d28aa94ddc92 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:59.759669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886dbb-8515-44ad-b250-d28aa94ddc92 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:59.760069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886dbb-8515-44ad-b250-d28aa94ddc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:59.766622 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1184/2366] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:04:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:04:59.790027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-85886dbb-8515-44ad-b250-d28aa94ddc92 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:59.791737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-85886dbb-8515-44ad-b250-d28aa94ddc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:59.803532 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1183/2367] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:04:59.807335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:59.825794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebefc6-1b6f-4459-b5a2-948aa6f80ac0 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:59.831682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:59.832618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:59.833175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:59.833684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:59.834457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:04:59.835050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:59.838983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:59.855649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1185/2368] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:04:59.860523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886dbb-8515-44ad-b250-d28aa94ddc92 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:59.872656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886dbb-8515-44ad-b250-d28aa94ddc92 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:59.879784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:59.880699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:59.881112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:59.881534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:59.882296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:59.884845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:59.966541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1184/2369] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:04:59 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:04:59.970343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:59.993005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cf4d1-69a7-4695-ad11-e74bf6078972 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:00.089859 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:00.132637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:00.133775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:00.134607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:00.134607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:00.135440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:00.146513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:00.205375 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1186/2370] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:04:59 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:00.209470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:00.227705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d422d-0c42-4be8-98ea-19331bc22156 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:00.241749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:00.242766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:00.243256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:00.243646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:00.244459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:00.247099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:00.267399 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1185/2371] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:00.271258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:00.288732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b086b1-dd2b-402d-ba12-74c36b3171da admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:00.295870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a3337-e7cd-4f47-8755-496b711e3510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:00.297014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3337-e7cd-4f47-8755-496b711e3510 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:00.297430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3337-e7cd-4f47-8755-496b711e3510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:00.297814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3337-e7cd-4f47-8755-496b711e3510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:00.298914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a3337-e7cd-4f47-8755-496b711e3510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:00.302227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a3337-e7cd-4f47-8755-496b711e3510 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:00.339635 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1187/2372] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:00.341239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:00.358322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b78d-cef3-4359-8a54-7ef34652c6f3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:00.394578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:00.395263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:00.395540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:00.395810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] PATH_INFO: `/v3/projects/0cb55558a1e3436a831a2cd1ba11fa48/users/a2b7b813e3b1448ba3360475b37a468f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:00.445370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb55558a1e3436a831a2cd1ba11fa48, user_id=a2b7b813e3b1448ba3360475b37a468f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:00.448031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:00.489675 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1186/2373] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:05:00 2022] PUT /identity/v3/projects/0cb55558a1e3436a831a2cd1ba11fa48/users/a2b7b813e3b1448ba3360475b37a468f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:05:00.490371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6220a72-4673-4209-b819-4e077b904a52 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:00.490978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6220a72-4673-4209-b819-4e077b904a52 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:00.491562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6220a72-4673-4209-b819-4e077b904a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:00.612712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e6220a72-4673-4209-b819-4e077b904a52 None None] MFA Rules not processed for user `a2b7b813e3b1448ba3360475b37a468f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:00.620802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e6220a72-4673-4209-b819-4e077b904a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:00.875806 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1188/2374] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:05:00.880468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:01.018779 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:01.082944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721b1df-338c-44d5-acb8-e1b9ca1365ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:01.089841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:01.090503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:01.104230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:01.104687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:01.106441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:01.109412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:01.192330 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1187/2375] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:05:00 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:01.193644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6220a72-4673-4209-b819-4e077b904a52 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:01.229456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6220a72-4673-4209-b819-4e077b904a52 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:01.429935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:01.431728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:01.432225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:01.432699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:01.433673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:01.436840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:01.473323 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1189/2376] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:05:01 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:01.478140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:01.493540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770937-092f-4d70-b896-e16df7144b0e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:01.500485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:01.501790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:01.502301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:01.502849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:01.503798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:01.505788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:01.520245 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1188/2377] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:01.524645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:01.561607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359cc1-e891-4515-aa75-578b938e6115 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:01.577515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:01.578332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:01.578748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:01.579179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] PATH_INFO: `/v3/projects/42dcd83d48eb40dd972f0a4e3837a6d9/users/aaae0255719f4975a5de2e05e8d74d03/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:01.604423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] RBAC: Authorizing `identity:create_grant(project_id=42dcd83d48eb40dd972f0a4e3837a6d9, user_id=aaae0255719f4975a5de2e05e8d74d03, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:01.608057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:01.649453 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1190/2378] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:05:01 2022] PUT /identity/v3/projects/42dcd83d48eb40dd972f0a4e3837a6d9/users/aaae0255719f4975a5de2e05e8d74d03/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:01.653269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:01.668206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9178bc-e160-4ac3-a92f-a6450920d517 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:01.773177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec904971-7cbb-4080-aee9-e80f1737d59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:01.773880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904971-7cbb-4080-aee9-e80f1737d59c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:01.774222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904971-7cbb-4080-aee9-e80f1737d59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:01.774685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904971-7cbb-4080-aee9-e80f1737d59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:01.775459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec904971-7cbb-4080-aee9-e80f1737d59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:01.777135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec904971-7cbb-4080-aee9-e80f1737d59c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:01.797443 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1189/2379] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:01.800376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:01.835343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08595-8138-4ea5-9341-e1e62d92babf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:01.843673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485211ea-7336-46c6-b81e-e82196138f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:01.844802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485211ea-7336-46c6-b81e-e82196138f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:01.844802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485211ea-7336-46c6-b81e-e82196138f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:01.845453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485211ea-7336-46c6-b81e-e82196138f6e admin admin] PATH_INFO: `/v3/projects/42dcd83d48eb40dd972f0a4e3837a6d9/users/aaae0255719f4975a5de2e05e8d74d03/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:01.848728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485211ea-7336-46c6-b81e-e82196138f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42dcd83d48eb40dd972f0a4e3837a6d9, user_id=aaae0255719f4975a5de2e05e8d74d03, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:01.852769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485211ea-7336-46c6-b81e-e82196138f6e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:01.882706 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:01.889695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1191/2380] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:05:01 2022] PUT /identity/v3/projects/42dcd83d48eb40dd972f0a4e3837a6d9/users/aaae0255719f4975a5de2e05e8d74d03/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:01.902031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c71fa5-3d92-40a3-89aa-dc7891f658bf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:01.904754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c71fa5-3d92-40a3-89aa-dc7891f658bf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:01.905306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c71fa5-3d92-40a3-89aa-dc7891f658bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:01.948045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-69c71fa5-3d92-40a3-89aa-dc7891f658bf None None] MFA Rules not processed for user `aaae0255719f4975a5de2e05e8d74d03`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:01.950379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-69c71fa5-3d92-40a3-89aa-dc7891f658bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:02.043197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:02.043580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:02.044782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:02.098824 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1190/2381] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:02.110601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd1a5-e91c-461b-b21c-df4ebf23600a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:02.110892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd1a5-e91c-461b-b21c-df4ebf23600a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:02.111171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd1a5-e91c-461b-b21c-df4ebf23600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:02.124025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] MFA Rules not processed for user `a048a1b75a74409fa68b87726d01d506`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:02.131167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:02.153762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d5cfd1a5-e91c-461b-b21c-df4ebf23600a None None] MFA Rules not processed for user `a2b7b813e3b1448ba3360475b37a468f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:02.155125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5cfd1a5-e91c-461b-b21c-df4ebf23600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:02.237884 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:02.274484 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1192/2382] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:02.301279 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1191/2383] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:02.508684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:02.510497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:02.607677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0f28e-dee3-49a6-8490-c769cc41438c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:02.608430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0f28e-dee3-49a6-8490-c769cc41438c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:02.608707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0f28e-dee3-49a6-8490-c769cc41438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:02.649647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9bf0f28e-dee3-49a6-8490-c769cc41438c None None] MFA Rules not processed for user `92d56e7f729243e386f7ce8080cf864e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:02.651075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9bf0f28e-dee3-49a6-8490-c769cc41438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:02.680774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8407cb-d760-41e0-a4d5-b64631706eed None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:02.699640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486406c6-1963-4c85-b00f-70b92d182a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:02.701106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486406c6-1963-4c85-b00f-70b92d182a04 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:02.701106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486406c6-1963-4c85-b00f-70b92d182a04 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:02.701106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486406c6-1963-4c85-b00f-70b92d182a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:02.704967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-486406c6-1963-4c85-b00f-70b92d182a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:02.756129 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1192/2384] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:02.807776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486406c6-1963-4c85-b00f-70b92d182a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:02.809463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486406c6-1963-4c85-b00f-70b92d182a04 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:02.820664 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1193/2385] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:02.903119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0f28e-dee3-49a6-8490-c769cc41438c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:02.920826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0f28e-dee3-49a6-8490-c769cc41438c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:02.927558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0a9a-ad4f-4fe7-a04c-eaa46989d6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:02.932748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0a9a-ad4f-4fe7-a04c-eaa46989d6eb service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:02.932939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0a9a-ad4f-4fe7-a04c-eaa46989d6eb service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:02.933215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0a9a-ad4f-4fe7-a04c-eaa46989d6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:02.952064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0a9a-ad4f-4fe7-a04c-eaa46989d6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:02.953804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0a9a-ad4f-4fe7-a04c-eaa46989d6eb service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:02.964888 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1193/2386] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:04.119272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ad61-a16a-4752-9757-24662683b4e0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:04.120265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ad61-a16a-4752-9757-24662683b4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:04.120690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ad61-a16a-4752-9757-24662683b4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:04.179248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d310ad61-a16a-4752-9757-24662683b4e0 None None] MFA Rules not processed for user `a2b7b813e3b1448ba3360475b37a468f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:04.180500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d310ad61-a16a-4752-9757-24662683b4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:04.203143 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1194/2387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:06.362196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4f0-6d8d-4a85-afe1-b07e843889a2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:06.362734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4f0-6d8d-4a85-afe1-b07e843889a2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:06.363230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4f0-6d8d-4a85-afe1-b07e843889a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:06.388077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b34f4f0-6d8d-4a85-afe1-b07e843889a2 None None] MFA Rules not processed for user `7aa53bfd731c433d93e308a56839a106`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:06.389583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b34f4f0-6d8d-4a85-afe1-b07e843889a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:06.397224 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1194/2388] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:07.451782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110d6-1390-430c-afe0-772e653d54dd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:07.452406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110d6-1390-430c-afe0-772e653d54dd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:07.452406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460110d6-1390-430c-afe0-772e653d54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:07.487731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-460110d6-1390-430c-afe0-772e653d54dd None None] MFA Rules not processed for user `51d78a7c9f864115ac02046fa5d313eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:07.489003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-460110d6-1390-430c-afe0-772e653d54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:07.556322 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:07.601111 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1195/2389] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:11.342198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986482-685e-4a2a-9445-b21cd78d239c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:11.342695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986482-685e-4a2a-9445-b21cd78d239c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:11.343039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986482-685e-4a2a-9445-b21cd78d239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:11.412880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-46986482-685e-4a2a-9445-b21cd78d239c None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:11.424101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-46986482-685e-4a2a-9445-b21cd78d239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:11.584530 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1195/2390] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:05:11.596772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110d6-1390-430c-afe0-772e653d54dd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:11.601367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-460110d6-1390-430c-afe0-772e653d54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:11.753463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460110d6-1390-430c-afe0-772e653d54dd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:11.761848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:11.763206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:11.763666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:11.764115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:11.784764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:11.788058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:11.803723 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1196/2391] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:05:21.563411 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=68 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:21.797427 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=41 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:24.202723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:24.203332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:24.203768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:24.266695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:24.269475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:24.285470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1196/2392] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:24.301825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:24.317274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34714-6344-401f-b27e-dbd28a3d98dc service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:24.324362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee7d7b-e398-472f-a9ef-b080712c22cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:24.325484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7d7b-e398-472f-a9ef-b080712c22cf service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:24.325976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7d7b-e398-472f-a9ef-b080712c22cf service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:24.326215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee7d7b-e398-472f-a9ef-b080712c22cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:24.341574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee7d7b-e398-472f-a9ef-b080712c22cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:24.343349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee7d7b-e398-472f-a9ef-b080712c22cf service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:24.359352 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1197/2393] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:05:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:05:34.242937 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:34.353003 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:35.110719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:35.112165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:35.298919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb966d92-4c1c-46d4-b48f-5b0dcfe40370 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:35.318588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:35.319481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:35.319767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:35.320037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] PATH_INFO: `/v3/users/95ac2f141e404f1cabdb767e4107aa3d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:35.321263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ac2f141e404f1cabdb767e4107aa3d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:35.326277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:35.462841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:35.463741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:35.464176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:35.485570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ac2f141e404f1cabdb767e4107aa3d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:35.486254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ac2f141e404f1cabdb767e4107aa3d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:35.487890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ac2f141e404f1cabdb767e4107aa3d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:35.491976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] MFA Rules not processed for user `fb2fa7cdc77043e2b9295424759e9863`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:35.494273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:35.504450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ac2f141e404f1cabdb767e4107aa3d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:35.537806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f7b5ce6-31fa-4498-b90b-033e49fd41eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ac2f141e404f1cabdb767e4107aa3d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:35.585954 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1197/2394] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:05:35 2022] DELETE /identity/v3/users/95ac2f141e404f1cabdb767e4107aa3d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:35.595727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:35.596010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:35.596288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:35.627910 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1198/2395] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:05:35.642170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:35.644031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:35.795761 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1198/2396] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:05:35.807418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:35.809005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:35.887618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c2f5d-5cc9-4242-865a-6e78764baf69 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:35.961463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:35.962960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:35.963343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:35.963714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:35.980214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:35.982663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:35.993785 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1199/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:36.249333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:36.251369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:36.288979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb034e05-c448-4038-ae03-f8d8ba1f224e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:36.303604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:36.306128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:36.306704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:36.307098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] PATH_INFO: `/v3/projects/feae46c5b38f41eeac7271450461f5bf` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:36.312534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feae46c5b38f41eeac7271450461f5bf)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:36.317291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:36.358807 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:36.406295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feae46c5b38f41eeac7271450461f5bf', 'request_id': 'req-3b14f23f-2361-4443-888b-0f06b1230675'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.436372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feae46c5b38f41eeac7271450461f5bf', 'request_id': 'req-3b14f23f-2361-4443-888b-0f06b1230675'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.458840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feae46c5b38f41eeac7271450461f5bf', 'request_id': 'req-3b14f23f-2361-4443-888b-0f06b1230675'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.472594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] The token cache is being invalidate because project feae46c5b38f41eeac7271450461f5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:05:36.472898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.473798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.475282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1199/2398] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:05:36 2022] DELETE /identity/v3/projects/feae46c5b38f41eeac7271450461f5bf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:36.482712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:36.493273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc864187-166e-46da-b9c3-4cec4c40b567 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:36.577159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:36.577800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:36.578077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:36.578345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] PATH_INFO: `/v3/users/3e936f78cc5649ccac04523d6c379283` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:36.579591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e936f78cc5649ccac04523d6c379283)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:36.581535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:36.586739 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:36.656028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e936f78cc5649ccac04523d6c379283'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.656752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e936f78cc5649ccac04523d6c379283'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.657502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e936f78cc5649ccac04523d6c379283'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.672278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e936f78cc5649ccac04523d6c379283'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.681034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1930e7e3-8fe3-4a43-bbe5-67ba2689293e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e936f78cc5649ccac04523d6c379283'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:36.715808 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1200/2399] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:05:36 2022] DELETE /identity/v3/users/3e936f78cc5649ccac04523d6c379283 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:37.535593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:37.537642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:37.567413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f23f-2361-4443-888b-0f06b1230675 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:37.657717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:37.658490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:37.658852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:37.659226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] PATH_INFO: `/v3/projects/4f7f85885acd4d55bbc5a1592937b53a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:37.660517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7f85885acd4d55bbc5a1592937b53a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:37.664308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:37.746037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7f85885acd4d55bbc5a1592937b53a', 'request_id': 'req-8440f046-328a-455e-ba54-bef0f5224a1b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:37.757602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7f85885acd4d55bbc5a1592937b53a', 'request_id': 'req-8440f046-328a-455e-ba54-bef0f5224a1b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:37.773112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7f85885acd4d55bbc5a1592937b53a', 'request_id': 'req-8440f046-328a-455e-ba54-bef0f5224a1b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:37.803595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] The token cache is being invalidate because project 4f7f85885acd4d55bbc5a1592937b53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:05:37.804023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:37.804786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8440f046-328a-455e-ba54-bef0f5224a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:37.812250 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1200/2400] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:05:37 2022] DELETE /identity/v3/projects/4f7f85885acd4d55bbc5a1592937b53a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:37.813707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda991ca-7e6b-4828-9935-bd0eaf19b8e5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:37.814150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda991ca-7e6b-4828-9935-bd0eaf19b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:37.814307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda991ca-7e6b-4828-9935-bd0eaf19b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:37.835170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-eda991ca-7e6b-4828-9935-bd0eaf19b8e5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:37.836384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-eda991ca-7e6b-4828-9935-bd0eaf19b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:37.939525 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1201/2401] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:37.947109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d29f79-b3cd-4ffd-8ec1-1c988aff73b1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:37.948327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d29f79-b3cd-4ffd-8ec1-1c988aff73b1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:37.950920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d29f79-b3cd-4ffd-8ec1-1c988aff73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:37.975343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-58d29f79-b3cd-4ffd-8ec1-1c988aff73b1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:37.977103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-58d29f79-b3cd-4ffd-8ec1-1c988aff73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:37.989586 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1201/2402] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:37.994092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda991ca-7e6b-4828-9935-bd0eaf19b8e5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:38.009012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda991ca-7e6b-4828-9935-bd0eaf19b8e5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:38.017014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:38.017753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.018101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.018444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:38.019168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:05:38.019553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:38.021523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:38.039239 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1202/2403] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:05:38.040478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d29f79-b3cd-4ffd-8ec1-1c988aff73b1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:38.062388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d29f79-b3cd-4ffd-8ec1-1c988aff73b1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:38.071513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:38.073746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.074283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.075428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:38.078244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:38.080143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:38.161142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1202/2404] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:05:38 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:38.164463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:38.179658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef78fc-3e36-4d03-a113-666f3b5f0a6d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:38.282860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:38.284085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.284572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.285212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:38.286016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:38.287772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:38.310928 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:38.322530 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1203/2405] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:05:38 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:38.323610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:38.331102 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:38.335659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bc4c5-a1a8-4240-882a-0eaf0f270b1a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:38.343037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:38.344149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.344897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.345462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:38.346396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:38.348809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:38.360930 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1203/2406] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:05:38.365864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:38.377023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1a4ca-1ffc-403c-83d7-494a1a089cb7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:38.388287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6e32-199c-428e-9eb7-17bda15fdaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:38.389459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6e32-199c-428e-9eb7-17bda15fdaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.389459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6e32-199c-428e-9eb7-17bda15fdaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.389674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6e32-199c-428e-9eb7-17bda15fdaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:38.390153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f6e32-199c-428e-9eb7-17bda15fdaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:38.392090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f6e32-199c-428e-9eb7-17bda15fdaf0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:38.410583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:38.417197 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1204/2407] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:38.422078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f3e3-045e-4aea-8188-a5901b6ec9eb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:38.428375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:38.429348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.430030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.430515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] PATH_INFO: `/v3/projects/8f8be09227f5413fa15742423063b055/users/36ea70b752664dec893fad2879a0abcc/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:38.496977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8be09227f5413fa15742423063b055, user_id=36ea70b752664dec893fad2879a0abcc, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:38.499827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:38.521588 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1204/2408] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:05:38 2022] PUT /identity/v3/projects/8f8be09227f5413fa15742423063b055/users/36ea70b752664dec893fad2879a0abcc/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:38.537782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836365-29a5-4067-ba28-262a32e76e17 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.537988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836365-29a5-4067-ba28-262a32e76e17 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.538181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836365-29a5-4067-ba28-262a32e76e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:38.635904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-19836365-29a5-4067-ba28-262a32e76e17 None None] MFA Rules not processed for user `36ea70b752664dec893fad2879a0abcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:38.643779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-19836365-29a5-4067-ba28-262a32e76e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:38.769886 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1205/2409] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:05:38.774107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:38.984177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bc8de-a990-46a1-a5c4-a2af4dc77590 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:38.997489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:38.998261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:38.998646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:38.999016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.000112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:39.002249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:39.089162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1205/2410] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:05:38 2022] POST /identity/v3/projects => generated 393 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:39.093790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19836365-29a5-4067-ba28-262a32e76e17 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:39.112656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19836365-29a5-4067-ba28-262a32e76e17 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:39.262818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:39.266680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:39.266974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:39.267259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.267967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:39.280946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:39.339820 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1206/2411] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:05:39 2022] POST /identity/v3/users => generated 303 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:39.344215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:39.397252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84978193-9b29-46fa-94be-3c541f0bdc14 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:39.406009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:39.406746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:39.407090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:39.407448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.408165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:39.409985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:39.425918 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1206/2412] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:39.426817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:39.441511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b31f5-ec38-4681-9330-6fb24d285ff8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:39.452699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:39.453506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:39.453789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:39.454066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] PATH_INFO: `/v3/projects/7d883ce1cd0d4cce8433bb0877d977e6/users/347cb5fcf587476693cd0968f097dda3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.494431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d883ce1cd0d4cce8433bb0877d977e6, user_id=347cb5fcf587476693cd0968f097dda3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:39.499586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:39.541436 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1207/2413] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:05:39 2022] PUT /identity/v3/projects/7d883ce1cd0d4cce8433bb0877d977e6/users/347cb5fcf587476693cd0968f097dda3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:39.546804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:39.566150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022a87b-f6a3-4b41-a2c2-e6425266fd48 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:39.711981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b70286-2b79-4cfe-84f0-40f9af8b2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:39.712939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70286-2b79-4cfe-84f0-40f9af8b2997 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:39.713370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70286-2b79-4cfe-84f0-40f9af8b2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:39.713753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70286-2b79-4cfe-84f0-40f9af8b2997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.714631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b70286-2b79-4cfe-84f0-40f9af8b2997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:39.717327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b70286-2b79-4cfe-84f0-40f9af8b2997 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:39.730307 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1207/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:39.735295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:39.749596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802323-ddf7-46a9-a44f-8cfbd66734bd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:39.755202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be02f6d-c744-4c24-a7f9-c8ff563dc878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:39.756298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02f6d-c744-4c24-a7f9-c8ff563dc878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:39.756785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02f6d-c744-4c24-a7f9-c8ff563dc878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:39.757290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be02f6d-c744-4c24-a7f9-c8ff563dc878 admin admin] PATH_INFO: `/v3/projects/7d883ce1cd0d4cce8433bb0877d977e6/users/347cb5fcf587476693cd0968f097dda3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.760027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be02f6d-c744-4c24-a7f9-c8ff563dc878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d883ce1cd0d4cce8433bb0877d977e6, user_id=347cb5fcf587476693cd0968f097dda3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:39.764008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be02f6d-c744-4c24-a7f9-c8ff563dc878 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:39.785957 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1208/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:05:39 2022] PUT /identity/v3/projects/7d883ce1cd0d4cce8433bb0877d977e6/users/347cb5fcf587476693cd0968f097dda3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:05:39.788498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:39.789307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:39.789812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.825874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] MFA Rules not processed for user `347cb5fcf587476693cd0968f097dda3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:39.827141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:39.864061 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:39.928286 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1208/2416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:39.943450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2518de-cd03-40d5-b522-87d28b25fdd0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:39.944931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2518de-cd03-40d5-b522-87d28b25fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:39.945399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2518de-cd03-40d5-b522-87d28b25fdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:39.985012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4d2518de-cd03-40d5-b522-87d28b25fdd0 None None] MFA Rules not processed for user `36ea70b752664dec893fad2879a0abcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:39.986366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d2518de-cd03-40d5-b522-87d28b25fdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:40.015462 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:40.067967 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1209/2417] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:40.089563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:40.091737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:40.179496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3fc64-86f9-488b-803c-f7a7f01f00cb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:40.186367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c8aa1-17e0-43e9-90dd-90ac3a4dd66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:40.187055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8aa1-17e0-43e9-90dd-90ac3a4dd66e service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:40.187407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8aa1-17e0-43e9-90dd-90ac3a4dd66e service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:40.187760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c8aa1-17e0-43e9-90dd-90ac3a4dd66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:40.196260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8aa1-17e0-43e9-90dd-90ac3a4dd66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:40.197895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c8aa1-17e0-43e9-90dd-90ac3a4dd66e service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:40.207901 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1209/2418] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:41.676611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:41.677159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:41.677248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:41.719365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] MFA Rules not processed for user `a2b7b813e3b1448ba3360475b37a468f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:41.720582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:41.784932 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1210/2419] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:42.151756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50578f-6d54-425e-b30a-0cc7dfadb999 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:42.153123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50578f-6d54-425e-b30a-0cc7dfadb999 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:42.153453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50578f-6d54-425e-b30a-0cc7dfadb999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:42.199807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9d50578f-6d54-425e-b30a-0cc7dfadb999 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:42.202076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d50578f-6d54-425e-b30a-0cc7dfadb999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:42.290389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1210/2420] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:42.304508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:42.306028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:42.414033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2483ff-8b18-44c4-8879-c426f374a0d0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:42.421399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223e9d-2919-4d7c-b9cd-fe54e4259db1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:42.422196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223e9d-2919-4d7c-b9cd-fe54e4259db1 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:42.422583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223e9d-2919-4d7c-b9cd-fe54e4259db1 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:42.422960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223e9d-2919-4d7c-b9cd-fe54e4259db1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:42.435405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223e9d-2919-4d7c-b9cd-fe54e4259db1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:42.437166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223e9d-2919-4d7c-b9cd-fe54e4259db1 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:42.447244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1211/2421] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:05:46.077313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdacb02-f5a9-46be-a0de-a6a615565b35 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:46.077880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdacb02-f5a9-46be-a0de-a6a615565b35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:46.078146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdacb02-f5a9-46be-a0de-a6a615565b35 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:46.079667 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1211/2422] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:05:46.085885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:46.086447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:46.086447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:46.114865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:46.116253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:46.174676 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1212/2423] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:46.190725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdacb02-f5a9-46be-a0de-a6a615565b35 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:46.192622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1bdacb02-f5a9-46be-a0de-a6a615565b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:46.221099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdacb02-f5a9-46be-a0de-a6a615565b35 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:46.221099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:46.221099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:46.221099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:46.221600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:46.261411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:46.263180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:46.283841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1212/2424] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:48.070219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:48.073821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:48.134518 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:48.213503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcfb97-ee31-4e0b-ad6e-9b58b9b89a51 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:48.228097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:48.230743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:48.231496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:48.232400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:48.236639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:48.272845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:48.279596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:48.314308 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1213/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:48.455043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:48.489014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aafde-6a96-43e9-bb2b-7260b47cb07d service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:48.504976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c9c8-b1b4-4da1-961c-fcfd0f901500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:48.505997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9c8-b1b4-4da1-961c-fcfd0f901500 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:48.507057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9c8-b1b4-4da1-961c-fcfd0f901500 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:48.507487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c9c8-b1b4-4da1-961c-fcfd0f901500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:48.510337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-91d6c9c8-b1b4-4da1-961c-fcfd0f901500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:48.534570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c9c8-b1b4-4da1-961c-fcfd0f901500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:48.536847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c9c8-b1b4-4da1-961c-fcfd0f901500 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:48.565264 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1213/2426] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:05:54.303869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:54.305512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:54.396092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd361b3-1198-4c74-a97b-bd890c658abb service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:54.405034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:54.405709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:54.405988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:54.406288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] PATH_INFO: `/v3/users/7984044d7dde41f393cb9b74dddcaba4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:54.407423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7984044d7dde41f393cb9b74dddcaba4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:54.409362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:54.470780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7984044d7dde41f393cb9b74dddcaba4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.471608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7984044d7dde41f393cb9b74dddcaba4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.472226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7984044d7dde41f393cb9b74dddcaba4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.485335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7984044d7dde41f393cb9b74dddcaba4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.492966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7984044d7dde41f393cb9b74dddcaba4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.507284 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1214/2427] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:05:54 2022] DELETE /identity/v3/users/7984044d7dde41f393cb9b74dddcaba4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:54.511931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:54.511931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:54.512917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:54.534586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:54.536354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:54.561204 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:54.599588 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1214/2428] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:54.609401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:54.610815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:54.642768 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:54.669970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b71e19-c47e-413a-aab3-d450c727d878 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:54.679156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0418f56-5dc5-4262-883c-d2e06cc421cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:54.679779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0418f56-5dc5-4262-883c-d2e06cc421cb service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:54.680052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0418f56-5dc5-4262-883c-d2e06cc421cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:54.680317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0418f56-5dc5-4262-883c-d2e06cc421cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:54.691699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0418f56-5dc5-4262-883c-d2e06cc421cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:54.692749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0418f56-5dc5-4262-883c-d2e06cc421cb service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:54.703737 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1215/2429] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:54.893723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:54.895242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:54.908989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc8ce1-1c6a-4642-a857-92c98fee69a8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:54.913753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:54.914391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:54.914667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:54.914987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] PATH_INFO: `/v3/projects/ce78854e690745178d7c32b71b8e4e34` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:54.916046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce78854e690745178d7c32b71b8e4e34)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:54.918203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:54.967566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce78854e690745178d7c32b71b8e4e34', 'request_id': 'req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.973986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce78854e690745178d7c32b71b8e4e34', 'request_id': 'req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.982693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce78854e690745178d7c32b71b8e4e34', 'request_id': 'req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.992981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] The token cache is being invalidate because project ce78854e690745178d7c32b71b8e4e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:05:54.993299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.993930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83c8edfc-7133-4efe-8c06-48e4fbd22e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:05:54.995413 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1215/2430] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:05:54 2022] DELETE /identity/v3/projects/ce78854e690745178d7c32b71b8e4e34 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:55.000324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0cb1-89cb-4c30-b8f4-3855f7a0faf2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.000607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0cb1-89cb-4c30-b8f4-3855f7a0faf2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.000902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0cb1-89cb-4c30-b8f4-3855f7a0faf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.021501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0f8c0cb1-89cb-4c30-b8f4-3855f7a0faf2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:55.022624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0f8c0cb1-89cb-4c30-b8f4-3855f7a0faf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:55.085966 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1216/2431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:55.094387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8736-9822-4e5e-8768-e942129d596e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.094698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8736-9822-4e5e-8768-e942129d596e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.094970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8736-9822-4e5e-8768-e942129d596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.116092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-449e8736-9822-4e5e-8768-e942129d596e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:55.117321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-449e8736-9822-4e5e-8768-e942129d596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:55.125175 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1216/2432] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:05:55.129445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0cb1-89cb-4c30-b8f4-3855f7a0faf2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:55.140847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0cb1-89cb-4c30-b8f4-3855f7a0faf2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:55.145515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:55.146119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.146398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.146668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.147310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:05:55.147629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:55.149227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:55.165820 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1217/2433] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:05:55.167233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8736-9822-4e5e-8768-e942129d596e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:55.177258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8736-9822-4e5e-8768-e942129d596e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:55.182017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:55.182643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.182918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.183184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.183857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:55.185772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:55.214303 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1217/2434] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:05:55 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:05:55.218733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:55.228651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7a37-82db-4130-90dc-1b1391b9cf2e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:55.298439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:55.299106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.299390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.299663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.301458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:55.302371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:55.331700 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1218/2435] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:05:55 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:05:55.336195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:55.350715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ccbc-76b5-4389-816c-437ccd3532db admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:55.356359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:55.356974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.357279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.357546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.358179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:55.359897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:55.375016 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1218/2436] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:05:55.375739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:55.387808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f78ed-6a5f-4564-adae-cc90ea394cbe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:55.393040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34d771-b92d-4ce9-b12a-be64a6f9c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:55.393676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34d771-b92d-4ce9-b12a-be64a6f9c722 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.393945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34d771-b92d-4ce9-b12a-be64a6f9c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.394209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34d771-b92d-4ce9-b12a-be64a6f9c722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.394876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34d771-b92d-4ce9-b12a-be64a6f9c722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:55.396634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34d771-b92d-4ce9-b12a-be64a6f9c722 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:55.409588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1219/2437] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:05:55.413770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:55.424862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916860f-0a55-4026-bf54-ebad283721b1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:55.429907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:55.430563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.430831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.431108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] PATH_INFO: `/v3/projects/5767d0e0a10343d99e97e1db9ddad749/users/c239a66f5b664487badcd3b12e6cb44a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.447057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5767d0e0a10343d99e97e1db9ddad749, user_id=c239a66f5b664487badcd3b12e6cb44a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:55.450257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:55.464201 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1219/2438] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:05:55 2022] PUT /identity/v3/projects/5767d0e0a10343d99e97e1db9ddad749/users/c239a66f5b664487badcd3b12e6cb44a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:05:55.476233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455d37-0e14-45b2-a111-0fa599ca935f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.476515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455d37-0e14-45b2-a111-0fa599ca935f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.476812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455d37-0e14-45b2-a111-0fa599ca935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.534874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8d455d37-0e14-45b2-a111-0fa599ca935f None None] MFA Rules not processed for user `c239a66f5b664487badcd3b12e6cb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:55.536182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8d455d37-0e14-45b2-a111-0fa599ca935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:55.568715 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:55.607892 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1220/2439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:55.620565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:55.624485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:55.686959 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:55.691242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652513a-c05c-4b27-bfb2-4784bd714e6f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:55.695939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:55.696635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:55.697379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:55.697889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:55.708924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:55.710424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:55.720157 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1220/2440] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:56.857916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d69b-d1c8-4b60-8b26-4ca91037cfc3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:56.858431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d69b-d1c8-4b60-8b26-4ca91037cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:56.858516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416d69b-d1c8-4b60-8b26-4ca91037cfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:56.890950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4416d69b-d1c8-4b60-8b26-4ca91037cfc3 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:56.892577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4416d69b-d1c8-4b60-8b26-4ca91037cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:56.957034 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1221/2441] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:05:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:56.969448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:56.971305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:57.046713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a29fb-107f-4994-ad12-f5b5958eec70 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:57.051822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:57.052588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:57.053277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:57.053594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:57.064250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:57.066120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:57.076332 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1221/2442] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:05:58.865742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:58.866268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:58.866571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:58.893747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:58.895307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:58.903070 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1222/2443] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:05:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:05:58.916124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:58.928658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb9a8b-efea-4b4a-a374-ceeabb8fe4d0 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:58.935295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430cdec-7c85-47c0-a0e6-8e2558c70cb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:58.936207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430cdec-7c85-47c0-a0e6-8e2558c70cb8 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:58.936646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430cdec-7c85-47c0-a0e6-8e2558c70cb8 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:58.936918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430cdec-7c85-47c0-a0e6-8e2558c70cb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:58.947625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430cdec-7c85-47c0-a0e6-8e2558c70cb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:58.949914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430cdec-7c85-47c0-a0e6-8e2558c70cb8 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:58.958720 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1222/2444] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:05:59.271162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:05:59.272557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:59.349086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80fc4-efac-4346-8a44-a8bbf8f8ce04 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:05:59.354760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841933fa-8161-47e9-aed3-202e2af6b3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:05:59.355921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841933fa-8161-47e9-aed3-202e2af6b3cc service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:59.356215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841933fa-8161-47e9-aed3-202e2af6b3cc service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:59.356498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841933fa-8161-47e9-aed3-202e2af6b3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:59.358269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-841933fa-8161-47e9-aed3-202e2af6b3cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:59.426945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841933fa-8161-47e9-aed3-202e2af6b3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:05:59.428575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841933fa-8161-47e9-aed3-202e2af6b3cc service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:05:59.432509 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:59.439989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1223/2445] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:05:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:05:59.465937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e519c-c04a-4612-97ba-36021a3cbbc3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:05:59.466152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e519c-c04a-4612-97ba-36021a3cbbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:05:59.466420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e519c-c04a-4612-97ba-36021a3cbbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:05:59.485267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eb7e519c-c04a-4612-97ba-36021a3cbbc3 None None] MFA Rules not processed for user `36ea70b752664dec893fad2879a0abcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:05:59.486461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb7e519c-c04a-4612-97ba-36021a3cbbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:05:59.547766 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1223/2446] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:00.362199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc3ab-be62-49ad-9982-5d5741233d62 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:00.362761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc3ab-be62-49ad-9982-5d5741233d62 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:00.362761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc3ab-be62-49ad-9982-5d5741233d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:00.394307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-afbdc3ab-be62-49ad-9982-5d5741233d62 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:00.395527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-afbdc3ab-be62-49ad-9982-5d5741233d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:00.404038 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1224/2447] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:00.416031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e519c-c04a-4612-97ba-36021a3cbbc3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:00.428617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e519c-c04a-4612-97ba-36021a3cbbc3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:00.434711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b365cf-32ae-4f97-a7d1-e48f7ed35633 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:00.435320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b365cf-32ae-4f97-a7d1-e48f7ed35633 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:00.435805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b365cf-32ae-4f97-a7d1-e48f7ed35633 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:00.436102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b365cf-32ae-4f97-a7d1-e48f7ed35633 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:00.445167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b365cf-32ae-4f97-a7d1-e48f7ed35633 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:00.447018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b365cf-32ae-4f97-a7d1-e48f7ed35633 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:00.455954 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1224/2448] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:06:00.707300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb481d-36d0-4ca8-8dee-74e4963aff70 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:00.707588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb481d-36d0-4ca8-8dee-74e4963aff70 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:00.707861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb481d-36d0-4ca8-8dee-74e4963aff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:00.727777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3dcb481d-36d0-4ca8-8dee-74e4963aff70 None None] MFA Rules not processed for user `c239a66f5b664487badcd3b12e6cb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:00.729166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3dcb481d-36d0-4ca8-8dee-74e4963aff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:00.736884 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1225/2449] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:01.136103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bbef1-845a-44f1-b366-ef3d77276cf6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:01.136448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bbef1-845a-44f1-b366-ef3d77276cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:01.136724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bbef1-845a-44f1-b366-ef3d77276cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:01.160722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-124bbef1-845a-44f1-b366-ef3d77276cf6 None None] MFA Rules not processed for user `c239a66f5b664487badcd3b12e6cb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:01.161962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-124bbef1-845a-44f1-b366-ef3d77276cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:01.169572 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1225/2450] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:03.410593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb481d-36d0-4ca8-8dee-74e4963aff70 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:03.427598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb481d-36d0-4ca8-8dee-74e4963aff70 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:03.434229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:03.435088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:03.435468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:03.435976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:03.438177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:03.595091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:03.598139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:03.623391 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1226/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:11.154904 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=76 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:13.522079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98f7c-2ed2-48ff-a9ae-53882f43eb73 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:13.523035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98f7c-2ed2-48ff-a9ae-53882f43eb73 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:13.523479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98f7c-2ed2-48ff-a9ae-53882f43eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:13.548112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1dc98f7c-2ed2-48ff-a9ae-53882f43eb73 None None] MFA Rules not processed for user `92d56e7f729243e386f7ce8080cf864e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:13.549730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1dc98f7c-2ed2-48ff-a9ae-53882f43eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:13.612133 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=37 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:13.624491 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1226/2452] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:23.614708 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=25 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:32.206043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:32.207530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:32.342771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5491e-42c4-46ac-9f0e-901d553e5991 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:32.348195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:32.349169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:32.349520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:32.349982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] PATH_INFO: `/v3/users/36ea70b752664dec893fad2879a0abcc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:32.351218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ea70b752664dec893fad2879a0abcc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:32.353377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:32.410227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ea70b752664dec893fad2879a0abcc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.411161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ea70b752664dec893fad2879a0abcc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.411840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ea70b752664dec893fad2879a0abcc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.425265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ea70b752664dec893fad2879a0abcc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.433300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ea70b752664dec893fad2879a0abcc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.448268 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1227/2453] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:06:32 2022] DELETE /identity/v3/users/36ea70b752664dec893fad2879a0abcc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:32.453009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:32.454364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:32.454875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:32.476157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:32.477706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:32.545748 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1227/2454] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:32.555953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:32.558108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:32.623501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d68070-c57b-482e-8b57-ad90903724e9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:32.627342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:32.627968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:32.628252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:32.628527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:32.639164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:32.640611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:32.653822 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1228/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:06:32.836976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:32.838461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:32.851889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b5c73-33b4-4e2f-b0cb-9171858dd995 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:32.857803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:32.858725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:32.859006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:32.859454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] PATH_INFO: `/v3/projects/8f8be09227f5413fa15742423063b055` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:32.860814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8be09227f5413fa15742423063b055)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:32.862756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:32.914822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8be09227f5413fa15742423063b055', 'request_id': 'req-9d5bb8c3-b617-4692-8e6c-44f2521899e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.922120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8be09227f5413fa15742423063b055', 'request_id': 'req-9d5bb8c3-b617-4692-8e6c-44f2521899e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.930406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8be09227f5413fa15742423063b055', 'request_id': 'req-9d5bb8c3-b617-4692-8e6c-44f2521899e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.943523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] The token cache is being invalidate because project 8f8be09227f5413fa15742423063b055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:06:32.944195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.944858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:32.947013 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1228/2456] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:06:32 2022] DELETE /identity/v3/projects/8f8be09227f5413fa15742423063b055 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:32.953193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:32.963303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edde19-0631-431f-99a7-ced25064c0d9 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:32.992733 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:33.035946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:33.036578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:33.036856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:33.037161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] PATH_INFO: `/v3/users/347cb5fcf587476693cd0968f097dda3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:33.038325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347cb5fcf587476693cd0968f097dda3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:33.040340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:33.096031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347cb5fcf587476693cd0968f097dda3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.096689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347cb5fcf587476693cd0968f097dda3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.097326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347cb5fcf587476693cd0968f097dda3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.111674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347cb5fcf587476693cd0968f097dda3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.119429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-75f2b6b3-60ad-4d4a-b265-5dcfed870ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347cb5fcf587476693cd0968f097dda3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.138587 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1229/2457] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:06:32 2022] DELETE /identity/v3/users/347cb5fcf587476693cd0968f097dda3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:33.351033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:33.352871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:33.384844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bb8c3-b617-4692-8e6c-44f2521899e9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:33.486856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:33.487587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:33.487929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:33.488269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] PATH_INFO: `/v3/projects/7d883ce1cd0d4cce8433bb0877d977e6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:33.489449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d883ce1cd0d4cce8433bb0877d977e6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:33.491364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:33.541010 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:33.571593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d883ce1cd0d4cce8433bb0877d977e6', 'request_id': 'req-58f19b32-cbff-4841-a881-5a503b4d5a8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.580420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d883ce1cd0d4cce8433bb0877d977e6', 'request_id': 'req-58f19b32-cbff-4841-a881-5a503b4d5a8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.590620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d883ce1cd0d4cce8433bb0877d977e6', 'request_id': 'req-58f19b32-cbff-4841-a881-5a503b4d5a8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.611387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] The token cache is being invalidate because project 7d883ce1cd0d4cce8433bb0877d977e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:06:33.611796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.612500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-58f19b32-cbff-4841-a881-5a503b4d5a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:33.614222 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1229/2458] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:06:33 2022] DELETE /identity/v3/projects/7d883ce1cd0d4cce8433bb0877d977e6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:33.622020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62adb21-05d3-4042-b9b5-6e31bd7ddb94 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:33.622508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62adb21-05d3-4042-b9b5-6e31bd7ddb94 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:33.622606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62adb21-05d3-4042-b9b5-6e31bd7ddb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:33.643598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d62adb21-05d3-4042-b9b5-6e31bd7ddb94 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:33.644824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d62adb21-05d3-4042-b9b5-6e31bd7ddb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:33.727485 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1230/2459] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:33.737088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa9d2-f860-47c4-b132-a0ec263cc68c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:33.737508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa9d2-f860-47c4-b132-a0ec263cc68c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:33.737884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa9d2-f860-47c4-b132-a0ec263cc68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:33.761404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2e5aa9d2-f860-47c4-b132-a0ec263cc68c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:33.762743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e5aa9d2-f860-47c4-b132-a0ec263cc68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:33.778286 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1230/2460] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:06:33.779744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62adb21-05d3-4042-b9b5-6e31bd7ddb94 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:33.789963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62adb21-05d3-4042-b9b5-6e31bd7ddb94 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:33.795934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:33.796701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:33.797097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:33.797474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:33.798223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:06:33.798628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:33.800326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:33.814106 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1231/2461] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:06:33.818690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aa9d2-f860-47c4-b132-a0ec263cc68c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:33.828518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aa9d2-f860-47c4-b132-a0ec263cc68c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:33.833285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:33.833894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:33.834175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:33.834449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:33.835083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:33.836973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:33.874349 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1231/2462] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:06:33 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:06:33.875532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:33.888188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255786-4a3b-4927-a5b5-1778bc952799 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:33.917247 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:33.953543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:33.954582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:33.954582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:33.954790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:33.955406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:33.958541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:33.987375 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1232/2463] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:06:33 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:06:33.989275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:34.002482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352272-3f56-4476-a5d8-b0816ff26b14 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:34.007754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:34.008439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.008823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.009181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.009692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:34.012601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:34.027395 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1232/2464] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:06:34.028453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:34.039063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a40e-49ba-4a12-8439-8f7d5b49de5f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:34.045447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dffc8-509f-47ac-b853-d6cff540a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:34.046084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dffc8-509f-47ac-b853-d6cff540a3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.046364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dffc8-509f-47ac-b853-d6cff540a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.046667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dffc8-509f-47ac-b853-d6cff540a3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.047310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dffc8-509f-47ac-b853-d6cff540a3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:34.048907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dffc8-509f-47ac-b853-d6cff540a3e9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:34.060790 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1233/2465] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:06:34.065125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:34.076776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3223ef-15a1-4d63-8b3c-6214a214929b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:34.081909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:34.082633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.082913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.083182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] PATH_INFO: `/v3/projects/edd6777d258e41a6ad83018cb11b2aab/users/beddfd95d1fa440ea27b87fee9f3fd7e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.103843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd6777d258e41a6ad83018cb11b2aab, user_id=beddfd95d1fa440ea27b87fee9f3fd7e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:34.108304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:34.130672 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1233/2466] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:06:34 2022] PUT /identity/v3/projects/edd6777d258e41a6ad83018cb11b2aab/users/beddfd95d1fa440ea27b87fee9f3fd7e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:06:34.141943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f579bf-2acd-48ec-a49c-2474d9143985 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.142427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f579bf-2acd-48ec-a49c-2474d9143985 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.142727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f579bf-2acd-48ec-a49c-2474d9143985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.183808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a4f579bf-2acd-48ec-a49c-2474d9143985 None None] MFA Rules not processed for user `beddfd95d1fa440ea27b87fee9f3fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:34.185508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4f579bf-2acd-48ec-a49c-2474d9143985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:34.296643 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1234/2467] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:34.301214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:34.470268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac9eb8-6f9b-4c43-ad7e-04c807647294 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:34.492587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:34.495853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.496231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.496586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.497809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:34.503808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:34.586037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f579bf-2acd-48ec-a49c-2474d9143985 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:34.599281 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1234/2468] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:06:34 2022] POST /identity/v3/projects => generated 393 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:06:34.611201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f579bf-2acd-48ec-a49c-2474d9143985 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:34.780872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:34.784617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.784917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.785258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.785904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:34.792249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:34.846170 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1235/2469] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:06:34 2022] POST /identity/v3/users => generated 303 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:06:34.849920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:34.868171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3f1b-e0f1-4dd6-b816-8a2e246e54bc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:34.881702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:34.884888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.885274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.885651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.886341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:34.889293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:34.918910 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1235/2470] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:06:34.923962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:34.938729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44406e-5bd5-44cd-9fd4-d355efe3a727 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:34.945304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:34.946086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:34.946367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:34.947216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] PATH_INFO: `/v3/projects/93529e9e67414b93846a08b604d107ce/users/8c2a8069a4ff4372bbeae0349084f93e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:34.967897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93529e9e67414b93846a08b604d107ce, user_id=8c2a8069a4ff4372bbeae0349084f93e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:34.970803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:35.004190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1236/2471] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:06:34 2022] PUT /identity/v3/projects/93529e9e67414b93846a08b604d107ce/users/8c2a8069a4ff4372bbeae0349084f93e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:35.005556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:35.021021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b77bb-517a-41ed-8817-c81466c2ef74 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:35.075548 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:35.147086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ebfa3-7606-4bc1-8aa2-5025458242fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:35.147919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ebfa3-7606-4bc1-8aa2-5025458242fe admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:35.148259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ebfa3-7606-4bc1-8aa2-5025458242fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:35.148636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ebfa3-7606-4bc1-8aa2-5025458242fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:35.149339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ebfa3-7606-4bc1-8aa2-5025458242fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:35.151302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ebfa3-7606-4bc1-8aa2-5025458242fe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:35.169100 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1236/2472] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:06:35.169282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:35.176872 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:35.186686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95b3a-7596-42b1-9e57-c47ba22faf5b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:35.193797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881655-d8ee-4303-85c5-3b5d699335ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:35.194541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881655-d8ee-4303-85c5-3b5d699335ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:35.194889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881655-d8ee-4303-85c5-3b5d699335ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:35.195233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881655-d8ee-4303-85c5-3b5d699335ab admin admin] PATH_INFO: `/v3/projects/93529e9e67414b93846a08b604d107ce/users/8c2a8069a4ff4372bbeae0349084f93e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:35.197519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0881655-d8ee-4303-85c5-3b5d699335ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=93529e9e67414b93846a08b604d107ce, user_id=8c2a8069a4ff4372bbeae0349084f93e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:35.200416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0881655-d8ee-4303-85c5-3b5d699335ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:35.213846 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1237/2473] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:06:35 2022] PUT /identity/v3/projects/93529e9e67414b93846a08b604d107ce/users/8c2a8069a4ff4372bbeae0349084f93e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:06:35.223687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:35.224055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:35.224337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:35.257507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] MFA Rules not processed for user `8c2a8069a4ff4372bbeae0349084f93e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:35.258715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:35.377208 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1237/2474] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:35.450593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7e48-ef89-441d-99e3-d75267cb97af None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:35.451014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7e48-ef89-441d-99e3-d75267cb97af None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:35.451434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7e48-ef89-441d-99e3-d75267cb97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:35.474512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-57cc7e48-ef89-441d-99e3-d75267cb97af None None] MFA Rules not processed for user `beddfd95d1fa440ea27b87fee9f3fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:35.476203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-57cc7e48-ef89-441d-99e3-d75267cb97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:35.565115 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1238/2475] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:35.576910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:35.578427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:35.668099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd909b3-0b40-4af4-9919-75e08ec17ae1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:35.673857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:35.674463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:35.674743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:35.675017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:35.683726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:35.685328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:35.694449 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1238/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:36.403395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882025-6a67-45c8-ba10-dcffcf509ca0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:36.404674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882025-6a67-45c8-ba10-dcffcf509ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:36.405266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882025-6a67-45c8-ba10-dcffcf509ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:36.433937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3f882025-6a67-45c8-ba10-dcffcf509ca0 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:36.436142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3f882025-6a67-45c8-ba10-dcffcf509ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:36.562230 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1239/2477] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:36.573846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:36.577407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:36.641284 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:36.694095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf7c2a-8136-4b62-8447-37add8152c48 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:36.699707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed954eb-c5ba-4f6a-b54b-52a5953d27fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:36.700545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed954eb-c5ba-4f6a-b54b-52a5953d27fa service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:36.700662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed954eb-c5ba-4f6a-b54b-52a5953d27fa service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:36.700891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed954eb-c5ba-4f6a-b54b-52a5953d27fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:36.710328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed954eb-c5ba-4f6a-b54b-52a5953d27fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:36.713643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed954eb-c5ba-4f6a-b54b-52a5953d27fa service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:36.723850 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1239/2478] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:06:39.494475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f23b19-197d-4e1d-bb26-f75e0cb5523d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:39.495044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f23b19-197d-4e1d-bb26-f75e0cb5523d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:39.495237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f23b19-197d-4e1d-bb26-f75e0cb5523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:39.524467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-92f23b19-197d-4e1d-bb26-f75e0cb5523d None None] MFA Rules not processed for user `fb2fa7cdc77043e2b9295424759e9863`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:39.526261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-92f23b19-197d-4e1d-bb26-f75e0cb5523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:39.614839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1240/2479] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:43.501188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1f44-2a93-4072-9d41-d347be1015dc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:43.501665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1f44-2a93-4072-9d41-d347be1015dc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:43.502009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e1f44-2a93-4072-9d41-d347be1015dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:43.594600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a40e1f44-2a93-4072-9d41-d347be1015dc None None] MFA Rules not processed for user `51d78a7c9f864115ac02046fa5d313eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:43.600076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a40e1f44-2a93-4072-9d41-d347be1015dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:43.808930 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1240/2480] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:45.612788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f23b19-197d-4e1d-bb26-f75e0cb5523d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:45.662975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f23b19-197d-4e1d-bb26-f75e0cb5523d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:45.688883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:45.691179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:45.692001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:45.692793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:45.713522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:45.717705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:45.746935 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1241/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:53.788898 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=43 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:55.735224 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:08.437650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:08.438332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:08.438332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:08.458166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:08.459302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:08.466578 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1241/2482] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:08.479282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:08.491085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dd1ee-ac44-410e-8a70-b85d840d2cac service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:08.496238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:08.496842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:08.497159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:08.497436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:08.507618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:08.509236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:08.518942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1242/2483] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:16.647368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:16.649511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:16.814715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264eed-1583-4ffd-92e4-7360c91877a5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:16.825863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:16.827437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:16.829213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:16.831762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] PATH_INFO: `/v3/users/a048a1b75a74409fa68b87726d01d506` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:16.833344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a048a1b75a74409fa68b87726d01d506)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:16.841486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:16.933433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a048a1b75a74409fa68b87726d01d506'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:16.934995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a048a1b75a74409fa68b87726d01d506'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:16.936501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a048a1b75a74409fa68b87726d01d506'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:16.954520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a048a1b75a74409fa68b87726d01d506'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:16.986881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a048a1b75a74409fa68b87726d01d506'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.015149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1242/2484] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:07:16 2022] DELETE /identity/v3/users/a048a1b75a74409fa68b87726d01d506 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:17.286152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:17.305402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a72197-0efa-45ed-bb0b-ebf14a815740 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:17.403975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:17.405379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:17.405849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:17.406314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] PATH_INFO: `/v3/projects/8ba5ac645c234659b1657c5202f7bc8b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:17.407641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba5ac645c234659b1657c5202f7bc8b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:17.409771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:17.532647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba5ac645c234659b1657c5202f7bc8b', 'request_id': 'req-cb6f826e-db7f-43d7-b050-c13fa7fa9326'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.548499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba5ac645c234659b1657c5202f7bc8b', 'request_id': 'req-cb6f826e-db7f-43d7-b050-c13fa7fa9326'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.557549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba5ac645c234659b1657c5202f7bc8b', 'request_id': 'req-cb6f826e-db7f-43d7-b050-c13fa7fa9326'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.584604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] The token cache is being invalidate because project 8ba5ac645c234659b1657c5202f7bc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:07:17.585328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.586569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.588858 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1243/2485] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:07:17 2022] DELETE /identity/v3/projects/8ba5ac645c234659b1657c5202f7bc8b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:17.593492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:17.595191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:17.615509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3eda1-815e-49e4-a08b-c5f97c6c33d0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:17.698156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:17.699845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:17.700228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:17.700599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] PATH_INFO: `/v3/users/3cf494a62bef4afeb18b89a1fced37df` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:17.703416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf494a62bef4afeb18b89a1fced37df)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:17.705426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:17.729544 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:17.785274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf494a62bef4afeb18b89a1fced37df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.786173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf494a62bef4afeb18b89a1fced37df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.787051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf494a62bef4afeb18b89a1fced37df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.796034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf494a62bef4afeb18b89a1fced37df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.811776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a21a2270-26fa-4609-898e-e9adf9527ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf494a62bef4afeb18b89a1fced37df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:17.828777 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1243/2486] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:07:17 2022] DELETE /identity/v3/users/3cf494a62bef4afeb18b89a1fced37df => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:07:18.059613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:18.062370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:18.097336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f826e-db7f-43d7-b050-c13fa7fa9326 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:18.182618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:18.183164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:18.183441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:18.183713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] PATH_INFO: `/v3/projects/84b14f91357b4808a704c2f9f7ed9357` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:18.184862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b14f91357b4808a704c2f9f7ed9357)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:18.187327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:18.225569 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:18.283316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b14f91357b4808a704c2f9f7ed9357', 'request_id': 'req-2aef40a0-acf3-4222-8e26-402db822e663'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:18.301487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b14f91357b4808a704c2f9f7ed9357', 'request_id': 'req-2aef40a0-acf3-4222-8e26-402db822e663'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:18.319211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b14f91357b4808a704c2f9f7ed9357', 'request_id': 'req-2aef40a0-acf3-4222-8e26-402db822e663'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:18.338950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] The token cache is being invalidate because project 84b14f91357b4808a704c2f9f7ed9357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:07:18.340011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:18.343591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2aef40a0-acf3-4222-8e26-402db822e663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:18.347109 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1244/2487] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:07:18 2022] DELETE /identity/v3/projects/84b14f91357b4808a704c2f9f7ed9357 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:18.351935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86109-6655-4916-9afa-a9d326769005 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:18.352495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86109-6655-4916-9afa-a9d326769005 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:18.352949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86109-6655-4916-9afa-a9d326769005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:18.392707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bea86109-6655-4916-9afa-a9d326769005 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:18.402140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bea86109-6655-4916-9afa-a9d326769005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:18.490905 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1244/2488] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:07:18.501554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dbf7-f4c1-46cb-8ad2-01b3b69bc510 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:18.502077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dbf7-f4c1-46cb-8ad2-01b3b69bc510 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:18.502579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5dbf7-f4c1-46cb-8ad2-01b3b69bc510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:18.586515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8bf5dbf7-f4c1-46cb-8ad2-01b3b69bc510 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:18.587783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8bf5dbf7-f4c1-46cb-8ad2-01b3b69bc510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:18.623229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1245/2489] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:18.623321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea86109-6655-4916-9afa-a9d326769005 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:18.641087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea86109-6655-4916-9afa-a9d326769005 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:18.673497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:18.675896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:18.676185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:18.676543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:18.677253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:07:18.677560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:18.679183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:18.745185 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1245/2490] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:07:18.746693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5dbf7-f4c1-46cb-8ad2-01b3b69bc510 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:18.759839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5dbf7-f4c1-46cb-8ad2-01b3b69bc510 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:18.781004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:18.781004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:18.781004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:18.781004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:18.788889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:18.793862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:18.899255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1246/2491] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:07:18 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:07:18.905515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:18.918819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8bb7-14c5-46bb-b26f-a4bbf3dbaa77 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:19.005761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:19.006466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:19.006740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:19.007019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:19.007803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:19.011117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:19.049114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1246/2492] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:07:18 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:07:19.057836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:19.065162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906a071-9a2e-4833-992f-348ad5ba01ed admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:19.078566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:19.079217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:19.079495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:19.079820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:19.080479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:19.082334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:19.098182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1247/2493] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:07:19.102271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:19.120355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609a28f-95d4-4062-8aae-5978a69c3f57 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:19.135112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499a5e5-2ef5-4be9-b516-7b0384db7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:19.135994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499a5e5-2ef5-4be9-b516-7b0384db7e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:19.136275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499a5e5-2ef5-4be9-b516-7b0384db7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:19.136543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499a5e5-2ef5-4be9-b516-7b0384db7e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:19.137218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499a5e5-2ef5-4be9-b516-7b0384db7e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:19.141798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499a5e5-2ef5-4be9-b516-7b0384db7e89 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:19.149723 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:19.179159 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1247/2494] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:07:19.180321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:19.195266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea012-d9d9-4fad-ac39-4f54035db0dd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:19.201391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:19.203057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:19.203437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:19.203809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] PATH_INFO: `/v3/projects/da1a306254e94a1eb2545f41c500b735/users/29009789afbe43398b1f2dcae80bff24/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:19.226360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1a306254e94a1eb2545f41c500b735, user_id=29009789afbe43398b1f2dcae80bff24, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:19.229205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:19.261214 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1248/2495] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:07:19 2022] PUT /identity/v3/projects/da1a306254e94a1eb2545f41c500b735/users/29009789afbe43398b1f2dcae80bff24/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:19.272149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c361-e2e4-41c1-936e-9aa7c21a14f6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:19.272437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c361-e2e4-41c1-936e-9aa7c21a14f6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:19.272710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c361-e2e4-41c1-936e-9aa7c21a14f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:19.440082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8b60c361-e2e4-41c1-936e-9aa7c21a14f6 None None] MFA Rules not processed for user `29009789afbe43398b1f2dcae80bff24`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:19.441310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b60c361-e2e4-41c1-936e-9aa7c21a14f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:19.593505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1248/2496] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:19.598178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:19.779272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822880dd-5808-4932-a2d8-c861af8a2b00 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:19.797774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:19.798471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:19.800909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:19.800909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:19.801375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:19.806109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:19.859831 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1249/2497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:07:19 2022] POST /identity/v3/projects => generated 389 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:07:19.864082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c361-e2e4-41c1-936e-9aa7c21a14f6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:19.879749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c361-e2e4-41c1-936e-9aa7c21a14f6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:19.986478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:19.987737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:19.988025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:19.988499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:19.989537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:19.993270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:20.020105 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1249/2498] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:07:19 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:07:20.023911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:20.035044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0a0f-da1c-4b81-9926-d66a8c071324 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:20.052412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:20.054337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:20.054677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:20.054958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:20.056482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:20.059048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:20.090672 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1250/2499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:07:20.091341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:20.104552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488bd7-1bf6-449d-bc0c-ca5422d5cc33 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:20.121860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:20.122540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:20.122955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:20.123074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] PATH_INFO: `/v3/projects/f776ab4594fc456094058670124235ba/users/4673c4ce41da446aaf3bbf9027f786cb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:20.145807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f776ab4594fc456094058670124235ba, user_id=4673c4ce41da446aaf3bbf9027f786cb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:20.149086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:20.169625 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1250/2500] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:07:20 2022] PUT /identity/v3/projects/f776ab4594fc456094058670124235ba/users/4673c4ce41da446aaf3bbf9027f786cb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:07:20.174246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:20.187672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be514a4a-6189-4bd2-8f50-4ecfd19e020b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:20.233932 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:20.299393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224da84-7d82-4fcf-9e4a-b823e75f6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:20.300060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224da84-7d82-4fcf-9e4a-b823e75f6a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:20.300340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224da84-7d82-4fcf-9e4a-b823e75f6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:20.300615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224da84-7d82-4fcf-9e4a-b823e75f6a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:20.302113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224da84-7d82-4fcf-9e4a-b823e75f6a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:20.303712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224da84-7d82-4fcf-9e4a-b823e75f6a45 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:20.316416 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1251/2501] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:07:20.320516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:20.331951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6b89-3df1-465f-8109-50f6e5c40609 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:20.337422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16d651-d4d0-412f-9cc5-4d81ff327a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:20.338158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16d651-d4d0-412f-9cc5-4d81ff327a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:20.338497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16d651-d4d0-412f-9cc5-4d81ff327a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:20.338835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16d651-d4d0-412f-9cc5-4d81ff327a03 admin admin] PATH_INFO: `/v3/projects/f776ab4594fc456094058670124235ba/users/4673c4ce41da446aaf3bbf9027f786cb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:20.342654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16d651-d4d0-412f-9cc5-4d81ff327a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f776ab4594fc456094058670124235ba, user_id=4673c4ce41da446aaf3bbf9027f786cb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:20.346515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16d651-d4d0-412f-9cc5-4d81ff327a03 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:20.360791 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1251/2502] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:07:20 2022] PUT /identity/v3/projects/f776ab4594fc456094058670124235ba/users/4673c4ce41da446aaf3bbf9027f786cb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:20.371315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979791-8075-4898-8840-ecfb677ba157 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:20.371597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979791-8075-4898-8840-ecfb677ba157 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:20.371868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43979791-8075-4898-8840-ecfb677ba157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:20.402635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-43979791-8075-4898-8840-ecfb677ba157 None None] MFA Rules not processed for user `4673c4ce41da446aaf3bbf9027f786cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:20.404171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-43979791-8075-4898-8840-ecfb677ba157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:20.496401 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1252/2503] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:20.498558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbdca4-592c-4cc1-a496-af568fda7cd8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:20.499444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbdca4-592c-4cc1-a496-af568fda7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:20.499718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbdca4-592c-4cc1-a496-af568fda7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:20.536599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cedbdca4-592c-4cc1-a496-af568fda7cd8 None None] MFA Rules not processed for user `29009789afbe43398b1f2dcae80bff24`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:20.538477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cedbdca4-592c-4cc1-a496-af568fda7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:20.591357 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:20.622683 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1252/2504] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:07:20.635465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43979791-8075-4898-8840-ecfb677ba157 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:20.637318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-43979791-8075-4898-8840-ecfb677ba157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:20.726165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43979791-8075-4898-8840-ecfb677ba157 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:20.732030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:20.732859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:20.733635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:20.733997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:20.745487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:20.747118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:20.758977 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1253/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:29.294300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8799b-85eb-4b40-a17a-dd3186e65ebc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:29.295431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8799b-85eb-4b40-a17a-dd3186e65ebc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:29.295642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8799b-85eb-4b40-a17a-dd3186e65ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:29.316541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-34f8799b-85eb-4b40-a17a-dd3186e65ebc None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:29.317796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-34f8799b-85eb-4b40-a17a-dd3186e65ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:29.376688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1253/2506] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:07:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:29.388927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:29.390513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:29.419932 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:29.464839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968d0da-5f96-4527-8b24-916f93ba7d35 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:29.471459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:29.472151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:29.472614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:29.472883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:29.488054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:29.489779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:29.499379 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1254/2507] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:36.556960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:36.558052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:36.558537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:36.583271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:36.584838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:36.599259 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1254/2508] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:07:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:36.620794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:36.634598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83857ac7-96f2-4e0c-b186-e91ec63e2ddc service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:36.642145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:36.643355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:36.644333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:36.644612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:36.672084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:36.673724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:36.696277 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1255/2509] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:39.327442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:39.328904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:39.348290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff85105-02a4-498b-b510-b29ed8f32f8b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:39.355199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:39.355831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:39.356244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:39.356526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:39.371363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:39.374344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:39.405125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1255/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:43.683070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:43.684793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:43.801806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa96d83-a3c6-4d93-af47-981d1ec42a57 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:43.807905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d90b0-2f68-4ee9-b801-a2aaed65b948 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:43.809007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d90b0-2f68-4ee9-b801-a2aaed65b948 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:43.810929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d90b0-2f68-4ee9-b801-a2aaed65b948 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:43.811731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d90b0-2f68-4ee9-b801-a2aaed65b948 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:43.814014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fc2d90b0-2f68-4ee9-b801-a2aaed65b948 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:43.834691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d90b0-2f68-4ee9-b801-a2aaed65b948 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:43.836737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d90b0-2f68-4ee9-b801-a2aaed65b948 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:43.851947 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1256/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:07:46.377110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:46.378718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:46.625433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13f54f-0496-4ae7-ae0f-c790090de135 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:46.631281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:46.632237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:46.632784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:46.642818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] PATH_INFO: `/v3/users/a2b7b813e3b1448ba3360475b37a468f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:46.648067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b7b813e3b1448ba3360475b37a468f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:46.650395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:46.776830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b7b813e3b1448ba3360475b37a468f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:46.778134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b7b813e3b1448ba3360475b37a468f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:46.779504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b7b813e3b1448ba3360475b37a468f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:46.793819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b7b813e3b1448ba3360475b37a468f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:46.807314 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:46.809964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b7b813e3b1448ba3360475b37a468f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:46.835082 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1256/2512] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:07:46 2022] DELETE /identity/v3/users/a2b7b813e3b1448ba3360475b37a468f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:46.840809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1a7d-f553-4030-8f0e-70170c9dd3c2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:46.845363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1a7d-f553-4030-8f0e-70170c9dd3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:46.845845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1a7d-f553-4030-8f0e-70170c9dd3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:46.883634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ce8f1a7d-f553-4030-8f0e-70170c9dd3c2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:46.887741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ce8f1a7d-f553-4030-8f0e-70170c9dd3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:46.973101 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1257/2513] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:46.982880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:46.984514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:47.186859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb440ff-eae2-49ef-9640-6ae9f7c88e74 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:47.213248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:47.213877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:47.214157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:47.214426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:47.237075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:47.237075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:47.259279 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1257/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:47.625424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f08a7-6b46-45a4-b9c2-794245d24868 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:47.625716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f08a7-6b46-45a4-b9c2-794245d24868 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:47.626160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f08a7-6b46-45a4-b9c2-794245d24868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:47.706410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-131f08a7-6b46-45a4-b9c2-794245d24868 None None] MFA Rules not processed for user `29009789afbe43398b1f2dcae80bff24`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:47.711150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:47.712711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:47.730021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-131f08a7-6b46-45a4-b9c2-794245d24868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:47.750939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bd895-6e17-4c73-a15b-ce4fc8c1b608 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:47.804765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:47.805514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:47.814922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:47.815454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] PATH_INFO: `/v3/projects/0cb55558a1e3436a831a2cd1ba11fa48` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:47.819711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb55558a1e3436a831a2cd1ba11fa48)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:47.836507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:47.926660 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:47.951062 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1258/2515] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:47.990309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb55558a1e3436a831a2cd1ba11fa48', 'request_id': 'req-ad086ba7-3550-475f-9398-8b986c6081d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.008778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb55558a1e3436a831a2cd1ba11fa48', 'request_id': 'req-ad086ba7-3550-475f-9398-8b986c6081d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.032106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb55558a1e3436a831a2cd1ba11fa48', 'request_id': 'req-ad086ba7-3550-475f-9398-8b986c6081d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.067997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] The token cache is being invalidate because project 0cb55558a1e3436a831a2cd1ba11fa48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:07:48.068550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.069414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.071722 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1258/2516] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:07:47 2022] DELETE /identity/v3/projects/0cb55558a1e3436a831a2cd1ba11fa48 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:07:48.075509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f08a7-6b46-45a4-b9c2-794245d24868 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:48.095834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:48.099007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f08a7-6b46-45a4-b9c2-794245d24868 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:48.100788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:48.256260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:48.257513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:48.257980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:48.259254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] PATH_INFO: `/v3/users/aaae0255719f4975a5de2e05e8d74d03` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:48.262849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaae0255719f4975a5de2e05e8d74d03)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:48.267959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:48.284169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086ba7-3550-475f-9398-8b986c6081d8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:48.290996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:48.291798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:48.292088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:48.292405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:48.297324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:48.324978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:48.328649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:48.344803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1259/2517] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:48.386376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaae0255719f4975a5de2e05e8d74d03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.387432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaae0255719f4975a5de2e05e8d74d03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.388265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaae0255719f4975a5de2e05e8d74d03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.413863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaae0255719f4975a5de2e05e8d74d03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.434188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8066f572-516f-4ba1-9438-c7238bf20d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaae0255719f4975a5de2e05e8d74d03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:48.464245 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1259/2518] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:07:48 2022] DELETE /identity/v3/users/aaae0255719f4975a5de2e05e8d74d03 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:48.795879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:48.797522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:48.820422 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:48.862302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc8597-5ad8-4e36-9882-1600e3a6b95e service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:48.996311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:48.996957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:48.997270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:48.998214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] PATH_INFO: `/v3/projects/42dcd83d48eb40dd972f0a4e3837a6d9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:49.002142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42dcd83d48eb40dd972f0a4e3837a6d9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:49.004932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:49.159891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42dcd83d48eb40dd972f0a4e3837a6d9', 'request_id': 'req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:49.192266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42dcd83d48eb40dd972f0a4e3837a6d9', 'request_id': 'req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:49.222217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42dcd83d48eb40dd972f0a4e3837a6d9', 'request_id': 'req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:49.250333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] The token cache is being invalidate because project 42dcd83d48eb40dd972f0a4e3837a6d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:07:49.250829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:49.251592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f2f600-00d1-4fcf-94c7-b24af8fc0b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:49.260422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1260/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:07:48 2022] DELETE /identity/v3/projects/42dcd83d48eb40dd972f0a4e3837a6d9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:49.261556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774048f5-08b1-426b-a16b-0b0e1a82d2b3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:49.262008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774048f5-08b1-426b-a16b-0b0e1a82d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:49.262115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774048f5-08b1-426b-a16b-0b0e1a82d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:49.299959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-774048f5-08b1-426b-a16b-0b0e1a82d2b3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:49.305583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-774048f5-08b1-426b-a16b-0b0e1a82d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:49.454090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1260/2520] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:07:49.468125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7171d3-c621-4237-806b-a4b024c02170 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:49.471087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7171d3-c621-4237-806b-a4b024c02170 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:49.471448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7171d3-c621-4237-806b-a4b024c02170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:49.509895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ea7171d3-c621-4237-806b-a4b024c02170 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:49.517396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ea7171d3-c621-4237-806b-a4b024c02170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:49.524550 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1261/2521] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:49.529710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774048f5-08b1-426b-a16b-0b0e1a82d2b3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:49.542109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774048f5-08b1-426b-a16b-0b0e1a82d2b3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:49.555376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:49.556359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:49.556826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:49.557275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:49.558470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:07:49.558659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:49.564471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:49.568254 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:49.588591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1261/2522] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:07:49.600438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7171d3-c621-4237-806b-a4b024c02170 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:49.616628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7171d3-c621-4237-806b-a4b024c02170 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:49.628185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:49.629639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:49.629929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:49.630201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:49.631445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:49.634785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:49.701192 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1262/2523] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:07:49 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:07:49.702219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:49.718743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a5c58-fb7c-4c24-adc9-eb09321661a8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:49.867955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:49.868586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:49.868868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:49.871006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:49.876126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:49.879039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:49.933434 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1262/2524] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:07:49 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:07:49.937925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:49.950265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:49.953243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:49.957658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb74e97-9373-4f72-b55c-1afc334578bf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:49.972017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:49.973086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:49.973602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:49.973988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:49.974950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:49.977269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:50.003661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1263/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:07:50.007064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:50.026064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703e00-721a-4bce-8610-e0ef21fecf60 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:50.037326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:50.038527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:50.038964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:50.039893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:50.041409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:50.044931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:50.073799 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1264/2526] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:07:50.078996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:50.107826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df35fa-8c57-4eba-a751-0dd1d2c90768 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:50.121989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:50.123241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:50.123748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:50.123748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:50.132732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:50.136567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6869f2-f072-4b92-b933-d1a516e9c95e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:50.159269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d40e-9d07-4301-8943-f6d58decec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:50.159960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d40e-9d07-4301-8943-f6d58decec33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:50.160239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d40e-9d07-4301-8943-f6d58decec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:50.166354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d40e-9d07-4301-8943-f6d58decec33 admin admin] PATH_INFO: `/v3/projects/77eeef8de82d4ae99927b2ffd8a56950/users/9b707d1d0d9b4a34b03ef506a0ad3be7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:50.241588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d40e-9d07-4301-8943-f6d58decec33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77eeef8de82d4ae99927b2ffd8a56950, user_id=9b707d1d0d9b4a34b03ef506a0ad3be7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:50.245855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d40e-9d07-4301-8943-f6d58decec33 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:50.285120 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1265/2527] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:07:50 2022] PUT /identity/v3/projects/77eeef8de82d4ae99927b2ffd8a56950/users/9b707d1d0d9b4a34b03ef506a0ad3be7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:50.298324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c089f9-c602-4778-aa86-7c695fc4f8fa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:50.298977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c089f9-c602-4778-aa86-7c695fc4f8fa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:50.299460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c089f9-c602-4778-aa86-7c695fc4f8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:50.332227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:50.334276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:50.352692 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1263/2528] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:50.372296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-31c089f9-c602-4778-aa86-7c695fc4f8fa None None] MFA Rules not processed for user `9b707d1d0d9b4a34b03ef506a0ad3be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:50.374361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31c089f9-c602-4778-aa86-7c695fc4f8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:50.385184 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:50.478362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1266/2529] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:07:51.033385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:51.034787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:51.052470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b59d-04cb-434e-b2de-8dfdfd1e978f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:51.098495 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:51.150467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54808f2-139c-43eb-92c9-c2a969dd58c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:51.151995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54808f2-139c-43eb-92c9-c2a969dd58c7 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:51.152272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54808f2-139c-43eb-92c9-c2a969dd58c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:51.152545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54808f2-139c-43eb-92c9-c2a969dd58c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:51.162099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54808f2-139c-43eb-92c9-c2a969dd58c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:51.163667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54808f2-139c-43eb-92c9-c2a969dd58c7 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:51.175136 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1264/2530] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:51.900329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c089f9-c602-4778-aa86-7c695fc4f8fa None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:52.034839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c089f9-c602-4778-aa86-7c695fc4f8fa None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:52.042959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:52.043379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.043657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.043924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] PATH_INFO: `/v3/users/9b707d1d0d9b4a34b03ef506a0ad3be7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.047425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b707d1d0d9b4a34b03ef506a0ad3be7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:52.049364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:52.112256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b707d1d0d9b4a34b03ef506a0ad3be7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.113384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b707d1d0d9b4a34b03ef506a0ad3be7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.114241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b707d1d0d9b4a34b03ef506a0ad3be7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.124092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b707d1d0d9b4a34b03ef506a0ad3be7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.138889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b707d1d0d9b4a34b03ef506a0ad3be7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.155511 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1267/2531] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:07:51 2022] DELETE /identity/v3/users/9b707d1d0d9b4a34b03ef506a0ad3be7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:52.160314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.160921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.161237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.194641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:52.196004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:52.314458 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1265/2532] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:52.324952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:52.327396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:52.363981 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:52.393568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110f71-3078-47ac-930d-ea58b9e8f02f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:52.398214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35587f6b-b55f-40f1-b9c9-16d223a0ede3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:52.398991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587f6b-b55f-40f1-b9c9-16d223a0ede3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.399383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587f6b-b55f-40f1-b9c9-16d223a0ede3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.399746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587f6b-b55f-40f1-b9c9-16d223a0ede3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.410362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35587f6b-b55f-40f1-b9c9-16d223a0ede3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:52.411844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35587f6b-b55f-40f1-b9c9-16d223a0ede3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:52.422187 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1268/2533] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:52.682812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:52.684343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:52.697406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653e9a7-92c9-4fbe-acd2-fe4b20a088df None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:52.703321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:52.703979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.704231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.704505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] PATH_INFO: `/v3/projects/77eeef8de82d4ae99927b2ffd8a56950` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.705649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=77eeef8de82d4ae99927b2ffd8a56950)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:52.707558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:52.756024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77eeef8de82d4ae99927b2ffd8a56950', 'request_id': 'req-b19b2524-4440-43a5-b622-c7dfeb7e37cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.761798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77eeef8de82d4ae99927b2ffd8a56950', 'request_id': 'req-b19b2524-4440-43a5-b622-c7dfeb7e37cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.768409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77eeef8de82d4ae99927b2ffd8a56950', 'request_id': 'req-b19b2524-4440-43a5-b622-c7dfeb7e37cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.781577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] The token cache is being invalidate because project 77eeef8de82d4ae99927b2ffd8a56950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:07:52.781861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.782478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b19b2524-4440-43a5-b622-c7dfeb7e37cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:52.783943 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1266/2534] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:07:52 2022] DELETE /identity/v3/projects/77eeef8de82d4ae99927b2ffd8a56950 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:52.788766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edff3e-3107-4fd1-87c4-6a1f149731e7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.789052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edff3e-3107-4fd1-87c4-6a1f149731e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.789380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edff3e-3107-4fd1-87c4-6a1f149731e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.809074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d1edff3e-3107-4fd1-87c4-6a1f149731e7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:52.811264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d1edff3e-3107-4fd1-87c4-6a1f149731e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:52.869355 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1269/2535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:52.878327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8b1b-f1ed-4b6d-9169-22f975741714 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.878633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8b1b-f1ed-4b6d-9169-22f975741714 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.878910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e8b1b-f1ed-4b6d-9169-22f975741714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.900253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fc2e8b1b-f1ed-4b6d-9169-22f975741714 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:52.901480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fc2e8b1b-f1ed-4b6d-9169-22f975741714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:52.909745 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1267/2536] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:52.913999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edff3e-3107-4fd1-87c4-6a1f149731e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:52.923747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edff3e-3107-4fd1-87c4-6a1f149731e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:52.928255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:52.928869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.929171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.929438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.930077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:07:52.930372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:52.931928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:52.943695 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1270/2537] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:07:52.947921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e8b1b-f1ed-4b6d-9169-22f975741714 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:52.957947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e8b1b-f1ed-4b6d-9169-22f975741714 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:52.962740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:52.963400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:52.963691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:52.963985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:52.964631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:52.966680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:52.995460 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1268/2538] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:07:52 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:07:53.006742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:53.021169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c90c9-4329-439a-a63e-0d29cef933c9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:53.087218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:53.087911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:53.088273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:53.088666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:53.089388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:53.091937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:53.121312 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1271/2539] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:07:53 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:07:53.126873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:53.167777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e76577-af9d-4fbf-90a1-2f1a35c18635 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:53.174883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:53.176122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:53.176405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:53.176676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:53.177357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:53.178938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:53.180788 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:53.197477 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1269/2540] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:07:53.198248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:53.210090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859bf14-5dec-42e6-9d59-3f2de5c42dd9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:53.215354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc39ba-277a-4eb1-94e7-d457a8986dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:53.216220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc39ba-277a-4eb1-94e7-d457a8986dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:53.216826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc39ba-277a-4eb1-94e7-d457a8986dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:53.217315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc39ba-277a-4eb1-94e7-d457a8986dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:53.218435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc39ba-277a-4eb1-94e7-d457a8986dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:53.220200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc39ba-277a-4eb1-94e7-d457a8986dbd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:53.240351 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1272/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:07:53.241350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:53.252610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ac5df-80c2-4100-b7a8-fe86dac65ee6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:53.261783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:53.265200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:53.265844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:53.266294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] PATH_INFO: `/v3/projects/076f54283a5f429a982fddf5a99776e7/users/990aefe967244ff09a3e2f109a2f47e2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:53.284801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=076f54283a5f429a982fddf5a99776e7, user_id=990aefe967244ff09a3e2f109a2f47e2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:53.287851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:53.323999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a810-7290-433d-a8ce-b51e4c4d7b60 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:53.324309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a810-7290-433d-a8ce-b51e4c4d7b60 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:53.324613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a810-7290-433d-a8ce-b51e4c4d7b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:53.328856 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1270/2542] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:07:53 2022] PUT /identity/v3/projects/076f54283a5f429a982fddf5a99776e7/users/990aefe967244ff09a3e2f109a2f47e2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:07:53.376723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2a72a810-7290-433d-a8ce-b51e4c4d7b60 None None] MFA Rules not processed for user `990aefe967244ff09a3e2f109a2f47e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:53.378805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a72a810-7290-433d-a8ce-b51e4c4d7b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:53.419969 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:53.463220 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1273/2543] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:53.804986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:53.807177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:53.899903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb0e5c-8a06-44fe-ac4c-bf8b148bb1bb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:53.906387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:53.907236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:53.907628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:53.907773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:53.917673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:53.919896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:53.935742 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1271/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:54.123570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5779fa-ff8a-4c0e-9b73-51e38043fd7c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:54.124131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5779fa-ff8a-4c0e-9b73-51e38043fd7c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:54.124587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5779fa-ff8a-4c0e-9b73-51e38043fd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:54.156247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bc5779fa-ff8a-4c0e-9b73-51e38043fd7c None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:54.157785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bc5779fa-ff8a-4c0e-9b73-51e38043fd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:54.234927 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1274/2545] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:07:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:54.250157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:54.252135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:54.375743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc725-5cbd-4b48-befa-f49d123fed1c service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:54.382449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aa4d3-b7fd-4195-a9dc-dcef42ee6bd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:54.383316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aa4d3-b7fd-4195-a9dc-dcef42ee6bd4 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:54.383694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aa4d3-b7fd-4195-a9dc-dcef42ee6bd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:54.384149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aa4d3-b7fd-4195-a9dc-dcef42ee6bd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:54.395773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642aa4d3-b7fd-4195-a9dc-dcef42ee6bd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:54.397323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642aa4d3-b7fd-4195-a9dc-dcef42ee6bd4 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:54.425445 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1272/2546] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:07:54.643166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06ef5-cb84-4f50-be6c-3f206c1b21ae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:54.643817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06ef5-cb84-4f50-be6c-3f206c1b21ae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:54.644309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c06ef5-cb84-4f50-be6c-3f206c1b21ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:54.695657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-22c06ef5-cb84-4f50-be6c-3f206c1b21ae None None] MFA Rules not processed for user `990aefe967244ff09a3e2f109a2f47e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:54.697629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-22c06ef5-cb84-4f50-be6c-3f206c1b21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:54.709126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1275/2547] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:55.251955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7d40-4d2f-475a-9d39-e1cc25523148 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:55.252886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7d40-4d2f-475a-9d39-e1cc25523148 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:55.253410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7d40-4d2f-475a-9d39-e1cc25523148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:55.279107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1e8c7d40-4d2f-475a-9d39-e1cc25523148 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:55.280606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1e8c7d40-4d2f-475a-9d39-e1cc25523148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:55.289742 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1273/2548] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:07:55.305341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06ef5-cb84-4f50-be6c-3f206c1b21ae None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:55.321520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c06ef5-cb84-4f50-be6c-3f206c1b21ae None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:55.331784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7e38-a64e-4f76-8f64-fbb11d774940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:55.332702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7e38-a64e-4f76-8f64-fbb11d774940 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:55.333268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7e38-a64e-4f76-8f64-fbb11d774940 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:55.333704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7e38-a64e-4f76-8f64-fbb11d774940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:55.345589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7e38-a64e-4f76-8f64-fbb11d774940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:55.349317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7e38-a64e-4f76-8f64-fbb11d774940 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:55.364315 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1276/2549] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:55.642106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c7d40-4d2f-475a-9d39-e1cc25523148 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:55.769959 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:55.814691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c7d40-4d2f-475a-9d39-e1cc25523148 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:55.819952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:55.820797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:55.821103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:55.821458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] PATH_INFO: `/v3/users/990aefe967244ff09a3e2f109a2f47e2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:55.822617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=990aefe967244ff09a3e2f109a2f47e2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:55.824947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:55.953512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990aefe967244ff09a3e2f109a2f47e2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:55.954383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990aefe967244ff09a3e2f109a2f47e2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:55.954999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990aefe967244ff09a3e2f109a2f47e2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:55.973671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990aefe967244ff09a3e2f109a2f47e2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:55.988758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990aefe967244ff09a3e2f109a2f47e2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:56.019232 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1274/2550] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:07:55 2022] DELETE /identity/v3/users/990aefe967244ff09a3e2f109a2f47e2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:56.023896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409cb9-0def-4d4a-a3fb-7d40fcc69496 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:56.024315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409cb9-0def-4d4a-a3fb-7d40fcc69496 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:56.024699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409cb9-0def-4d4a-a3fb-7d40fcc69496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:56.102689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6a409cb9-0def-4d4a-a3fb-7d40fcc69496 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:56.104700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a409cb9-0def-4d4a-a3fb-7d40fcc69496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:56.285810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1277/2551] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:56.308018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:56.310249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:56.403995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4328f2-fc65-4b48-ba72-ada5752a9035 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:56.407839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:56.408448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:56.408729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:56.409012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:56.418379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:56.420054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:56.430655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1275/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:56.558636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c3372-0078-413a-8e18-c82bdb392def None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:56.559502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c3372-0078-413a-8e18-c82bdb392def None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:56.560170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c3372-0078-413a-8e18-c82bdb392def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:56.610562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7f5c3372-0078-413a-8e18-c82bdb392def None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:56.611843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7f5c3372-0078-413a-8e18-c82bdb392def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:56.697365 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:56.724007 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1278/2553] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:07:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:56.740580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:56.742026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:56.755282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:56.755955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:56.756319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:56.802403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:56.805416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:56.825910 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1279/2554] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:07:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:56.841101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:56.843332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:56.871887 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:56.879786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0cafb-cdbe-4086-83cf-d9f5c67716a7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:56.889917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:56.890838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:56.891397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:56.892088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:56.907000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:56.922963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:56.940989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1276/2555] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:57.083801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1354-05be-455c-a00c-6fa66dce1b0d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:57.104150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505157f-9318-4144-a3cf-3fd8afdebad5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:57.105485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505157f-9318-4144-a3cf-3fd8afdebad5 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:57.105914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505157f-9318-4144-a3cf-3fd8afdebad5 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:57.106243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505157f-9318-4144-a3cf-3fd8afdebad5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:57.117556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505157f-9318-4144-a3cf-3fd8afdebad5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:57.119284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505157f-9318-4144-a3cf-3fd8afdebad5 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:57.129850 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1280/2556] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:57.365593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:57.369187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:57.410053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152bdb-3736-4f14-ac63-5ebd4b146443 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:57.427817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:57.430463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:57.435789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:57.436655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] PATH_INFO: `/v3/projects/076f54283a5f429a982fddf5a99776e7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:57.442999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076f54283a5f429a982fddf5a99776e7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:57.449300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:57.597035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076f54283a5f429a982fddf5a99776e7', 'request_id': 'req-8cacfd14-eece-4a10-b240-9f3581c5f5b7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:57.609782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076f54283a5f429a982fddf5a99776e7', 'request_id': 'req-8cacfd14-eece-4a10-b240-9f3581c5f5b7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:57.627808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076f54283a5f429a982fddf5a99776e7', 'request_id': 'req-8cacfd14-eece-4a10-b240-9f3581c5f5b7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:57.656776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] The token cache is being invalidate because project 076f54283a5f429a982fddf5a99776e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:07:57.657291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:57.658341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8cacfd14-eece-4a10-b240-9f3581c5f5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:07:57.668031 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1277/2557] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:07:57 2022] DELETE /identity/v3/projects/076f54283a5f429a982fddf5a99776e7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:57.673444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa019-11f1-413d-a0d2-d967280dd2e1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:57.673850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa019-11f1-413d-a0d2-d967280dd2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:57.674000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa019-11f1-413d-a0d2-d967280dd2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:57.711329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9e9aa019-11f1-413d-a0d2-d967280dd2e1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:57.714856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9e9aa019-11f1-413d-a0d2-d967280dd2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:57.836360 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1281/2558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:57.838119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d445a-5d8b-4865-8cb5-13db3d3558d4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:57.838603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d445a-5d8b-4865-8cb5-13db3d3558d4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:57.838767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d445a-5d8b-4865-8cb5-13db3d3558d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:57.885382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f58d445a-5d8b-4865-8cb5-13db3d3558d4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:57.896293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f58d445a-5d8b-4865-8cb5-13db3d3558d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:57.911060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa019-11f1-413d-a0d2-d967280dd2e1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:57.911256 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1278/2559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:57.943314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa019-11f1-413d-a0d2-d967280dd2e1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:57.949485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:57.951220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:57.951784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:57.952355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:57.953259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:07:57.953989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:57.956757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:57.972731 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1282/2560] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:07:57.978424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d445a-5d8b-4865-8cb5-13db3d3558d4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:58.025595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d445a-5d8b-4865-8cb5-13db3d3558d4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:58.042087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353225-2d14-43d0-bf99-645a9b13537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:58.043775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353225-2d14-43d0-bf99-645a9b13537e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.044173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353225-2d14-43d0-bf99-645a9b13537e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.044520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353225-2d14-43d0-bf99-645a9b13537e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.045341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab353225-2d14-43d0-bf99-645a9b13537e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:58.050960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab353225-2d14-43d0-bf99-645a9b13537e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:58.141072 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1279/2561] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:07:57 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:07:58.145831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:58.158559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.159106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.160962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.162173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc6db-25f9-4471-aee6-6dfad39e5ab7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:58.205097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:58.206881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:58.282094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:58.282745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.283170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.283524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.284537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:58.288581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:58.329134 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:58.347775 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1283/2562] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:07:58 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:07:58.349694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:58.371928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7abc4c-d4ce-450f-b52b-4e0f71064349 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:58.377450 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1280/2563] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:58.391749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:58.392518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.392751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.392983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.393625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:58.398126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:58.421549 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1284/2564] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:07:58.422131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:58.423698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:58.425794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:58.447456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a6f64-3ead-4c2d-b5ca-6c67bbe7779c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:58.462689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:58.464980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.465285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.465547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.466385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:58.470326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:58.500578 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1285/2565] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:07:58.505323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:58.532868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3356-040b-4d59-9260-13674a1da33f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:58.562104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76faa0-89cb-4458-9ecc-eccca112bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:58.563040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76faa0-89cb-4458-9ecc-eccca112bbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.563534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76faa0-89cb-4458-9ecc-eccca112bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.563956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76faa0-89cb-4458-9ecc-eccca112bbb2 admin admin] PATH_INFO: `/v3/projects/45f18b6a80bf4bf8b5dc2b9430218b2f/users/df90577a806f428fa15f9fce70d69a54/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.614187 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:07:58.618973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76faa0-89cb-4458-9ecc-eccca112bbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f18b6a80bf4bf8b5dc2b9430218b2f, user_id=df90577a806f428fa15f9fce70d69a54, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:58.669974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b6b2-40a1-4b49-bce2-d7972ccbe753 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:58.675360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76faa0-89cb-4458-9ecc-eccca112bbb2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:58.687218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:58.688015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.688329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.688590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.696189 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1286/2566] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:07:58 2022] PUT /identity/v3/projects/45f18b6a80bf4bf8b5dc2b9430218b2f/users/df90577a806f428fa15f9fce70d69a54/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:07:58.702123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f017cd-03c3-4910-a5ad-4f6e45806426 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:58.702585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f017cd-03c3-4910-a5ad-4f6e45806426 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:58.703530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f017cd-03c3-4910-a5ad-4f6e45806426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:58.714036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:58.715633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:58.742541 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1281/2567] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:07:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:07:58.777149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-02f017cd-03c3-4910-a5ad-4f6e45806426 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:58.779215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-02f017cd-03c3-4910-a5ad-4f6e45806426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:58.954966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1287/2568] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:07:58.965895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:07:58.968891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:07:59.088574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f79c8-8902-4781-9ce8-48e68b11cf96 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:07:59.208100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:07:59.209028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:59.209579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:59.210056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:59.222346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:07:59.224213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:07:59.236662 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1282/2569] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:07:59.894787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee226915-e971-4a9e-bc85-6c28df210053 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:07:59.895346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee226915-e971-4a9e-bc85-6c28df210053 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:07:59.895346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee226915-e971-4a9e-bc85-6c28df210053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:07:59.938734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ee226915-e971-4a9e-bc85-6c28df210053 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:07:59.939969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ee226915-e971-4a9e-bc85-6c28df210053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:00.088360 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1288/2570] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:00.133936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:00.281682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b1822-09c8-46f1-9bd7-fc371195c869 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:00.286746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23397c1-3fa2-48db-bce4-8f86dcb20268 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:00.287363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23397c1-3fa2-48db-bce4-8f86dcb20268 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:00.287639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23397c1-3fa2-48db-bce4-8f86dcb20268 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:00.287907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23397c1-3fa2-48db-bce4-8f86dcb20268 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:00.296982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23397c1-3fa2-48db-bce4-8f86dcb20268 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:00.298661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23397c1-3fa2-48db-bce4-8f86dcb20268 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:00.307673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1283/2571] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:08:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:08:06.282556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:06.286577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:06.289033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:06.368329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] MFA Rules not processed for user `df90577a806f428fa15f9fce70d69a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:06.368329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:06.512360 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:06.614223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0f4b3-e22b-4f4c-b029-62970422b897 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:06.615150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0f4b3-e22b-4f4c-b029-62970422b897 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:06.615579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0f4b3-e22b-4f4c-b029-62970422b897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:06.621200 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1289/2572] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:06.655817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d6f0f4b3-e22b-4f4c-b029-62970422b897 None None] MFA Rules not processed for user `df90577a806f428fa15f9fce70d69a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:06.657054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d6f0f4b3-e22b-4f4c-b029-62970422b897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:06.674074 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1284/2573] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:08:07.018785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:07.020376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:07.264975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fa199-7aae-4983-892f-a62c62abe5d2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:07.279566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:07.280338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:07.280658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:07.281119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:07.302475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:07.305534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:07.348013 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1290/2574] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:09.192348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0ee0b-6cbc-4075-a9e0-fad945ca1a28 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:09.192969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0ee0b-6cbc-4075-a9e0-fad945ca1a28 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:09.192969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0ee0b-6cbc-4075-a9e0-fad945ca1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:09.223915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-56c0ee0b-6cbc-4075-a9e0-fad945ca1a28 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:09.227990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-56c0ee0b-6cbc-4075-a9e0-fad945ca1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:09.243086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1285/2575] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:09.261730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:09.285869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925ab52-ce33-47a7-9018-dc9eb4f71696 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:09.297941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:09.298566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:09.298844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:09.299116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:09.312886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:09.314724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:09.326996 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1291/2576] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:08:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:08:10.147086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0ee0b-6cbc-4075-a9e0-fad945ca1a28 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:10.163029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0ee0b-6cbc-4075-a9e0-fad945ca1a28 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:10.174035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14e3a-da9c-4ed2-bd52-32cea5041dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:10.175452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14e3a-da9c-4ed2-bd52-32cea5041dcb service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:10.177246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14e3a-da9c-4ed2-bd52-32cea5041dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:10.177802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14e3a-da9c-4ed2-bd52-32cea5041dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:10.182603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-83f14e3a-da9c-4ed2-bd52-32cea5041dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:10.206627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f14e3a-da9c-4ed2-bd52-32cea5041dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:10.210156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f14e3a-da9c-4ed2-bd52-32cea5041dcb service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:10.231023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1286/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:10.807566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:10.809772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:10.828536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0ca82-7a95-44cf-81bb-cc71ebf147f0 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:10.835219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:10.836100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:10.836569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:10.837039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:10.840116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:10.862490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:10.864079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:10.876774 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1292/2578] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:13.693091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504c2e-1c33-46b8-babb-e6622ed2526b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:13.693582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504c2e-1c33-46b8-babb-e6622ed2526b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:13.693686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504c2e-1c33-46b8-babb-e6622ed2526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:13.706009 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:13.742742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b6504c2e-1c33-46b8-babb-e6622ed2526b None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:13.744564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b6504c2e-1c33-46b8-babb-e6622ed2526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:13.786385 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1287/2579] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:08:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:13.793580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:13.821448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acd40a-cbe4-495a-b27c-fe7f8c3273a6 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:13.827103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:13.827730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:13.828014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:13.828283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:13.856015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:13.858959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:13.869338 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1293/2580] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:08:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:08:14.225512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25495f3-a066-43d0-925c-1e6bf9acedbf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:14.225796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25495f3-a066-43d0-925c-1e6bf9acedbf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:14.226064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25495f3-a066-43d0-925c-1e6bf9acedbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:14.275833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b25495f3-a066-43d0-925c-1e6bf9acedbf None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:14.277205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b25495f3-a066-43d0-925c-1e6bf9acedbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:14.303988 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1288/2581] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:08:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:14.311655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:14.322698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424d8c3-e7c9-49de-b6af-aad1b3942012 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:14.341563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:14.342200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:14.342480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:14.342753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:14.358385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:14.360547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:14.369826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1294/2582] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:08:14.701432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff443a8-8cbc-4441-ba83-617d9e56bf53 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:14.702006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff443a8-8cbc-4441-ba83-617d9e56bf53 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:14.702106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff443a8-8cbc-4441-ba83-617d9e56bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:14.723258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2ff443a8-8cbc-4441-ba83-617d9e56bf53 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:14.724786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2ff443a8-8cbc-4441-ba83-617d9e56bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:14.734590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1289/2583] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:08:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:14.750247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:14.761698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f438-20bf-4d15-ba4a-0510d7d8a7f2 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:14.767692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:14.768301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:14.768601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:14.768848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:14.777476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:14.780114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:14.788925 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1295/2584] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:08:14.878997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff443a8-8cbc-4441-ba83-617d9e56bf53 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:14.895884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff443a8-8cbc-4441-ba83-617d9e56bf53 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:14.903667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddbf7e-88c1-4a8d-b180-8dfd9cb23376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:14.904689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbf7e-88c1-4a8d-b180-8dfd9cb23376 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:14.907822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:14.910872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:14.917683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbf7e-88c1-4a8d-b180-8dfd9cb23376 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:14.918128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbf7e-88c1-4a8d-b180-8dfd9cb23376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:14.940183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-00ddbf7e-88c1-4a8d-b180-8dfd9cb23376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:14.970111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddbf7e-88c1-4a8d-b180-8dfd9cb23376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:14.971759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddbf7e-88c1-4a8d-b180-8dfd9cb23376 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:14.983278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4907b-cc92-49dc-8970-013ee28c1051 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:15.000701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1290/2585] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:15.007702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:15.009163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:15.009450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:15.013140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] PATH_INFO: `/v3/users/c239a66f5b664487badcd3b12e6cb44a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:15.018588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c239a66f5b664487badcd3b12e6cb44a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:15.028175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:15.173714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c239a66f5b664487badcd3b12e6cb44a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.174634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c239a66f5b664487badcd3b12e6cb44a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.175454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c239a66f5b664487badcd3b12e6cb44a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.184055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c239a66f5b664487badcd3b12e6cb44a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.190101 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:15.203292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c239a66f5b664487badcd3b12e6cb44a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.222936 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1296/2586] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:14 2022] DELETE /identity/v3/users/c239a66f5b664487badcd3b12e6cb44a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:15.227183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:15.227471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:15.227798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:15.250596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:15.251930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:15.329203 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1291/2587] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:15.347746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:15.350083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:15.461126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e36887-14a5-44e7-b13f-28b5b315c7b4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:15.465174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985646f-4682-4120-87a7-c3bb3e532b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:15.466840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985646f-4682-4120-87a7-c3bb3e532b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:15.467353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985646f-4682-4120-87a7-c3bb3e532b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:15.467686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985646f-4682-4120-87a7-c3bb3e532b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:15.477634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985646f-4682-4120-87a7-c3bb3e532b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:15.479397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985646f-4682-4120-87a7-c3bb3e532b79 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:15.490741 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1297/2588] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:15.818985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:15.820605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:15.834088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425d81d-a2f5-43a5-b25b-ac32b2502026 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:15.851920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:15.852584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:15.852882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:15.853127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] PATH_INFO: `/v3/projects/5767d0e0a10343d99e97e1db9ddad749` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:15.855111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5767d0e0a10343d99e97e1db9ddad749)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:15.857648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:15.933615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5767d0e0a10343d99e97e1db9ddad749', 'request_id': 'req-69ca6ed2-e997-4c84-811b-6e903d850332'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.941189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5767d0e0a10343d99e97e1db9ddad749', 'request_id': 'req-69ca6ed2-e997-4c84-811b-6e903d850332'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.949088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5767d0e0a10343d99e97e1db9ddad749', 'request_id': 'req-69ca6ed2-e997-4c84-811b-6e903d850332'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.965324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] The token cache is being invalidate because project 5767d0e0a10343d99e97e1db9ddad749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:15.965784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.966531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69ca6ed2-e997-4c84-811b-6e903d850332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:15.968149 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1292/2589] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:15 2022] DELETE /identity/v3/projects/5767d0e0a10343d99e97e1db9ddad749 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:15.973214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3b4-47fb-45ad-b737-4ebc170adeb2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:15.973718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3b4-47fb-45ad-b737-4ebc170adeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:15.973818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ee3b4-47fb-45ad-b737-4ebc170adeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:15.996398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9a4ee3b4-47fb-45ad-b737-4ebc170adeb2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:15.998467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9a4ee3b4-47fb-45ad-b737-4ebc170adeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:16.077278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1298/2590] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:16.084888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075d68-c97a-46c6-8ed1-1d8defd04a83 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.085278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075d68-c97a-46c6-8ed1-1d8defd04a83 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.089946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb075d68-c97a-46c6-8ed1-1d8defd04a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.145852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bb075d68-c97a-46c6-8ed1-1d8defd04a83 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:16.146459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb075d68-c97a-46c6-8ed1-1d8defd04a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:16.163704 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1293/2591] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:08:16.167573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3b4-47fb-45ad-b737-4ebc170adeb2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:16.180673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ee3b4-47fb-45ad-b737-4ebc170adeb2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:16.188798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:16.191427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.191901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.192371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.193302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:08:16.193781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:16.195563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:16.211151 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1299/2592] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:16.217204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075d68-c97a-46c6-8ed1-1d8defd04a83 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:16.241806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb075d68-c97a-46c6-8ed1-1d8defd04a83 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:16.248296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:16.248985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.249311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.249583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.250219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:16.252261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:16.286726 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1294/2593] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:16 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:16.291111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:16.303294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0f88b-8c38-43a7-836c-ceedfe6ad4c8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:16.371637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:16.372407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.372821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.373278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.374018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:16.376173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:16.393157 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:16.405677 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1300/2594] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:16 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:16.407203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:16.418189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1863625-464b-4d91-aa61-09bba985774b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:16.423464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:16.424175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.424610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.424885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.425554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:16.427168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:16.440438 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1295/2595] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:16.441667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:16.452526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a31c4-0305-4a73-8b90-8d8c7848d675 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:16.457352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee227e4-d923-4990-b28e-87a1d2061add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:16.458217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee227e4-d923-4990-b28e-87a1d2061add admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.458217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee227e4-d923-4990-b28e-87a1d2061add admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.458458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee227e4-d923-4990-b28e-87a1d2061add admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.459084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee227e4-d923-4990-b28e-87a1d2061add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:16.460660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee227e4-d923-4990-b28e-87a1d2061add admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:16.472458 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1301/2596] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:08:16.476377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:16.490167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2d7aa-b777-4497-b6ce-3275571e4840 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:16.494930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:16.495657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.496006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.496344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] PATH_INFO: `/v3/projects/cfe14475f8f7472e916d1d1350452b94/users/3bc26084f1db4390980d1e4b766a5cd1/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.508458 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:16.513539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe14475f8f7472e916d1d1350452b94, user_id=3bc26084f1db4390980d1e4b766a5cd1, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:16.516811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:16.531301 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1296/2597] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:16 2022] PUT /identity/v3/projects/cfe14475f8f7472e916d1d1350452b94/users/3bc26084f1db4390980d1e4b766a5cd1/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:16.536362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd9bb7-0459-4e51-99b2-39fb163aaa79 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.537562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd9bb7-0459-4e51-99b2-39fb163aaa79 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.538014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd9bb7-0459-4e51-99b2-39fb163aaa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.560910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-facd9bb7-0459-4e51-99b2-39fb163aaa79 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:16.562253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-facd9bb7-0459-4e51-99b2-39fb163aaa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:16.631844 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1302/2598] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:16.641884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:16.643786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:16.703448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a670ac6-32a8-46c1-8f32-8450796cc9b3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:16.707356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236e231-72c0-490a-9786-0c3ad53aefdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:16.707994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236e231-72c0-490a-9786-0c3ad53aefdc service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:16.708241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236e231-72c0-490a-9786-0c3ad53aefdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:16.708520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236e231-72c0-490a-9786-0c3ad53aefdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:16.726556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236e231-72c0-490a-9786-0c3ad53aefdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:16.729251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236e231-72c0-490a-9786-0c3ad53aefdc service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:16.740355 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1297/2599] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:08:19.426639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:19.427771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:19.428414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:19.459582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] MFA Rules not processed for user `51d78a7c9f864115ac02046fa5d313eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:19.460823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:19.476694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:19.477277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:19.477277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:19.540022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:19.541631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:19.639489 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1303/2600] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:19.687626 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1298/2601] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:08:19.701898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:19.703181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:19.853500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a296-e662-4acb-8024-8a3a25c250ca None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:19.862640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4ad23-d62c-47c4-969c-2e1337328a73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:19.863330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ad23-d62c-47c4-969c-2e1337328a73 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:19.863654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ad23-d62c-47c4-969c-2e1337328a73 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:19.864516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4ad23-d62c-47c4-969c-2e1337328a73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:19.876334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4ad23-d62c-47c4-969c-2e1337328a73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:19.879807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4ad23-d62c-47c4-969c-2e1337328a73 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:19.891024 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1304/2602] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:08:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:08:26.153112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:26.155677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:26.175853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cfc8a-1f2d-45c5-99e8-9b5fce437a3f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:26.180237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:26.181212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:26.181687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:26.182109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:26.184489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:26.212961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:26.214460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:26.230587 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1299/2603] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:28.250843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:28.251621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:28.251797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:28.372973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] MFA Rules not processed for user `3bc26084f1db4390980d1e4b766a5cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:28.375090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:28.412518 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:28.709783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1305/2604] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:08:29.355432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:29.358193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:29.502816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add690d-79cb-4537-95dd-fc8fef2a5090 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:29.511426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:29.512454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:29.512934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:29.513440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:29.523772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:29.526357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:29.539954 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1300/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:30.022764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:30.024379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:30.051766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0974be9-57a2-4878-bdf9-061b64438874 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:30.073433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:30.075014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:30.075389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:30.075822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] PATH_INFO: `/v3/users/7aa53bfd731c433d93e308a56839a106` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:30.077177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa53bfd731c433d93e308a56839a106)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:30.079206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:30.172783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa53bfd731c433d93e308a56839a106'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.173624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa53bfd731c433d93e308a56839a106'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.174662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa53bfd731c433d93e308a56839a106'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.201644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa53bfd731c433d93e308a56839a106'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.258202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa53bfd731c433d93e308a56839a106'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.337718 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1306/2606] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:30 2022] DELETE /identity/v3/users/7aa53bfd731c433d93e308a56839a106 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:30.558204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:30.575898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f1a0-c941-43d6-ae88-553112a9408b service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:30.590864 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:30.682808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:30.683632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:30.684620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:30.684994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] PATH_INFO: `/v3/projects/779105b1442046df876206475707ff8f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:30.686318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779105b1442046df876206475707ff8f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:30.688335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:30.749879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779105b1442046df876206475707ff8f', 'request_id': 'req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.757459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779105b1442046df876206475707ff8f', 'request_id': 'req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.774754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779105b1442046df876206475707ff8f', 'request_id': 'req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.804155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] The token cache is being invalidate because project 779105b1442046df876206475707ff8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:30.804575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.805467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:30.807229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1301/2607] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:30 2022] DELETE /identity/v3/projects/779105b1442046df876206475707ff8f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:30.812770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:30.816435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:30.841729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb028-451f-4d28-8513-2217d4ba36e0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:31.066710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:31.067399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:31.067655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:31.067923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] PATH_INFO: `/v3/users/b72b1a062e2e48798d29ea165e2c20a3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:31.069264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72b1a062e2e48798d29ea165e2c20a3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:31.071374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:31.104230 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:31.130635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72b1a062e2e48798d29ea165e2c20a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.131510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72b1a062e2e48798d29ea165e2c20a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.133035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72b1a062e2e48798d29ea165e2c20a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.145204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72b1a062e2e48798d29ea165e2c20a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.160836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92410a96-9998-4d5b-9662-c1e4806e635c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72b1a062e2e48798d29ea165e2c20a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.179426 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1307/2608] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:30 2022] DELETE /identity/v3/users/b72b1a062e2e48798d29ea165e2c20a3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:08:31.438982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:31.440505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:31.461850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b87a-2f35-43bd-80de-fd4e7f1dd663 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:31.614872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:31.615535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:31.615816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:31.616089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] PATH_INFO: `/v3/projects/ca4568f10cd74fb59e1de26df0110ff9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:31.620540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4568f10cd74fb59e1de26df0110ff9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:31.622564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:31.682052 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:31.689919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4568f10cd74fb59e1de26df0110ff9', 'request_id': 'req-c66ac7df-e94d-4111-9209-1a92e75991ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.696175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4568f10cd74fb59e1de26df0110ff9', 'request_id': 'req-c66ac7df-e94d-4111-9209-1a92e75991ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.703011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4568f10cd74fb59e1de26df0110ff9', 'request_id': 'req-c66ac7df-e94d-4111-9209-1a92e75991ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.720360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] The token cache is being invalidate because project ca4568f10cd74fb59e1de26df0110ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:31.720981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.721889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c66ac7df-e94d-4111-9209-1a92e75991ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:31.726911 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1302/2609] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:31 2022] DELETE /identity/v3/projects/ca4568f10cd74fb59e1de26df0110ff9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:31.730661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f06f6-7cbb-43cb-8fa8-6036492fdab0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:31.731666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f06f6-7cbb-43cb-8fa8-6036492fdab0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:31.732037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f06f6-7cbb-43cb-8fa8-6036492fdab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:31.753226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-538f06f6-7cbb-43cb-8fa8-6036492fdab0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:31.754639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-538f06f6-7cbb-43cb-8fa8-6036492fdab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:31.816683 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1308/2610] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:31.825343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414a92f-4491-477e-907f-ff6eab792dbd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:31.825625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414a92f-4491-477e-907f-ff6eab792dbd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:31.825902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414a92f-4491-477e-907f-ff6eab792dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:31.846725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1414a92f-4491-477e-907f-ff6eab792dbd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:31.847955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1414a92f-4491-477e-907f-ff6eab792dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:31.856273 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1303/2611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:31.862765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f06f6-7cbb-43cb-8fa8-6036492fdab0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:31.877889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f06f6-7cbb-43cb-8fa8-6036492fdab0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:31.884506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:31.885396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:31.885830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:31.886298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:31.887813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:08:31.888192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:31.890395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:31.911360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414a92f-4491-477e-907f-ff6eab792dbd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:31.917310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1309/2612] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:31.942203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414a92f-4491-477e-907f-ff6eab792dbd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:31.947783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:31.948826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:31.949368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:31.950228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:31.950948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:31.952720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:32.000249 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1304/2613] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:31 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:32.008426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:32.032581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108d2bb-9b17-4d9d-a1cd-054fb1a74560 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:32.160659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:32.162317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:32.162846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:32.163390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:32.164242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:32.168992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:32.196715 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1310/2614] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:32 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:32.201582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:32.212254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e80c-8599-4e41-90dd-df66c3ceb7c5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:32.218632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:32.219539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:32.219817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:32.220089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:32.220746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:32.222452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:32.236311 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1305/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:32.238280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:32.249200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22711cca-e03b-4801-9b9a-787ba9dc8f7c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:32.260501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e694ca5-9cc4-428e-ac00-bdce82c04cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:32.261312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694ca5-9cc4-428e-ac00-bdce82c04cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:32.262998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694ca5-9cc4-428e-ac00-bdce82c04cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:32.263475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694ca5-9cc4-428e-ac00-bdce82c04cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:32.264448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694ca5-9cc4-428e-ac00-bdce82c04cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:32.266708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694ca5-9cc4-428e-ac00-bdce82c04cb5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:32.284289 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1311/2616] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:32.285939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:32.299144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88463-7748-4564-b76b-807617f1d260 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:32.307722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:32.308602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:32.310375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:32.310985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] PATH_INFO: `/v3/projects/5964bc44f7f44f5c8d54dce3301b2e36/users/e7508410259d4df7bd231db49c35c8c9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:32.344640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5964bc44f7f44f5c8d54dce3301b2e36, user_id=e7508410259d4df7bd231db49c35c8c9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:32.359014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:32.375967 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1306/2617] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:32 2022] PUT /identity/v3/projects/5964bc44f7f44f5c8d54dce3301b2e36/users/e7508410259d4df7bd231db49c35c8c9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:32.381817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:32.382192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:32.382688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:32.412057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:32.414790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:32.424274 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:32.491559 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1312/2618] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:32.503826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:32.505741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:32.586815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cf0c4-2aa8-40dc-a892-062269e4ea99 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:32.591046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa299c-020a-406c-9c46-a87b56115820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:32.591712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa299c-020a-406c-9c46-a87b56115820 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:32.591992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa299c-020a-406c-9c46-a87b56115820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:32.592268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa299c-020a-406c-9c46-a87b56115820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:32.601545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa299c-020a-406c-9c46-a87b56115820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:32.602978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa299c-020a-406c-9c46-a87b56115820 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:32.613482 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1307/2619] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:39.058066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:39.060205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:39.089689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777595-3a5d-42ba-9adc-daa8d48be09f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:39.109386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:39.110226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:39.110504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:39.110860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] PATH_INFO: `/v3/users/29009789afbe43398b1f2dcae80bff24` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:39.112111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29009789afbe43398b1f2dcae80bff24)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:39.113997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:39.204094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29009789afbe43398b1f2dcae80bff24'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:39.205553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29009789afbe43398b1f2dcae80bff24'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:39.206375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29009789afbe43398b1f2dcae80bff24'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:39.223669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29009789afbe43398b1f2dcae80bff24'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:39.244245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29009789afbe43398b1f2dcae80bff24'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:39.270413 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1313/2620] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:39 2022] DELETE /identity/v3/users/29009789afbe43398b1f2dcae80bff24 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:39.275044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:39.275558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:39.275760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:39.334014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:39.335665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:39.427167 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1308/2621] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:39.489390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:39.490903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:39.622013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcba45-630c-4db5-a466-374a69f569b7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:39.654316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:39.654964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:39.655241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:39.655518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:39.689966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:39.691763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:39.716319 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1314/2622] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:40.735864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:40.737517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:40.755908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3718a6-3a43-4ee0-a719-fe8767392e90 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:40.779044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:40.780036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:40.780826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:40.781957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] PATH_INFO: `/v3/users/3bc26084f1db4390980d1e4b766a5cd1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:40.786367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc26084f1db4390980d1e4b766a5cd1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:40.790845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:40.799939 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:40.911360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc26084f1db4390980d1e4b766a5cd1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:40.913967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc26084f1db4390980d1e4b766a5cd1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:40.917444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc26084f1db4390980d1e4b766a5cd1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:40.962380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc26084f1db4390980d1e4b766a5cd1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:40.986117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c13670c1-c8e4-4908-bfe6-ba6cfb95c677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc26084f1db4390980d1e4b766a5cd1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:41.051935 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1309/2623] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:40 2022] DELETE /identity/v3/users/3bc26084f1db4390980d1e4b766a5cd1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:41.280239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:41.300216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cd4a9-d596-4860-89e8-e3a1d206a20a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:41.354821 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:41.446163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:41.446815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:41.447084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:41.447356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] PATH_INFO: `/v3/projects/cfe14475f8f7472e916d1d1350452b94` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:41.450249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe14475f8f7472e916d1d1350452b94)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:41.452150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:41.575935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe14475f8f7472e916d1d1350452b94', 'request_id': 'req-d33603aa-83ca-49d3-8d54-7300790490cf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:41.590900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe14475f8f7472e916d1d1350452b94', 'request_id': 'req-d33603aa-83ca-49d3-8d54-7300790490cf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:41.614535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe14475f8f7472e916d1d1350452b94', 'request_id': 'req-d33603aa-83ca-49d3-8d54-7300790490cf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:41.631210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] The token cache is being invalidate because project cfe14475f8f7472e916d1d1350452b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:41.631871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:41.634434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d33603aa-83ca-49d3-8d54-7300790490cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:41.643969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1315/2624] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:41 2022] DELETE /identity/v3/projects/cfe14475f8f7472e916d1d1350452b94 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:41.649368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4cf1a-5055-45dd-8369-d670c7254448 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:41.649681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4cf1a-5055-45dd-8369-d670c7254448 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:41.649957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4cf1a-5055-45dd-8369-d670c7254448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:41.689551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bad4cf1a-5055-45dd-8369-d670c7254448 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:41.691104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bad4cf1a-5055-45dd-8369-d670c7254448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:41.838694 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1310/2625] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:41.846500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415cb1-34da-40ba-be86-fe4b395c89bb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:41.847206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415cb1-34da-40ba-be86-fe4b395c89bb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:41.847687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415cb1-34da-40ba-be86-fe4b395c89bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:41.877143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-80415cb1-34da-40ba-be86-fe4b395c89bb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:41.878687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-80415cb1-34da-40ba-be86-fe4b395c89bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:41.893339 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1316/2626] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:41.906350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4cf1a-5055-45dd-8369-d670c7254448 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:41.921628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4cf1a-5055-45dd-8369-d670c7254448 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:41.931388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:41.932401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:41.933023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:41.933752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:41.934696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:08:41.935223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:41.937199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:41.954539 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1311/2627] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:41.959659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415cb1-34da-40ba-be86-fe4b395c89bb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:41.970444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415cb1-34da-40ba-be86-fe4b395c89bb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:41.977194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:41.977881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:41.979427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:41.979820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:41.982035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:41.983677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.036205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1317/2628] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:41 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:42.040188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:42.053303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9a8c-17e7-41a2-a01b-8ca2b766ab6a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:42.178255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:42.179515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.179851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.184334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.185991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:42.188503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.212724 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:42.227373 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1312/2629] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:42 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:08:42.231598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:42.242408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b02b-d6dd-4cb5-a7e1-ab2a323a12ec admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:42.247894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:42.248516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.248929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.249035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.249889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:42.251746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.268114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:42.269173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1318/2630] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:42.279204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1666ef5-10a1-44b9-aea1-da98b027262e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:42.284206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:42.284826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.285140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.285455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.286111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:42.287741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.314660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:42.321623 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1313/2631] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:08:42.328193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2648f-b755-4c37-ac32-91de4859a884 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:42.335468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86407aa6-7e77-428d-8882-d2f05c094292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:42.335468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86407aa6-7e77-428d-8882-d2f05c094292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.335468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86407aa6-7e77-428d-8882-d2f05c094292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.335468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86407aa6-7e77-428d-8882-d2f05c094292 admin admin] PATH_INFO: `/v3/projects/c45ab68122394569aa2678282b9aad0b/users/890601cbe0fb40dcbc5eef6d36bd2b00/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.358600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86407aa6-7e77-428d-8882-d2f05c094292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45ab68122394569aa2678282b9aad0b, user_id=890601cbe0fb40dcbc5eef6d36bd2b00, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:42.362556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86407aa6-7e77-428d-8882-d2f05c094292 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.371853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:42.375034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:42.405173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1319/2632] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:42 2022] PUT /identity/v3/projects/c45ab68122394569aa2678282b9aad0b/users/890601cbe0fb40dcbc5eef6d36bd2b00/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:08:42.406770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.407122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.407520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.419262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313354b2-e270-4fdb-9664-371e252c860b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:42.449725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:42.450377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:42.537227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:42.537883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.538160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.538430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] PATH_INFO: `/v3/projects/da1a306254e94a1eb2545f41c500b735` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.541422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1a306254e94a1eb2545f41c500b735)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:42.544103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.565180 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:42.595532 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1320/2633] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:42.606092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:42.607599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:42.656650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1a306254e94a1eb2545f41c500b735', 'request_id': 'req-ebea4703-57af-4681-91fe-636521a83af4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.667262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1a306254e94a1eb2545f41c500b735', 'request_id': 'req-ebea4703-57af-4681-91fe-636521a83af4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.677573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1a306254e94a1eb2545f41c500b735', 'request_id': 'req-ebea4703-57af-4681-91fe-636521a83af4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.709913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0b784-12ad-4235-97f3-45af9c6aefd9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:42.712658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] The token cache is being invalidate because project da1a306254e94a1eb2545f41c500b735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:42.713055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.713991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.720964 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1314/2634] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:42 2022] DELETE /identity/v3/projects/da1a306254e94a1eb2545f41c500b735 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:42.721905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:42.723444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:42.812561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4703-57af-4681-91fe-636521a83af4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:42.816952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:42.817713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.817999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.818271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.819708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:42.820216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:42.820552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:42.820907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:42.821282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] PATH_INFO: `/v3/users/4673c4ce41da446aaf3bbf9027f786cb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:42.822871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4673c4ce41da446aaf3bbf9027f786cb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:42.825349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.838354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:42.841137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:42.855033 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:42.867708 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1321/2635] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:08:42.923482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4673c4ce41da446aaf3bbf9027f786cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.925534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4673c4ce41da446aaf3bbf9027f786cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.927932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4673c4ce41da446aaf3bbf9027f786cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.958266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4673c4ce41da446aaf3bbf9027f786cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:42.975514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f658a0d3-4c43-4778-b654-446e957ec102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4673c4ce41da446aaf3bbf9027f786cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:43.006086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1315/2636] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:42 2022] DELETE /identity/v3/users/4673c4ce41da446aaf3bbf9027f786cb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:08:43.859806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:43.877249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550be8af-0280-428b-a819-f0a6ffedd752 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:44.032747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:44.033656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:44.034123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:44.034470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] PATH_INFO: `/v3/projects/f776ab4594fc456094058670124235ba` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:44.041638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f776ab4594fc456094058670124235ba)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:44.045284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:44.209946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f776ab4594fc456094058670124235ba', 'request_id': 'req-19e69cb0-effe-47a8-980b-5ac6a8c83124'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:44.213132 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:44.223443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f776ab4594fc456094058670124235ba', 'request_id': 'req-19e69cb0-effe-47a8-980b-5ac6a8c83124'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:44.244249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f776ab4594fc456094058670124235ba', 'request_id': 'req-19e69cb0-effe-47a8-980b-5ac6a8c83124'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:44.300154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] The token cache is being invalidate because project f776ab4594fc456094058670124235ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:44.301520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:44.302847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19e69cb0-effe-47a8-980b-5ac6a8c83124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:44.305123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1322/2637] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:43 2022] DELETE /identity/v3/projects/f776ab4594fc456094058670124235ba => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:44.310806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded83b6-cc7d-4ded-94a4-da1916ae8416 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:44.311676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded83b6-cc7d-4ded-94a4-da1916ae8416 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:44.312442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded83b6-cc7d-4ded-94a4-da1916ae8416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:44.388870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5ded83b6-cc7d-4ded-94a4-da1916ae8416 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:44.390682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5ded83b6-cc7d-4ded-94a4-da1916ae8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:44.560711 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1316/2638] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:44.562190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6b35-9637-453d-b45a-d6bf5c88eaf0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:44.562549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6b35-9637-453d-b45a-d6bf5c88eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:44.562890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6b35-9637-453d-b45a-d6bf5c88eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:44.602348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-055c6b35-9637-453d-b45a-d6bf5c88eaf0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:44.608975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-055c6b35-9637-453d-b45a-d6bf5c88eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:44.630769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded83b6-cc7d-4ded-94a4-da1916ae8416 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:44.638166 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1323/2639] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:44.643677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded83b6-cc7d-4ded-94a4-da1916ae8416 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:44.648919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:44.650119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:44.650511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:44.650873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:44.651686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:08:44.652600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:44.654606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:44.677455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6b35-9637-453d-b45a-d6bf5c88eaf0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:44.685313 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1317/2640] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:44.704084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6b35-9637-453d-b45a-d6bf5c88eaf0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:44.721759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:44.723087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:44.724779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:44.725182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:44.725932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:44.734045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:44.813416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:44.822715 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1324/2641] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:44 2022] POST /identity/v3/projects => generated 395 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:08:44.829015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f420-3825-4b91-9590-c4b43dae58c0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:45.034401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:45.035053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:45.035334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:45.035604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:45.036546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:45.038183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:45.089333 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1318/2642] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:44 2022] POST /identity/v3/users => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:45.095061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:45.113017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120f6a0-c44b-41c4-99c9-a9e6164ce09f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:45.131603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:45.132421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:45.132805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:45.133686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:45.134449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:45.137235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:45.154642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:45.155133 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1325/2643] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:45.175266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ca5d6-0f4c-4953-81e2-8c1d64e558eb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:45.187276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312bc4-a880-43b6-a54b-2caf15c7f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:45.187924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312bc4-a880-43b6-a54b-2caf15c7f157 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:45.188206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312bc4-a880-43b6-a54b-2caf15c7f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:45.188478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312bc4-a880-43b6-a54b-2caf15c7f157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:45.189165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312bc4-a880-43b6-a54b-2caf15c7f157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:45.190841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312bc4-a880-43b6-a54b-2caf15c7f157 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:45.213345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1319/2644] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:08:45.216996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:45.227907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5394245-b81c-4784-8fa8-abb9c6b24da4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:45.236783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:45.237777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:45.238291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:45.238779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] PATH_INFO: `/v3/projects/8c28b83d6467457a96e3fc5aa45bb265/users/df58d589d7c04d6bbde7620205d1e070/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:45.278952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c28b83d6467457a96e3fc5aa45bb265, user_id=df58d589d7c04d6bbde7620205d1e070, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:45.281901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:45.316642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1326/2645] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:45 2022] PUT /identity/v3/projects/8c28b83d6467457a96e3fc5aa45bb265/users/df58d589d7c04d6bbde7620205d1e070/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:45.318441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf939ce-aa77-48bd-9d84-52c060433970 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:45.318917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf939ce-aa77-48bd-9d84-52c060433970 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:45.319026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf939ce-aa77-48bd-9d84-52c060433970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:45.327856 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:45.396333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bdf939ce-aa77-48bd-9d84-52c060433970 None None] MFA Rules not processed for user `df58d589d7c04d6bbde7620205d1e070`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:45.397616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bdf939ce-aa77-48bd-9d84-52c060433970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:45.582099 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1320/2646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:45.586711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:45.732850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15c1c1-9a9d-4208-86ad-e1139488e95a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:45.752113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:45.752718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:45.753008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:45.753338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:45.757114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:45.760289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:45.803316 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1327/2647] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:45 2022] POST /identity/v3/projects => generated 395 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:45.807511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf939ce-aa77-48bd-9d84-52c060433970 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:45.830328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf939ce-aa77-48bd-9d84-52c060433970 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:46.023380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:46.024012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.024288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.024557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.025226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:46.027221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:46.083236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1321/2648] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:45 2022] POST /identity/v3/users => generated 304 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:46.086757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:46.104364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46753a5-051f-48de-a98b-3bcd483328e7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:46.119927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:46.120689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.121515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.122051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.124753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:46.129362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:46.147655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:46.151370 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1328/2649] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:46.163479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fbcc-e90e-45cc-8c11-44d33e8e7afd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:46.183800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:46.184579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.184971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.185287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] PATH_INFO: `/v3/projects/d525f2139ccc4f8798b71204a06ee3e0/users/1c14647ade4d46999d7f2d7cf96a3711/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.217460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d525f2139ccc4f8798b71204a06ee3e0, user_id=1c14647ade4d46999d7f2d7cf96a3711, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:46.227889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:46.259722 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1322/2650] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:46 2022] PUT /identity/v3/projects/d525f2139ccc4f8798b71204a06ee3e0/users/1c14647ade4d46999d7f2d7cf96a3711/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:46.264572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:46.286662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e1e80-7166-4aef-a8b4-d01d16323511 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:46.390553 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:46.412130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0253d-ab04-431c-9505-1bc073601c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:46.413611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0253d-ab04-431c-9505-1bc073601c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.414059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0253d-ab04-431c-9505-1bc073601c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.414496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0253d-ab04-431c-9505-1bc073601c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.415437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0253d-ab04-431c-9505-1bc073601c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:46.418118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0253d-ab04-431c-9505-1bc073601c97 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:46.451965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:46.465882 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1329/2651] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:46.469861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059fad2-dab6-468f-a7d5-9d2a16e96f63 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:46.476293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:46.477775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.478236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.478666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] PATH_INFO: `/v3/projects/d525f2139ccc4f8798b71204a06ee3e0/users/1c14647ade4d46999d7f2d7cf96a3711/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.480924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d525f2139ccc4f8798b71204a06ee3e0, user_id=1c14647ade4d46999d7f2d7cf96a3711, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:46.484132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:46.516707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674b231-5427-4b7d-a89e-ef293317aa31 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.517236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674b231-5427-4b7d-a89e-ef293317aa31 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.517667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674b231-5427-4b7d-a89e-ef293317aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.520478 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1323/2652] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:46 2022] PUT /identity/v3/projects/d525f2139ccc4f8798b71204a06ee3e0/users/1c14647ade4d46999d7f2d7cf96a3711/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:46.581480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2674b231-5427-4b7d-a89e-ef293317aa31 None None] MFA Rules not processed for user `1c14647ade4d46999d7f2d7cf96a3711`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:46.582983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2674b231-5427-4b7d-a89e-ef293317aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:46.754347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:46.757527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:46.801256 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1330/2653] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:46.805296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674b231-5427-4b7d-a89e-ef293317aa31 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:46.872678 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:46.926531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab393f00-786e-4525-bdc5-9c93179a6a90 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:46.940804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:46.941472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.941748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.942336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.949480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:46.967221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674b231-5427-4b7d-a89e-ef293317aa31 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:46.981194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:46.985688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:46.986425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:46.987617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:46.988288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:46.988693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:46.989486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:47.005510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:47.014864 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1324/2654] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:08:47.078764 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1331/2655] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:46 2022] POST /identity/v3/projects => generated 393 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:47.082981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:47.099696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ebb5-9bcf-487b-97e2-d82dfd53c531 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:47.354321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:47.354973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:47.355447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:47.356276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:47.356530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:47.373791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:47.472400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:47.475446 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1325/2656] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:47 2022] POST /identity/v3/users => generated 297 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:47.498683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025a343-9a72-4bfa-9a8e-3d153a3d9b76 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:47.522798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:47.523423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:47.523699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:47.523969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:47.524620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:47.526232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:47.587054 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1332/2657] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:08:47.592229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:47.613767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9058d7f-21e6-450d-a7a4-db17bb4c2532 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:47.634516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419cba9-497a-4e37-baed-b1b2799a9fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:47.638047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419cba9-497a-4e37-baed-b1b2799a9fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:47.638483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419cba9-497a-4e37-baed-b1b2799a9fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:47.638859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419cba9-497a-4e37-baed-b1b2799a9fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:47.639632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419cba9-497a-4e37-baed-b1b2799a9fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:47.642497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419cba9-497a-4e37-baed-b1b2799a9fdd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:47.672364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1326/2658] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:47.676486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:47.695986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25924b01-8519-4923-b251-e1744b57b6dc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:47.715406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:47.716889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:47.717215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:47.717491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] PATH_INFO: `/v3/projects/414eb43491e6498e9efccecc67ba28e4/users/9fd3cbf1c1c34f2f9004d90de5467fad/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:47.758012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] RBAC: Authorizing `identity:create_grant(project_id=414eb43491e6498e9efccecc67ba28e4, user_id=9fd3cbf1c1c34f2f9004d90de5467fad, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:47.760831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:47.818135 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1333/2659] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:47 2022] PUT /identity/v3/projects/414eb43491e6498e9efccecc67ba28e4/users/9fd3cbf1c1c34f2f9004d90de5467fad/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:47.832264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ff1-fad5-4ce9-8c88-dea7b02ee7fa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:47.835526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ff1-fad5-4ce9-8c88-dea7b02ee7fa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:47.836133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ff1-fad5-4ce9-8c88-dea7b02ee7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:47.884684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ed153ff1-fad5-4ce9-8c88-dea7b02ee7fa None None] MFA Rules not processed for user `9fd3cbf1c1c34f2f9004d90de5467fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:47.887067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ed153ff1-fad5-4ce9-8c88-dea7b02ee7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:48.167791 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1327/2660] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:48.525825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:48.534201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:48.625553 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:48.703994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f66f6-d7d1-451b-8bdc-426411e0565d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:48.716345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:48.716994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:48.717305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:48.717579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:48.721814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:48.771528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:48.772732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:48.773601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:48.908776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] MFA Rules not processed for user `e7508410259d4df7bd231db49c35c8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:48.913798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:48.970009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:48.975204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:49.023957 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1334/2661] 10.222.0.16 () {60 vars in 1396 bytes} [Sun Sep 11 01:08:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:49.068193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:49.167758 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1328/2662] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:08:49.173237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:49.174714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:49.276169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3610b-f323-4536-9629-5e4315e298b5 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:49.283640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:49.284651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:49.285044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:49.285451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:49.287542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:49.288734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:49.297153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:49.299369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:49.372256 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1335/2663] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:49 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:08:49.375737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:49.475688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3238bac-7801-4025-a96f-a73cdc3a1252 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:49.522562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154074f2-0df2-461b-a240-3e00d4516a14 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:49.549221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:49.550062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:49.550457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:49.550850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:49.551600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:49.554720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:49.593929 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:49.629783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1336/2664] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:49 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:08:49.635446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:49.676552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4579b5c-f0ff-431f-a7c0-2ab0102ef7f8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:49.693631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:49.697536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:49.698370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:49.699951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:49.701013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:49.703710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7af1e-e98a-472f-8ddf-fe0d0329ab31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:49.707270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7af1e-e98a-472f-8ddf-fe0d0329ab31 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:49.708652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:49.709027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7af1e-e98a-472f-8ddf-fe0d0329ab31 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:49.709462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7af1e-e98a-472f-8ddf-fe0d0329ab31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:49.754561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1337/2665] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:49.757660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:49.798708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6217dd1-542a-4212-8f42-5dd0339d6225 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:49.813458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:49.816553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:49.818192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:49.820947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] PATH_INFO: `/v3/projects/4068219bc55249bead263f07bceca5b6/users/3f540ecf8f4e43d6870e501dc8f296eb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:49.874826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4068219bc55249bead263f07bceca5b6, user_id=3f540ecf8f4e43d6870e501dc8f296eb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:49.879250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:49.922032 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1338/2666] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:49 2022] PUT /identity/v3/projects/4068219bc55249bead263f07bceca5b6/users/3f540ecf8f4e43d6870e501dc8f296eb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:49.927049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:49.934359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7af1e-e98a-472f-8ddf-fe0d0329ab31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:49.936709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7af1e-e98a-472f-8ddf-fe0d0329ab31 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:49.970768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1329/2667] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:49 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:08:50.089228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfde895-75b0-4f97-b86c-ec834872ff78 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:50.104439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6849-2d94-43fc-bf09-182ba0ed7077 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:50.104720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6849-2d94-43fc-bf09-182ba0ed7077 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:50.105004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a6849-2d94-43fc-bf09-182ba0ed7077 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:50.106915 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1330/2668] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:08:50.112065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6849-2d94-43fc-bf09-182ba0ed7077 None None] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:08:50.116598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:50.117208 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:50.118105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:50.118611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:50.119268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:50.122271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:50.124621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:50.142523 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1339/2669] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:50.147947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:50.185531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c30f0d-2f1e-46ba-b854-fb2cd8b2e6a3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:50.197454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68562e-8766-4871-a4ca-abf43e64bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:50.198278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68562e-8766-4871-a4ca-abf43e64bb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:50.200251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68562e-8766-4871-a4ca-abf43e64bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:50.200251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68562e-8766-4871-a4ca-abf43e64bb99 admin admin] PATH_INFO: `/v3/projects/4068219bc55249bead263f07bceca5b6/users/3f540ecf8f4e43d6870e501dc8f296eb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:50.202519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68562e-8766-4871-a4ca-abf43e64bb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4068219bc55249bead263f07bceca5b6, user_id=3f540ecf8f4e43d6870e501dc8f296eb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:50.205618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68562e-8766-4871-a4ca-abf43e64bb99 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:50.224712 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1340/2670] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:50 2022] PUT /identity/v3/projects/4068219bc55249bead263f07bceca5b6/users/3f540ecf8f4e43d6870e501dc8f296eb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:50.331673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6849-2d94-43fc-bf09-182ba0ed7077 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:50.524098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a6849-2d94-43fc-bf09-182ba0ed7077 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:50.766549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd55bd2-263e-4ec2-ae05-bc52e2838141 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c14647ade4d46999d7f2d7cf96a3711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd525f2139ccc4f8798b71204a06ee3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:50.768205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55bd2-263e-4ec2-ae05-bc52e2838141 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:50.769102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55bd2-263e-4ec2-ae05-bc52e2838141 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:50.769966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd55bd2-263e-4ec2-ae05-bc52e2838141 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] PATH_INFO: `/v3/projects/8c28b83d6467457a96e3fc5aa45bb265` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:50.783704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd55bd2-263e-4ec2-ae05-bc52e2838141 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c28b83d6467457a96e3fc5aa45bb265)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:50.786700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd55bd2-263e-4ec2-ae05-bc52e2838141 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:50.791507 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1331/2671] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:08:50 2022] GET /identity/v3/projects/8c28b83d6467457a96e3fc5aa45bb265 => generated 395 bytes in 680 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:08:51.551466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55dc5-5b5b-4574-9260-de90df7a502e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:51.552031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55dc5-5b5b-4574-9260-de90df7a502e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:51.552031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55dc5-5b5b-4574-9260-de90df7a502e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:51.590897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56adfee-ee2d-4956-80fa-2063986df8b1 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:51.590897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56adfee-ee2d-4956-80fa-2063986df8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:51.590897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56adfee-ee2d-4956-80fa-2063986df8b1 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:51.592483 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1332/2672] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:08:51.600729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56adfee-ee2d-4956-80fa-2063986df8b1 None None] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:08:51.602800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a56adfee-ee2d-4956-80fa-2063986df8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:51.614797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-dba55dc5-5b5b-4574-9260-de90df7a502e None None] MFA Rules not processed for user `890601cbe0fb40dcbc5eef6d36bd2b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:51.616480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dba55dc5-5b5b-4574-9260-de90df7a502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:51.746453 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:51.800223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56adfee-ee2d-4956-80fa-2063986df8b1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:51.819327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56adfee-ee2d-4956-80fa-2063986df8b1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:51.842938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a9a63-0efc-4906-8c85-f699a98caa1b tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c14647ade4d46999d7f2d7cf96a3711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd525f2139ccc4f8798b71204a06ee3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:51.843618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9a63-0efc-4906-8c85-f699a98caa1b tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:51.843902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9a63-0efc-4906-8c85-f699a98caa1b tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:51.844181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9a63-0efc-4906-8c85-f699a98caa1b tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] PATH_INFO: `/v3/projects/8c28b83d6467457a96e3fc5aa45bb265` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:51.852648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a9a63-0efc-4906-8c85-f699a98caa1b tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c28b83d6467457a96e3fc5aa45bb265)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:51.860718 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1341/2673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:51.860969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a9a63-0efc-4906-8c85-f699a98caa1b tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:51.860969 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1333/2674] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:08:51 2022] GET /identity/v3/projects/8c28b83d6467457a96e3fc5aa45bb265 => generated 395 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:51.930189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba55dc5-5b5b-4574-9260-de90df7a502e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:51.950422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba55dc5-5b5b-4574-9260-de90df7a502e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:51.969503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:51.970683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:51.971025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:51.971372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:51.982227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:51.984159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:52.005420 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1342/2675] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:52.162449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6c5fc-ecc8-4ee5-ab43-616642c87f6d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:52.162729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6c5fc-ecc8-4ee5-ab43-616642c87f6d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:52.163005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6c5fc-ecc8-4ee5-ab43-616642c87f6d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:52.164346 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1334/2676] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:08:52.170198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:08:52.191825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:52.208955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdefb97-9ac9-4e16-94f5-b06569d3aaa2 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:52.224110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ed355-c7d3-4a04-9566-110b62c267e8 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c14647ade4d46999d7f2d7cf96a3711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd525f2139ccc4f8798b71204a06ee3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:52.225230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ed355-c7d3-4a04-9566-110b62c267e8 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:52.225472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ed355-c7d3-4a04-9566-110b62c267e8 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:52.225811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ed355-c7d3-4a04-9566-110b62c267e8 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] PATH_INFO: `/v3/projects/8c28b83d6467457a96e3fc5aa45bb265` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:52.227673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ed355-c7d3-4a04-9566-110b62c267e8 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c28b83d6467457a96e3fc5aa45bb265)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:52.232138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ed355-c7d3-4a04-9566-110b62c267e8 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:52.237653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1343/2677] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:08:52 2022] GET /identity/v3/projects/8c28b83d6467457a96e3fc5aa45bb265 => generated 395 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:53.596489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6c5fc-ecc8-4ee5-ab43-616642c87f6d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:53.623931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6c5fc-ecc8-4ee5-ab43-616642c87f6d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:53.657430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:53.657986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:53.658268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:53.658540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:53.883857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:53.886629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:53.910433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1335/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:53 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:54.198105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acd4e-a0fc-40f9-b9e7-936c2529405b None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:54.199163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acd4e-a0fc-40f9-b9e7-936c2529405b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:54.199668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acd4e-a0fc-40f9-b9e7-936c2529405b None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:54.201510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1344/2679] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:08:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:08:54.207474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:08:54.227324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:54.264000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92a603-d736-46c5-9a93-dd20dd778841 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:54.285928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c14647ade4d46999d7f2d7cf96a3711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd525f2139ccc4f8798b71204a06ee3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:54.286885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:54.287379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:54.287876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] PATH_INFO: `/v3/projects/8c28b83d6467457a96e3fc5aa45bb265` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:54.290698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c28b83d6467457a96e3fc5aa45bb265)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:54.294033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:54.296444 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1336/2680] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:08:54 2022] GET /identity/v3/projects/8c28b83d6467457a96e3fc5aa45bb265 => generated 395 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:54.407443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460c320-6807-4f7d-8bb3-01efb133083d None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:54.407723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460c320-6807-4f7d-8bb3-01efb133083d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:54.408158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460c320-6807-4f7d-8bb3-01efb133083d None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:54.409923 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1345/2681] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:08:54.417770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:08:54.462559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:54.510548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868f23-c0f1-4f9e-bff3-2e6ffd7e7dd6 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:54.538025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c14647ade4d46999d7f2d7cf96a3711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd525f2139ccc4f8798b71204a06ee3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:54.540227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:54.540831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:54.541359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] PATH_INFO: `/v3/projects/8c28b83d6467457a96e3fc5aa45bb265` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:54.545081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c28b83d6467457a96e3fc5aa45bb265)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:54.547617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:54.550969 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1337/2682] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:08:54 2022] GET /identity/v3/projects/8c28b83d6467457a96e3fc5aa45bb265 => generated 395 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:55.412340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26b3a3-529a-450a-8655-a7c922814343 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:55.412894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26b3a3-529a-450a-8655-a7c922814343 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:55.412894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26b3a3-529a-450a-8655-a7c922814343 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:55.414500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1346/2683] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:08:55.425383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:08:55.456044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:55.483285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557cc49-ea84-4fb3-ad69-d0982b4aebe7 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:55.503930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c14647ade4d46999d7f2d7cf96a3711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd525f2139ccc4f8798b71204a06ee3e0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:55.505387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:55.505764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:55.506055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] PATH_INFO: `/v3/projects/414eb43491e6498e9efccecc67ba28e4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:55.507717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorizing `identity:get_project(project_id=414eb43491e6498e9efccecc67ba28e4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:55.515505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:55.524852 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1338/2684] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:08:55 2022] GET /identity/v3/projects/414eb43491e6498e9efccecc67ba28e4 => generated 393 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:55.696991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26b3a3-529a-450a-8655-a7c922814343 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:55.714248 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:55.814446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:55.823383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:55.880359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26b3a3-529a-450a-8655-a7c922814343 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:55.893096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:55.895270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:55.895548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:55.895821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] PATH_INFO: `/v3/users/df58d589d7c04d6bbde7620205d1e070` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:55.900247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df58d589d7c04d6bbde7620205d1e070)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:55.903942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:55.967783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c69a0-0edf-4c56-b4e0-41229cafa964 tempest-FlavorsAccessNegativeTestJSON-1683070737 tempest-FlavorsAccessNegativeTestJSON-1683070737-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:55.990615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:55.992095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:55.992611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:55.993324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] PATH_INFO: `/v3/users/df90577a806f428fa15f9fce70d69a54` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:55.998711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df90577a806f428fa15f9fce70d69a54)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:56.000972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:56.048426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df58d589d7c04d6bbde7620205d1e070'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.049320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df58d589d7c04d6bbde7620205d1e070'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.050189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df58d589d7c04d6bbde7620205d1e070'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.076473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df58d589d7c04d6bbde7620205d1e070'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.124320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a46d199e-5d6f-4e40-83a9-4fc329b7865b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df58d589d7c04d6bbde7620205d1e070'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.136021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df90577a806f428fa15f9fce70d69a54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.138885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df90577a806f428fa15f9fce70d69a54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.140469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df90577a806f428fa15f9fce70d69a54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.146212 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:56.155494 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1347/2685] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:55 2022] DELETE /identity/v3/users/df58d589d7c04d6bbde7620205d1e070 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:56.156924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:56.157253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:56.157577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:56.173233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df90577a806f428fa15f9fce70d69a54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.182182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bfa7f94b-ca2e-49ce-9aaa-d6c0c5daee6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df90577a806f428fa15f9fce70d69a54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:56.186075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:56.187329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:56.222750 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1339/2686] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:55 2022] DELETE /identity/v3/users/df90577a806f428fa15f9fce70d69a54 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:56.228142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:56.228792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:56.229309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:56.271222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:56.273862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:56.292361 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1348/2687] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:08:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:56.324124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:56.327361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:56.430048 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:56.527295 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1340/2688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:56.575506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:56.576172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e591755-f3b8-4d17-88ae-c97baf566bb4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:56.576995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:56.719479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:56.721665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:56.724313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:56.724740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:56.749528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed580-a52a-4ce3-adbe-1bc6283a5eab None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:56.761828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb7aac-e1a3-4799-a363-145262a975d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:56.763938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7aac-e1a3-4799-a363-145262a975d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:56.768462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7aac-e1a3-4799-a363-145262a975d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:56.769467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7aac-e1a3-4799-a363-145262a975d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:56.829929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb7aac-e1a3-4799-a363-145262a975d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:56.832360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb7aac-e1a3-4799-a363-145262a975d3 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:56.875381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1341/2689] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:08:56.905187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:56.906773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:56.919159 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1349/2690] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:08:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:08:57.047079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13c60-b9f1-4682-b281-596f2fa75b0a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:57.047801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13c60-b9f1-4682-b281-596f2fa75b0a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:57.048916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13c60-b9f1-4682-b281-596f2fa75b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:57.169750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-97b13c60-b9f1-4682-b281-596f2fa75b0a None None] MFA Rules not processed for user `890601cbe0fb40dcbc5eef6d36bd2b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:57.173404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:57.175414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-97b13c60-b9f1-4682-b281-596f2fa75b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:57.177100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:57.221529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75c599-e4e2-4776-8f4a-da37aed741af service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:57.255706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:57.256381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:57.256647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:57.273728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] PATH_INFO: `/v3/projects/45f18b6a80bf4bf8b5dc2b9430218b2f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:57.278978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f18b6a80bf4bf8b5dc2b9430218b2f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:57.284708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:57.442731 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1342/2691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:57.535362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f18b6a80bf4bf8b5dc2b9430218b2f', 'request_id': 'req-17f8c403-2bff-480f-9cc8-9bd63c577db0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:57.601352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f18b6a80bf4bf8b5dc2b9430218b2f', 'request_id': 'req-17f8c403-2bff-480f-9cc8-9bd63c577db0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:57.622280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f18b6a80bf4bf8b5dc2b9430218b2f', 'request_id': 'req-17f8c403-2bff-480f-9cc8-9bd63c577db0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:57.632465 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:57.643784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] The token cache is being invalidate because project 45f18b6a80bf4bf8b5dc2b9430218b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:57.644333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:57.647987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-17f8c403-2bff-480f-9cc8-9bd63c577db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:57.655420 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1350/2692] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:57 2022] DELETE /identity/v3/projects/45f18b6a80bf4bf8b5dc2b9430218b2f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:57.656560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6b60-0150-4294-ad28-ca1afa7cbc13 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:57.657044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6b60-0150-4294-ad28-ca1afa7cbc13 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:57.657186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6b60-0150-4294-ad28-ca1afa7cbc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:57.733821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-01dc6b60-0150-4294-ad28-ca1afa7cbc13 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:57.737030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-01dc6b60-0150-4294-ad28-ca1afa7cbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:57.774932 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:57.920061 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1343/2693] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:57.923319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:57.923599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:57.924084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:57.979517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:57.982678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:58.005267 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1351/2694] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:58.010899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc6b60-0150-4294-ad28-ca1afa7cbc13 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.052515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc6b60-0150-4294-ad28-ca1afa7cbc13 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:58.075131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:58.075820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:58.076101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:58.076379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:58.079700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:08:58.080014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:58.091596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:58.114102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.119351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:58.144114 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1344/2695] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:08:58.148507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.167982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d5c9c-6eaa-4a35-baf9-2a0108c26151 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:58.181491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:58.183739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:58.184418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:58.184793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:58.185699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:58.189588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:58.354425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383299d-a012-4539-b5e8-e4b329b438a5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:58.369884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:58.371991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:58.372577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:58.373257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:58.376020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:58.400545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:58.403779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:58.423919 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1352/2696] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:08:58.565892 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1345/2697] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:08:58 2022] POST /identity/v3/projects => generated 377 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:08:58.569192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.592543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf3e8c-1100-4cb4-909f-cc6db8de8ae0 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:58.723327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:58.724994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:58.725394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:58.725761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:58.726509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:58.730340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:58.775965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.776511 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1353/2698] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:08:58 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:08:58.792178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89276be1-8286-4864-bf5b-6ec800199923 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:58.809498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:58.810141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:58.810417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:58.810692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:58.811351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:58.812950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:58.853084 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1346/2699] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:58.857174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.874721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceb734-d1fd-4aa9-8c93-fce90a9b3358 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:58.885347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:58.888540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:58.888953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:58.889569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:58.891457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:58.894062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:58.928573 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1354/2700] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:08:58.929434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.946392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddec282-42ad-4fdc-bca0-14c7e53085f9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:58.962214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:58.964051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:58.965318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd45aa5-df9a-42ba-901f-b9aafcc3ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:58.966450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd45aa5-df9a-42ba-901f-b9aafcc3ec13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:58.967035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd45aa5-df9a-42ba-901f-b9aafcc3ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:58.967530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd45aa5-df9a-42ba-901f-b9aafcc3ec13 admin admin] PATH_INFO: `/v3/projects/353ea3efb7ad4cf1a92b0b434b662d52/users/559b3d4a02af42bd98dacd08b9e45a4c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:58.996598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892a800-ed07-48d3-82ce-01142902d7bb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:59.000070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd45aa5-df9a-42ba-901f-b9aafcc3ec13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353ea3efb7ad4cf1a92b0b434b662d52, user_id=559b3d4a02af42bd98dacd08b9e45a4c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:59.012481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:59.013260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:59.013539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:59.013809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] PATH_INFO: `/v3/projects/8c28b83d6467457a96e3fc5aa45bb265` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:59.014538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd45aa5-df9a-42ba-901f-b9aafcc3ec13 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:59.015784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c28b83d6467457a96e3fc5aa45bb265)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:59.017769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:59.066619 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1347/2701] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:08:58 2022] PUT /identity/v3/projects/353ea3efb7ad4cf1a92b0b434b662d52/users/559b3d4a02af42bd98dacd08b9e45a4c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:08:59.073798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e986a-48c7-4fda-b3da-a67b65da8b4e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:59.074458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e986a-48c7-4fda-b3da-a67b65da8b4e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:59.074969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e986a-48c7-4fda-b3da-a67b65da8b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:59.100289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e58e986a-48c7-4fda-b3da-a67b65da8b4e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:08:59.102741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e58e986a-48c7-4fda-b3da-a67b65da8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:59.143512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c28b83d6467457a96e3fc5aa45bb265', 'request_id': 'req-f90c8e19-107d-4c5b-b521-a886cf74f990'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.151399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c28b83d6467457a96e3fc5aa45bb265', 'request_id': 'req-f90c8e19-107d-4c5b-b521-a886cf74f990'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.196600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c28b83d6467457a96e3fc5aa45bb265', 'request_id': 'req-f90c8e19-107d-4c5b-b521-a886cf74f990'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.212479 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1348/2702] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:08:59.221586 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:59.230532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] The token cache is being invalidate because project 8c28b83d6467457a96e3fc5aa45bb265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:08:59.231279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.232102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.237355 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1355/2703] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:08:58 2022] DELETE /identity/v3/projects/8c28b83d6467457a96e3fc5aa45bb265 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:08:59.240789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e986a-48c7-4fda-b3da-a67b65da8b4e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:59.254267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e986a-48c7-4fda-b3da-a67b65da8b4e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:59.257836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:08:59.260276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:59.269767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:59.272767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:59.273273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:59.273935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] PATH_INFO: `/v3/users/1c14647ade4d46999d7f2d7cf96a3711` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:59.278393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c14647ade4d46999d7f2d7cf96a3711)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:59.280921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:59.425764 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:08:59.434897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c14647ade4d46999d7f2d7cf96a3711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.438254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c14647ade4d46999d7f2d7cf96a3711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.441566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c14647ade4d46999d7f2d7cf96a3711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.466712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c8e19-107d-4c5b-b521-a886cf74f990 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:08:59.471792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c14647ade4d46999d7f2d7cf96a3711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.484589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:08:59.487143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:08:59.487536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:08:59.490058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c14647ade4d46999d7f2d7cf96a3711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:08:59.490314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:08:59.500684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:08:59.562431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:08:59.569681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:08:59.575806 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1349/2704] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:08:59 2022] DELETE /identity/v3/users/1c14647ade4d46999d7f2d7cf96a3711 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:08:59.591937 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1356/2705] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:00.416730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:00.418722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:00.644318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:00.647583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:00.677959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7623ba-ccea-4872-bd8e-cf7c63b12df0 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:00.724567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5a545-9531-467d-8e41-28db2b71218f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:00.747435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:00.748074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:00.748352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:00.752907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:00.758198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:00.985335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:00.987236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:00.987909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:00.988957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] PATH_INFO: `/v3/projects/d525f2139ccc4f8798b71204a06ee3e0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:00.992203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d525f2139ccc4f8798b71204a06ee3e0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:00.997542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:01.094946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:01.122317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:01.156583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd525f2139ccc4f8798b71204a06ee3e0', 'request_id': 'req-51cce79f-e349-4a74-bdd4-b59e93cce3bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.173010 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1350/2706] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:01.173918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd525f2139ccc4f8798b71204a06ee3e0', 'request_id': 'req-51cce79f-e349-4a74-bdd4-b59e93cce3bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.210435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd525f2139ccc4f8798b71204a06ee3e0', 'request_id': 'req-51cce79f-e349-4a74-bdd4-b59e93cce3bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.246587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] The token cache is being invalidate because project d525f2139ccc4f8798b71204a06ee3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:01.249233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.251685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.257463 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1357/2707] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:00 2022] DELETE /identity/v3/projects/d525f2139ccc4f8798b71204a06ee3e0 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:01.263266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:01.288392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3221a-a64f-4800-8d9a-d634b5ae1a80 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:01.456071 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:01.477477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:01.478765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:01.479241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:01.479689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] PATH_INFO: `/v3/users/9fd3cbf1c1c34f2f9004d90de5467fad` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:01.482652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd3cbf1c1c34f2f9004d90de5467fad)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:01.487247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:01.600497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd3cbf1c1c34f2f9004d90de5467fad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.601242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd3cbf1c1c34f2f9004d90de5467fad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.602822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd3cbf1c1c34f2f9004d90de5467fad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.674914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd3cbf1c1c34f2f9004d90de5467fad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.690903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43062c76-d33b-4293-b280-9bbf21a40454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd3cbf1c1c34f2f9004d90de5467fad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:01.717229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1351/2708] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:01 2022] DELETE /identity/v3/users/9fd3cbf1c1c34f2f9004d90de5467fad => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:02.618532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:02.620573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:02.644220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce79f-e349-4a74-bdd4-b59e93cce3bd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:02.779298 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:02.967101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:02.967760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:02.968050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:02.968317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] PATH_INFO: `/v3/projects/414eb43491e6498e9efccecc67ba28e4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:02.976436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414eb43491e6498e9efccecc67ba28e4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:02.981551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:03.157896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414eb43491e6498e9efccecc67ba28e4', 'request_id': 'req-e79c65e1-be7a-4111-ad5a-837d825ca793'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:03.173717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414eb43491e6498e9efccecc67ba28e4', 'request_id': 'req-e79c65e1-be7a-4111-ad5a-837d825ca793'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:03.191377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414eb43491e6498e9efccecc67ba28e4', 'request_id': 'req-e79c65e1-be7a-4111-ad5a-837d825ca793'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:03.215873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] The token cache is being invalidate because project 414eb43491e6498e9efccecc67ba28e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:03.216427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:03.221179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79c65e1-be7a-4111-ad5a-837d825ca793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:03.222963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1358/2709] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:02 2022] DELETE /identity/v3/projects/414eb43491e6498e9efccecc67ba28e4 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:03.230221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f60d-66c7-45e5-8448-02575d433003 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:03.231603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f60d-66c7-45e5-8448-02575d433003 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:03.232113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f60d-66c7-45e5-8448-02575d433003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:03.266242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-23a5f60d-66c7-45e5-8448-02575d433003 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:03.268144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-23a5f60d-66c7-45e5-8448-02575d433003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:03.424306 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1352/2710] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:03.425965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f777b8-1ddd-4c9a-82d9-f02c815a1a51 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:03.426743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f777b8-1ddd-4c9a-82d9-f02c815a1a51 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:03.427100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f777b8-1ddd-4c9a-82d9-f02c815a1a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:03.517251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-96f777b8-1ddd-4c9a-82d9-f02c815a1a51 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:03.519049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96f777b8-1ddd-4c9a-82d9-f02c815a1a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:03.588132 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1359/2711] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:03.589927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5f60d-66c7-45e5-8448-02575d433003 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:03.611442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5f60d-66c7-45e5-8448-02575d433003 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:03.617682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:03.618494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:03.619602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:03.621743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:03.622609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:09:03.623081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:03.626713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:03.666846 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1353/2712] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:09:03.669248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f777b8-1ddd-4c9a-82d9-f02c815a1a51 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:03.689665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f777b8-1ddd-4c9a-82d9-f02c815a1a51 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:03.699005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:03.699981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:03.700408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:03.700827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:03.701781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:03.739595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:03.819422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:03.820132 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1360/2713] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:03 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:03.834636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f8e24-fd70-4888-b7a9-1960c21c2cf5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:03.980655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:03.981608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:03.982592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:03.982982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:03.983745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:03.985936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:04.014169 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:04.052070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:04.052629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1354/2714] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:03 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:04.074514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53215405-8e31-431f-90c5-54d2ff860038 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:04.095765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:04.096577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:04.096851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:04.097201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:04.097853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:04.109307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:04.141594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:04.142209 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1361/2715] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:04.178840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc828a2-571c-40ff-b8ce-bb673c5c78fa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:04.186255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebff9d-d0c0-4937-9b72-13c645a2150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:04.186880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebff9d-d0c0-4937-9b72-13c645a2150a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:04.187260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebff9d-d0c0-4937-9b72-13c645a2150a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:04.187531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebff9d-d0c0-4937-9b72-13c645a2150a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:04.188635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebff9d-d0c0-4937-9b72-13c645a2150a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:04.190596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebff9d-d0c0-4937-9b72-13c645a2150a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:04.211196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:04.220968 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1355/2716] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:04.222504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55276a-2d4e-4ebc-96d6-8c09bf574238 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:04.222789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55276a-2d4e-4ebc-96d6-8c09bf574238 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:04.224665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55276a-2d4e-4ebc-96d6-8c09bf574238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:04.229645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774d239-4ccd-48dd-882f-eed0902c8962 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:04.239720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8adf4b-e0f3-4aa1-8245-b819f84b6a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:04.240102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8adf4b-e0f3-4aa1-8245-b819f84b6a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:04.240320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8adf4b-e0f3-4aa1-8245-b819f84b6a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:04.241101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8adf4b-e0f3-4aa1-8245-b819f84b6a69 admin admin] PATH_INFO: `/v3/projects/575bf6d1e7d84261baa0e349f26824f9/users/db154ecdb176431181a080cd55bb98ea/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:04.268111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1e55276a-2d4e-4ebc-96d6-8c09bf574238 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:04.270783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1e55276a-2d4e-4ebc-96d6-8c09bf574238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:04.275516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8adf4b-e0f3-4aa1-8245-b819f84b6a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575bf6d1e7d84261baa0e349f26824f9, user_id=db154ecdb176431181a080cd55bb98ea, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:04.279521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8adf4b-e0f3-4aa1-8245-b819f84b6a69 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:04.363798 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1362/2717] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:04 2022] PUT /identity/v3/projects/575bf6d1e7d84261baa0e349f26824f9/users/db154ecdb176431181a080cd55bb98ea/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:04.370310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:04.377555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:04.377902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:04.477714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] MFA Rules not processed for user `db154ecdb176431181a080cd55bb98ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:04.480711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:04.537816 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1356/2718] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:04.604053 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:04.654737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1363/2719] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:04.660373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55276a-2d4e-4ebc-96d6-8c09bf574238 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:04.681364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55276a-2d4e-4ebc-96d6-8c09bf574238 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:04.841219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:04.842001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:04.842388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:04.843053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:04.843930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:04.846037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:04.876586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:04.878229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:04.909805 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1357/2720] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:04 2022] POST /identity/v3/projects => generated 393 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:04.913556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:05.032952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086e06c-901d-43b2-bc8f-368f4d3ea614 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:05.043859 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:05.048241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ab8f8-53d9-4755-bd61-9095eeaa656f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:05.058667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:05.059474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:05.060414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:05.060813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:05.062385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:05.066673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:05.116412 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1358/2721] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:04 2022] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:05.117953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:05.138323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0be57b-9b2a-4168-bc3f-6c953f566553 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:05.155467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:05.156561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:05.157091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:05.159120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:05.160096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:05.162462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:05.188404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:05.189418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:05.191564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:05.192064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:05.200175 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1359/2722] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:09:05.202356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:05.224661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc3351-a08a-46fc-bb21-173005f3ecb3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:05.242809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:05.244263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:05.247428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:05.247428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] PATH_INFO: `/v3/projects/5d14197b417b4cddbf81b016f73cf7ba/users/6285bed74ac84869872d1e4ddef2755f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:05.305427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d14197b417b4cddbf81b016f73cf7ba, user_id=6285bed74ac84869872d1e4ddef2755f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:05.309660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:05.348970 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1360/2723] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:05 2022] PUT /identity/v3/projects/5d14197b417b4cddbf81b016f73cf7ba/users/6285bed74ac84869872d1e4ddef2755f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:05.348970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:05.436016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:05.441023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:05.494682 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1364/2724] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:09:05.533989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94910ed4-3111-46db-9004-33d984a08a60 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:05.540217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70122-b5bf-4f81-8047-bf41d983150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:05.541291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70122-b5bf-4f81-8047-bf41d983150b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:05.545855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70122-b5bf-4f81-8047-bf41d983150b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:05.546151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70122-b5bf-4f81-8047-bf41d983150b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:05.546849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac70122-b5bf-4f81-8047-bf41d983150b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:05.548578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac70122-b5bf-4f81-8047-bf41d983150b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:05.566137 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1361/2725] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:09:05.569851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:05.590883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e6e9f-e43a-4c51-921a-65bd875b2a5c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:05.610187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:05.610925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:05.611258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:05.611620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] PATH_INFO: `/v3/projects/5d14197b417b4cddbf81b016f73cf7ba/users/6285bed74ac84869872d1e4ddef2755f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:05.614281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d14197b417b4cddbf81b016f73cf7ba, user_id=6285bed74ac84869872d1e4ddef2755f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:05.617038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:05.655137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1365/2726] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:05 2022] PUT /identity/v3/projects/5d14197b417b4cddbf81b016f73cf7ba/users/6285bed74ac84869872d1e4ddef2755f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:05.665984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:05.666288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:05.671075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:05.757443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] MFA Rules not processed for user `6285bed74ac84869872d1e4ddef2755f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:05.765131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:05.986272 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1362/2727] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:07.990555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:07.992457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:08.123467 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:08.405339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c36c6-cb40-4c53-88a9-992931f55c30 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:08.443492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:08.444180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:08.444457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:08.444728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:08.496154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:08.497768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:08.550596 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1366/2728] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:09.238858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:09.240653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:09.295387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cab86-ffd9-4cd3-a48b-6fe4e1dd0e45 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:09.324155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96546b8-18b0-4708-b51b-8791f9ee31b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:09.325099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96546b8-18b0-4708-b51b-8791f9ee31b5 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:09.325630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96546b8-18b0-4708-b51b-8791f9ee31b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:09.326041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96546b8-18b0-4708-b51b-8791f9ee31b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:09.328769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e96546b8-18b0-4708-b51b-8791f9ee31b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:09.359644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96546b8-18b0-4708-b51b-8791f9ee31b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:09.362346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96546b8-18b0-4708-b51b-8791f9ee31b5 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:09.392976 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1363/2729] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:11.478947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:11.615092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c31ff-6d33-4eae-9233-7b3f4a954c3c service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:11.619886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:11.620696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:11.621114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:11.621494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] PATH_INFO: `/v3/users/db154ecdb176431181a080cd55bb98ea` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:11.622850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db154ecdb176431181a080cd55bb98ea)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:11.625029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:11.706578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db154ecdb176431181a080cd55bb98ea'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:11.707419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db154ecdb176431181a080cd55bb98ea'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:11.708128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db154ecdb176431181a080cd55bb98ea'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:11.719738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db154ecdb176431181a080cd55bb98ea'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:11.780064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db154ecdb176431181a080cd55bb98ea'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:11.799915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1367/2730] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:11 2022] DELETE /identity/v3/users/db154ecdb176431181a080cd55bb98ea => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:11.804338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bdcb8-6dba-495b-9d8a-0317e21183b3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:11.804907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bdcb8-6dba-495b-9d8a-0317e21183b3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:11.805176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bdcb8-6dba-495b-9d8a-0317e21183b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:11.847397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6f8bdcb8-6dba-495b-9d8a-0317e21183b3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:11.849245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6f8bdcb8-6dba-495b-9d8a-0317e21183b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:11.866125 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:11.988177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1364/2731] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:09:12.068689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:12.071709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:12.145677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:12.146097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:12.146564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:12.180375 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:12.240151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] MFA Rules not processed for user `3f540ecf8f4e43d6870e501dc8f296eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:12.247764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:12.250742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251854-3109-42a6-8bbe-2d52b297fa8a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:12.262800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:12.264936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:12.266491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:12.266877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:12.292131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:12.295800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:12.325518 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1368/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:12.520174 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1365/2733] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:13.298952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:13.300527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:13.374578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:13.376203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:13.422226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908a5-35cd-46a5-b018-02dfc0faab43 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:13.445899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:13.446550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:13.446826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:13.447093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] PATH_INFO: `/v3/projects/575bf6d1e7d84261baa0e349f26824f9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:13.456553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575bf6d1e7d84261baa0e349f26824f9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:13.458541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:13.590911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b537fa-3049-4a30-8e18-5a5db17bb457 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:13.621055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575bf6d1e7d84261baa0e349f26824f9', 'request_id': 'req-d678f873-bde7-40fd-a028-05413dbdd1e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:13.641939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575bf6d1e7d84261baa0e349f26824f9', 'request_id': 'req-d678f873-bde7-40fd-a028-05413dbdd1e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:13.664415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575bf6d1e7d84261baa0e349f26824f9', 'request_id': 'req-d678f873-bde7-40fd-a028-05413dbdd1e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:13.708933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] The token cache is being invalidate because project 575bf6d1e7d84261baa0e349f26824f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:13.709526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:13.728195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:13.735830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1366/2734] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:13 2022] DELETE /identity/v3/projects/575bf6d1e7d84261baa0e349f26824f9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:13.739815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:13.746464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:13.833613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d58d-ee76-441b-8c3f-fc3d7bb8ce26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:13.834234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d58d-ee76-441b-8c3f-fc3d7bb8ce26 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:13.834507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d58d-ee76-441b-8c3f-fc3d7bb8ce26 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:13.834775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d58d-ee76-441b-8c3f-fc3d7bb8ce26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:13.840710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-85b6d58d-ee76-441b-8c3f-fc3d7bb8ce26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:13.892026 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:14.011628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678f873-bde7-40fd-a028-05413dbdd1e5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:14.027345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:14.028415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:14.028695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:14.029481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] PATH_INFO: `/v3/users/6285bed74ac84869872d1e4ddef2755f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:14.031010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6285bed74ac84869872d1e4ddef2755f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:14.032961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:14.044117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d58d-ee76-441b-8c3f-fc3d7bb8ce26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:14.049439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d58d-ee76-441b-8c3f-fc3d7bb8ce26 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:14.083944 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1369/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:14.192720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6285bed74ac84869872d1e4ddef2755f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:14.193545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6285bed74ac84869872d1e4ddef2755f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:14.196765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6285bed74ac84869872d1e4ddef2755f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:14.248592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6285bed74ac84869872d1e4ddef2755f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:14.284621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6285bed74ac84869872d1e4ddef2755f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:14.327215 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1367/2736] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:13 2022] DELETE /identity/v3/users/6285bed74ac84869872d1e4ddef2755f => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:15.940433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:15.940923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:15.941037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:15.977159 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:15.996718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] MFA Rules not processed for user `559b3d4a02af42bd98dacd08b9e45a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:15.998110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:16.081114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1370/2737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:16.082613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:16.084185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:16.243311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b57e99-936d-481d-b275-bb0f256d8ee8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:16.255189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:16.256213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:16.256786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:16.258573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:16.259479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:16.263316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:16.306392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:16.308675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:16.347712 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1368/2738] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:16 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:16.351861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:16.421854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6973c-e75c-495a-b5bc-5a4313768ece None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:16.482673 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:16.612631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895c634-5e33-40e6-8233-b0e03a4bb0f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:16.631900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:16.632735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:16.633135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:16.636748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:16.636748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:16.646203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:16.727029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:16.727611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:16.727889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:16.728165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] PATH_INFO: `/v3/projects/5d14197b417b4cddbf81b016f73cf7ba` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:16.738012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d14197b417b4cddbf81b016f73cf7ba)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:16.742108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:16.742291 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1369/2739] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:16 2022] POST /identity/v3/users => generated 296 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:16.748243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:16.788869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6c3b-7fc7-441d-aaa9-20edb2ce54c8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:16.861310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d14197b417b4cddbf81b016f73cf7ba', 'request_id': 'req-794d3c92-19c7-446c-9072-dbaea0839df5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:16.887856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d14197b417b4cddbf81b016f73cf7ba', 'request_id': 'req-794d3c92-19c7-446c-9072-dbaea0839df5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:16.929127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d14197b417b4cddbf81b016f73cf7ba', 'request_id': 'req-794d3c92-19c7-446c-9072-dbaea0839df5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:16.946574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] The token cache is being invalidate because project 5d14197b417b4cddbf81b016f73cf7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:16.947642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:16.949710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-794d3c92-19c7-446c-9072-dbaea0839df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:16.954161 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1371/2740] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:16 2022] DELETE /identity/v3/projects/5d14197b417b4cddbf81b016f73cf7ba => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:16.959595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62635-9542-424f-a7fa-508fd2375ad2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:16.960086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62635-9542-424f-a7fa-508fd2375ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:16.960535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62635-9542-424f-a7fa-508fd2375ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.012965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:17.015784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.016185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.016574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.019435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:17.019435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:17.051449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6ad62635-9542-424f-a7fa-508fd2375ad2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:17.058367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6ad62635-9542-424f-a7fa-508fd2375ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:17.069002 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1370/2741] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:17.073934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:17.091127 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1372/2742] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:17.091402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:17.098529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a10d-66d5-4682-bfda-4e0199c79d6c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.099075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a10d-66d5-4682-bfda-4e0199c79d6c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.099533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a10d-66d5-4682-bfda-4e0199c79d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.149455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0877a10d-66d5-4682-bfda-4e0199c79d6c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:17.150993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0877a10d-66d5-4682-bfda-4e0199c79d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:17.152825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8da3f-b0e3-4db2-999d-7afcb3d504be admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:17.166348 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1373/2743] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:09:17.171178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a10d-66d5-4682-bfda-4e0199c79d6c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:17.178886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:17.179667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.180115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.180625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] PATH_INFO: `/v3/projects/930ce6a4c444491381df5e31a737cf64/users/1063c72a527541fe8d43af7b3f283ee8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.196000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a10d-66d5-4682-bfda-4e0199c79d6c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:17.207333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:17.208324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.208608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.209046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.209900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:09:17.210203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:17.212004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:17.246455 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1374/2744] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:09:17.247659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930ce6a4c444491381df5e31a737cf64, user_id=1063c72a527541fe8d43af7b3f283ee8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:17.250999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:17.257617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:17.262512 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:17.268488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913fcd2-dd61-4a3d-93c6-8ed19ab6953f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:17.278916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:17.280903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.281206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.283946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.284590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:17.289041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:17.316056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1371/2745] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:17 2022] PUT /identity/v3/projects/930ce6a4c444491381df5e31a737cf64/users/1063c72a527541fe8d43af7b3f283ee8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:17.326141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:17.379041 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1375/2746] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:17 2022] POST /identity/v3/projects => generated 399 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:17.381289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:17.470418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90454b89-cacf-496c-8a3d-ba7b7c02d139 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:17.571194 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:17.625217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:17.627062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.627062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.627062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.630681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:17.632602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:17.670808 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1372/2747] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:17.676770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:17.695692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c609-bd66-4710-a9b4-8125bae7f43e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:17.712595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3a136-1eb8-4ec8-9ce1-30b7c581e0cf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:17.725435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:17.726213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.726583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.726861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.728803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:17.729803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:17.730602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:17.730993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:17.731390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] PATH_INFO: `/v3/projects/930ce6a4c444491381df5e31a737cf64/users/1063c72a527541fe8d43af7b3f283ee8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:17.733829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930ce6a4c444491381df5e31a737cf64, user_id=1063c72a527541fe8d43af7b3f283ee8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:17.734255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:17.736397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:17.764166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1373/2748] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:17 2022] PUT /identity/v3/projects/930ce6a4c444491381df5e31a737cf64/users/1063c72a527541fe8d43af7b3f283ee8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:17.817081 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1376/2749] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:17 2022] POST /identity/v3/users => generated 300 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:17.817814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:18.003772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d32e25-48fc-47d7-a6fe-eeba5e1c4331 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:18.010719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:18.011511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:18.011900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:18.012279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:18.013220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:18.016141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:18.028924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1374/2750] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:09:18.033256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:18.046713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eb156-424e-4829-8877-2dbb3a52ba8d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:18.063748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf74e-64ed-4cc6-88ef-ac9f7aada3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:18.064744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf74e-64ed-4cc6-88ef-ac9f7aada3df admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:18.065346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf74e-64ed-4cc6-88ef-ac9f7aada3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:18.065856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf74e-64ed-4cc6-88ef-ac9f7aada3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:18.066728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddf74e-64ed-4cc6-88ef-ac9f7aada3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:18.069540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddf74e-64ed-4cc6-88ef-ac9f7aada3df admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:18.093684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:18.094941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1377/2751] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:18.141213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b523f6-0e06-4636-bb0e-314417191b71 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:18.161631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:18.168464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:18.168761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:18.170061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] PATH_INFO: `/v3/projects/300c284b8456409eb1452f1f2aed6f16/users/78d6169f193241cd872866e8be4160be/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:18.207623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=300c284b8456409eb1452f1f2aed6f16, user_id=78d6169f193241cd872866e8be4160be, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:18.210929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:18.249416 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1375/2752] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:18 2022] PUT /identity/v3/projects/300c284b8456409eb1452f1f2aed6f16/users/78d6169f193241cd872866e8be4160be/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:18.260377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146b592-0dd7-4403-8a9b-b804a1da157b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:18.260883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146b592-0dd7-4403-8a9b-b804a1da157b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:18.261300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146b592-0dd7-4403-8a9b-b804a1da157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:18.373393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6146b592-0dd7-4403-8a9b-b804a1da157b None None] MFA Rules not processed for user `78d6169f193241cd872866e8be4160be`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:18.379720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6146b592-0dd7-4403-8a9b-b804a1da157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:18.713832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:18.727214 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1378/2753] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:18.926844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745dd59-0cd8-4da7-acc6-a31aa7315f4c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:18.939288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:18.940241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:18.941360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:18.941851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:18.944442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:18.950594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:19.046252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1376/2754] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:18 2022] POST /identity/v3/projects => generated 397 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:19.050195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146b592-0dd7-4403-8a9b-b804a1da157b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:19.084127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146b592-0dd7-4403-8a9b-b804a1da157b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:19.282417 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:19.317660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:19.318365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:19.318610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:19.318867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:19.325423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:19.330240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:19.413895 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1379/2755] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:19 2022] POST /identity/v3/users => generated 305 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:19.426131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:19.447125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555b8e-93ce-4cf1-bfb3-b3dd1cd12c81 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:19.468370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:19.474325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:19.474813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:19.475701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:19.476672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:19.482475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:19.531732 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1377/2756] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:19.533282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:19.550987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a99324-328c-49b7-a086-902ee1e41f07 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:19.575836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:19.576452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:19.576733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:19.577008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] PATH_INFO: `/v3/projects/5d5d25cdfefd4ed28b64960b028d9e19/users/f8c5300f7dd84910b26cd9b9eac5d8b0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:19.642042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5d25cdfefd4ed28b64960b028d9e19, user_id=f8c5300f7dd84910b26cd9b9eac5d8b0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:19.652385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:19.692417 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1380/2757] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:19 2022] PUT /identity/v3/projects/5d5d25cdfefd4ed28b64960b028d9e19/users/f8c5300f7dd84910b26cd9b9eac5d8b0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:19.693729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:19.709793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbde53-c5b2-485d-bf09-ebd9e5620856 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:19.759537 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:19.781944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:19.784895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:19.950922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:19.955709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:19.956893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:19.957222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:19.957938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:19.964173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:19.990800 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1378/2758] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:19.994289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:20.024124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4087bd3-b5e9-4c96-b438-1b96a807ab19 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:20.039606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f58d-35d0-41d0-aefd-c6ab2934b7a8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:20.051211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:20.052683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:20.052972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:20.053272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:20.056114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be81ae-aff8-4cfb-b1f4-5a4863756f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:20.057150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be81ae-aff8-4cfb-b1f4-5a4863756f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:20.058351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be81ae-aff8-4cfb-b1f4-5a4863756f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:20.058843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be81ae-aff8-4cfb-b1f4-5a4863756f76 admin admin] PATH_INFO: `/v3/projects/5d5d25cdfefd4ed28b64960b028d9e19/users/f8c5300f7dd84910b26cd9b9eac5d8b0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:20.060759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:20.061712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be81ae-aff8-4cfb-b1f4-5a4863756f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5d25cdfefd4ed28b64960b028d9e19, user_id=f8c5300f7dd84910b26cd9b9eac5d8b0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:20.064746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be81ae-aff8-4cfb-b1f4-5a4863756f76 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:20.091235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1379/2759] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:19 2022] PUT /identity/v3/projects/5d5d25cdfefd4ed28b64960b028d9e19/users/f8c5300f7dd84910b26cd9b9eac5d8b0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:20.102669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68eeac-6e76-4bda-b3a7-ecbf5faf8b10 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:20.103626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68eeac-6e76-4bda-b3a7-ecbf5faf8b10 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:20.104734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68eeac-6e76-4bda-b3a7-ecbf5faf8b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:20.174377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-af68eeac-6e76-4bda-b3a7-ecbf5faf8b10 None None] MFA Rules not processed for user `f8c5300f7dd84910b26cd9b9eac5d8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:20.175890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-af68eeac-6e76-4bda-b3a7-ecbf5faf8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:20.220030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:20.223854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:20.264505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1381/2760] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:09:20.404722 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1380/2761] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:20.923180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:20.943150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc346a4-b20d-4d96-b3d9-e1e87e409ceb service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:21.071957 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:21.130078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:21.130925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:21.132107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:21.133514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:21.327135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:21.329144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:21.340836 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1382/2762] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:21.365601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:21.365601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:21.365601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:21.418752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] MFA Rules not processed for user `e7508410259d4df7bd231db49c35c8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:21.419974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:21.560628 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1381/2763] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:24.219733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:24.221256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:24.346200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3239035-138e-40a4-98ec-222167273a92 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:24.354605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:24.355757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:24.356037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:24.356313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:24.360394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:24.395053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:24.400139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:24.443363 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1383/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:26.762121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:26.764199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:26.823414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c67d-3d90-4e3d-b071-931bd37707c3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:26.873840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0cb59-6c90-418d-98f4-5d0ccb8a3eae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:26.874492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0cb59-6c90-418d-98f4-5d0ccb8a3eae service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:26.874772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0cb59-6c90-418d-98f4-5d0ccb8a3eae service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:26.875041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0cb59-6c90-418d-98f4-5d0ccb8a3eae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:26.904126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0cb59-6c90-418d-98f4-5d0ccb8a3eae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:26.906382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0cb59-6c90-418d-98f4-5d0ccb8a3eae service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:26.939184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1382/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:28.276837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:28.366079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373960d0-5a92-4695-b4b0-e6432eefbb19 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:28.372911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:28.374106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:28.374610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:28.375114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] PATH_INFO: `/v3/users/78d6169f193241cd872866e8be4160be` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:28.377016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d6169f193241cd872866e8be4160be)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:28.379958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:28.436128 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:28.450270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d6169f193241cd872866e8be4160be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:28.451099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d6169f193241cd872866e8be4160be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:28.451799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d6169f193241cd872866e8be4160be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:28.462034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d6169f193241cd872866e8be4160be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:28.482981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d6169f193241cd872866e8be4160be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:28.519568 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1384/2766] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:28 2022] DELETE /identity/v3/users/78d6169f193241cd872866e8be4160be => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:28.520688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:28.521195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:28.521306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:28.552713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:28.554238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:28.561775 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:28.660065 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1383/2767] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:09:28.675759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:28.677328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:28.764971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe8fa-4725-4db0-addc-2227fe63c45f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:28.786296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:28.788787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:28.789121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:28.791401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:28.813191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:28.815252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:28.835795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1385/2768] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:29.848877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:29.850362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:29.876856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d0f8c-0875-467c-b87d-469e8850442b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:29.882595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:29.883241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:29.884181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:29.884459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] PATH_INFO: `/v3/projects/300c284b8456409eb1452f1f2aed6f16` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:29.885738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300c284b8456409eb1452f1f2aed6f16)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:29.887748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:29.960456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:29.960956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300c284b8456409eb1452f1f2aed6f16', 'request_id': 'req-1dd36449-73a4-496e-afdc-18fac68453c8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:29.962614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:29.972304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300c284b8456409eb1452f1f2aed6f16', 'request_id': 'req-1dd36449-73a4-496e-afdc-18fac68453c8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:29.980995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4ae2-7892-4730-b8d1-bed376a0892f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:29.984184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300c284b8456409eb1452f1f2aed6f16', 'request_id': 'req-1dd36449-73a4-496e-afdc-18fac68453c8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.007768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] The token cache is being invalidate because project 300c284b8456409eb1452f1f2aed6f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:30.008065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.009258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.018066 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1384/2769] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:29 2022] DELETE /identity/v3/projects/300c284b8456409eb1452f1f2aed6f16 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:30.019420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:30.021723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:30.087849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:30.089765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:30.090064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:30.090379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:30.092370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:30.180180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36449-73a4-496e-afdc-18fac68453c8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:30.198305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:30.198497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:30.199324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:30.199774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:30.200472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:30.201126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] PATH_INFO: `/v3/users/f8c5300f7dd84910b26cd9b9eac5d8b0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:30.203857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c5300f7dd84910b26cd9b9eac5d8b0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:30.210225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:30.217469 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1386/2770] 10.222.0.16 () {60 vars in 1396 bytes} [Sun Sep 11 01:09:29 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3315 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:30.284165 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:30.297649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c5300f7dd84910b26cd9b9eac5d8b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.299088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c5300f7dd84910b26cd9b9eac5d8b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.299781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c5300f7dd84910b26cd9b9eac5d8b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.324050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c5300f7dd84910b26cd9b9eac5d8b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.331870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6bf1a33f-6c34-4b48-8824-e77ddbb961c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c5300f7dd84910b26cd9b9eac5d8b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:30.352934 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1385/2771] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:30 2022] DELETE /identity/v3/users/f8c5300f7dd84910b26cd9b9eac5d8b0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:31.566147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:31.573802 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:31.582380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad05d-ec1b-48f7-ba80-eaefe6d96070 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:31.755251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:31.756388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:31.756846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:31.757348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] PATH_INFO: `/v3/projects/5d5d25cdfefd4ed28b64960b028d9e19` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:31.763343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5d25cdfefd4ed28b64960b028d9e19)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:31.770696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:31.927573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5d25cdfefd4ed28b64960b028d9e19', 'request_id': 'req-6197c38b-4b97-46d3-a05b-67bd63a9b379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:31.943487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5d25cdfefd4ed28b64960b028d9e19', 'request_id': 'req-6197c38b-4b97-46d3-a05b-67bd63a9b379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:31.952123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:31.952985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:31.953280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:31.969258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5d25cdfefd4ed28b64960b028d9e19', 'request_id': 'req-6197c38b-4b97-46d3-a05b-67bd63a9b379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:31.993037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] The token cache is being invalidate because project 5d5d25cdfefd4ed28b64960b028d9e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:31.993499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:31.995413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6197c38b-4b97-46d3-a05b-67bd63a9b379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:32.002662 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1387/2772] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:31 2022] DELETE /identity/v3/projects/5d5d25cdfefd4ed28b64960b028d9e19 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:32.009020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c622-e8bf-4802-9fef-2f3fa537056c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.010992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c622-e8bf-4802-9fef-2f3fa537056c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.010992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c622-e8bf-4802-9fef-2f3fa537056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.038870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] MFA Rules not processed for user `1063c72a527541fe8d43af7b3f283ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:32.040278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:32.058838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fa63c622-e8bf-4802-9fef-2f3fa537056c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:32.060087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa63c622-e8bf-4802-9fef-2f3fa537056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:32.177131 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1388/2773] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:32.182188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774810-d56c-48d5-b325-5ff4943d37e6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.183008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774810-d56c-48d5-b325-5ff4943d37e6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.183008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774810-d56c-48d5-b325-5ff4943d37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.206897 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1386/2774] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:09:32.219867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:32.221668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:32.224470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-be774810-d56c-48d5-b325-5ff4943d37e6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:32.225554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-be774810-d56c-48d5-b325-5ff4943d37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:32.247537 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1389/2775] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:32.280951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774810-d56c-48d5-b325-5ff4943d37e6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:32.307007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be774810-d56c-48d5-b325-5ff4943d37e6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:32.317876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:32.320316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.320668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.321015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.323520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:09:32.323520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:32.331294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:32.373184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1390/2776] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:09:32.377450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:32.391039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82191e3-79c5-4df0-ad12-e06b015c3d84 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:32.405756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:32.407428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.407747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.408504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.409054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:32.410979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:32.429117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf4932-016f-4fa7-a736-e88f1bc0b480 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:32.433523 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:32.436087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:32.436830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.437268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.437547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.439934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:32.457084 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1391/2777] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:32 2022] POST /identity/v3/projects => generated 395 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:32.458098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:32.555558 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:32.629774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3614b9-6412-492a-a388-03fb8605af69 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:32.636784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:32.638793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:32.648454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:32.648995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.649347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.649624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.651483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:32.655869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:32.671358 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1387/2778] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:09:32.711063 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1392/2779] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:32 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:32.716114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:32.748061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9733-5fcb-4cbe-94d8-d2b10f143630 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:32.764550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:32.766621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.768182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.768615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.773751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:32.775513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:32.816505 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1388/2780] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:32.820622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:32.835901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15248cd-9770-4218-9c36-93c9e22cafda admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:32.844824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3518e8b-6b1b-4085-8451-70fda87adf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:32.845479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518e8b-6b1b-4085-8451-70fda87adf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.845754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518e8b-6b1b-4085-8451-70fda87adf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.846025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518e8b-6b1b-4085-8451-70fda87adf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:32.846666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3518e8b-6b1b-4085-8451-70fda87adf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:32.848244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3518e8b-6b1b-4085-8451-70fda87adf2e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:32.890809 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1393/2781] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:32.895207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:32.949303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbd11a-0404-48bd-8601-cc65b63d6a55 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:32.967306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:32.971901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:32.972338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:32.973373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] PATH_INFO: `/v3/projects/a8e3960ff12b428abc832a26166137f2/users/0c2ce706d9004f939a7f2f986005d5cb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:33.020409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e3960ff12b428abc832a26166137f2, user_id=0c2ce706d9004f939a7f2f986005d5cb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:33.024121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:33.066564 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1389/2782] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:32 2022] PUT /identity/v3/projects/a8e3960ff12b428abc832a26166137f2/users/0c2ce706d9004f939a7f2f986005d5cb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:33.146622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ab9c-f67d-4afc-9852-d1b636ff3c09 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:33.146851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ab9c-f67d-4afc-9852-d1b636ff3c09 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:33.146990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ab9c-f67d-4afc-9852-d1b636ff3c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:33.261857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-de28ab9c-f67d-4afc-9852-d1b636ff3c09 None None] MFA Rules not processed for user `0c2ce706d9004f939a7f2f986005d5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:33.263110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-de28ab9c-f67d-4afc-9852-d1b636ff3c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:33.542030 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1394/2783] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:33.546789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:33.773693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c93d-0f43-4fe9-9e05-a7f81e5b7aa9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:33.795087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:33.795852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:33.797568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:33.798482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:33.803960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:33.812655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:33.889879 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1390/2784] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:33 2022] POST /identity/v3/projects => generated 393 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:33.902792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28ab9c-f67d-4afc-9852-d1b636ff3c09 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:33.926960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28ab9c-f67d-4afc-9852-d1b636ff3c09 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:34.121729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:34.122672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:34.123125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:34.123551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:34.124351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:34.126891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:34.152778 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:34.187911 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1395/2785] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:33 2022] POST /identity/v3/users => generated 303 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:34.191551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:34.212649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6066e85-4d46-44ee-8b02-59d8302e47f2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:34.227332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:34.227994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:34.228252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:34.228523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:34.240158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:34.242375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:34.277560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:34.283193 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1391/2786] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:34.305367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354cf3f-93a9-410d-a3fc-12887797ef44 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:34.329500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:34.330979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:34.331511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:34.331890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] PATH_INFO: `/v3/projects/555ee6de6f984a5b8fb224740b8d8a77/users/6e5bffcf0b9b48129c4984785bbf9f3c/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:34.388856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=555ee6de6f984a5b8fb224740b8d8a77, user_id=6e5bffcf0b9b48129c4984785bbf9f3c, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:34.395472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:34.421919 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1396/2787] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:34 2022] PUT /identity/v3/projects/555ee6de6f984a5b8fb224740b8d8a77/users/6e5bffcf0b9b48129c4984785bbf9f3c/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:34.425847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:34.439971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876ae5-7ef5-4e97-8b1d-3636afdf98f0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:34.672417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcddc5-6bc2-4e17-b382-8ceaceb9e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:34.674615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcddc5-6bc2-4e17-b382-8ceaceb9e90d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:34.674900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcddc5-6bc2-4e17-b382-8ceaceb9e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:34.675170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcddc5-6bc2-4e17-b382-8ceaceb9e90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:34.675835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcddc5-6bc2-4e17-b382-8ceaceb9e90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:34.681798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcddc5-6bc2-4e17-b382-8ceaceb9e90d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:34.712199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:34.712422 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1392/2788] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:34.732656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781bf36-9a37-448f-a9ba-4c1de1d04f4b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:34.749192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:34.751161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:34.752840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:34.753472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] PATH_INFO: `/v3/projects/555ee6de6f984a5b8fb224740b8d8a77/users/6e5bffcf0b9b48129c4984785bbf9f3c/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:34.762464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] RBAC: Authorizing `identity:create_grant(project_id=555ee6de6f984a5b8fb224740b8d8a77, user_id=6e5bffcf0b9b48129c4984785bbf9f3c, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:34.769884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:34.804563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1397/2789] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:34 2022] PUT /identity/v3/projects/555ee6de6f984a5b8fb224740b8d8a77/users/6e5bffcf0b9b48129c4984785bbf9f3c/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:34.816543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95329b-c416-4c70-9b0e-f967c406b9b8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:34.816821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95329b-c416-4c70-9b0e-f967c406b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:34.817586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95329b-c416-4c70-9b0e-f967c406b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:34.887766 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:34.916130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8b95329b-c416-4c70-9b0e-f967c406b9b8 None None] MFA Rules not processed for user `6e5bffcf0b9b48129c4984785bbf9f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:34.919883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8b95329b-c416-4c70-9b0e-f967c406b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:35.267417 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1393/2790] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:36.422660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:36.426911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:36.691921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ccef-5e8b-4139-875b-d1416c02620b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:36.711512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888105-bcfc-4232-8e68-2494000e413c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:36.711855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888105-bcfc-4232-8e68-2494000e413c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:36.713742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888105-bcfc-4232-8e68-2494000e413c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:36.714107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888105-bcfc-4232-8e68-2494000e413c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:36.760969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888105-bcfc-4232-8e68-2494000e413c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:36.762695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888105-bcfc-4232-8e68-2494000e413c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:36.814737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1398/2791] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:37.424998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95329b-c416-4c70-9b0e-f967c406b9b8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:37.578307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95329b-c416-4c70-9b0e-f967c406b9b8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:37.586174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:37.593769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:37.593769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:37.595099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] PATH_INFO: `/v3/users/0c2ce706d9004f939a7f2f986005d5cb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:37.602175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2ce706d9004f939a7f2f986005d5cb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:37.609178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:37.736625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2ce706d9004f939a7f2f986005d5cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:37.737363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2ce706d9004f939a7f2f986005d5cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:37.738414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2ce706d9004f939a7f2f986005d5cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:37.754978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2ce706d9004f939a7f2f986005d5cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:37.783478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2ce706d9004f939a7f2f986005d5cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:37.823709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1394/2792] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:37 2022] DELETE /identity/v3/users/0c2ce706d9004f939a7f2f986005d5cb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:37.825709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:37.826274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:37.826375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:37.874013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:37.880861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:38.040938 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1399/2793] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:38.078633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:38.080791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:38.128883 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:38.275302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd743a-c475-4d53-9de4-e1bdc0e8ef05 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:38.301838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:38.302560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:38.302845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:38.303138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:38.372349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:38.374853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:38.436204 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1395/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:39.818761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:39.821308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:39.883046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c05a-9ca5-49a6-b6a7-6a4aeaa95b4c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:39.910012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:39.910758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:39.911102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:39.911885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] PATH_INFO: `/v3/projects/a8e3960ff12b428abc832a26166137f2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:39.921981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e3960ff12b428abc832a26166137f2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:39.924502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:40.007274 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:40.038541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e3960ff12b428abc832a26166137f2', 'request_id': 'req-4906dfbd-0047-4968-ab48-f29b19aaf9a9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.053433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e3960ff12b428abc832a26166137f2', 'request_id': 'req-4906dfbd-0047-4968-ab48-f29b19aaf9a9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.071400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e3960ff12b428abc832a26166137f2', 'request_id': 'req-4906dfbd-0047-4968-ab48-f29b19aaf9a9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.087655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] The token cache is being invalidate because project a8e3960ff12b428abc832a26166137f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:40.088813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.089989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4906dfbd-0047-4968-ab48-f29b19aaf9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.095719 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1400/2795] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:39 2022] DELETE /identity/v3/projects/a8e3960ff12b428abc832a26166137f2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:40.096486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:40.110598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088e68-b60b-460c-9de0-ada5438b8265 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:40.250069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:40.251258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:40.251607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:40.251949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] PATH_INFO: `/v3/users/6e5bffcf0b9b48129c4984785bbf9f3c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:40.253516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5bffcf0b9b48129c4984785bbf9f3c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:40.256048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:40.373612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5bffcf0b9b48129c4984785bbf9f3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.374534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5bffcf0b9b48129c4984785bbf9f3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.375597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5bffcf0b9b48129c4984785bbf9f3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.391887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:40.392112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:40.392546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:40.396252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5bffcf0b9b48129c4984785bbf9f3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.413451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5bffcf0b9b48129c4984785bbf9f3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:40.437404 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1396/2796] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:40 2022] DELETE /identity/v3/users/6e5bffcf0b9b48129c4984785bbf9f3c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:40.452279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:40.455841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:40.579787 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1401/2797] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:09:40.608648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:40.610349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:40.697505 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:40.767150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6465c-d822-49ab-bacc-95b922a32eae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:40.780209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472479a-715f-4e19-a377-9d19ecfe0d27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:40.781388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472479a-715f-4e19-a377-9d19ecfe0d27 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:40.782060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472479a-715f-4e19-a377-9d19ecfe0d27 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:40.782824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472479a-715f-4e19-a377-9d19ecfe0d27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:40.798455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472479a-715f-4e19-a377-9d19ecfe0d27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:40.800310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472479a-715f-4e19-a377-9d19ecfe0d27 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:40.811353 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1397/2798] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:09:41.269754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:41.272232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:41.426748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbabda-276b-4c50-8e5b-ce709b6a79e6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:41.439487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:41.440596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:41.441293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:41.441831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] PATH_INFO: `/v3/projects/555ee6de6f984a5b8fb224740b8d8a77` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:41.443307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555ee6de6f984a5b8fb224740b8d8a77)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:41.448663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:41.529826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555ee6de6f984a5b8fb224740b8d8a77', 'request_id': 'req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:41.547262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555ee6de6f984a5b8fb224740b8d8a77', 'request_id': 'req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:41.561286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555ee6de6f984a5b8fb224740b8d8a77', 'request_id': 'req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:41.573142 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:41.586046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] The token cache is being invalidate because project 555ee6de6f984a5b8fb224740b8d8a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:41.588923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:41.589085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ffb552a-a6f7-4ff3-9f35-8ca20747c241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:41.600287 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1402/2799] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:41 2022] DELETE /identity/v3/projects/555ee6de6f984a5b8fb224740b8d8a77 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:41.605410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0000-ebe4-4253-968f-a8714a57e884 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:41.605897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0000-ebe4-4253-968f-a8714a57e884 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:41.606101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b0000-ebe4-4253-968f-a8714a57e884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:41.633845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-469b0000-ebe4-4253-968f-a8714a57e884 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:41.634504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-469b0000-ebe4-4253-968f-a8714a57e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:41.767140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1398/2800] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:41.776215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba02cd4-d09e-4310-bcc8-35ada7891049 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:41.776215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba02cd4-d09e-4310-bcc8-35ada7891049 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:41.776215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba02cd4-d09e-4310-bcc8-35ada7891049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:41.820666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0ba02cd4-d09e-4310-bcc8-35ada7891049 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:41.822390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0ba02cd4-d09e-4310-bcc8-35ada7891049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:41.878260 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1403/2801] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:41.881375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0000-ebe4-4253-968f-a8714a57e884 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:41.900399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b0000-ebe4-4253-968f-a8714a57e884 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:41.908387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:41.909406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:41.909910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:41.910392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:41.912035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:09:41.912584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:41.915218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:41.955775 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1399/2802] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:09:41.958791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba02cd4-d09e-4310-bcc8-35ada7891049 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:41.977775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba02cd4-d09e-4310-bcc8-35ada7891049 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:41.992572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:41.993700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:41.997329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:41.997803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:42.001419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:42.005686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:42.069302 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1404/2803] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:41 2022] POST /identity/v3/projects => generated 411 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:42.073670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:42.098172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78ed5d-ca3e-49e2-a87a-c7d6ec909a4a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:42.240493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:42.241304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:42.241720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:42.242218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:42.242852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:42.245818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:42.318803 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1400/2804] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:42 2022] POST /identity/v3/users => generated 306 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:42.320535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:42.339955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e48f6d-07ee-4545-b09f-d2d806fe25d8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:42.354868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:42.355625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:42.355909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:42.356181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:42.358006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:42.360445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:42.403184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1405/2805] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:42.407184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:42.437653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444b902-8c72-4d01-9df8-d491bb1fdf3d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:42.450352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e81aef-7302-4ea1-a09a-eac32e771e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:42.452493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e81aef-7302-4ea1-a09a-eac32e771e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:42.453259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e81aef-7302-4ea1-a09a-eac32e771e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:42.454125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e81aef-7302-4ea1-a09a-eac32e771e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:42.455169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e81aef-7302-4ea1-a09a-eac32e771e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:42.460285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e81aef-7302-4ea1-a09a-eac32e771e94 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:42.511992 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1401/2806] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:42.515269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:42.535155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9b0b8-f70f-47d2-9db5-06b12e3af83a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:42.548229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:42.549342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:42.549899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:42.550149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] PATH_INFO: `/v3/projects/da9b1279c0734edbbb64e5b6ce984c71/users/23702e78219b4a7aa0788c0596ed6f3b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:42.628714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9b1279c0734edbbb64e5b6ce984c71, user_id=23702e78219b4a7aa0788c0596ed6f3b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:42.646748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:42.701564 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1406/2807] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:42 2022] PUT /identity/v3/projects/da9b1279c0734edbbb64e5b6ce984c71/users/23702e78219b4a7aa0788c0596ed6f3b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:42.716038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7518-55f8-4a8c-95ad-a1182c015bba None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:42.716608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7518-55f8-4a8c-95ad-a1182c015bba None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:42.716849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7518-55f8-4a8c-95ad-a1182c015bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:42.766694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-be5b7518-55f8-4a8c-95ad-a1182c015bba None None] MFA Rules not processed for user `23702e78219b4a7aa0788c0596ed6f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:42.767916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-be5b7518-55f8-4a8c-95ad-a1182c015bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:42.813489 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:42.989135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1402/2808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:42.993917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:43.156387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9adb1b-4f81-45a6-a43b-964e335c1bdd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:43.173204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:43.173810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:43.174096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:43.174399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:43.175322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:43.177348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:43.269747 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1407/2809] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:42 2022] POST /identity/v3/projects => generated 411 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:43.274223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7518-55f8-4a8c-95ad-a1182c015bba None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:43.298613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b7518-55f8-4a8c-95ad-a1182c015bba None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:43.456614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:43.457435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:43.459821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:43.460209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:43.461050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:43.464857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:43.501385 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1403/2810] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:43 2022] POST /identity/v3/users => generated 312 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:43.505990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:43.532214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbe4ff-a3a1-47e4-af04-30ab48bebdd2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:43.552750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:43.553378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:43.553874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:43.554003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:43.554569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:43.563908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:43.615933 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1408/2811] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:43.616105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:43.637838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47274d-78ac-4220-8ba0-d1ab15101ea6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:43.644377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:43.645404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:43.646030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:43.646308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] PATH_INFO: `/v3/projects/669899d443d34f8db4a7c7861aac9984/users/e0880221f4e940b09417f9564ba42c18/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:43.667225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] RBAC: Authorizing `identity:create_grant(project_id=669899d443d34f8db4a7c7861aac9984, user_id=e0880221f4e940b09417f9564ba42c18, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:43.670408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:43.702248 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1404/2812] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:43 2022] PUT /identity/v3/projects/669899d443d34f8db4a7c7861aac9984/users/e0880221f4e940b09417f9564ba42c18/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:43.707388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:43.724375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ae29a-4e10-4df7-8d65-814d2a610717 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:43.831656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f41cb5-8811-40ec-8b01-04b16606346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:43.833383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f41cb5-8811-40ec-8b01-04b16606346e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:43.834255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f41cb5-8811-40ec-8b01-04b16606346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:43.839493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f41cb5-8811-40ec-8b01-04b16606346e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:43.840334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f41cb5-8811-40ec-8b01-04b16606346e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:43.842125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f41cb5-8811-40ec-8b01-04b16606346e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:43.860114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1409/2813] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:43.860723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:43.875661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d038e3-9e80-49cb-8169-9ff308a6871d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:43.894324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:43.895517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:43.895801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:43.896077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] PATH_INFO: `/v3/projects/669899d443d34f8db4a7c7861aac9984/users/e0880221f4e940b09417f9564ba42c18/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:43.898530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669899d443d34f8db4a7c7861aac9984, user_id=e0880221f4e940b09417f9564ba42c18, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:43.911080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:43.930743 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1405/2814] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:43 2022] PUT /identity/v3/projects/669899d443d34f8db4a7c7861aac9984/users/e0880221f4e940b09417f9564ba42c18/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:43.941970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:43.942338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:43.942782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:43.959791 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:44.010384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] MFA Rules not processed for user `e0880221f4e940b09417f9564ba42c18`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:44.013383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:44.220596 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1410/2815] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:44.234338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:44.249233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:44.457790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43ba21-0d8b-4cdb-8e86-1fce501d8658 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:44.465020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:44.465691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:44.465975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:44.466246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:44.477489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:44.480516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:44.484377 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:44.492447 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1406/2816] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:44 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:44.944884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:44.947418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:44.979753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad6f1b-dfb2-4ea5-9ff3-ff74691bf48c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:44.991137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f5411-7775-40b1-ab1f-79b7f76a4379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:44.992274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f5411-7775-40b1-ab1f-79b7f76a4379 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:44.992747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f5411-7775-40b1-ab1f-79b7f76a4379 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:44.993242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f5411-7775-40b1-ab1f-79b7f76a4379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:45.141136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f5411-7775-40b1-ab1f-79b7f76a4379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:45.160707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f5411-7775-40b1-ab1f-79b7f76a4379 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:45.184873 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1411/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:44 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:45.279402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:45.498018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0130f-dc4e-498b-91cb-4ff324490e06 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:45.548297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:45.550331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:45.552121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:45.552527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] PATH_INFO: `/v3/users/23702e78219b4a7aa0788c0596ed6f3b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:45.557799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23702e78219b4a7aa0788c0596ed6f3b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:45.565163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:45.605809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:45.606076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:45.606511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:45.691735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] MFA Rules not processed for user `92d56e7f729243e386f7ce8080cf864e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:45.697873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:45.744021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23702e78219b4a7aa0788c0596ed6f3b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:45.746439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23702e78219b4a7aa0788c0596ed6f3b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:45.755478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23702e78219b4a7aa0788c0596ed6f3b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:45.814362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23702e78219b4a7aa0788c0596ed6f3b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:45.844110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e53cb939-8eb8-4708-9018-2d70cb5f13d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23702e78219b4a7aa0788c0596ed6f3b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:45.868969 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1407/2818] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:45 2022] DELETE /identity/v3/users/23702e78219b4a7aa0788c0596ed6f3b => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:45.874337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:45.874969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:45.875531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:45.928906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:45.934243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1412/2819] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:45.935698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:46.083499 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1408/2820] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:46.097109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:46.098638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:46.211189 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:46.298292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2a0d8-6735-41e8-82b7-892a32cd74a9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:46.448065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:46.449317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:46.449848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:46.451326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:46.471166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:46.474228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:46.504316 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1413/2821] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:47.462544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:47.465748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:47.500091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21f48-c9bc-4c2a-9b51-ea77db764f6d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:47.520091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:47.520805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:47.521025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:47.521331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] PATH_INFO: `/v3/projects/da9b1279c0734edbbb64e5b6ce984c71` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:47.523105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9b1279c0734edbbb64e5b6ce984c71)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:47.525249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:47.563926 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:47.696385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9b1279c0734edbbb64e5b6ce984c71', 'request_id': 'req-fd14f330-dbe6-4e10-be65-57f2d98e5278'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:47.713772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9b1279c0734edbbb64e5b6ce984c71', 'request_id': 'req-fd14f330-dbe6-4e10-be65-57f2d98e5278'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:47.731053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9b1279c0734edbbb64e5b6ce984c71', 'request_id': 'req-fd14f330-dbe6-4e10-be65-57f2d98e5278'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:47.796890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] The token cache is being invalidate because project da9b1279c0734edbbb64e5b6ce984c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:47.798214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:47.799892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:47.815521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:47.816180 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1409/2822] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:47 2022] DELETE /identity/v3/projects/da9b1279c0734edbbb64e5b6ce984c71 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:47.833388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fb908-9cc7-436f-a63a-df1fc302e782 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:48.044940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:48.047037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:48.047247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:48.047521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] PATH_INFO: `/v3/users/e0880221f4e940b09417f9564ba42c18` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:48.061600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0880221f4e940b09417f9564ba42c18)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:48.077759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:48.321631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0880221f4e940b09417f9564ba42c18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:48.322933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0880221f4e940b09417f9564ba42c18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:48.323872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0880221f4e940b09417f9564ba42c18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:48.343023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0880221f4e940b09417f9564ba42c18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:48.380215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c8c59dd-2940-4c3e-a790-11d30d489ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0880221f4e940b09417f9564ba42c18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:48.408980 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1414/2823] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:09:47 2022] DELETE /identity/v3/users/e0880221f4e940b09417f9564ba42c18 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:49.304061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:49.307499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:49.345696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14f330-dbe6-4e10-be65-57f2d98e5278 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:49.491012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:49.492032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:49.492710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:49.493232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] PATH_INFO: `/v3/projects/669899d443d34f8db4a7c7861aac9984` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:49.494764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669899d443d34f8db4a7c7861aac9984)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:49.497285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:49.578222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669899d443d34f8db4a7c7861aac9984', 'request_id': 'req-6afdf3f6-61e0-4e3a-9c16-9e65af543549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:49.584001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669899d443d34f8db4a7c7861aac9984', 'request_id': 'req-6afdf3f6-61e0-4e3a-9c16-9e65af543549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:49.590866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669899d443d34f8db4a7c7861aac9984', 'request_id': 'req-6afdf3f6-61e0-4e3a-9c16-9e65af543549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:49.628571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] The token cache is being invalidate because project 669899d443d34f8db4a7c7861aac9984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:09:49.628892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:49.629713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6afdf3f6-61e0-4e3a-9c16-9e65af543549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:09:49.634575 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1410/2824] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:09:49 2022] DELETE /identity/v3/projects/669899d443d34f8db4a7c7861aac9984 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:49.638938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd203b39-5696-434a-bc10-e291dbf25d86 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:49.639519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd203b39-5696-434a-bc10-e291dbf25d86 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:49.639519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd203b39-5696-434a-bc10-e291dbf25d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:49.665685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fd203b39-5696-434a-bc10-e291dbf25d86 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:49.667242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd203b39-5696-434a-bc10-e291dbf25d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:49.673473 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:49.757157 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1415/2825] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:49.767552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d398-7ab2-4b58-9831-ef3ac686fb9c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:49.767840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d398-7ab2-4b58-9831-ef3ac686fb9c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:49.768249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2d398-7ab2-4b58-9831-ef3ac686fb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:49.819314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cea2d398-7ab2-4b58-9831-ef3ac686fb9c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:49.821692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cea2d398-7ab2-4b58-9831-ef3ac686fb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:49.857103 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1411/2826] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:49.861245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd203b39-5696-434a-bc10-e291dbf25d86 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:49.893351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd203b39-5696-434a-bc10-e291dbf25d86 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:49.905868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:49.906876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:49.907372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:49.907843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:49.910742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:09:49.911285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:49.914156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:49.969050 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1416/2827] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:09:49.972427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2d398-7ab2-4b58-9831-ef3ac686fb9c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:49.984680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2d398-7ab2-4b58-9831-ef3ac686fb9c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:49.992151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:49.993095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:49.993491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:49.994128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:49.994881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:49.998465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:50.118624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:50.126742 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1412/2828] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:49 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:50.171161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546ba45-f8c0-476f-ab34-bcefe4440efc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:50.570997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:50.571634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:50.571924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:50.572261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:50.572850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:50.582960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:50.641418 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1417/2829] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:50 2022] POST /identity/v3/users => generated 288 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:50.643175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:50.657227 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:50.666609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc5133-5933-4c5e-93a2-41fa7964900c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:50.688590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:50.689615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:50.690121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:50.690617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:50.691687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:50.695331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:50.722984 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1413/2830] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:50.723720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:50.751254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9632-c58c-4d10-8153-2c046a339d63 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:50.767921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184ea41-61af-44d8-8a31-a65a28f39a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:50.768578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184ea41-61af-44d8-8a31-a65a28f39a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:50.768839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184ea41-61af-44d8-8a31-a65a28f39a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:50.769142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184ea41-61af-44d8-8a31-a65a28f39a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:50.770384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184ea41-61af-44d8-8a31-a65a28f39a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:50.771419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184ea41-61af-44d8-8a31-a65a28f39a2b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:50.802439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:50.815664 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1418/2831] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:09:50.819081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80cae3-7632-49d1-a0e7-e0214bfc8e20 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:50.831744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:50.832445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:50.832841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:50.833009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] PATH_INFO: `/v3/projects/71af8395bfe048a6b6c9fac060b98a4d/users/06333292bb3e459ca52949843119e4b5/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:50.873381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71af8395bfe048a6b6c9fac060b98a4d, user_id=06333292bb3e459ca52949843119e4b5, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:50.878607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:50.919979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:50.920419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:50.920700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:50.930509 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1414/2832] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:50 2022] PUT /identity/v3/projects/71af8395bfe048a6b6c9fac060b98a4d/users/06333292bb3e459ca52949843119e4b5/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:51.000606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] MFA Rules not processed for user `06333292bb3e459ca52949843119e4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:51.003519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:51.183008 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1419/2833] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:09:51.187649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:51.201792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:51.211667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:51.248857 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:51.347793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4000216-0099-4dae-abd3-1086ee4ca54d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:51.355284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:51.355981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:51.356409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:51.356752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:51.357942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:51.360995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:51.406669 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1415/2834] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:09:51 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:09:51.412258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:51.451070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee514b-2836-4a03-a7d3-e0ffb6ffe440 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:51.608218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886519-8ac6-4e84-a672-b71cd11537af admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:51.639653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:51.640775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:51.642860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:51.643442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:51.648574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:51.651987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:51.672309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:51.678347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:51.680150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:51.680451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:51.690041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:51.739725 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1416/2835] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:09:51 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:09:51.743471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:51.814548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc5aa-1e2e-4945-bd43-82de099504a0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:51.824211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:51.825363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:51.825898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:51.826432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:51.827323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:51.833086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:51.860140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1417/2836] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:51.863915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:51.878816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915de51f-7771-4c93-baa0-a25682ce359a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:51.886739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:51.887804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:51.888394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:51.888899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] PATH_INFO: `/v3/projects/d8fa500aae8149b59e37946d0fbbcc28/users/c2fc43659e084cefa74714e1d0525621/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:51.939020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fa500aae8149b59e37946d0fbbcc28, user_id=c2fc43659e084cefa74714e1d0525621, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:51.942718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:51.945048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:51.947564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:51.973021 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1420/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:51 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:09:51.987437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1418/2838] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:51 2022] PUT /identity/v3/projects/d8fa500aae8149b59e37946d0fbbcc28/users/c2fc43659e084cefa74714e1d0525621/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:09:51.990600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:52.032208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58974-e05c-4c32-963f-ac730d5fb756 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:52.195397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f2dda-7820-4dfb-b4fa-b01059e1a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:52.198199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f2dda-7820-4dfb-b4fa-b01059e1a218 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:52.198869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f2dda-7820-4dfb-b4fa-b01059e1a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:52.199620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f2dda-7820-4dfb-b4fa-b01059e1a218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:52.202416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f2dda-7820-4dfb-b4fa-b01059e1a218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:52.204115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f2dda-7820-4dfb-b4fa-b01059e1a218 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:52.250436 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1421/2839] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:09:52.255963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:52.277933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4ff61-2cd3-47b5-84df-e6c7d4c121f1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:52.295707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ad9e8-bb64-4f9c-a67e-5c722d4a1736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:52.297180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad9e8-bb64-4f9c-a67e-5c722d4a1736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:52.298199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad9e8-bb64-4f9c-a67e-5c722d4a1736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:52.300995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad9e8-bb64-4f9c-a67e-5c722d4a1736 admin admin] PATH_INFO: `/v3/projects/d8fa500aae8149b59e37946d0fbbcc28/users/c2fc43659e084cefa74714e1d0525621/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:52.307560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ad9e8-bb64-4f9c-a67e-5c722d4a1736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fa500aae8149b59e37946d0fbbcc28, user_id=c2fc43659e084cefa74714e1d0525621, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:52.320012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ad9e8-bb64-4f9c-a67e-5c722d4a1736 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:52.326956 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:52.354364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1419/2840] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:09:52 2022] PUT /identity/v3/projects/d8fa500aae8149b59e37946d0fbbcc28/users/c2fc43659e084cefa74714e1d0525621/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:09:52.366307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:52.367012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:52.367256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:52.424049 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:09:52.450105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] MFA Rules not processed for user `c2fc43659e084cefa74714e1d0525621`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:52.451862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:52.605230 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1422/2841] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:09:52.605883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719ab81-57f5-46ca-8bd8-3c4956b7fbf8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:52.606175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719ab81-57f5-46ca-8bd8-3c4956b7fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:52.610586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719ab81-57f5-46ca-8bd8-3c4956b7fbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:52.654308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b719ab81-57f5-46ca-8bd8-3c4956b7fbf8 None None] MFA Rules not processed for user `06333292bb3e459ca52949843119e4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:09:52.655547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b719ab81-57f5-46ca-8bd8-3c4956b7fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:52.782843 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1420/2842] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:09:52.800070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:09:52.801905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:09:53.016952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad16f19-66ed-4c93-8dd3-9487e097c5c5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:09:53.044566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:09:53.045225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:09:53.045514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:09:53.045793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:09:53.069728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:09:53.071509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:09:53.084365 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1423/2843] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:02.769174 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=1,keystone:SELECT=27 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:03.078263 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=64 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:03.200276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:03.202198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:03.203021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:03.255264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:03.256697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:03.396079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1421/2844] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:03.454257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:03.456315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:03.710772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650bdf6-acd1-4fbc-8604-518938ec1928 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:03.726379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706f391-0691-42e2-b28b-9edd6342adfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:03.729168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f391-0691-42e2-b28b-9edd6342adfe service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:03.729744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f391-0691-42e2-b28b-9edd6342adfe service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:03.730083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f391-0691-42e2-b28b-9edd6342adfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:03.753882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706f391-0691-42e2-b28b-9edd6342adfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:03.756001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706f391-0691-42e2-b28b-9edd6342adfe service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:03.781753 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1424/2845] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:10:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:10:04.499644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:04.501835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:04.535480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a8934-928c-4fb2-951f-bdbe2584d970 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:04.552461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:04.553407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:04.554004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:04.554434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:04.556432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:04.649633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:04.652937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:04.669224 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1422/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:08.072904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567466-c7e5-495f-bb63-f8c785dae281 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:08.073892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567466-c7e5-495f-bb63-f8c785dae281 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:08.074358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567466-c7e5-495f-bb63-f8c785dae281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:08.100429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4b567466-c7e5-495f-bb63-f8c785dae281 None None] MFA Rules not processed for user `fb2fa7cdc77043e2b9295424759e9863`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:08.101774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b567466-c7e5-495f-bb63-f8c785dae281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:08.191865 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1425/2847] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:13.265220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:13.266613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:13.417744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af211f-e7de-4cd3-9407-47f21059b8f9 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:13.437119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:13.440148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:13.440441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:13.440722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] PATH_INFO: `/v3/users/beddfd95d1fa440ea27b87fee9f3fd7e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:13.443572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beddfd95d1fa440ea27b87fee9f3fd7e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:13.451257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:13.537605 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:13.548378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beddfd95d1fa440ea27b87fee9f3fd7e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:13.549838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beddfd95d1fa440ea27b87fee9f3fd7e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:13.551313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beddfd95d1fa440ea27b87fee9f3fd7e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:13.581040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beddfd95d1fa440ea27b87fee9f3fd7e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:13.599057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beddfd95d1fa440ea27b87fee9f3fd7e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:13.628172 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1423/2848] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:13 2022] DELETE /identity/v3/users/beddfd95d1fa440ea27b87fee9f3fd7e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:13.632643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:13.633298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:13.633582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:13.672450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:13.674220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:13.802190 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1426/2849] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:13.819356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:13.824194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:14.029595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3733db0-fd52-4118-bf61-0a76a5ce7497 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:14.069557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:14.072700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:14.072977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:14.078538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:14.114723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:14.123235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:14.187413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1424/2850] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:14.977705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:14.980036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:15.007708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50fa0b-9bad-46b1-8fa8-1633ae6efcd4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:15.015883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:15.016740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:15.017886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:15.018332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] PATH_INFO: `/v3/projects/edd6777d258e41a6ad83018cb11b2aab` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:15.020140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd6777d258e41a6ad83018cb11b2aab)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:15.022618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:15.154282 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:15.274334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd6777d258e41a6ad83018cb11b2aab', 'request_id': 'req-d26c06e2-5255-4a65-8416-9b71f6e3bd49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.309197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd6777d258e41a6ad83018cb11b2aab', 'request_id': 'req-d26c06e2-5255-4a65-8416-9b71f6e3bd49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.353910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd6777d258e41a6ad83018cb11b2aab', 'request_id': 'req-d26c06e2-5255-4a65-8416-9b71f6e3bd49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.382263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] The token cache is being invalidate because project edd6777d258e41a6ad83018cb11b2aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:15.382974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.383916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.387572 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1427/2851] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:14 2022] DELETE /identity/v3/projects/edd6777d258e41a6ad83018cb11b2aab => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:15.391480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:15.410869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f063a-f61d-4ca4-a17c-02a1b7debcc0 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:15.565509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:15.566155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:15.566430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:15.566699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] PATH_INFO: `/v3/users/8c2a8069a4ff4372bbeae0349084f93e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:15.568683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2a8069a4ff4372bbeae0349084f93e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:15.571666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:15.709113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2a8069a4ff4372bbeae0349084f93e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.710468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2a8069a4ff4372bbeae0349084f93e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.711536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2a8069a4ff4372bbeae0349084f93e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.742027 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:15.745957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2a8069a4ff4372bbeae0349084f93e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.773838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5ee2c5a-61dd-4401-8e57-4bb6ca49037b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2a8069a4ff4372bbeae0349084f93e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:15.811784 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1425/2852] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:15 2022] DELETE /identity/v3/users/8c2a8069a4ff4372bbeae0349084f93e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:16.819804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:16.822785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:16.841357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c06e2-5255-4a65-8416-9b71f6e3bd49 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:16.957169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:16.957829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:16.964333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:16.964333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] PATH_INFO: `/v3/projects/93529e9e67414b93846a08b604d107ce` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:16.964333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93529e9e67414b93846a08b604d107ce)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:16.966290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:17.061651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93529e9e67414b93846a08b604d107ce', 'request_id': 'req-71f5bf43-7b1e-4397-86b6-c9076cceb14f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:17.073903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93529e9e67414b93846a08b604d107ce', 'request_id': 'req-71f5bf43-7b1e-4397-86b6-c9076cceb14f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:17.087506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93529e9e67414b93846a08b604d107ce', 'request_id': 'req-71f5bf43-7b1e-4397-86b6-c9076cceb14f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:17.106521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] The token cache is being invalidate because project 93529e9e67414b93846a08b604d107ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:17.106866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:17.107663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-71f5bf43-7b1e-4397-86b6-c9076cceb14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:17.111746 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1428/2853] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:16 2022] DELETE /identity/v3/projects/93529e9e67414b93846a08b604d107ce => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:17.116765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258d3c-fde8-49b0-b988-154a1476caa6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:17.117272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258d3c-fde8-49b0-b988-154a1476caa6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:17.117608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258d3c-fde8-49b0-b988-154a1476caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:17.177979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-87258d3c-fde8-49b0-b988-154a1476caa6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:17.182258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-87258d3c-fde8-49b0-b988-154a1476caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:17.336735 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1426/2854] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:17.347206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11aa68-c43f-4882-ae4e-9381d71279cf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:17.347206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11aa68-c43f-4882-ae4e-9381d71279cf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:17.347206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11aa68-c43f-4882-ae4e-9381d71279cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:17.391406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4a11aa68-c43f-4882-ae4e-9381d71279cf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:17.394145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4a11aa68-c43f-4882-ae4e-9381d71279cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:17.413374 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1429/2855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:17.414656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87258d3c-fde8-49b0-b988-154a1476caa6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:17.431913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87258d3c-fde8-49b0-b988-154a1476caa6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:17.437302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:17.438209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:17.438753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:17.439025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:17.439892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:17.440417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:17.442276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:17.481306 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1427/2856] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:17.486561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11aa68-c43f-4882-ae4e-9381d71279cf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:17.502870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11aa68-c43f-4882-ae4e-9381d71279cf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:17.528487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811f21e-ab06-48f6-af72-d1c162bb441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:17.537289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f21e-ab06-48f6-af72-d1c162bb441d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:17.537612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f21e-ab06-48f6-af72-d1c162bb441d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:17.537796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f21e-ab06-48f6-af72-d1c162bb441d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:17.538494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811f21e-ab06-48f6-af72-d1c162bb441d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:17.546293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811f21e-ab06-48f6-af72-d1c162bb441d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:17.693696 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1430/2857] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:17 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:17.698120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:17.732462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed91034-3353-4309-b66b-390cb7c7bf72 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:17.895420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2179-7410-4870-9aec-d5e3a43e0483 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:17.895921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2179-7410-4870-9aec-d5e3a43e0483 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:17.896022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2179-7410-4870-9aec-d5e3a43e0483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:17.913434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:17.914051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:17.914331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:17.914605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:17.915802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:17.918074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:17.925972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-62db2179-7410-4870-9aec-d5e3a43e0483 None None] MFA Rules not processed for user `559b3d4a02af42bd98dacd08b9e45a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:17.927769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-62db2179-7410-4870-9aec-d5e3a43e0483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:17.950396 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:17.950642 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1428/2858] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:17 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:17.956505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:17.968399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e0c6-4acf-4c83-a854-1d1a259a75f8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:17.974424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:17.975024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:17.975571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:17.975852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:17.977115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:17.978936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:17.995089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1429/2859] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:17.997535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.013221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ee9df-d61e-497d-86e2-cb3621617560 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.019576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.020502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.021055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.021539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.022960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.029111 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1431/2860] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:10:18.029891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.035797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79671718-2833-4637-9842-a3c01dc7e27f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.036598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79671718-2833-4637-9842-a3c01dc7e27f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.037226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79671718-2833-4637-9842-a3c01dc7e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.045308 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1430/2861] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:18.048970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.064538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b2b1e-16ad-4b4f-9ae9-386685fe27ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.066891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79671718-2833-4637-9842-a3c01dc7e27f None None] MFA Rules not processed for user `559b3d4a02af42bd98dacd08b9e45a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:18.068413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79671718-2833-4637-9842-a3c01dc7e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:18.070805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.071680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.071977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.072568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] PATH_INFO: `/v3/projects/82ab48bdc2ac4512b3da3d5b159d3747/users/49748f6cc6dd43d9b23e3b4949280973/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.079807 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1432/2862] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:18.092888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ab48bdc2ac4512b3da3d5b159d3747, user_id=49748f6cc6dd43d9b23e3b4949280973, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.097246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.117405 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1431/2863] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:18 2022] PUT /identity/v3/projects/82ab48bdc2ac4512b3da3d5b159d3747/users/49748f6cc6dd43d9b23e3b4949280973/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:18.129102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6012-b7d0-4310-a14f-5d9a00865e28 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.129775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6012-b7d0-4310-a14f-5d9a00865e28 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.130219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6012-b7d0-4310-a14f-5d9a00865e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.183096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-037d6012-b7d0-4310-a14f-5d9a00865e28 None None] MFA Rules not processed for user `49748f6cc6dd43d9b23e3b4949280973`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:18.184566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-037d6012-b7d0-4310-a14f-5d9a00865e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:18.279291 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1433/2864] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:18.279855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.312760 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:18.388915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc2ed6-3edc-4e95-b76f-1a68d0552189 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.393919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.394871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.395418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.395882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.396679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.400666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.441726 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1432/2865] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:18 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:10:18.445933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d6012-b7d0-4310-a14f-5d9a00865e28 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.460097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d6012-b7d0-4310-a14f-5d9a00865e28 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.548505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.549716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.550012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.550289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.551010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.553420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.596118 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1434/2866] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:18 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:18.597697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.615131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a514e-70f3-4fec-b908-80229e99a298 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.628241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.628772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.629046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.629365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.630021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.631616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.646176 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1433/2867] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:18.650121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.663796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50968-6411-4a5c-b539-473c6ad2a900 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.674783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.675865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.675865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.676094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] PATH_INFO: `/v3/projects/e8e6c71f66304f33948c90a273c783a6/users/895b0415cf774df2bf6ffa44f050a8a8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.697866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e6c71f66304f33948c90a273c783a6, user_id=895b0415cf774df2bf6ffa44f050a8a8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.700725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.722864 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1435/2868] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:18 2022] PUT /identity/v3/projects/e8e6c71f66304f33948c90a273c783a6/users/895b0415cf774df2bf6ffa44f050a8a8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:18.726618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.740773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c2330-c2cd-4583-affd-9e56a4f0eea1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.819276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986e49-8d3f-460b-ac10-4ec28270f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.822738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986e49-8d3f-460b-ac10-4ec28270f16b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.822738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986e49-8d3f-460b-ac10-4ec28270f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.822979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986e49-8d3f-460b-ac10-4ec28270f16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.824567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986e49-8d3f-460b-ac10-4ec28270f16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.826236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986e49-8d3f-460b-ac10-4ec28270f16b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.849366 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1434/2869] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:10:18.853644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:18.874820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7ce0-f5c3-4b9e-a997-eed9be925d73 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:18.884590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:18.885359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.885643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.885914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] PATH_INFO: `/v3/projects/e8e6c71f66304f33948c90a273c783a6/users/895b0415cf774df2bf6ffa44f050a8a8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:18.897892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e6c71f66304f33948c90a273c783a6, user_id=895b0415cf774df2bf6ffa44f050a8a8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:18.902150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:18.922002 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:18.933532 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1436/2870] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:18 2022] PUT /identity/v3/projects/e8e6c71f66304f33948c90a273c783a6/users/895b0415cf774df2bf6ffa44f050a8a8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:18.950122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32279b-23b4-4ebd-a71e-bdb79d101dda None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:18.950428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32279b-23b4-4ebd-a71e-bdb79d101dda None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:18.951985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32279b-23b4-4ebd-a71e-bdb79d101dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:19.037142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8f32279b-23b4-4ebd-a71e-bdb79d101dda None None] MFA Rules not processed for user `895b0415cf774df2bf6ffa44f050a8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:19.040831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8f32279b-23b4-4ebd-a71e-bdb79d101dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:19.198954 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1435/2871] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:19.212733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:19.214999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:19.404434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fbfe1-1c13-4f83-a0ca-5177f769f776 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:19.418388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e49bf-8daa-42e4-994b-514ba1847494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:19.419446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e49bf-8daa-42e4-994b-514ba1847494 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:19.419751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e49bf-8daa-42e4-994b-514ba1847494 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:19.420024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e49bf-8daa-42e4-994b-514ba1847494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:19.437896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e49bf-8daa-42e4-994b-514ba1847494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:19.443591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e49bf-8daa-42e4-994b-514ba1847494 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:19.458520 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1437/2872] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:19.712953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32279b-23b4-4ebd-a71e-bdb79d101dda None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:19.734583 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:19.891633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32279b-23b4-4ebd-a71e-bdb79d101dda None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:19.908017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:19.908842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:19.909189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:19.909508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] PATH_INFO: `/v3/users/49748f6cc6dd43d9b23e3b4949280973` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:19.914026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49748f6cc6dd43d9b23e3b4949280973)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:19.919536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:20.031986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49748f6cc6dd43d9b23e3b4949280973'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:20.033219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49748f6cc6dd43d9b23e3b4949280973'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:20.035862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49748f6cc6dd43d9b23e3b4949280973'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:20.064565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49748f6cc6dd43d9b23e3b4949280973'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:20.075033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49748f6cc6dd43d9b23e3b4949280973'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:20.093228 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1436/2873] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:19 2022] DELETE /identity/v3/users/49748f6cc6dd43d9b23e3b4949280973 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:20.097507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:20.098031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:20.098031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:20.152572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:20.154087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:20.258558 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1438/2874] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:20.269833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:20.271864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:20.391560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458107de-8f17-4238-8dad-8ee9855123c3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:20.404406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:20.407303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:20.407659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:20.408567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:20.439816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:20.442799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:20.469297 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1437/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:21.436670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:21.438323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:21.452202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeef090-c228-4a97-93d2-d3b62c477d70 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:21.458182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:21.459088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:21.459613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:21.460321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] PATH_INFO: `/v3/projects/82ab48bdc2ac4512b3da3d5b159d3747` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:21.461600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ab48bdc2ac4512b3da3d5b159d3747)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:21.464705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:21.530516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ab48bdc2ac4512b3da3d5b159d3747', 'request_id': 'req-87618e8d-692c-4f66-86df-57b20275d2b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.541644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ab48bdc2ac4512b3da3d5b159d3747', 'request_id': 'req-87618e8d-692c-4f66-86df-57b20275d2b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.551315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ab48bdc2ac4512b3da3d5b159d3747', 'request_id': 'req-87618e8d-692c-4f66-86df-57b20275d2b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.564489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] The token cache is being invalidate because project 82ab48bdc2ac4512b3da3d5b159d3747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:21.564761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.565480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.567029 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1439/2876] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:21 2022] DELETE /identity/v3/projects/82ab48bdc2ac4512b3da3d5b159d3747 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:21.571959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:21.582770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98934-450a-4c15-a398-26196239d636 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:21.614832 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:21.660872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:21.661550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:21.662398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:21.662679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] PATH_INFO: `/v3/users/895b0415cf774df2bf6ffa44f050a8a8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:21.664336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895b0415cf774df2bf6ffa44f050a8a8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:21.666347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:21.728436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895b0415cf774df2bf6ffa44f050a8a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.729673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895b0415cf774df2bf6ffa44f050a8a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.730804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895b0415cf774df2bf6ffa44f050a8a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.744991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895b0415cf774df2bf6ffa44f050a8a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.752555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d54e09e-2b73-4be9-a4c2-d4bbb4c94755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895b0415cf774df2bf6ffa44f050a8a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:21.769840 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1438/2877] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:21 2022] DELETE /identity/v3/users/895b0415cf774df2bf6ffa44f050a8a8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:22.180576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:22.183054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:22.203180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618e8d-692c-4f66-86df-57b20275d2b1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:22.218817 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:22.316528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:22.317413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:22.317816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:22.319044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] PATH_INFO: `/v3/projects/e8e6c71f66304f33948c90a273c783a6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:22.321795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e6c71f66304f33948c90a273c783a6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:22.325902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:22.489997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e6c71f66304f33948c90a273c783a6', 'request_id': 'req-c04f251e-0c93-49e1-81fd-b9c3afa3c025'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:22.501253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e6c71f66304f33948c90a273c783a6', 'request_id': 'req-c04f251e-0c93-49e1-81fd-b9c3afa3c025'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:22.528564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e6c71f66304f33948c90a273c783a6', 'request_id': 'req-c04f251e-0c93-49e1-81fd-b9c3afa3c025'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:22.565325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] The token cache is being invalidate because project e8e6c71f66304f33948c90a273c783a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:22.565844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:22.568729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c04f251e-0c93-49e1-81fd-b9c3afa3c025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:22.570893 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1440/2878] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:22 2022] DELETE /identity/v3/projects/e8e6c71f66304f33948c90a273c783a6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:22.576307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a432499-5151-4364-a6c0-289d6b4f0e55 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:22.576779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a432499-5151-4364-a6c0-289d6b4f0e55 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:22.576870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a432499-5151-4364-a6c0-289d6b4f0e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:22.604435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3a432499-5151-4364-a6c0-289d6b4f0e55 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:22.605748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3a432499-5151-4364-a6c0-289d6b4f0e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:22.755552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1439/2879] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:22.765855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:22.766458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:22.767062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:22.801418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:22.803896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:22.834397 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1441/2880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:22.835666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a432499-5151-4364-a6c0-289d6b4f0e55 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:22.863397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a432499-5151-4364-a6c0-289d6b4f0e55 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:22.882479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:22.883112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:22.885297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:22.885584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:22.886391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:22.886700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:22.894090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:22.919450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:22.921457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:22.939794 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1440/2881] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:22.943200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:22.967905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1c206-674a-494e-9536-b69bb1190a6d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:22.984833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:22.985724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:22.986089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:22.986613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:22.987857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:22.991776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:23.070155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b42e79-f1bf-418f-b5b3-61697b622bdd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:23.079143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:23.081955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:23.082309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:23.082661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:23.087921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:23.089389 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1441/2882] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:22 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:23.090793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:23.113261 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:23.203098 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:23.236715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f1577-9cb2-43ed-a14d-deb0c483a307 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:23.248066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:23.248691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:23.248967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:23.249390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:23.251540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:23.254790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:23.255736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:23.258057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:23.288557 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1442/2883] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:23.298923 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1442/2884] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:23 2022] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:23.305448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:23.344691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ab2e-9827-4787-86b4-f25dd7c9d6e1 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:23.359650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:23.360525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:23.361019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:23.361523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:23.362396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:23.364269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:23.398881 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1443/2885] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:23.403289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:23.424118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e9e79-bd29-4a80-aeb5-2f996d52f6cf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:23.424118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c83ec-64f8-434b-b19b-08674f9afd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:23.425105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c83ec-64f8-434b-b19b-08674f9afd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:23.425457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c83ec-64f8-434b-b19b-08674f9afd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:23.425676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c83ec-64f8-434b-b19b-08674f9afd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:23.438201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c83ec-64f8-434b-b19b-08674f9afd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:23.454353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c83ec-64f8-434b-b19b-08674f9afd4d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:23.475932 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1443/2886] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:10:23.482142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:23.508269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e54cf-53b9-4f03-b2e4-c03bc330fcc8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:23.521473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:23.522573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:23.523089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:23.523590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] PATH_INFO: `/v3/projects/e1f624503e96480fb81d53b2b6089307/users/78595241de7f4f2bbad5242bc0dd4408/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:23.584473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f624503e96480fb81d53b2b6089307, user_id=78595241de7f4f2bbad5242bc0dd4408, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:23.587910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:23.618795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1444/2887] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:23 2022] PUT /identity/v3/projects/e1f624503e96480fb81d53b2b6089307/users/78595241de7f4f2bbad5242bc0dd4408/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:23.629635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bebead-45a3-403b-a3a9-b38f912e2b99 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:23.630135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bebead-45a3-403b-a3a9-b38f912e2b99 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:23.630225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bebead-45a3-403b-a3a9-b38f912e2b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:23.684036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-59bebead-45a3-403b-a3a9-b38f912e2b99 None None] MFA Rules not processed for user `78595241de7f4f2bbad5242bc0dd4408`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:23.685624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59bebead-45a3-403b-a3a9-b38f912e2b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:23.777840 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1444/2888] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:23.783267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:23.887070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d64b85-29a0-4cc0-bb53-032a840a2507 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:23.906877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:23.906998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:23.907328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:23.907533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:23.908177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:23.911215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:23.992006 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1445/2889] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:23 2022] POST /identity/v3/projects => generated 401 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:24.013045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bebead-45a3-403b-a3a9-b38f912e2b99 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:24.034308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bebead-45a3-403b-a3a9-b38f912e2b99 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:24.214423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:24.214978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:24.215315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:24.215660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:24.216253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:24.230682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:24.259054 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1445/2890] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:24 2022] POST /identity/v3/users => generated 307 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:24.263193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:24.273690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd881fc4-8599-41f4-a100-2d00629f9a06 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:24.279625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:24.280234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:24.280513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:24.280781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:24.281488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:24.283081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:24.296902 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1446/2891] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:24.301201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:24.313321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e71d9-2241-4e4b-b01a-5dce3d877128 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:24.329286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:24.330555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:24.330870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:24.331236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] PATH_INFO: `/v3/projects/615578fe421f4d4cadacc93e0a068785/users/a3aeb20594c9456898a89973a1f67cd3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:24.342319 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:24.353169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615578fe421f4d4cadacc93e0a068785, user_id=a3aeb20594c9456898a89973a1f67cd3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:24.355546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:24.373028 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1446/2892] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:24 2022] PUT /identity/v3/projects/615578fe421f4d4cadacc93e0a068785/users/a3aeb20594c9456898a89973a1f67cd3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:24.377278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:24.394985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27954e9f-c2f1-418e-9882-1c716ab20390 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:24.471126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04513c66-1725-46b8-b08a-795ad5760c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:24.471778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513c66-1725-46b8-b08a-795ad5760c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:24.472058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513c66-1725-46b8-b08a-795ad5760c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:24.472322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513c66-1725-46b8-b08a-795ad5760c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:24.473373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04513c66-1725-46b8-b08a-795ad5760c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:24.475235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04513c66-1725-46b8-b08a-795ad5760c9b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:24.487434 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1447/2893] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:10:24.491758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:24.508041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c4cb-a1eb-4c15-9db2-493d0d67e610 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:24.520286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:24.521110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:24.521395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:24.521673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] PATH_INFO: `/v3/projects/615578fe421f4d4cadacc93e0a068785/users/a3aeb20594c9456898a89973a1f67cd3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:24.525231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615578fe421f4d4cadacc93e0a068785, user_id=a3aeb20594c9456898a89973a1f67cd3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:24.533423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:24.562693 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1447/2894] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:24 2022] PUT /identity/v3/projects/615578fe421f4d4cadacc93e0a068785/users/a3aeb20594c9456898a89973a1f67cd3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:24.572904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:24.573482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:24.573482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:24.601740 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:24.614530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] MFA Rules not processed for user `a3aeb20594c9456898a89973a1f67cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:24.616916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:24.749553 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1448/2895] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:24.763821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:24.765785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:24.925222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94ed84-cb1f-4991-875c-9eef4b22eaa9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:24.935310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:24.936148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:24.936528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:24.936916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:24.946471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:24.948324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:24.960171 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1448/2896] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:25.955475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:25.957176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:25.985511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15087ac-4b36-46d9-8774-10576e78c383 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:26.002740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078df8c8-7390-4ebc-8b8d-6ced19fb6387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:26.003371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df8c8-7390-4ebc-8b8d-6ced19fb6387 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:26.003670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df8c8-7390-4ebc-8b8d-6ced19fb6387 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:26.004325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df8c8-7390-4ebc-8b8d-6ced19fb6387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:26.142553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078df8c8-7390-4ebc-8b8d-6ced19fb6387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:26.144601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078df8c8-7390-4ebc-8b8d-6ced19fb6387 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:26.159596 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1449/2897] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:25 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:26.204204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:26.422577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665d1e2-936e-4560-870d-a5cbff236694 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:26.438814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:26.439744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:26.440259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:26.440772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] PATH_INFO: `/v3/users/78595241de7f4f2bbad5242bc0dd4408` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:26.445827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78595241de7f4f2bbad5242bc0dd4408)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:26.448317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:26.576232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78595241de7f4f2bbad5242bc0dd4408'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:26.577050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78595241de7f4f2bbad5242bc0dd4408'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:26.577796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78595241de7f4f2bbad5242bc0dd4408'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:26.605263 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:26.608476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78595241de7f4f2bbad5242bc0dd4408'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:26.623598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78595241de7f4f2bbad5242bc0dd4408'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:26.660087 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1449/2898] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:26 2022] DELETE /identity/v3/users/78595241de7f4f2bbad5242bc0dd4408 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:26.661907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:26.662308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:26.662685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:26.726173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:26.736544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:26.905341 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1450/2899] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:27.318886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:27.321460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:27.442295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf7490-67b9-43e1-9686-2b2246f00570 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:27.452907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:27.454668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:27.455261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:27.455711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:27.469609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:27.470200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:27.489109 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1450/2900] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:28.733491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:28.736011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:28.752942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507538b-072b-4e56-b305-2703d8620c3c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:28.759770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:28.761127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:28.761999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:28.763000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] PATH_INFO: `/v3/users/51d78a7c9f864115ac02046fa5d313eb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:28.765249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d78a7c9f864115ac02046fa5d313eb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:28.768221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:28.798963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:28.800409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:28.819020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f15117-39fc-45bc-968b-15139690d8e6 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:28.822810 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:28.832347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:28.833331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:28.833796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:28.834381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] PATH_INFO: `/v3/projects/e1f624503e96480fb81d53b2b6089307` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:28.837884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f624503e96480fb81d53b2b6089307)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:28.841337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:28.877833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d78a7c9f864115ac02046fa5d313eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.880141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d78a7c9f864115ac02046fa5d313eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.882076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d78a7c9f864115ac02046fa5d313eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.902362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d78a7c9f864115ac02046fa5d313eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.912521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f624503e96480fb81d53b2b6089307', 'request_id': 'req-9e6de102-8c72-4d07-b7aa-cd257b4b7982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.921769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f624503e96480fb81d53b2b6089307', 'request_id': 'req-9e6de102-8c72-4d07-b7aa-cd257b4b7982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.933179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f624503e96480fb81d53b2b6089307', 'request_id': 'req-9e6de102-8c72-4d07-b7aa-cd257b4b7982'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.940386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ca9ff79f-dcf3-4d06-bdeb-a5685e1a90e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d78a7c9f864115ac02046fa5d313eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.960069 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1451/2901] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:28 2022] DELETE /identity/v3/users/51d78a7c9f864115ac02046fa5d313eb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:28.960609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] The token cache is being invalidate because project e1f624503e96480fb81d53b2b6089307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:28.960923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.963535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:28.964696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:28.964974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:28.965407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:28.967326 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1451/2902] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:28 2022] DELETE /identity/v3/projects/e1f624503e96480fb81d53b2b6089307 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:28.971297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:28.973843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:29.026369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:29.027592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:29.110428 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1452/2903] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:29.121440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:29.123065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:29.127817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6de102-8c72-4d07-b7aa-cd257b4b7982 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:29.140129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:29.143181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:29.143535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:29.143897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] PATH_INFO: `/v3/users/a3aeb20594c9456898a89973a1f67cd3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:29.146265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3aeb20594c9456898a89973a1f67cd3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:29.150821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:29.165484 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:29.225573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015e934-47a4-4dc4-9f85-a53fa257ea2c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:29.232316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:29.233308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:29.233909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:29.234553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:29.243873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3aeb20594c9456898a89973a1f67cd3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:29.244628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3aeb20594c9456898a89973a1f67cd3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:29.245987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3aeb20594c9456898a89973a1f67cd3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:29.249200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:29.251669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:29.261464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3aeb20594c9456898a89973a1f67cd3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:29.268029 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1453/2904] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:10:29.278644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3aeb20594c9456898a89973a1f67cd3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:29.305328 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1452/2905] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:28 2022] DELETE /identity/v3/users/a3aeb20594c9456898a89973a1f67cd3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:29.825178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:29.826740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:29.851647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cf08a-7d2a-40be-9e8c-25fbf50ac2ef service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:29.952445 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:29.989403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:29.990516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:29.990902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:29.991677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] PATH_INFO: `/v3/projects/2c2eb5c0d4ea4c029a753a6e42a139e7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:29.994172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2eb5c0d4ea4c029a753a6e42a139e7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:29.996425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:30.085142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2eb5c0d4ea4c029a753a6e42a139e7', 'request_id': 'req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.101351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2eb5c0d4ea4c029a753a6e42a139e7', 'request_id': 'req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.122771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2eb5c0d4ea4c029a753a6e42a139e7', 'request_id': 'req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.147668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] The token cache is being invalidate because project 2c2eb5c0d4ea4c029a753a6e42a139e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:30.147968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.148981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.156130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1454/2906] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:29 2022] DELETE /identity/v3/projects/2c2eb5c0d4ea4c029a753a6e42a139e7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:30.157077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:30.157539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:30.158630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:30.158754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:30.199266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e4f2-5972-47da-9d17-1b76e8160bf3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:30.294201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827b53-4cbd-4c4c-b1e7-41c76f47a43b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:30.300200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:30.301027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:30.301187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:30.301681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] PATH_INFO: `/v3/projects/615578fe421f4d4cadacc93e0a068785` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:30.303145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=615578fe421f4d4cadacc93e0a068785)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:30.305265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:30.363895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:30.364547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:30.364822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:30.365179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] PATH_INFO: `/v3/users/8958142504364d99acd792cc8c4472e5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:30.366514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8958142504364d99acd792cc8c4472e5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:30.370302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:30.437466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615578fe421f4d4cadacc93e0a068785', 'request_id': 'req-84a1dea8-8e9b-453a-8569-c74ca56cbb49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.441478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8958142504364d99acd792cc8c4472e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.442295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8958142504364d99acd792cc8c4472e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.442961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8958142504364d99acd792cc8c4472e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.445177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615578fe421f4d4cadacc93e0a068785', 'request_id': 'req-84a1dea8-8e9b-453a-8569-c74ca56cbb49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.460393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615578fe421f4d4cadacc93e0a068785', 'request_id': 'req-84a1dea8-8e9b-453a-8569-c74ca56cbb49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.465238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8958142504364d99acd792cc8c4472e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.477727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fee5f8ba-3653-4bd1-9f6b-8a114c5e4122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8958142504364d99acd792cc8c4472e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.484165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] The token cache is being invalidate because project 615578fe421f4d4cadacc93e0a068785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:30.485246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.487364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-84a1dea8-8e9b-453a-8569-c74ca56cbb49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:30.493743 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1455/2907] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:30 2022] DELETE /identity/v3/projects/615578fe421f4d4cadacc93e0a068785 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:30.499309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff036-f256-43c0-9f32-fc3044a452eb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:30.499594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff036-f256-43c0-9f32-fc3044a452eb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:30.499869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff036-f256-43c0-9f32-fc3044a452eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:30.503264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1453/2908] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:30 2022] DELETE /identity/v3/users/8958142504364d99acd792cc8c4472e5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:30.547069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-885ff036-f256-43c0-9f32-fc3044a452eb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:30.548441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-885ff036-f256-43c0-9f32-fc3044a452eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:30.553888 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:30.654387 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1456/2909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:10:30.656496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5618-8e28-4316-b4b1-1a80bc001832 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:30.656783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5618-8e28-4316-b4b1-1a80bc001832 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:30.657091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5618-8e28-4316-b4b1-1a80bc001832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:30.671234 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:30.707899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-34af5618-8e28-4316-b4b1-1a80bc001832 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:30.712337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-34af5618-8e28-4316-b4b1-1a80bc001832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:30.736822 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1454/2910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:30.739866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff036-f256-43c0-9f32-fc3044a452eb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:30.759854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff036-f256-43c0-9f32-fc3044a452eb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:30.772024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:30.772656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:30.772930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:30.773253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:30.773876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:30.774257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:30.776573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:30.815561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1457/2911] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:30.817113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5618-8e28-4316-b4b1-1a80bc001832 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:30.849743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5618-8e28-4316-b4b1-1a80bc001832 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:30.867502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:30.869678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:30.872430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:30.874489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:30.874835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:30.877214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:30.877965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:30.882394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:30.893505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b681a0-4ddb-40c1-b372-2351a5afbbd7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:30.908543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:30.909351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:30.909624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:30.909891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] PATH_INFO: `/v3/projects/96fb7dda97704bdfa9a35532ffe5594c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:30.916632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fb7dda97704bdfa9a35532ffe5594c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:30.919271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:30.936014 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1455/2912] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:30 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:30.940371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.048461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fb7dda97704bdfa9a35532ffe5594c', 'request_id': 'req-87c0d8ad-04d9-4a87-bd04-6c149783c595'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:31.061691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fb7dda97704bdfa9a35532ffe5594c', 'request_id': 'req-87c0d8ad-04d9-4a87-bd04-6c149783c595'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:31.061875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203470-0c98-41d1-bd43-6e3253426a06 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.077398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fb7dda97704bdfa9a35532ffe5594c', 'request_id': 'req-87c0d8ad-04d9-4a87-bd04-6c149783c595'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:31.107164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] The token cache is being invalidate because project 96fb7dda97704bdfa9a35532ffe5594c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:31.107605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:31.110300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-87c0d8ad-04d9-4a87-bd04-6c149783c595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:31.117129 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1458/2913] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:30 2022] DELETE /identity/v3/projects/96fb7dda97704bdfa9a35532ffe5594c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:31.119117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1279b-4d7b-4584-bf56-e411b0adfdd8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.119467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1279b-4d7b-4584-bf56-e411b0adfdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.119808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1279b-4d7b-4584-bf56-e411b0adfdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.167069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e7e1279b-4d7b-4584-bf56-e411b0adfdd8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:31.172981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7e1279b-4d7b-4584-bf56-e411b0adfdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:31.185001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.186938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.189405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.191320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.197603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.199897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.213362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1459/2914] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:31.216156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f86ec-1689-4f0f-a427-5c0a309988e3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.216664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f86ec-1689-4f0f-a427-5c0a309988e3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.217007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f86ec-1689-4f0f-a427-5c0a309988e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.237669 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1456/2915] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:30 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:31.241662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.245307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:31.259294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-991f86ec-1689-4f0f-a427-5c0a309988e3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:31.261378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-991f86ec-1689-4f0f-a427-5c0a309988e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:31.265407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e764e-ba46-4b7e-bab6-51b2aecaeaac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.273195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.274457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.275579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.276106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.276969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.283144 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1460/2916] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:10:31.283975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.284363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f86ec-1689-4f0f-a427-5c0a309988e3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.307680 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1457/2917] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:31.309285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f86ec-1689-4f0f-a427-5c0a309988e3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.311603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.322483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.323496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.323842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.324179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.324930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:31.325356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.332375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.339895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f153a-0838-45d1-a8f0-ea24bacba92a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.353919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.354547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.354822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.355157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.355729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.357348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.361835 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1461/2918] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:31.365938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.386102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bbeca-affa-4b0d-be52-2cc2d92bcbc8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.386470 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1458/2919] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:31.387369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.400441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.401121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.401408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.401719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.402409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.404570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.410657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d181b-e0d4-4b97-be71-6aab88bf5acb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.423246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2da5-7ed4-44dc-af7f-aeb912c81068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.423912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2da5-7ed4-44dc-af7f-aeb912c81068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.424184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2da5-7ed4-44dc-af7f-aeb912c81068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.424448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2da5-7ed4-44dc-af7f-aeb912c81068 admin admin] PATH_INFO: `/v3/projects/9d51175eb36e4047a5f1312d0b9b6059/users/b7bda6344ae348648373e6fa9b530bef/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.443977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2da5-7ed4-44dc-af7f-aeb912c81068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d51175eb36e4047a5f1312d0b9b6059, user_id=b7bda6344ae348648373e6fa9b530bef, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.447319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2da5-7ed4-44dc-af7f-aeb912c81068 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.475491 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1462/2920] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:31 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:10:31.476741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.487571 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1459/2921] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:31 2022] PUT /identity/v3/projects/9d51175eb36e4047a5f1312d0b9b6059/users/b7bda6344ae348648373e6fa9b530bef/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:31.492085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.492569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.493215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.519762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:31.521214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:31.534293 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:31.546422 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:31.616010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e231-1ff1-43d6-a3ae-ab496ce3a06c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.625929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.628052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.628759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.630931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.632271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.634744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.651109 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1460/2922] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:31.658130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.659702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:31.675160 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1463/2923] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:31 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:31.679171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.703336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e96c6-949d-47d4-8eaf-a410d2af9022 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.713891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.714599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.714877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.715154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.716602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.718686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.739706 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1464/2924] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:31.741032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.752261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439455e-4ff6-421c-aee0-db03c9c330ea None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.754048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324182e-954b-4091-9557-0be3342ba4eb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.757365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01dade-83cf-484c-9333-9cda181d2826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.758278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01dade-83cf-484c-9333-9cda181d2826 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.759480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01dade-83cf-484c-9333-9cda181d2826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.759773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.760282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01dade-83cf-484c-9333-9cda181d2826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.760575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.760975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.761281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.762087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.764948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.775716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01dade-83cf-484c-9333-9cda181d2826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.781999 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1465/2925] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:31.783033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01dade-83cf-484c-9333-9cda181d2826 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.784193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:31.798462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335cb06-8f9d-4345-bf06-49a07935e659 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:31.810049 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1461/2926] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:10:31.810949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:31.811961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.812471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.812982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] PATH_INFO: `/v3/projects/94f8f29beb7741c39a6e336ddd53e2e0/users/922620a8145c433db7655c323d6303a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.833927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f8f29beb7741c39a6e336ddd53e2e0, user_id=922620a8145c433db7655c323d6303a8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:31.847654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:31.886296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201306-2bdf-4072-af2c-291ded31d0e5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:31.886467 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1466/2927] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:31 2022] PUT /identity/v3/projects/94f8f29beb7741c39a6e336ddd53e2e0/users/922620a8145c433db7655c323d6303a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:31.886914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201306-2bdf-4072-af2c-291ded31d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:31.886914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7201306-2bdf-4072-af2c-291ded31d0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:31.971225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e7201306-2bdf-4072-af2c-291ded31d0e5 None None] MFA Rules not processed for user `922620a8145c433db7655c323d6303a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:31.974209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e7201306-2bdf-4072-af2c-291ded31d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:32.138777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1462/2928] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:32.143032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:32.293183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8de28-d133-4db6-8790-c7dc5bd95f51 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:32.316721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:32.317784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:32.318331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:32.319001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:32.320103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:32.322334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:32.377099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1467/2929] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:32 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:32.381585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201306-2bdf-4072-af2c-291ded31d0e5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:32.401609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7201306-2bdf-4072-af2c-291ded31d0e5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:32.552083 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:32.577267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:32.577891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:32.578169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:32.578490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:32.579139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:32.581016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:32.636354 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1463/2930] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:32 2022] POST /identity/v3/users => generated 298 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:32.641822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:32.656753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84afdd-a387-4907-a545-847ed1bfde39 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:32.667132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:32.710018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:32.713315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:32.714082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:32.715668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:32.718689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:32.734488 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1468/2931] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:32.738266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:32.755060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b953e6-1b90-4601-b738-6a0857c185d5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:32.762905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:32.763664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:32.764901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:32.765298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] PATH_INFO: `/v3/projects/a810ad210b4942aaab2550f433215bff/users/f8b21486bf264994b39d9cbf80dbaf84/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:32.807351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a810ad210b4942aaab2550f433215bff, user_id=f8b21486bf264994b39d9cbf80dbaf84, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:32.810390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:32.834758 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1464/2932] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:32 2022] PUT /identity/v3/projects/a810ad210b4942aaab2550f433215bff/users/f8b21486bf264994b39d9cbf80dbaf84/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:32.838668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:32.859234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0cbe-8cce-483d-89ec-896f6f4093d2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:32.924368 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:32.944349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c02f-f81b-46c2-a7f5-423d1ab6525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:32.945869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c02f-f81b-46c2-a7f5-423d1ab6525f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:32.947408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c02f-f81b-46c2-a7f5-423d1ab6525f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:32.948054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c02f-f81b-46c2-a7f5-423d1ab6525f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:32.949835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18c02f-f81b-46c2-a7f5-423d1ab6525f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:32.953282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18c02f-f81b-46c2-a7f5-423d1ab6525f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:32.972992 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1469/2933] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:32.973887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:32.987983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ee1b8-1ef0-4b83-bde0-589effcb02c1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:33.004874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:33.005669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:33.011422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:33.011697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] PATH_INFO: `/v3/projects/a810ad210b4942aaab2550f433215bff/users/f8b21486bf264994b39d9cbf80dbaf84/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:33.016439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a810ad210b4942aaab2550f433215bff, user_id=f8b21486bf264994b39d9cbf80dbaf84, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:33.018675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:33.061477 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1465/2934] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:32 2022] PUT /identity/v3/projects/a810ad210b4942aaab2550f433215bff/users/f8b21486bf264994b39d9cbf80dbaf84/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:33.062239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566a0ba-9ebc-462d-8520-3519e5733da4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:33.062753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566a0ba-9ebc-462d-8520-3519e5733da4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:33.063257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566a0ba-9ebc-462d-8520-3519e5733da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:33.171820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a566a0ba-9ebc-462d-8520-3519e5733da4 None None] MFA Rules not processed for user `f8b21486bf264994b39d9cbf80dbaf84`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:33.173236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a566a0ba-9ebc-462d-8520-3519e5733da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:33.325601 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1470/2935] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:33.351026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:33.355236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:33.559591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc80bc-f021-4c0c-b2b4-9a2e26fc5c8b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:33.566585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce207e5-f768-4c0e-8de8-51af4b83b6a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:33.567439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce207e5-f768-4c0e-8de8-51af4b83b6a6 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:33.567698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce207e5-f768-4c0e-8de8-51af4b83b6a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:33.568127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce207e5-f768-4c0e-8de8-51af4b83b6a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:33.579774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce207e5-f768-4c0e-8de8-51af4b83b6a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:33.581760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce207e5-f768-4c0e-8de8-51af4b83b6a6 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:33.604079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1466/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:34.088776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566a0ba-9ebc-462d-8520-3519e5733da4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:34.264930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566a0ba-9ebc-462d-8520-3519e5733da4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:34.279932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:34.280868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:34.281376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:34.281840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] PATH_INFO: `/v3/users/922620a8145c433db7655c323d6303a8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:34.288257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922620a8145c433db7655c323d6303a8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:34.291154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:34.405048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922620a8145c433db7655c323d6303a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:34.406342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922620a8145c433db7655c323d6303a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:34.408427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922620a8145c433db7655c323d6303a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:34.424698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922620a8145c433db7655c323d6303a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:34.454393 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:34.459579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922620a8145c433db7655c323d6303a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:34.487363 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1471/2937] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:34 2022] DELETE /identity/v3/users/922620a8145c433db7655c323d6303a8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:34.491844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:34.492163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:34.492453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:34.564505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:34.566026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:34.727315 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1467/2938] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:34.768745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:34.770436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:34.865591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac3a9-937a-49f3-b9d5-75156ee98db9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:34.872867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:34.874528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:34.874528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:34.875473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:34.910577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:34.914368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:34.969008 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1472/2939] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:35.545369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:35.546826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:35.567419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48100e-b4d1-461f-a297-dbe1a915e120 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:35.578718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:35.579416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:35.579696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:35.579964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] PATH_INFO: `/v3/projects/94f8f29beb7741c39a6e336ddd53e2e0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:35.586015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f8f29beb7741c39a6e336ddd53e2e0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:35.588035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:35.662553 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:35.697103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f8f29beb7741c39a6e336ddd53e2e0', 'request_id': 'req-512233b3-396c-4039-a574-9b0ca4eafc29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:35.703743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f8f29beb7741c39a6e336ddd53e2e0', 'request_id': 'req-512233b3-396c-4039-a574-9b0ca4eafc29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:35.716278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f8f29beb7741c39a6e336ddd53e2e0', 'request_id': 'req-512233b3-396c-4039-a574-9b0ca4eafc29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:35.742138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] The token cache is being invalidate because project 94f8f29beb7741c39a6e336ddd53e2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:35.742435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:35.745472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:35.747454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1468/2940] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:35 2022] DELETE /identity/v3/projects/94f8f29beb7741c39a6e336ddd53e2e0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:35.752476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:35.765247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f89019-c087-4928-9f4e-a82f4ae9a121 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:35.933913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:35.940879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:35.942729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:35.945357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] PATH_INFO: `/v3/users/f8b21486bf264994b39d9cbf80dbaf84` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:35.949830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b21486bf264994b39d9cbf80dbaf84)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:35.960828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:36.127970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b21486bf264994b39d9cbf80dbaf84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:36.130810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b21486bf264994b39d9cbf80dbaf84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:36.134509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b21486bf264994b39d9cbf80dbaf84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:36.172288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b21486bf264994b39d9cbf80dbaf84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:36.216743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9aea5f1c-8147-4f64-be8b-4bfadff6e6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b21486bf264994b39d9cbf80dbaf84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:36.248060 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1473/2941] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:35 2022] DELETE /identity/v3/users/f8b21486bf264994b39d9cbf80dbaf84 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:37.259478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:37.264968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:37.302906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512233b3-396c-4039-a574-9b0ca4eafc29 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:37.397757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:37.398705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:37.399919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:37.400295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] PATH_INFO: `/v3/projects/a810ad210b4942aaab2550f433215bff` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:37.401760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a810ad210b4942aaab2550f433215bff)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:37.404211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:37.474592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a810ad210b4942aaab2550f433215bff', 'request_id': 'req-4ee81111-020f-4252-bc94-af6f81b22c31'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:37.484490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a810ad210b4942aaab2550f433215bff', 'request_id': 'req-4ee81111-020f-4252-bc94-af6f81b22c31'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:37.495980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a810ad210b4942aaab2550f433215bff', 'request_id': 'req-4ee81111-020f-4252-bc94-af6f81b22c31'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:37.516966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] The token cache is being invalidate because project a810ad210b4942aaab2550f433215bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:37.517564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:37.518235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ee81111-020f-4252-bc94-af6f81b22c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:37.520274 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1469/2942] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:37 2022] DELETE /identity/v3/projects/a810ad210b4942aaab2550f433215bff => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:37.527760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe7ec-4117-472f-9cb4-aedee86f7dde None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:37.530004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe7ec-4117-472f-9cb4-aedee86f7dde None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:37.530547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fe7ec-4117-472f-9cb4-aedee86f7dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:37.574178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8d3fe7ec-4117-472f-9cb4-aedee86f7dde None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:37.576042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8d3fe7ec-4117-472f-9cb4-aedee86f7dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:37.588633 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:37.796966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1474/2943] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:37.797933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293267dc-07df-44a1-80ba-b544a2eaa10b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:37.798231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293267dc-07df-44a1-80ba-b544a2eaa10b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:37.798513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293267dc-07df-44a1-80ba-b544a2eaa10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:37.882072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-293267dc-07df-44a1-80ba-b544a2eaa10b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:37.891392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-293267dc-07df-44a1-80ba-b544a2eaa10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:37.924538 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1470/2944] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:37.928784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fe7ec-4117-472f-9cb4-aedee86f7dde None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:37.943746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fe7ec-4117-472f-9cb4-aedee86f7dde None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:37.950649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:37.951278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:37.951634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:37.951932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:37.952925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:37.954011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:37.955762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:37.985116 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1475/2945] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:37.988996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293267dc-07df-44a1-80ba-b544a2eaa10b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:37.999850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293267dc-07df-44a1-80ba-b544a2eaa10b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:38.007974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:38.009428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:38.009798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:38.010067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:38.010721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:38.012909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:38.081132 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1471/2946] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:37 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:38.084126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:38.103772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1d5c-7b96-436d-804d-8dbe9edbb38f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:38.226571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:38.227951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:38.230185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:38.230469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:38.231235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:38.233666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:38.285310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1476/2947] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:38 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:38.289085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:38.304828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9833eb-a7b7-4daf-aaec-6eef2b54ef5d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:38.316953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:38.318001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:38.318492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:38.318988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:38.319856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:38.321909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:38.350256 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1472/2948] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:38.354502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:38.381983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673839d-baee-4437-8617-9f8647df70f1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:38.401200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcaa51-1080-4dff-97fb-e229f13da5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:38.404976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaa51-1080-4dff-97fb-e229f13da5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:38.405318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaa51-1080-4dff-97fb-e229f13da5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:38.405593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaa51-1080-4dff-97fb-e229f13da5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:38.409621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcaa51-1080-4dff-97fb-e229f13da5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:38.417205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcaa51-1080-4dff-97fb-e229f13da5d7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:38.455065 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1477/2949] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:38.456213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:38.485170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a411-ddfe-402b-acff-3f732f2cb2fa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:38.491113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:38.491900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:38.492091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:38.492320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] PATH_INFO: `/v3/projects/604cfb26cff6492c943d9e535a35b653/users/bc30cb3b43f84317b4d6dab8804d3b2c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:38.501741 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:38.533354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604cfb26cff6492c943d9e535a35b653, user_id=bc30cb3b43f84317b4d6dab8804d3b2c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:38.533354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:38.564563 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1473/2950] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:38 2022] PUT /identity/v3/projects/604cfb26cff6492c943d9e535a35b653/users/bc30cb3b43f84317b4d6dab8804d3b2c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:38.578347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b217b-51ab-4479-8509-51837e32b19a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:38.578905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b217b-51ab-4479-8509-51837e32b19a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:38.579199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b217b-51ab-4479-8509-51837e32b19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:38.642832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-623b217b-51ab-4479-8509-51837e32b19a None None] MFA Rules not processed for user `bc30cb3b43f84317b4d6dab8804d3b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:38.645611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-623b217b-51ab-4479-8509-51837e32b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:38.784853 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1478/2951] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:38.790274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:38.895784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8a48b-2506-48b8-bfbb-43e1f805eaa8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:38.913386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:38.914098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:38.915182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:38.915416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:38.916124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:38.918060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:38.989191 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1474/2952] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:38 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:10:38.994319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b217b-51ab-4479-8509-51837e32b19a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:39.018954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b217b-51ab-4479-8509-51837e32b19a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:39.034906 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:39.142376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:39.142995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.143275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.143712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.144493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:39.146569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:39.185344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1479/2953] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:38 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:39.185582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:39.200612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fc725-5de2-40be-baee-20e7fcaccd45 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:39.209048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:39.209702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.209983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.221325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.221685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:39.223324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:39.260589 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1475/2954] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:39.262328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:39.279188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf60c-6e84-44b2-a99e-2d6b99329bc3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:39.293532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:39.296452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.296762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.297353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] PATH_INFO: `/v3/projects/342b2a3f51b64507bf41bf17aed67574/users/f946c76d637440a8aeeb6d48913c9a2f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.338829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=342b2a3f51b64507bf41bf17aed67574, user_id=f946c76d637440a8aeeb6d48913c9a2f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:39.341569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:39.373275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1480/2955] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:39 2022] PUT /identity/v3/projects/342b2a3f51b64507bf41bf17aed67574/users/f946c76d637440a8aeeb6d48913c9a2f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:39.377433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:39.392459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d592d8-9a6c-46ce-89ea-eb65c112d784 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:39.491767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4aed6-f0bb-4ab1-9105-bb0578a9c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:39.492415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4aed6-f0bb-4ab1-9105-bb0578a9c783 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.493599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4aed6-f0bb-4ab1-9105-bb0578a9c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.493878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4aed6-f0bb-4ab1-9105-bb0578a9c783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.494662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4aed6-f0bb-4ab1-9105-bb0578a9c783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:39.496831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4aed6-f0bb-4ab1-9105-bb0578a9c783 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:39.509717 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1476/2956] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:39.516494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:39.529703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe62aa-9702-48ca-854a-a254eed7b20a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:39.537970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:39.539413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.540229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.540654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] PATH_INFO: `/v3/projects/342b2a3f51b64507bf41bf17aed67574/users/f946c76d637440a8aeeb6d48913c9a2f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.545189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] RBAC: Authorizing `identity:create_grant(project_id=342b2a3f51b64507bf41bf17aed67574, user_id=f946c76d637440a8aeeb6d48913c9a2f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:39.550568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:39.572143 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1481/2957] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:39 2022] PUT /identity/v3/projects/342b2a3f51b64507bf41bf17aed67574/users/f946c76d637440a8aeeb6d48913c9a2f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:39.583098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2c8d-8336-4fdd-93a3-6b0ed9edff0d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.584430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2c8d-8336-4fdd-93a3-6b0ed9edff0d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.584882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2c8d-8336-4fdd-93a3-6b0ed9edff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.654903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e54b2c8d-8336-4fdd-93a3-6b0ed9edff0d None None] MFA Rules not processed for user `f946c76d637440a8aeeb6d48913c9a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:39.656154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e54b2c8d-8336-4fdd-93a3-6b0ed9edff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:39.735878 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:39.794194 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1477/2958] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:39.814255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:39.834529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd59c53-2291-49cc-a7aa-684e17ef800b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:39.867236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:39.868562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.869202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.872347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.879283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:39.879989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:39.884905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:39.919833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1482/2959] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:10:39.923939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b2c8d-8336-4fdd-93a3-6b0ed9edff0d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:39.937353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b2c8d-8336-4fdd-93a3-6b0ed9edff0d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:39.950783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:39.951797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:39.952322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:39.952816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:39.953854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:39.955997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:40.050502 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1478/2960] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:39 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:40.054618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:40.137505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ae3c-238e-4113-aad6-abd39f88be70 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:40.294343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1956cd-16cb-41c8-9500-fb0e5f5ab661 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:40.295282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1956cd-16cb-41c8-9500-fb0e5f5ab661 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:40.295567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1956cd-16cb-41c8-9500-fb0e5f5ab661 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:40.295845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1956cd-16cb-41c8-9500-fb0e5f5ab661 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:40.297099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1956cd-16cb-41c8-9500-fb0e5f5ab661 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:40.297423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1956cd-16cb-41c8-9500-fb0e5f5ab661 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:40.299747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1956cd-16cb-41c8-9500-fb0e5f5ab661 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:40.320710 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1483/2961] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:10:40.327025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:40.328771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:40.548033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c335-456d-4239-9f5e-89d73bf154d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:40.574679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:40.575342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:40.575626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:40.575899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:40.587332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:40.589374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:40.606624 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1479/2962] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:40.635266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaed13-6bbb-461d-a063-5042defe9ce5 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:40.635567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaed13-6bbb-461d-a063-5042defe9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:40.635961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaed13-6bbb-461d-a063-5042defe9ce5 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:40.638907 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1484/2963] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:10:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:10:40.644218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:10:40.663377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:40.692720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51b37d-9a07-4fea-9a90-ef059def77c9 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:40.708070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:40.708800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:40.709098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:40.709847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/projects/8fde87798ae84fdeaa935057c1f3764d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:40.712387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fde87798ae84fdeaa935057c1f3764d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:40.715327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:40.722569 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1480/2964] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:10:40 2022] GET /identity/v3/projects/8fde87798ae84fdeaa935057c1f3764d => generated 371 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:41.808355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f5d8d-8917-41a7-9360-0036640e4050 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:41.808924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f5d8d-8917-41a7-9360-0036640e4050 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:41.808924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f5d8d-8917-41a7-9360-0036640e4050 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:41.810542 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1485/2965] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:10:41.816050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:10:41.845001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:41.870491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26175db4-35b5-4f3a-bd4a-787bfaf32639 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:41.882521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:41.883721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:41.884017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:41.884410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/projects/8fde87798ae84fdeaa935057c1f3764d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:41.886167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fde87798ae84fdeaa935057c1f3764d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:41.888829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:41.891693 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1481/2966] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:10:41 2022] GET /identity/v3/projects/8fde87798ae84fdeaa935057c1f3764d => generated 371 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:41.975078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f5d8d-8917-41a7-9360-0036640e4050 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:41.999308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f5d8d-8917-41a7-9360-0036640e4050 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:42.025858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:42.030681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:42.032303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:42.032585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:42.034314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:42.034832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:42.044947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:42.090210 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1486/2967] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:42.091232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:42.125413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8931f-f886-4f95-9d9c-c5258d60ac3b tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:42.171875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40b86-c70d-4d9f-b67e-e12618b18116 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:42.175748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40b86-c70d-4d9f-b67e-e12618b18116 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:42.176061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40b86-c70d-4d9f-b67e-e12618b18116 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:42.176349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40b86-c70d-4d9f-b67e-e12618b18116 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:42.177123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40b86-c70d-4d9f-b67e-e12618b18116 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:42.183325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b40b86-c70d-4d9f-b67e-e12618b18116 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:42.246967 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1482/2968] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:42 2022] POST /identity/v3/users => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:42.248205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:42.254576 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:42.261603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c4b9-7701-461e-8c44-3f529e8463d2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:42.295880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:42.296684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:42.299267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:42.301092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:42.301931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:42.308869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:42.311978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:42.365694 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1487/2969] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:42.793619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aff5f-0079-4b5b-a94f-120669039c93 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:42.794177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aff5f-0079-4b5b-a94f-120669039c93 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:42.794602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aff5f-0079-4b5b-a94f-120669039c93 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:42.796298 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1483/2970] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:10:42.803750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:10:42.805596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:42.840645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:42.872078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d76da-5047-48c2-b75e-6122200e82ad tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:42.904655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:42.905778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:42.906230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:42.907256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/projects/8fde87798ae84fdeaa935057c1f3764d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:42.909552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fde87798ae84fdeaa935057c1f3764d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:42.915663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:42.920239 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1488/2971] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:10:42 2022] GET /identity/v3/projects/8fde87798ae84fdeaa935057c1f3764d => generated 371 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:43.444132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3918e-5434-417f-9fa0-07a3e9868eac None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:43.444734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3918e-5434-417f-9fa0-07a3e9868eac None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:43.444734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3918e-5434-417f-9fa0-07a3e9868eac None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:43.446673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1484/2972] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:10:43.453674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:10:43.538033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:43.554619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af1d7-ed4b-41a4-ac4d-17893c38767c tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:43.563274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:43.565552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:43.566107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:43.566562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/projects/8fde87798ae84fdeaa935057c1f3764d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:43.568282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fde87798ae84fdeaa935057c1f3764d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:43.570996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:43.575066 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1489/2973] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:10:43 2022] GET /identity/v3/projects/8fde87798ae84fdeaa935057c1f3764d => generated 371 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:43.610428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3918e-5434-417f-9fa0-07a3e9868eac None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:43.634833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3918e-5434-417f-9fa0-07a3e9868eac None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:43.645942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:43.648185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:43.651172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:43.651938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/users/f1a8f0619512412b9b989437fde175ef` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:43.691762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f1a8f0619512412b9b989437fde175ef)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:43.694479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:43.699525 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:43.782657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a8f0619512412b9b989437fde175ef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:43.783574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a8f0619512412b9b989437fde175ef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:43.784824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a8f0619512412b9b989437fde175ef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:43.804873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a8f0619512412b9b989437fde175ef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:43.841608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a8f0619512412b9b989437fde175ef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:43.861649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1485/2974] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:43 2022] DELETE /identity/v3/users/f1a8f0619512412b9b989437fde175ef => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:43.864738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:43.869978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:43.902553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c125-edf5-4fa5-9edf-8e6987e1f8f2 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:44.030297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f946c76d637440a8aeeb6d48913c9a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342b2a3f51b64507bf41bf17aed67574', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:44.033026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:44.033477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:44.034007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] PATH_INFO: `/v3/projects/8fde87798ae84fdeaa935057c1f3764d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:44.036233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8fde87798ae84fdeaa935057c1f3764d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:44.046219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:44.120700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fde87798ae84fdeaa935057c1f3764d', 'request_id': 'req-becb1b81-d70d-4287-9194-3e5a8ac08437'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.133472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fde87798ae84fdeaa935057c1f3764d', 'request_id': 'req-becb1b81-d70d-4287-9194-3e5a8ac08437'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.170688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fde87798ae84fdeaa935057c1f3764d', 'request_id': 'req-becb1b81-d70d-4287-9194-3e5a8ac08437'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.199653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] The token cache is being invalidate because project 8fde87798ae84fdeaa935057c1f3764d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:44.200139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.202010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-becb1b81-d70d-4287-9194-3e5a8ac08437 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.209997 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1490/2975] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:43 2022] DELETE /identity/v3/projects/8fde87798ae84fdeaa935057c1f3764d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:44.212762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:44.214964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:44.320222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141e9f5-7acd-488b-a8b2-fb3f72b2b948 tempest-QuotasAdminTestV257-1050106766 tempest-QuotasAdminTestV257-1050106766-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:44.436341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:44.437698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:44.438066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:44.438337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] PATH_INFO: `/v3/users/bc30cb3b43f84317b4d6dab8804d3b2c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:44.439583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc30cb3b43f84317b4d6dab8804d3b2c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:44.441861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:44.477747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c7b50-aa94-4277-b016-b21efed2764b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:44.478530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c7b50-aa94-4277-b016-b21efed2764b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:44.478530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c7b50-aa94-4277-b016-b21efed2764b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:44.502096 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:44.538841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc30cb3b43f84317b4d6dab8804d3b2c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.541433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc30cb3b43f84317b4d6dab8804d3b2c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.542804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc30cb3b43f84317b4d6dab8804d3b2c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.571565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-389c7b50-aa94-4277-b016-b21efed2764b None None] MFA Rules not processed for user `b7bda6344ae348648373e6fa9b530bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:44.572947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-389c7b50-aa94-4277-b016-b21efed2764b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:44.615164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc30cb3b43f84317b4d6dab8804d3b2c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.646056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-74f90c5f-36a8-4efc-864e-0664765d6602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc30cb3b43f84317b4d6dab8804d3b2c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:44.679818 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1486/2976] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:44 2022] DELETE /identity/v3/users/bc30cb3b43f84317b4d6dab8804d3b2c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:44.683931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:44.683931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:44.685369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:44.716359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:44.718306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:44.724907 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:44.761704 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1491/2977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:44.776813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:44.777136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:44.777417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:44.840122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] MFA Rules not processed for user `b7bda6344ae348648373e6fa9b530bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:44.843417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:44.854479 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1487/2978] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:44.868880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:44.872635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:45.010606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fa38c-61cf-48e1-a151-e253d5693007 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:45.022835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:45.023443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:45.023764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:45.024437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:45.029902 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1492/2979] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:45.045036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:45.046520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:45.074007 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1488/2980] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:45.472443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:45.475522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:45.689301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a2062-e187-4efe-ab65-eefaf360ba99 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:45.703807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:45.704489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:45.704747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:45.705010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:45.731961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:45.733836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:45.769067 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1493/2981] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:46.393093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:46.395529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:46.447739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02490802-a048-4c60-9b9f-3e081dfa8a94 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:46.473415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:46.476168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:46.476466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:46.477269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:46.485356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:46.759718 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:46.793351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:46.795345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:46.807161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:46.809006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:46.846285 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1489/2982] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:46.856964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50466-eb2d-4e80-b0fa-b9619462cde9 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:46.869416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:46.869416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:46.869826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:46.870200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] PATH_INFO: `/v3/projects/604cfb26cff6492c943d9e535a35b653` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:46.872744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] RBAC: Authorizing `identity:delete_project(project_id=604cfb26cff6492c943d9e535a35b653)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:46.888353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:47.051477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604cfb26cff6492c943d9e535a35b653', 'request_id': 'req-3f36148d-43a3-441d-b46c-6cc86cbd833f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.086809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604cfb26cff6492c943d9e535a35b653', 'request_id': 'req-3f36148d-43a3-441d-b46c-6cc86cbd833f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.118754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604cfb26cff6492c943d9e535a35b653', 'request_id': 'req-3f36148d-43a3-441d-b46c-6cc86cbd833f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.146822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] The token cache is being invalidate because project 604cfb26cff6492c943d9e535a35b653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:47.150003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.154226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.157265 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1494/2983] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:46 2022] DELETE /identity/v3/projects/604cfb26cff6492c943d9e535a35b653 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:47.161229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:47.180717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4fdf-e992-49f2-977f-610a7901e440 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:47.434042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:47.438760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:47.443871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:47.446075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] PATH_INFO: `/v3/users/f946c76d637440a8aeeb6d48913c9a2f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:47.449907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f946c76d637440a8aeeb6d48913c9a2f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:47.451982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:47.581506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f946c76d637440a8aeeb6d48913c9a2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.584246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f946c76d637440a8aeeb6d48913c9a2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.585003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f946c76d637440a8aeeb6d48913c9a2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.611629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f946c76d637440a8aeeb6d48913c9a2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.623570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f946c76d637440a8aeeb6d48913c9a2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:47.642227 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1490/2984] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:47 2022] DELETE /identity/v3/users/f946c76d637440a8aeeb6d48913c9a2f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:48.866993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:48.869397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:48.886888 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:48.932858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:48.935075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:49.213243 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:49.279334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36148d-43a3-441d-b46c-6cc86cbd833f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:49.290858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf6147-f895-4b76-abe3-7363f03d1180 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:49.293991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13642bc-8996-4476-8013-1e562226027f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:49.294633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13642bc-8996-4476-8013-1e562226027f service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:49.294905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13642bc-8996-4476-8013-1e562226027f service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:49.295925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13642bc-8996-4476-8013-1e562226027f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:49.301478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b13642bc-8996-4476-8013-1e562226027f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:49.304852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5141-ba78-4abb-8c38-18558d976a8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:49.306752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5141-ba78-4abb-8c38-18558d976a8a service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:49.307028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5141-ba78-4abb-8c38-18558d976a8a service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:49.307299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5141-ba78-4abb-8c38-18558d976a8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:49.313956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bdfd5141-ba78-4abb-8c38-18558d976a8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:49.329426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13642bc-8996-4476-8013-1e562226027f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:49.331739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13642bc-8996-4476-8013-1e562226027f service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:49.344500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5141-ba78-4abb-8c38-18558d976a8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:49.346125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5141-ba78-4abb-8c38-18558d976a8a service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:49.360163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1495/2985] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:49.367820 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1491/2986] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:52.233772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13642bc-8996-4476-8013-1e562226027f service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:52.235321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b13642bc-8996-4476-8013-1e562226027f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:52.358653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13642bc-8996-4476-8013-1e562226027f service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:52.373927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:52.374600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:52.374875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:52.376500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] PATH_INFO: `/v3/projects/342b2a3f51b64507bf41bf17aed67574` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:52.378499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342b2a3f51b64507bf41bf17aed67574)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:52.381404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:52.496325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342b2a3f51b64507bf41bf17aed67574', 'request_id': 'req-c6422ce2-445b-44a9-9c80-f36b6f41e077'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:52.512655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342b2a3f51b64507bf41bf17aed67574', 'request_id': 'req-c6422ce2-445b-44a9-9c80-f36b6f41e077'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:52.527839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342b2a3f51b64507bf41bf17aed67574', 'request_id': 'req-c6422ce2-445b-44a9-9c80-f36b6f41e077'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:52.548984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] The token cache is being invalidate because project 342b2a3f51b64507bf41bf17aed67574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:52.549475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:52.555246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c6422ce2-445b-44a9-9c80-f36b6f41e077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:52.557039 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1496/2987] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:52 2022] DELETE /identity/v3/projects/342b2a3f51b64507bf41bf17aed67574 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:52.563804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448757c-3385-4566-822a-15172bbe3263 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:52.564232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448757c-3385-4566-822a-15172bbe3263 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:52.564324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448757c-3385-4566-822a-15172bbe3263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:52.599470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9448757c-3385-4566-822a-15172bbe3263 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:52.600973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9448757c-3385-4566-822a-15172bbe3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:52.699335 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1492/2988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:52.708496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d1dd-4b5e-4855-8333-b3de3c86e624 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:52.709096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d1dd-4b5e-4855-8333-b3de3c86e624 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:52.709517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d1dd-4b5e-4855-8333-b3de3c86e624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:52.726459 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:52.756083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0f95d1dd-4b5e-4855-8333-b3de3c86e624 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:52.757719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0f95d1dd-4b5e-4855-8333-b3de3c86e624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:52.791233 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1497/2989] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:52.798164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448757c-3385-4566-822a-15172bbe3263 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:52.824297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448757c-3385-4566-822a-15172bbe3263 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:52.839551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:52.841183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:52.841778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:52.842268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:52.848216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:10:52.848828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:52.853942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:52.889773 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1493/2990] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:10:52.895839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d1dd-4b5e-4855-8333-b3de3c86e624 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:52.928215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d1dd-4b5e-4855-8333-b3de3c86e624 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:52.937690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:52.938317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:52.938594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:52.938864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:52.939514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:52.947103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:53.012165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1498/2991] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:52 2022] POST /identity/v3/projects => generated 409 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:53.016009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:53.035334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5c2f8-6af3-46c5-a4c6-bc529899a36d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:53.183606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:53.184274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:53.184550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:53.184817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:53.185735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:53.191985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:53.224863 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1494/2992] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:53 2022] POST /identity/v3/users => generated 305 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:53.227377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:53.241488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e67388-1f10-4320-be7e-6b83e3170acb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:53.247466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:53.248137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:53.248417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:53.248685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:53.249422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:53.251969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:53.282006 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1499/2993] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:10:53.286154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:53.301040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71b20b-26f9-4ad7-9e4f-842ff6d0643e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:53.317281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8dc64-f7b9-4f66-a25e-6b7cabe9b314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:53.319218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8dc64-f7b9-4f66-a25e-6b7cabe9b314 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:53.320357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8dc64-f7b9-4f66-a25e-6b7cabe9b314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:53.320767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8dc64-f7b9-4f66-a25e-6b7cabe9b314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:53.321450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8dc64-f7b9-4f66-a25e-6b7cabe9b314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:53.328201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8dc64-f7b9-4f66-a25e-6b7cabe9b314 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:53.355214 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1495/2994] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:10:53.359027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:53.371368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c920d-bd0b-477d-94a7-c05d6ab6f34e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:53.382897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:53.384654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:53.385334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:53.385812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] PATH_INFO: `/v3/projects/91c84f3d422a484cb900f4971a607898/users/dbe78551861a44dd9da452a414446e67/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:53.418879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c84f3d422a484cb900f4971a607898, user_id=dbe78551861a44dd9da452a414446e67, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:53.421952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:53.469367 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1500/2995] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:53 2022] PUT /identity/v3/projects/91c84f3d422a484cb900f4971a607898/users/dbe78551861a44dd9da452a414446e67/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:53.533578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1189-2ef0-49ee-896b-56c01545542d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:53.534141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1189-2ef0-49ee-896b-56c01545542d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:53.534742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1189-2ef0-49ee-896b-56c01545542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:53.581905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-946d1189-2ef0-49ee-896b-56c01545542d None None] MFA Rules not processed for user `dbe78551861a44dd9da452a414446e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:53.588486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-946d1189-2ef0-49ee-896b-56c01545542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:53.632430 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:53.748380 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1496/2996] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:53.752582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:53.899954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b7f89-7c62-4710-bdb9-67080773ddef admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:53.925146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:53.927847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:53.928188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:53.928465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:53.936180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:53.945528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:54.019070 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1501/2997] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:10:53 2022] POST /identity/v3/projects => generated 409 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:54.023957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1189-2ef0-49ee-896b-56c01545542d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:54.041855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1189-2ef0-49ee-896b-56c01545542d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:54.188119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:54.189253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:54.201183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:54.201834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:54.204016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:54.214257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:54.277167 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1497/2998] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:10:54 2022] POST /identity/v3/users => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:10:54.280532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:54.298931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d037c-2e6f-4919-b4b5-99a1e9520aa1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:54.309418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:54.310308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:54.310818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:54.311257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:54.312124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:54.315658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:54.334887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1502/2999] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:10:54.340232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:54.354935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3f36-c446-4400-ba90-7f10c707f147 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:54.364457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:54.365442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:54.365959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:54.366479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] PATH_INFO: `/v3/projects/bfa14724ef194ab49765d350cabeda28/users/3e8a772e9d42456e9b9616bacc9f1b03/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:54.397492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa14724ef194ab49765d350cabeda28, user_id=3e8a772e9d42456e9b9616bacc9f1b03, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:54.404026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:54.427014 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1498/3000] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:54 2022] PUT /identity/v3/projects/bfa14724ef194ab49765d350cabeda28/users/3e8a772e9d42456e9b9616bacc9f1b03/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:54.432249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:54.443750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d54c7b-3c4b-4931-953d-0befdc285f1f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:54.532061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82d08-2cf1-4b64-846e-cc01b018172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:54.533320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82d08-2cf1-4b64-846e-cc01b018172a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:54.534006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82d08-2cf1-4b64-846e-cc01b018172a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:54.534504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82d08-2cf1-4b64-846e-cc01b018172a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:54.535548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb82d08-2cf1-4b64-846e-cc01b018172a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:54.537632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb82d08-2cf1-4b64-846e-cc01b018172a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:54.555934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:54.556364 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1503/3001] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:10:54.575895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7dd1e-82a1-4f12-92da-ab2ee5b998f1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:54.600886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:54.603351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:54.606653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:54.607300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] PATH_INFO: `/v3/projects/bfa14724ef194ab49765d350cabeda28/users/3e8a772e9d42456e9b9616bacc9f1b03/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:54.611996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa14724ef194ab49765d350cabeda28, user_id=3e8a772e9d42456e9b9616bacc9f1b03, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:54.615006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:54.633911 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1499/3002] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:10:54 2022] PUT /identity/v3/projects/bfa14724ef194ab49765d350cabeda28/users/3e8a772e9d42456e9b9616bacc9f1b03/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:10:54.643348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c8e7d-be55-4d9c-b505-3c60cd284762 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:54.643633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c8e7d-be55-4d9c-b505-3c60cd284762 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:54.643908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c8e7d-be55-4d9c-b505-3c60cd284762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:54.682448 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:54.698997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0c1c8e7d-be55-4d9c-b505-3c60cd284762 None None] MFA Rules not processed for user `3e8a772e9d42456e9b9616bacc9f1b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:54.700242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0c1c8e7d-be55-4d9c-b505-3c60cd284762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:54.801767 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1504/3003] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:10:54.811014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:54.916469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6f21c-e424-48cb-b2e4-c804ea25ab7f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:54.923620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:54.924195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:54.924622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:54.924903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] PATH_INFO: `/v3/users/dbe78551861a44dd9da452a414446e67` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:54.926480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe78551861a44dd9da452a414446e67)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:54.928597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:54.949714 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:55.032001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe78551861a44dd9da452a414446e67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:55.033294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe78551861a44dd9da452a414446e67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:55.034049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe78551861a44dd9da452a414446e67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:55.053254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe78551861a44dd9da452a414446e67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:55.066568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe78551861a44dd9da452a414446e67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:55.094065 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1500/3004] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:54 2022] DELETE /identity/v3/users/dbe78551861a44dd9da452a414446e67 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:55.095604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:55.095895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:55.096165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:55.120234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:10:55.121922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:55.217636 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1505/3005] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:10:55.259759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:55.263245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:55.380733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca90ae5-4268-40e0-a03e-beacad266a26 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:55.388715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:55.389810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:55.390565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:55.391033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:55.406492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:55.408162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:55.424044 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1501/3006] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:57.392963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:57.394578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:57.408866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f7a5b-ea37-44c9-8a84-0b31696feb68 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:57.415846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:57.416518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:57.416892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:57.417320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] PATH_INFO: `/v3/projects/91c84f3d422a484cb900f4971a607898` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:57.418589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c84f3d422a484cb900f4971a607898)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:57.420577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:57.500365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c84f3d422a484cb900f4971a607898', 'request_id': 'req-8e8a4a2e-6688-4431-9acd-3803e8b36be6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.509369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c84f3d422a484cb900f4971a607898', 'request_id': 'req-8e8a4a2e-6688-4431-9acd-3803e8b36be6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.540385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c84f3d422a484cb900f4971a607898', 'request_id': 'req-8e8a4a2e-6688-4431-9acd-3803e8b36be6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.561355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] The token cache is being invalidate because project 91c84f3d422a484cb900f4971a607898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:57.562403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.563687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.574603 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1506/3007] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:57 2022] DELETE /identity/v3/projects/91c84f3d422a484cb900f4971a607898 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:57.576280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:57.593341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882207-0da9-4d8f-a6bc-589ea70de971 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:57.733575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:57.734231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:57.734515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:57.734793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] PATH_INFO: `/v3/users/3e8a772e9d42456e9b9616bacc9f1b03` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:57.736107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8a772e9d42456e9b9616bacc9f1b03)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:57.738335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:57.796527 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:57.811565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8a772e9d42456e9b9616bacc9f1b03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.812340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8a772e9d42456e9b9616bacc9f1b03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.813445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8a772e9d42456e9b9616bacc9f1b03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.832340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8a772e9d42456e9b9616bacc9f1b03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.842393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8a772e9d42456e9b9616bacc9f1b03'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:57.864120 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1502/3008] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:10:57 2022] DELETE /identity/v3/users/3e8a772e9d42456e9b9616bacc9f1b03 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:58.689643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:58.692135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:58.725111 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:58.834340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a4a2e-6688-4431-9acd-3803e8b36be6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:58.983474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c603a-4673-4c7e-8c32-9856a99f3786 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:58.984127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c603a-4673-4c7e-8c32-9856a99f3786 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:58.984474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c603a-4673-4c7e-8c32-9856a99f3786 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:58.984812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c603a-4673-4c7e-8c32-9856a99f3786 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:58.986728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d10c603a-4673-4c7e-8c32-9856a99f3786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:59.002036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c603a-4673-4c7e-8c32-9856a99f3786 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:59.004492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c603a-4673-4c7e-8c32-9856a99f3786 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:59.017889 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1507/3009] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:59.651692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:59.653692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:59.824505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd11e-294b-42c1-ad77-740319b09e1c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:59.831044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:59.831740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:59.831903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:59.832679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] PATH_INFO: `/v3/projects/bfa14724ef194ab49765d350cabeda28` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:59.834197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa14724ef194ab49765d350cabeda28)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:59.836680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:59.928625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa14724ef194ab49765d350cabeda28', 'request_id': 'req-ac96dc50-4028-4b26-a7e6-68e149ddd376'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:59.941632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa14724ef194ab49765d350cabeda28', 'request_id': 'req-ac96dc50-4028-4b26-a7e6-68e149ddd376'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:59.952490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa14724ef194ab49765d350cabeda28', 'request_id': 'req-ac96dc50-4028-4b26-a7e6-68e149ddd376'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:59.987549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] The token cache is being invalidate because project bfa14724ef194ab49765d350cabeda28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:10:59.987980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:59.988797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:10:59.999362 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1503/3010] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:10:59 2022] DELETE /identity/v3/projects/bfa14724ef194ab49765d350cabeda28 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:10:59.999627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d43a4-e7aa-42b1-bd3d-b7b839f1048f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.000073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d43a4-e7aa-42b1-bd3d-b7b839f1048f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.000073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d43a4-e7aa-42b1-bd3d-b7b839f1048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.027568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a63d43a4-e7aa-42b1-bd3d-b7b839f1048f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:00.029874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a63d43a4-e7aa-42b1-bd3d-b7b839f1048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:00.053953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:00.056696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:00.132820 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:00.146446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96dc50-4028-4b26-a7e6-68e149ddd376 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:00.153482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71eea4-ae64-45ea-afa6-404d6f70369b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:00.154100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71eea4-ae64-45ea-afa6-404d6f70369b service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.155947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71eea4-ae64-45ea-afa6-404d6f70369b service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.156287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71eea4-ae64-45ea-afa6-404d6f70369b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.158538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5e71eea4-ae64-45ea-afa6-404d6f70369b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:00.177818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71eea4-ae64-45ea-afa6-404d6f70369b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:00.180586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71eea4-ae64-45ea-afa6-404d6f70369b service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:00.193113 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1504/3011] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:00.194147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1508/3012] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:11:00.204724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb4f98-31a8-4056-84d0-2db2d3f602eb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.205250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb4f98-31a8-4056-84d0-2db2d3f602eb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.205657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb4f98-31a8-4056-84d0-2db2d3f602eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.230130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2bdb4f98-31a8-4056-84d0-2db2d3f602eb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:00.231771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2bdb4f98-31a8-4056-84d0-2db2d3f602eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:00.243763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1505/3013] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:00.248337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d43a4-e7aa-42b1-bd3d-b7b839f1048f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:00.263656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d43a4-e7aa-42b1-bd3d-b7b839f1048f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:00.274591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:00.275503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.278478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.278478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.278873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:11:00.281432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:00.283145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:00.317010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb4f98-31a8-4056-84d0-2db2d3f602eb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:00.322480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1509/3014] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:11:00.335465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb4f98-31a8-4056-84d0-2db2d3f602eb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:00.340305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:00.340921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.341225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.341652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.342287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:00.362793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:00.424484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:00.434905 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1506/3015] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:11:00 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:11:00.437502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa9ea0-5971-4053-8a77-34f56c1bda1f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:00.534898 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:00.590721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:00.591925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.592226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.592504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.593180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:00.595352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:00.648817 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1510/3016] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:11:00 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:11:00.652411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:00.672477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6128ab-bcae-4a71-a045-c11d1415fe08 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:00.686024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:00.688004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.691850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.692387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.693334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:00.700341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:00.729572 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1507/3017] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:00.733866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:00.748859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eef3-cb89-48ce-a916-83994919fed1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:00.767458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7fbfd-1f44-46da-9492-d3247cecf188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:00.768088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fbfd-1f44-46da-9492-d3247cecf188 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.768610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fbfd-1f44-46da-9492-d3247cecf188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.768892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fbfd-1f44-46da-9492-d3247cecf188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.769575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7fbfd-1f44-46da-9492-d3247cecf188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:00.772666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7fbfd-1f44-46da-9492-d3247cecf188 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:00.807177 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1511/3018] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:11:00.809628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:00.829134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214a930-c3b3-4389-9de6-0ba2b6781f29 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:00.840294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:00.841245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.842050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.842429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] PATH_INFO: `/v3/projects/8d2481ad485b4d64a7dcf0b48e8f49e8/users/265cbfea926e4d5ab6012be74c0c59c2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:00.883994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2481ad485b4d64a7dcf0b48e8f49e8, user_id=265cbfea926e4d5ab6012be74c0c59c2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:00.887627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:00.922621 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1508/3019] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:11:00 2022] PUT /identity/v3/projects/8d2481ad485b4d64a7dcf0b48e8f49e8/users/265cbfea926e4d5ab6012be74c0c59c2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:00.932475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:00.932760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:00.933040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:01.004038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] MFA Rules not processed for user `265cbfea926e4d5ab6012be74c0c59c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:01.005544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:01.172362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1512/3020] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:01.389910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:01.391769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:01.435173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:01.436648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:01.542906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3c845-6068-4b1f-bb74-14ed06e15ab2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:01.563583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:01.564895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:01.565296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:01.566753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:01.568134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:01.587038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:01.590241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:01.607910 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1509/3021] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:01.609448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:01.611081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:01.613352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b018c-8d5b-4a11-bef3-813352074694 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:01.622119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:01.623358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:01.623884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:01.624405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] PATH_INFO: `/v3/users/890601cbe0fb40dcbc5eef6d36bd2b00` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:01.625975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890601cbe0fb40dcbc5eef6d36bd2b00)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:01.629646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:01.705029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890601cbe0fb40dcbc5eef6d36bd2b00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:01.705731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890601cbe0fb40dcbc5eef6d36bd2b00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:01.706845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890601cbe0fb40dcbc5eef6d36bd2b00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:01.709631 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:01.718928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890601cbe0fb40dcbc5eef6d36bd2b00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:01.739563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890601cbe0fb40dcbc5eef6d36bd2b00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:01.747662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ec5ff-fb2f-4c08-b74d-03d81e9d1eb0 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:01.754337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9595de-2150-464d-bf48-cd27c9d66b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:01.756066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9595de-2150-464d-bf48-cd27c9d66b80 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:01.756385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9595de-2150-464d-bf48-cd27c9d66b80 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:01.757005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9595de-2150-464d-bf48-cd27c9d66b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:01.761926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7e9595de-2150-464d-bf48-cd27c9d66b80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:01.765612 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1513/3022] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:11:01 2022] DELETE /identity/v3/users/890601cbe0fb40dcbc5eef6d36bd2b00 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:01.789654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9595de-2150-464d-bf48-cd27c9d66b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:01.793412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9595de-2150-464d-bf48-cd27c9d66b80 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:01.799430 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:01.811395 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1510/3023] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:02.100416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:02.103387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:02.215729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87086af-26eb-4493-a19d-32479de00691 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:02.222034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:02.222811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:02.223092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:02.223366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] PATH_INFO: `/v3/projects/c45ab68122394569aa2678282b9aad0b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:02.224523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45ab68122394569aa2678282b9aad0b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:02.226645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:02.304968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45ab68122394569aa2678282b9aad0b', 'request_id': 'req-b1491455-9afa-43c2-8e2e-1e8b85127c99'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:02.319337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45ab68122394569aa2678282b9aad0b', 'request_id': 'req-b1491455-9afa-43c2-8e2e-1e8b85127c99'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:02.338281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45ab68122394569aa2678282b9aad0b', 'request_id': 'req-b1491455-9afa-43c2-8e2e-1e8b85127c99'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:02.363906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] The token cache is being invalidate because project c45ab68122394569aa2678282b9aad0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:11:02.364217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:02.365520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1491455-9afa-43c2-8e2e-1e8b85127c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:02.370763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1514/3024] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:11:02 2022] DELETE /identity/v3/projects/c45ab68122394569aa2678282b9aad0b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:02.374966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928042-8484-4359-ace4-ef899fbe44b6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:02.375296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928042-8484-4359-ace4-ef899fbe44b6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:02.375582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02928042-8484-4359-ace4-ef899fbe44b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:02.432604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-02928042-8484-4359-ace4-ef899fbe44b6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:02.433905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-02928042-8484-4359-ace4-ef899fbe44b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:02.565684 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1511/3025] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:02.571620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a381898-46bb-41a8-8dfb-37502a9e8331 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:02.574471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a381898-46bb-41a8-8dfb-37502a9e8331 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:02.574471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a381898-46bb-41a8-8dfb-37502a9e8331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:02.612493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5a381898-46bb-41a8-8dfb-37502a9e8331 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:02.613871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5a381898-46bb-41a8-8dfb-37502a9e8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:02.629093 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1515/3026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:02.630380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02928042-8484-4359-ace4-ef899fbe44b6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:02.643963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02928042-8484-4359-ace4-ef899fbe44b6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:02.662870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:02.663711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:02.664750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:02.665150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:02.665967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:11:02.666400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:02.670986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:02.705969 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1512/3027] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:11:02.710102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a381898-46bb-41a8-8dfb-37502a9e8331 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:02.735511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a381898-46bb-41a8-8dfb-37502a9e8331 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:02.749259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:02.750208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:02.750591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:02.750965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:02.751724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:02.754483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:02.796271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1516/3028] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:11:02 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:11:02.800346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:02.814516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de430f20-c533-4f26-8031-3a719a72de48 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:02.894005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:02.895580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:02.896090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:02.897112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:02.899224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:02.902175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:02.945743 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1513/3029] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:11:02 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:11:02.945925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:02.947622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a154dc-66f3-4508-b490-b2d35d7ce83d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:02.955031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:02.955935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:02.956223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:02.956554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:02.957924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:02.959845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:02.977941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:02.978539 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1517/3030] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:02.992092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5457332-e05d-4976-8aa9-cbdb82f75c75 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:03.004231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fca988-a8b6-4c93-bd1a-30bbb99c22d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:03.005027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca988-a8b6-4c93-bd1a-30bbb99c22d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:03.005410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca988-a8b6-4c93-bd1a-30bbb99c22d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:03.005750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fca988-a8b6-4c93-bd1a-30bbb99c22d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:03.006688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fca988-a8b6-4c93-bd1a-30bbb99c22d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:03.009704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fca988-a8b6-4c93-bd1a-30bbb99c22d4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:03.040939 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1514/3031] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:11:03.046235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:03.062430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ece85-67e3-4125-8f6e-4c270d1da05a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:03.068303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:03.068991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:03.069307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:03.069674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] PATH_INFO: `/v3/projects/59da9491909f47418cd5316b02fcf1ef/users/13cb40a462d047bfb9cdf97a8b18092e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:03.103745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59da9491909f47418cd5316b02fcf1ef, user_id=13cb40a462d047bfb9cdf97a8b18092e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:03.106731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:03.111427 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:03.143342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:03.143699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:03.143892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:03.153651 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1518/3032] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:11:03 2022] PUT /identity/v3/projects/59da9491909f47418cd5316b02fcf1ef/users/13cb40a462d047bfb9cdf97a8b18092e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:03.200611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:03.204031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:03.248627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:03.250499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:03.363045 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1515/3033] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:03.374242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:03.376890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:03.381051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7e614-9939-4f37-b1b7-9f59a92899a0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:03.387796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:03.388527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:03.388903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:03.389221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] PATH_INFO: `/v3/users/265cbfea926e4d5ab6012be74c0c59c2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:03.391239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=265cbfea926e4d5ab6012be74c0c59c2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:03.393397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:03.395694 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:03.468142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265cbfea926e4d5ab6012be74c0c59c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:03.468859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265cbfea926e4d5ab6012be74c0c59c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:03.469697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265cbfea926e4d5ab6012be74c0c59c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:03.478892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265cbfea926e4d5ab6012be74c0c59c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:03.501038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e670cb96-d6d4-4565-a7ab-8430cfecf20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265cbfea926e4d5ab6012be74c0c59c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:03.534987 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1519/3034] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:11:03 2022] DELETE /identity/v3/users/265cbfea926e4d5ab6012be74c0c59c2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:03.539601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:03.539893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:03.540171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:03.565941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861176d9-adc8-4ae1-860d-0c2f2e252a25 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:03.598574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:03.599729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:03.648608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731ce8-6795-4c36-96ee-a8aad1dd42bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:03.649552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731ce8-6795-4c36-96ee-a8aad1dd42bf service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:03.649983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731ce8-6795-4c36-96ee-a8aad1dd42bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:03.650263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731ce8-6795-4c36-96ee-a8aad1dd42bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:03.652709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4731ce8-6795-4c36-96ee-a8aad1dd42bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:03.747070 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1520/3035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:11:03.760585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:03.761787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:03.782041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47088c32-eaa1-4937-845b-001d2e765c66 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:03.791072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:03.791697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:03.792004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:03.792243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:03.813916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:03.815356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:03.822522 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:03.833359 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1521/3036] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:03.859953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4731ce8-6795-4c36-96ee-a8aad1dd42bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:03.865411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4731ce8-6795-4c36-96ee-a8aad1dd42bf service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:03.909378 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1516/3037] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:04.617412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:04.620346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:04.655595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e5419-450b-42fc-b819-16e7c077f6d0 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:04.665656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:04.666924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:04.667485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:04.668030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] PATH_INFO: `/v3/projects/8d2481ad485b4d64a7dcf0b48e8f49e8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:04.672367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2481ad485b4d64a7dcf0b48e8f49e8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:04.676636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:04.868680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2481ad485b4d64a7dcf0b48e8f49e8', 'request_id': 'req-d6785fec-d744-4153-beb7-96439912aa18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:04.884458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2481ad485b4d64a7dcf0b48e8f49e8', 'request_id': 'req-d6785fec-d744-4153-beb7-96439912aa18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:04.918292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2481ad485b4d64a7dcf0b48e8f49e8', 'request_id': 'req-d6785fec-d744-4153-beb7-96439912aa18'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:05.007064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] The token cache is being invalidate because project 8d2481ad485b4d64a7dcf0b48e8f49e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:11:05.016221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:05.017368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d6785fec-d744-4153-beb7-96439912aa18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:05.021654 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1522/3038] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:11:04 2022] DELETE /identity/v3/projects/8d2481ad485b4d64a7dcf0b48e8f49e8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:05.026947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07ad2-e34b-4c2a-9031-3aa37760deb7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.028067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07ad2-e34b-4c2a-9031-3aa37760deb7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.028923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe07ad2-e34b-4c2a-9031-3aa37760deb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.073529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bfe07ad2-e34b-4c2a-9031-3aa37760deb7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:05.075282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bfe07ad2-e34b-4c2a-9031-3aa37760deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:05.241817 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1517/3039] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:05.244558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e351-fb3e-4303-a57c-08011f6c66cc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.244876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e351-fb3e-4303-a57c-08011f6c66cc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.245182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e351-fb3e-4303-a57c-08011f6c66cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.314550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-30a8e351-fb3e-4303-a57c-08011f6c66cc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:05.315921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-30a8e351-fb3e-4303-a57c-08011f6c66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:05.338791 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1523/3040] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:05.344034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe07ad2-e34b-4c2a-9031-3aa37760deb7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:05.361791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe07ad2-e34b-4c2a-9031-3aa37760deb7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:05.379693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:05.380417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.380863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.381282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.382018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:11:05.382332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:05.384923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:05.394873 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:05.408029 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1518/3041] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:11:05.412186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e351-fb3e-4303-a57c-08011f6c66cc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:05.427781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e351-fb3e-4303-a57c-08011f6c66cc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:05.438558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:05.444191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.446361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.446889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.448708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:05.454415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:05.538112 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1524/3042] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:11:05 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:11:05.543124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:05.579023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd3462-cdb6-4360-9bdd-0a4c38e1a957 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:05.681413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:05.682253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.682709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.683134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.683940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:05.687586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:05.738109 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1519/3043] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:11:05 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:11:05.742821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:05.760361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd1529-7d46-4418-85b6-a95e0507788d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:05.771450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:05.772087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.774153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.774320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.776035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:05.780912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:05.806893 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1525/3044] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:05.811340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:05.827321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac08b-a44a-400a-b472-59258db68ea8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:05.849019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7f9c-684c-40e9-8277-3ada7a8aaef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:05.849795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7f9c-684c-40e9-8277-3ada7a8aaef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.850077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7f9c-684c-40e9-8277-3ada7a8aaef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.850356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7f9c-684c-40e9-8277-3ada7a8aaef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.851940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe7f9c-684c-40e9-8277-3ada7a8aaef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:05.852954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe7f9c-684c-40e9-8277-3ada7a8aaef7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:05.875965 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1520/3045] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:11:05.881401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:05.901215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf213d-718f-4c19-839c-37c73e5acc32 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:05.915905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:05.916595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:05.916955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:05.917343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] PATH_INFO: `/v3/projects/ee7005164d7a4a4f815438dbcabe813a/users/5aa2c8eaca144fca8336eba156112b9e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:05.960336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7005164d7a4a4f815438dbcabe813a, user_id=5aa2c8eaca144fca8336eba156112b9e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:05.965686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:06.000570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1526/3046] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:11:05 2022] PUT /identity/v3/projects/ee7005164d7a4a4f815438dbcabe813a/users/5aa2c8eaca144fca8336eba156112b9e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:11:06.016522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337a07-7879-4369-b732-e6e768f7cf34 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:06.016825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337a07-7879-4369-b732-e6e768f7cf34 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:06.017359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337a07-7879-4369-b732-e6e768f7cf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:06.096833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-aa337a07-7879-4369-b732-e6e768f7cf34 None None] MFA Rules not processed for user `5aa2c8eaca144fca8336eba156112b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:06.098253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aa337a07-7879-4369-b732-e6e768f7cf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:06.244227 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1521/3047] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:06.254615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:06.256409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:06.614133 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:06.622025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb1ff-c39c-4aa7-be7f-7d3b87e31d55 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:06.638594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abf608-7fcd-4abe-b5b7-10374bff0a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:06.654559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abf608-7fcd-4abe-b5b7-10374bff0a26 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:06.655098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abf608-7fcd-4abe-b5b7-10374bff0a26 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:06.655495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abf608-7fcd-4abe-b5b7-10374bff0a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:06.683397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abf608-7fcd-4abe-b5b7-10374bff0a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:06.690264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abf608-7fcd-4abe-b5b7-10374bff0a26 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:06.723914 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1527/3048] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:08.325893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337a07-7879-4369-b732-e6e768f7cf34 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:08.555193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:08.656058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337a07-7879-4369-b732-e6e768f7cf34 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:08.676767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:08.680476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:08.683071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:08.683809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] PATH_INFO: `/v3/users/5aa2c8eaca144fca8336eba156112b9e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:08.690106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa2c8eaca144fca8336eba156112b9e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:08.694227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:08.841032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa2c8eaca144fca8336eba156112b9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:08.843546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa2c8eaca144fca8336eba156112b9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:08.847454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa2c8eaca144fca8336eba156112b9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:08.895526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa2c8eaca144fca8336eba156112b9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:08.928432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa2c8eaca144fca8336eba156112b9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:08.971459 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1522/3049] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:11:08 2022] DELETE /identity/v3/users/5aa2c8eaca144fca8336eba156112b9e => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:11:08.976405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:08.976837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:08.977017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:09.105404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:09.106655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:09.373918 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1528/3050] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:09.431884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:09.433401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:09.632843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0f878-3b96-4c4e-be38-291c216c24fa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:09.657916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235590a3-a985-4f29-a6e7-2353dfabf3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:09.658627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235590a3-a985-4f29-a6e7-2353dfabf3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:09.658916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235590a3-a985-4f29-a6e7-2353dfabf3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:09.659193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235590a3-a985-4f29-a6e7-2353dfabf3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:09.682251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235590a3-a985-4f29-a6e7-2353dfabf3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:09.683776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235590a3-a985-4f29-a6e7-2353dfabf3a1 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:09.719724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1523/3051] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:11.037375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:11.039656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:11.054957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a0f08-2dff-42d7-b028-a6d435c839a6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:11.061457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:11.062510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:11.062953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:11.064152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] PATH_INFO: `/v3/projects/ee7005164d7a4a4f815438dbcabe813a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:11.065836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7005164d7a4a4f815438dbcabe813a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:11.068015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:11.205262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7005164d7a4a4f815438dbcabe813a', 'request_id': 'req-f0b4a282-e785-42c3-bc8f-6b585be6358f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:11.212577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7005164d7a4a4f815438dbcabe813a', 'request_id': 'req-f0b4a282-e785-42c3-bc8f-6b585be6358f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:11.232213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7005164d7a4a4f815438dbcabe813a', 'request_id': 'req-f0b4a282-e785-42c3-bc8f-6b585be6358f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:11.250624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] The token cache is being invalidate because project ee7005164d7a4a4f815438dbcabe813a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:11:11.251350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:11.252893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0b4a282-e785-42c3-bc8f-6b585be6358f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:11.255637 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1529/3052] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:11:11 2022] DELETE /identity/v3/projects/ee7005164d7a4a4f815438dbcabe813a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:11.261950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bf96-c106-4f12-8158-8ee70a38bc4b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:11.265077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bf96-c106-4f12-8158-8ee70a38bc4b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:11.265569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bf96-c106-4f12-8158-8ee70a38bc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:11.336828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6365bf96-c106-4f12-8158-8ee70a38bc4b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:11.338147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6365bf96-c106-4f12-8158-8ee70a38bc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:11.406438 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:11.445968 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1524/3053] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:11.468853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31861e-17d2-4384-b566-b7302bb71246 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:11.469172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31861e-17d2-4384-b566-b7302bb71246 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:11.469451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31861e-17d2-4384-b566-b7302bb71246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:11.518669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6b31861e-17d2-4384-b566-b7302bb71246 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:11.520294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b31861e-17d2-4384-b566-b7302bb71246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:11.552102 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1530/3054] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:11.556701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bf96-c106-4f12-8158-8ee70a38bc4b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:11.570441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bf96-c106-4f12-8158-8ee70a38bc4b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:11.594370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:11.594845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:11.595137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:11.595550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:11.599742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:11:11.600099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:11.601907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:11.641160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31861e-17d2-4384-b566-b7302bb71246 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:11.661994 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1525/3055] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:11:11.675754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31861e-17d2-4384-b566-b7302bb71246 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:11.722664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa95e1d-bb25-414b-a3f0-f1d7021aaca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:11.723906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95e1d-bb25-414b-a3f0-f1d7021aaca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:11.729313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95e1d-bb25-414b-a3f0-f1d7021aaca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:11.729715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa95e1d-bb25-414b-a3f0-f1d7021aaca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:11.730766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa95e1d-bb25-414b-a3f0-f1d7021aaca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:11.738756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa95e1d-bb25-414b-a3f0-f1d7021aaca4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:11.806017 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1531/3056] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:11:11 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:11:11.810052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:11.826320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d336f-aba0-4ff2-95b2-9f3bf3fd55b7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:11.833826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:11.834115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:11.834425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:11.898561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] MFA Rules not processed for user `13cb40a462d047bfb9cdf97a8b18092e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:11.899934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:11.917355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:11.918191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:11.918703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:11.919049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:11.919693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:11.922231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:11.926996 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:11.967422 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1526/3057] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:11:11 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:11:11.972830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:11.994135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9639c-d07b-4e14-b353-e4f2f6623bb9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:12.000948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:12.001766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:12.002207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:12.002550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:12.003265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:12.004949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:12.033902 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1527/3058] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:12.036889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:12.037605 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1532/3059] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:11:12.049707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:12.051853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:12.061966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e721be-9468-4ab3-b565-ea71b340521c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:12.067730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:12.068338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:12.068621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:12.068893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:12.069604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:12.071486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:12.087106 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1528/3060] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:11:12.091955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:12.107770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85dca-9ae2-4e07-b694-18c28bfc18ab admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:12.113593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53936665-d02e-4bdb-b31a-6c6722f8b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:12.114461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53936665-d02e-4bdb-b31a-6c6722f8b149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:12.114735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53936665-d02e-4bdb-b31a-6c6722f8b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:12.115004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53936665-d02e-4bdb-b31a-6c6722f8b149 admin admin] PATH_INFO: `/v3/projects/cb2045206c084bb2b64b35a66df54c4d/users/af4b97d1c40c4ba4b41d30788d6a82d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:12.139598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53936665-d02e-4bdb-b31a-6c6722f8b149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2045206c084bb2b64b35a66df54c4d, user_id=af4b97d1c40c4ba4b41d30788d6a82d4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:12.143332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53936665-d02e-4bdb-b31a-6c6722f8b149 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:12.152061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7c8cc-af50-4fbc-beef-24b95ef6cf67 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:12.157153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:12.157979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:12.158400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:12.158767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:12.170268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:12.172153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:12.179060 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1529/3061] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:11:12 2022] PUT /identity/v3/projects/cb2045206c084bb2b64b35a66df54c4d/users/af4b97d1c40c4ba4b41d30788d6a82d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:12.180885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097e84-13e0-4872-ad65-4a8e016a994c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:12.181202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097e84-13e0-4872-ad65-4a8e016a994c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:12.181480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097e84-13e0-4872-ad65-4a8e016a994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:12.184415 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1533/3062] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:12.247683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9f097e84-13e0-4872-ad65-4a8e016a994c None None] MFA Rules not processed for user `af4b97d1c40c4ba4b41d30788d6a82d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:12.250119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9f097e84-13e0-4872-ad65-4a8e016a994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:12.393115 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1530/3063] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:12.406367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:12.408323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:12.547152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9749f-ea5e-4b41-ac74-f2da32f40711 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:12.596083 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:12.665002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015539af-6153-4d60-86c9-a995cbb07dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:12.665996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015539af-6153-4d60-86c9-a995cbb07dd2 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:12.666457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015539af-6153-4d60-86c9-a995cbb07dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:12.666911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015539af-6153-4d60-86c9-a995cbb07dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:12.677818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015539af-6153-4d60-86c9-a995cbb07dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:12.680764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015539af-6153-4d60-86c9-a995cbb07dd2 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:12.698441 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1534/3064] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:14.291769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097e84-13e0-4872-ad65-4a8e016a994c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:14.314151 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:14.392042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097e84-13e0-4872-ad65-4a8e016a994c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:14.399153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:14.400322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:14.401187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:14.401719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] PATH_INFO: `/v3/users/af4b97d1c40c4ba4b41d30788d6a82d4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:14.403645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4b97d1c40c4ba4b41d30788d6a82d4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:14.406382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:14.553027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4b97d1c40c4ba4b41d30788d6a82d4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:14.553922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4b97d1c40c4ba4b41d30788d6a82d4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:14.554652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4b97d1c40c4ba4b41d30788d6a82d4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:14.573100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4b97d1c40c4ba4b41d30788d6a82d4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:14.581199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4b97d1c40c4ba4b41d30788d6a82d4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:14.620006 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1531/3065] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:11:14 2022] DELETE /identity/v3/users/af4b97d1c40c4ba4b41d30788d6a82d4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:14.625146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c66932-4da6-4ac4-9d30-828bb06e1cac None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:14.625667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c66932-4da6-4ac4-9d30-828bb06e1cac None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:14.626543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c66932-4da6-4ac4-9d30-828bb06e1cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:14.657789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-38c66932-4da6-4ac4-9d30-828bb06e1cac None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:14.659431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-38c66932-4da6-4ac4-9d30-828bb06e1cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:14.794659 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1535/3066] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:14.807952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:14.810594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:14.968395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1285eb8-8742-4fd9-b744-df9219d3bd1b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:14.980056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:14.980841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:14.981313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:14.982550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:15.008880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:15.009038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79993589-774d-4106-86ca-8abf8f7a49d5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:15.009323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79993589-774d-4106-86ca-8abf8f7a49d5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:15.009655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79993589-774d-4106-86ca-8abf8f7a49d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:15.010685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:15.023744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1532/3067] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:15.034515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79993589-774d-4106-86ca-8abf8f7a49d5 None None] MFA Rules not processed for user `13cb40a462d047bfb9cdf97a8b18092e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:15.035808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79993589-774d-4106-86ca-8abf8f7a49d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:15.107527 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1536/3068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:15.722140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:15.724225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:15.749149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39737-282d-4a9e-9226-949d64457db8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:15.761494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:15.761764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:15.762512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:15.762512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] PATH_INFO: `/v3/projects/cb2045206c084bb2b64b35a66df54c4d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:15.765930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2045206c084bb2b64b35a66df54c4d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:15.767994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:15.829200 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:15.876937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2045206c084bb2b64b35a66df54c4d', 'request_id': 'req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:15.886215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2045206c084bb2b64b35a66df54c4d', 'request_id': 'req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:15.894757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2045206c084bb2b64b35a66df54c4d', 'request_id': 'req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:15.918543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] The token cache is being invalidate because project cb2045206c084bb2b64b35a66df54c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:11:15.919191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:15.919591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fc855c-dd0b-4905-9cf6-aaaf87fdb4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:15.923127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1533/3069] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:11:15 2022] DELETE /identity/v3/projects/cb2045206c084bb2b64b35a66df54c4d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:15.928148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90976d-cb7f-4259-a773-b5f01c8c21af None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:15.929794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90976d-cb7f-4259-a773-b5f01c8c21af None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:15.930552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90976d-cb7f-4259-a773-b5f01c8c21af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:15.954401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5b90976d-cb7f-4259-a773-b5f01c8c21af None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:15.956310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5b90976d-cb7f-4259-a773-b5f01c8c21af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:16.047562 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1537/3070] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:16.049380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888e78-b946-4d07-a038-eb21cd6f6e1c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.049667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888e78-b946-4d07-a038-eb21cd6f6e1c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.049945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af888e78-b946-4d07-a038-eb21cd6f6e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.096566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-af888e78-b946-4d07-a038-eb21cd6f6e1c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:16.102170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-af888e78-b946-4d07-a038-eb21cd6f6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:16.124468 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1534/3071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:16.125650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90976d-cb7f-4259-a773-b5f01c8c21af None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:16.145393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90976d-cb7f-4259-a773-b5f01c8c21af None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:16.155516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:16.156145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.156610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.156886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.157594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:11:16.157947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:16.159551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:16.166498 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:16.185281 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1538/3072] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:11:16.187964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888e78-b946-4d07-a038-eb21cd6f6e1c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:16.199268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af888e78-b946-4d07-a038-eb21cd6f6e1c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:16.215543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:16.216175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.216451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.216736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.217909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:16.219616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:16.288190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1535/3073] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:11:16 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:11:16.290463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:16.309846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f64516-57e7-41ea-b278-0acf99739730 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:16.383463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:16.384362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.384698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.384979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.387625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:16.389143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:16.425157 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1539/3074] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:11:16 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:11:16.430538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:16.445260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3328b7-6dc5-4a46-a061-7dc9c8e67739 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:16.456165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:16.456719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.456996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.457343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.458559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:16.460382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:16.473113 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1536/3075] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:16.476671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:16.490392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195586ef-5f02-4293-ac61-3327affa0bc8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:16.496657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704cd82-ff60-407c-9941-90e95b5f7067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:16.497301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704cd82-ff60-407c-9941-90e95b5f7067 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.498013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704cd82-ff60-407c-9941-90e95b5f7067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.498429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704cd82-ff60-407c-9941-90e95b5f7067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.499317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704cd82-ff60-407c-9941-90e95b5f7067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:16.500905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704cd82-ff60-407c-9941-90e95b5f7067 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:16.521137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1540/3076] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:16.532011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:16.544253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb45f52-2a98-43c6-8ccd-2832a315b6fa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:16.551194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:16.552186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.553011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.553482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] PATH_INFO: `/v3/projects/c4b3f8942ee24c58aa238ec62bff2541/users/34fd5da006404d83b346312106419060/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.582372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b3f8942ee24c58aa238ec62bff2541, user_id=34fd5da006404d83b346312106419060, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:16.587085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:16.610937 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1537/3077] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:11:16 2022] PUT /identity/v3/projects/c4b3f8942ee24c58aa238ec62bff2541/users/34fd5da006404d83b346312106419060/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:16.622619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01eb6-23df-4595-b08c-dda43b66ad90 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:16.622956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01eb6-23df-4595-b08c-dda43b66ad90 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:16.623668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd01eb6-23df-4595-b08c-dda43b66ad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:16.670637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2bd01eb6-23df-4595-b08c-dda43b66ad90 None None] MFA Rules not processed for user `34fd5da006404d83b346312106419060`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:16.673131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2bd01eb6-23df-4595-b08c-dda43b66ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:16.796390 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1541/3078] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:17.582889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:17.585032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:17.770606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b555314-b16f-4cd5-934a-d97594612559 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:17.781631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a013-872c-4bff-ad87-19f92643ac8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:17.782533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a013-872c-4bff-ad87-19f92643ac8c service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:17.783704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a013-872c-4bff-ad87-19f92643ac8c service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:17.784915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a013-872c-4bff-ad87-19f92643ac8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:17.817471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9a013-872c-4bff-ad87-19f92643ac8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:17.821669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9a013-872c-4bff-ad87-19f92643ac8c service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:17.860982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1538/3079] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:17.942605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01eb6-23df-4595-b08c-dda43b66ad90 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:18.101857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd01eb6-23df-4595-b08c-dda43b66ad90 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:18.108921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:18.109716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:18.110594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:18.113304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] PATH_INFO: `/v3/users/34fd5da006404d83b346312106419060` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:18.116427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fd5da006404d83b346312106419060)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:18.119457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:18.132183 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:18.229984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fd5da006404d83b346312106419060'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:18.230904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fd5da006404d83b346312106419060'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:18.231634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fd5da006404d83b346312106419060'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:18.247235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fd5da006404d83b346312106419060'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:18.275285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fd5da006404d83b346312106419060'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:18.301589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1542/3080] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:11:17 2022] DELETE /identity/v3/users/34fd5da006404d83b346312106419060 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:18.306085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:18.306733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:18.307075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:18.350454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:18.352390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:18.420751 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:18.553301 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1539/3081] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:18.553601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:18.556106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:18.773391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259df0-c3e3-4406-bc56-23ca5743a1ca admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:18.778440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd18ba-fd1a-4e55-979b-7d415965ffeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:18.779819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd18ba-fd1a-4e55-979b-7d415965ffeb service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:18.782587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd18ba-fd1a-4e55-979b-7d415965ffeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:18.783385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd18ba-fd1a-4e55-979b-7d415965ffeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:18.802920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd18ba-fd1a-4e55-979b-7d415965ffeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:18.806533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd18ba-fd1a-4e55-979b-7d415965ffeb service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:18.899389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1543/3082] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:19.671917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:19.673911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:19.696230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973616db-ce94-4e00-8dbb-4f0fb38e8348 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:19.717866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:19.718814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:19.719717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:19.720170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] PATH_INFO: `/v3/projects/c4b3f8942ee24c58aa238ec62bff2541` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:19.722943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b3f8942ee24c58aa238ec62bff2541)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:19.725208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:19.888909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b3f8942ee24c58aa238ec62bff2541', 'request_id': 'req-c24373eb-eabc-47b5-a99f-0083c8fc0636'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:19.907490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b3f8942ee24c58aa238ec62bff2541', 'request_id': 'req-c24373eb-eabc-47b5-a99f-0083c8fc0636'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:19.926355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b3f8942ee24c58aa238ec62bff2541', 'request_id': 'req-c24373eb-eabc-47b5-a99f-0083c8fc0636'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:19.960896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] The token cache is being invalidate because project c4b3f8942ee24c58aa238ec62bff2541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:11:19.961603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:19.964028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c24373eb-eabc-47b5-a99f-0083c8fc0636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:19.966648 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1540/3083] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:11:19 2022] DELETE /identity/v3/projects/c4b3f8942ee24c58aa238ec62bff2541 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:19.972005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438196-8698-4dcd-9465-da36a27ff2df None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:19.973274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438196-8698-4dcd-9465-da36a27ff2df None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:19.973753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438196-8698-4dcd-9465-da36a27ff2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.051296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e4438196-8698-4dcd-9465-da36a27ff2df None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:20.052555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4438196-8698-4dcd-9465-da36a27ff2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:20.285120 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1544/3084] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:11:20.287472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113d30-be08-4e4f-bb97-5552bd49fb61 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.287792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113d30-be08-4e4f-bb97-5552bd49fb61 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.288068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113d30-be08-4e4f-bb97-5552bd49fb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.340014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-71113d30-be08-4e4f-bb97-5552bd49fb61 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:20.343943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-71113d30-be08-4e4f-bb97-5552bd49fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:20.370571 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1541/3085] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:20.377318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4438196-8698-4dcd-9465-da36a27ff2df None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:20.395226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4438196-8698-4dcd-9465-da36a27ff2df None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:20.442040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:20.442705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.443968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.444401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.446230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:11:20.446553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:20.448263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:20.471837 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1545/3086] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:11:20.477820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71113d30-be08-4e4f-bb97-5552bd49fb61 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:20.491160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71113d30-be08-4e4f-bb97-5552bd49fb61 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:20.504048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:20.506230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.506701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.507169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.508845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:20.511495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:20.607392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1542/3087] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:11:20 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:11:20.608772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:20.627222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105b8ef-3d9b-451b-b046-d3e33b539847 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:20.646392 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:20.717135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:20.717924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.718322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.718761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.719580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:20.721927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:20.755333 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1546/3088] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:11:20 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:11:20.756883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:20.769950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb5df-c89f-4e72-a392-62d51cb9ba7b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:20.776806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:20.779024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.779558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.780042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.781017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:20.783718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:20.802094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:20.817259 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1543/3089] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:20.818420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c431f-c390-40ac-87f5-4e0f57fd98f9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:20.826006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d8abe-9858-4d89-926d-7e23916ea95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:20.827163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8abe-9858-4d89-926d-7e23916ea95f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.827879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8abe-9858-4d89-926d-7e23916ea95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.828416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d8abe-9858-4d89-926d-7e23916ea95f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.829415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d8abe-9858-4d89-926d-7e23916ea95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:20.831822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d8abe-9858-4d89-926d-7e23916ea95f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:20.853792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:20.865481 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1547/3090] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:20.868028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da020e8-f044-488f-829b-eaa1dfdbc92f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:20.873734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:20.874677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.875170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.875656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] PATH_INFO: `/v3/projects/b4a5b3634e114d0aa9a443d52b710246/users/0d8390c3ea2843e3ad8065bcfdaf4c83/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.915880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a5b3634e114d0aa9a443d52b710246, user_id=0d8390c3ea2843e3ad8065bcfdaf4c83, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:20.919191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:20.949467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cfb5-d2b0-4219-a8cd-97b7ff0eca52 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:20.949790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cfb5-d2b0-4219-a8cd-97b7ff0eca52 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:20.950165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09cfb5-d2b0-4219-a8cd-97b7ff0eca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:20.953093 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1544/3091] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:11:20 2022] PUT /identity/v3/projects/b4a5b3634e114d0aa9a443d52b710246/users/0d8390c3ea2843e3ad8065bcfdaf4c83/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:20.972141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ed09cfb5-d2b0-4219-a8cd-97b7ff0eca52 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:20.973643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ed09cfb5-d2b0-4219-a8cd-97b7ff0eca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:21.104638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:21.106834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:21.119721 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1548/3092] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:21.309126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319b10e-993b-4426-b256-28f183cd7f06 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:21.329039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:21.329944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:21.330285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:21.330692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:21.339849 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:21.348997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:21.353451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:21.380209 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1545/3093] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:24.294731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09cfb5-d2b0-4219-a8cd-97b7ff0eca52 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:24.310536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09cfb5-d2b0-4219-a8cd-97b7ff0eca52 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:24.323081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4479e-c814-4bff-bc08-c8e4835f014c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:24.325351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4479e-c814-4bff-bc08-c8e4835f014c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:24.325954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4479e-c814-4bff-bc08-c8e4835f014c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:24.327873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4479e-c814-4bff-bc08-c8e4835f014c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:24.335623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3ca4479e-c814-4bff-bc08-c8e4835f014c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:24.467602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4479e-c814-4bff-bc08-c8e4835f014c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:24.469083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4479e-c814-4bff-bc08-c8e4835f014c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:24.483155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1549/3094] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:24.721921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:24.727115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:24.756770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2708c-573d-49fd-a17a-87bf0f956eca service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:24.767907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:24.769384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:24.770343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:24.770956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] PATH_INFO: `/v3/users/06333292bb3e459ca52949843119e4b5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:24.778424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06333292bb3e459ca52949843119e4b5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:24.780118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:24.887885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06333292bb3e459ca52949843119e4b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:24.888978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06333292bb3e459ca52949843119e4b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:24.889865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06333292bb3e459ca52949843119e4b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:24.917581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06333292bb3e459ca52949843119e4b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:24.950361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06333292bb3e459ca52949843119e4b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:24.970027 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1546/3095] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:11:24 2022] DELETE /identity/v3/users/06333292bb3e459ca52949843119e4b5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:24.974836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:24.975374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:24.976504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:25.000886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:25.002495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:25.029629 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:25.104609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:25.107150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:25.202514 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1550/3096] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:11:25.234696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc05f5-8cb6-4882-acf7-cc2af8057f87 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:25.240429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:25.240979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:25.241424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:25.241965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:25.245270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:25.263027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:25.264802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:25.296685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:25.304987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:25.311614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0177150-00a2-48d7-8a98-2a0a7d893192 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:25.344914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:25.345599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:25.345884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:25.351741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:25.371079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1547/3097] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:11:25.389279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:25.391903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:25.408235 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1551/3098] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:26.106935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:26.109251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:26.149631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49807e7-a526-47af-9012-a21ae5579685 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:26.166321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:26.167079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:26.167364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:26.167645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] PATH_INFO: `/v3/projects/71af8395bfe048a6b6c9fac060b98a4d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:26.169980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71af8395bfe048a6b6c9fac060b98a4d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:26.172222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:26.321962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71af8395bfe048a6b6c9fac060b98a4d', 'request_id': 'req-b46db19d-6cd7-4dab-81e7-5092693dbce4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.328368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71af8395bfe048a6b6c9fac060b98a4d', 'request_id': 'req-b46db19d-6cd7-4dab-81e7-5092693dbce4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.337545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71af8395bfe048a6b6c9fac060b98a4d', 'request_id': 'req-b46db19d-6cd7-4dab-81e7-5092693dbce4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.339934 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:26.374514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] The token cache is being invalidate because project 71af8395bfe048a6b6c9fac060b98a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:11:26.374804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.380663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.386747 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1548/3099] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:11:26 2022] DELETE /identity/v3/projects/71af8395bfe048a6b6c9fac060b98a4d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:26.392784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:26.427205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138e3b0-650b-4024-a0a9-8ac9fc6d232e service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:26.584256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:26.585526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:26.585809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:26.589416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] PATH_INFO: `/v3/users/c2fc43659e084cefa74714e1d0525621` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:26.593673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fc43659e084cefa74714e1d0525621)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:26.595643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:26.712408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fc43659e084cefa74714e1d0525621'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.716860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fc43659e084cefa74714e1d0525621'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.718523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fc43659e084cefa74714e1d0525621'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.735997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fc43659e084cefa74714e1d0525621'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.793160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1352ffd1-e97a-4ef4-b704-ec1fed6afb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fc43659e084cefa74714e1d0525621'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:26.829510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1552/3100] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:11:26 2022] DELETE /identity/v3/users/c2fc43659e084cefa74714e1d0525621 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:28.019818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:28.021976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:28.060109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db19d-6cd7-4dab-81e7-5092693dbce4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:28.206840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:28.207507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:28.207747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:28.208273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] PATH_INFO: `/v3/projects/d8fa500aae8149b59e37946d0fbbcc28` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:28.216581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fa500aae8149b59e37946d0fbbcc28)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:28.218880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:28.321744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fa500aae8149b59e37946d0fbbcc28', 'request_id': 'req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:28.334942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fa500aae8149b59e37946d0fbbcc28', 'request_id': 'req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:28.349851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fa500aae8149b59e37946d0fbbcc28', 'request_id': 'req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:28.372663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] The token cache is being invalidate because project d8fa500aae8149b59e37946d0fbbcc28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:11:28.374199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:28.375418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3bb7cd33-bfd5-4420-9ab7-345bd15e49b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:11:28.384135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1549/3101] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:11:28 2022] DELETE /identity/v3/projects/d8fa500aae8149b59e37946d0fbbcc28 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:11:28.385366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d4ad-c089-4ee6-b4ce-8fa0f018cd56 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:28.386377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d4ad-c089-4ee6-b4ce-8fa0f018cd56 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:28.386933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d4ad-c089-4ee6-b4ce-8fa0f018cd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:28.423896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d0b3d4ad-c089-4ee6-b4ce-8fa0f018cd56 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:28.425987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d0b3d4ad-c089-4ee6-b4ce-8fa0f018cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:28.454807 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:28.541115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1553/3102] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:11:28.550180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dfb5-5a67-4dc3-93a6-982d36653c27 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:28.552138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dfb5-5a67-4dc3-93a6-982d36653c27 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:28.552631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dfb5-5a67-4dc3-93a6-982d36653c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:28.644772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b0e0dfb5-5a67-4dc3-93a6-982d36653c27 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:28.649774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b0e0dfb5-5a67-4dc3-93a6-982d36653c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:28.686617 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1550/3103] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:28.687881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3d4ad-c089-4ee6-b4ce-8fa0f018cd56 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:28.703734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3d4ad-c089-4ee6-b4ce-8fa0f018cd56 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:28.711400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:28.712270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:28.712714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:28.713186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:28.714002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:11:28.715718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:28.717616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:28.734782 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1554/3104] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:11:28.739232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0dfb5-5a67-4dc3-93a6-982d36653c27 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:28.751221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0dfb5-5a67-4dc3-93a6-982d36653c27 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:28.762045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:28.762976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:28.763487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:28.763823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:28.764539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:28.769105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:28.828924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1551/3105] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:11:28 2022] POST /identity/v3/projects => generated 397 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:11:28.833271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:28.852281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f203f-5f9c-4b8c-aef4-99b8250a4691 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:29.159371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:29.160361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:29.160876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:29.161572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:29.162496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:29.165672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:29.199496 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1555/3106] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:11:28 2022] POST /identity/v3/users => generated 299 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:11:29.204502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:29.221539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777fad0-b4b4-43b0-8b00-3a2fb9f0c565 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:29.247111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:29.247738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:29.252026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:29.252307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:29.253053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:29.261919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:29.289317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:29.297004 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1552/3107] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:11:29.305162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd12f6c-7e4c-4dd4-8d12-5303e4c71eea admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:29.321683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb495b1d-d9eb-469c-be6c-fbbdf66cf2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:29.322620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495b1d-d9eb-469c-be6c-fbbdf66cf2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:29.323069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495b1d-d9eb-469c-be6c-fbbdf66cf2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:29.323659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495b1d-d9eb-469c-be6c-fbbdf66cf2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:29.324501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb495b1d-d9eb-469c-be6c-fbbdf66cf2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:29.326428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb495b1d-d9eb-469c-be6c-fbbdf66cf2f4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:29.369293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:29.380201 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1556/3108] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:11:29.393749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc7eac-e463-49fc-8ffe-87d7e7386ee2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:29.407341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:29.408083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:29.408536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:29.408811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] PATH_INFO: `/v3/projects/335f86b3bc8c415a9a6619103b14b0b6/users/6b446b7d04ae45b3959fe37fc9dd5177/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:29.445355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] RBAC: Authorizing `identity:create_grant(project_id=335f86b3bc8c415a9a6619103b14b0b6, user_id=6b446b7d04ae45b3959fe37fc9dd5177, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:29.451896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:29.530211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:29.531607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:29.532264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:29.535420 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1553/3109] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:11:29 2022] PUT /identity/v3/projects/335f86b3bc8c415a9a6619103b14b0b6/users/6b446b7d04ae45b3959fe37fc9dd5177/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:11:29.612836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:29.614261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:29.795393 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1557/3110] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:29.852123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:29.854354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:29.900092 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:30.003059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f234bf-5bd9-4028-844e-9b528406887f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:30.008733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175741d-76d9-4355-a9de-3c8f5084ba6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:30.009488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175741d-76d9-4355-a9de-3c8f5084ba6c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:30.010842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175741d-76d9-4355-a9de-3c8f5084ba6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:30.011160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175741d-76d9-4355-a9de-3c8f5084ba6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:30.033321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175741d-76d9-4355-a9de-3c8f5084ba6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:30.036483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175741d-76d9-4355-a9de-3c8f5084ba6c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:30.049236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1554/3111] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:30.522936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:30.534708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:30.604682 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:30.719385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d033bc-6891-49c2-9962-f4720b791b44 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:30.744091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:30.745017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:30.745358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:30.745764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:30.749551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:30.866917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:30.868816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:30.883580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1558/3112] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:31.486426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec301-d82a-40a6-8622-b5772b6616f2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:31.486954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec301-d82a-40a6-8622-b5772b6616f2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:31.487182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec301-d82a-40a6-8622-b5772b6616f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:31.564668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c1fec301-d82a-40a6-8622-b5772b6616f2 None None] MFA Rules not processed for user `0d8390c3ea2843e3ad8065bcfdaf4c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:31.566301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c1fec301-d82a-40a6-8622-b5772b6616f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:31.709496 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1555/3113] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:31.842987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:31.861004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f51809-42b4-49e2-91ef-ac445e85774d service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:31.879595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7510b84-3e79-4ec8-a476-6256131bc543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:31.881988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510b84-3e79-4ec8-a476-6256131bc543 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:31.884329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510b84-3e79-4ec8-a476-6256131bc543 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:31.884821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510b84-3e79-4ec8-a476-6256131bc543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:31.900920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7510b84-3e79-4ec8-a476-6256131bc543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:31.905686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7510b84-3e79-4ec8-a476-6256131bc543 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:31.920299 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1559/3114] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:33.325828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7199e2-cdbe-446a-b100-59ef46a3d7c2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:33.326298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7199e2-cdbe-446a-b100-59ef46a3d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:33.327955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7199e2-cdbe-446a-b100-59ef46a3d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:33.356875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fd7199e2-cdbe-446a-b100-59ef46a3d7c2 None None] MFA Rules not processed for user `0d8390c3ea2843e3ad8065bcfdaf4c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:33.360410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fd7199e2-cdbe-446a-b100-59ef46a3d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:33.380468 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1556/3115] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:41.914025 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=50 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:43.348166 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=53 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:44.796342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7709582-3e35-43a8-8e22-fda8a73e2968 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:44.796919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7709582-3e35-43a8-8e22-fda8a73e2968 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:44.796919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7709582-3e35-43a8-8e22-fda8a73e2968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:44.847084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d7709582-3e35-43a8-8e22-fda8a73e2968 None None] MFA Rules not processed for user `e7508410259d4df7bd231db49c35c8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:44.852943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d7709582-3e35-43a8-8e22-fda8a73e2968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:44.997667 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1560/3116] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:45.991240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307eccf-29e9-48e3-a037-2162ab6d9623 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:45.992162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307eccf-29e9-48e3-a037-2162ab6d9623 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:45.992162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307eccf-29e9-48e3-a037-2162ab6d9623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:46.081717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0307eccf-29e9-48e3-a037-2162ab6d9623 None None] MFA Rules not processed for user `6b446b7d04ae45b3959fe37fc9dd5177`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:46.083891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0307eccf-29e9-48e3-a037-2162ab6d9623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:46.220176 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1557/3117] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:46.236872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e87e7-8f59-4465-a7a4-a307abe99ed2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:46.237636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e87e7-8f59-4465-a7a4-a307abe99ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:46.237790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e87e7-8f59-4465-a7a4-a307abe99ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:46.279300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e30e87e7-8f59-4465-a7a4-a307abe99ed2 None None] MFA Rules not processed for user `6b446b7d04ae45b3959fe37fc9dd5177`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:46.283458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e30e87e7-8f59-4465-a7a4-a307abe99ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:46.292471 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1561/3118] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:11:47.422858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307eccf-29e9-48e3-a037-2162ab6d9623 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:11:47.442750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307eccf-29e9-48e3-a037-2162ab6d9623 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:11:47.452304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab14620-e5a3-49f8-917b-cb4a3eee9d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:11:47.456106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab14620-e5a3-49f8-917b-cb4a3eee9d69 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:47.457796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab14620-e5a3-49f8-917b-cb4a3eee9d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:47.458830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab14620-e5a3-49f8-917b-cb4a3eee9d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:47.470851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab14620-e5a3-49f8-917b-cb4a3eee9d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:11:47.472863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab14620-e5a3-49f8-917b-cb4a3eee9d69 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:11:47.495416 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1558/3119] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:11:56.266450 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=28 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:57.480257 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=38 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:11:57.886603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:11:57.887079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:11:57.887400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:11:57.917957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] MFA Rules not processed for user `b7bda6344ae348648373e6fa9b530bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:11:57.919188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:11:58.018491 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1562/3120] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:08.009233 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=25 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:13.138008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc31cc-5e83-4a03-a425-0e75695a9ec2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:13.138520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc31cc-5e83-4a03-a425-0e75695a9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:13.138520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc31cc-5e83-4a03-a425-0e75695a9ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:13.194979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1ebc31cc-5e83-4a03-a425-0e75695a9ec2 None None] MFA Rules not processed for user `0d8390c3ea2843e3ad8065bcfdaf4c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:13.198271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ebc31cc-5e83-4a03-a425-0e75695a9ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:13.217309 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1559/3121] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:19.890542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:19.894198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:20.055023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c39fa-8b29-4ae0-836d-edcae16b6039 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:20.062699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea654f-2d17-4096-a2ad-80718386376a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:20.063054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea654f-2d17-4096-a2ad-80718386376a service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:20.063491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea654f-2d17-4096-a2ad-80718386376a service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:20.063904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea654f-2d17-4096-a2ad-80718386376a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:20.066500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-29ea654f-2d17-4096-a2ad-80718386376a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:20.080683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea654f-2d17-4096-a2ad-80718386376a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:20.082535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea654f-2d17-4096-a2ad-80718386376a service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:20.104226 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1563/3122] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:20.300753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:20.301717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:20.301717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:20.331858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] MFA Rules not processed for user `6b446b7d04ae45b3959fe37fc9dd5177`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:20.337108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:20.357076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1560/3123] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:23.946895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0873-af4e-4caf-9cfd-4f5acd45ad68 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:23.947357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0873-af4e-4caf-9cfd-4f5acd45ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:23.947432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0873-af4e-4caf-9cfd-4f5acd45ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:23.995859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4a5e0873-af4e-4caf-9cfd-4f5acd45ad68 None None] MFA Rules not processed for user `13cb40a462d047bfb9cdf97a8b18092e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:23.997421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4a5e0873-af4e-4caf-9cfd-4f5acd45ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:24.187889 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1564/3124] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:28.408691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:28.412112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:28.431021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef6aab-bd9b-49ee-87cc-04e3abd5b076 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:28.447024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:28.451606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:28.451894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:28.452171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:28.460480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:28.484233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:28.486299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:28.505801 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1561/3125] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:34.169150 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=57 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:38.493921 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=12 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:43.134616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0873-af4e-4caf-9cfd-4f5acd45ad68 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:43.146206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0873-af4e-4caf-9cfd-4f5acd45ad68 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:43.150497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:43.151378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:43.151852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:43.152356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:43.154617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:43.182027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:43.183677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:43.211183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1565/3126] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:47.626199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:47.627768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:47.641572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c7e7-52ab-4249-859d-cd37f96674c8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:47.648229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:47.648944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:47.649321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:47.649661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] PATH_INFO: `/v3/users/e7508410259d4df7bd231db49c35c8c9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:47.651035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7508410259d4df7bd231db49c35c8c9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:47.653305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:47.723672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7508410259d4df7bd231db49c35c8c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:47.724650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7508410259d4df7bd231db49c35c8c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:47.725703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7508410259d4df7bd231db49c35c8c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:47.742831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7508410259d4df7bd231db49c35c8c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:47.755121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7508410259d4df7bd231db49c35c8c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:47.777380 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1562/3127] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:12:47 2022] DELETE /identity/v3/users/e7508410259d4df7bd231db49c35c8c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:48.525753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:48.554313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5acfe4-b0c7-4d8e-a7c6-6ba1d8ea1389 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:48.701984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:48.703367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:48.704463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:48.705190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] PATH_INFO: `/v3/projects/5964bc44f7f44f5c8d54dce3301b2e36` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:48.707972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5964bc44f7f44f5c8d54dce3301b2e36)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:48.710912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:48.825782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5964bc44f7f44f5c8d54dce3301b2e36', 'request_id': 'req-9286002e-ce79-47f4-809b-7bfe5b837731'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:48.844093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5964bc44f7f44f5c8d54dce3301b2e36', 'request_id': 'req-9286002e-ce79-47f4-809b-7bfe5b837731'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:48.870080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:48.877792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:48.879160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5964bc44f7f44f5c8d54dce3301b2e36', 'request_id': 'req-9286002e-ce79-47f4-809b-7bfe5b837731'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:48.974899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] The token cache is being invalidate because project 5964bc44f7f44f5c8d54dce3301b2e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:12:48.975532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:48.976763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:48.992332 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1566/3128] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:12:48 2022] DELETE /identity/v3/projects/5964bc44f7f44f5c8d54dce3301b2e36 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:48.994726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:48.996437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:49.078866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1a528-0641-4415-88b2-e1136dd20683 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:49.164343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286002e-ce79-47f4-809b-7bfe5b837731 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:49.178399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:49.179058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:49.179345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:49.179675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] PATH_INFO: `/v3/users/3f540ecf8f4e43d6870e501dc8f296eb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:49.180963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f540ecf8f4e43d6870e501dc8f296eb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:49.183053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:49.223822 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:49.229412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:49.230340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:49.230924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:49.232137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:49.234757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:49.290286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f540ecf8f4e43d6870e501dc8f296eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:49.291976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f540ecf8f4e43d6870e501dc8f296eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:49.293510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f540ecf8f4e43d6870e501dc8f296eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:49.308984 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:49.314214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f540ecf8f4e43d6870e501dc8f296eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:49.348739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f540ecf8f4e43d6870e501dc8f296eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:49.361475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:49.363212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:49.374114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1567/3129] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:12:48 2022] DELETE /identity/v3/users/3f540ecf8f4e43d6870e501dc8f296eb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:49.379697 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1563/3130] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:50.244054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:50.245729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:50.417016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecdb1f-adfa-4e76-b489-91fc0568af59 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:50.432049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:50.432259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:50.432542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:50.432819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] PATH_INFO: `/v3/users/92d56e7f729243e386f7ce8080cf864e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:50.438512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d56e7f729243e386f7ce8080cf864e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:50.440742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:50.490442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:50.508744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb37f1-d55e-4109-933f-bc074f655b64 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:50.518067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:50.519184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:50.519184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:50.520218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] PATH_INFO: `/v3/projects/4068219bc55249bead263f07bceca5b6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:50.521953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4068219bc55249bead263f07bceca5b6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:50.526350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:50.574615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d56e7f729243e386f7ce8080cf864e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.577699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d56e7f729243e386f7ce8080cf864e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.579097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d56e7f729243e386f7ce8080cf864e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.620796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d56e7f729243e386f7ce8080cf864e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.638054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4068219bc55249bead263f07bceca5b6', 'request_id': 'req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.648064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4068219bc55249bead263f07bceca5b6', 'request_id': 'req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.656700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4068219bc55249bead263f07bceca5b6', 'request_id': 'req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.667183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-76af29fc-59df-4b90-b643-fe251456bc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d56e7f729243e386f7ce8080cf864e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.685394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] The token cache is being invalidate because project 4068219bc55249bead263f07bceca5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:12:50.687624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.690903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a455ad8b-1e95-4f28-9faa-341bdfc4e8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:50.695696 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1564/3131] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:12:50 2022] DELETE /identity/v3/projects/4068219bc55249bead263f07bceca5b6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:50.696181 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1568/3132] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:12:50 2022] DELETE /identity/v3/users/92d56e7f729243e386f7ce8080cf864e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:50.704019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829159-0c46-4907-9583-965877296626 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:50.704266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829159-0c46-4907-9583-965877296626 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:50.704574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829159-0c46-4907-9583-965877296626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:50.744457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a5829159-0c46-4907-9583-965877296626 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:50.748070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a5829159-0c46-4907-9583-965877296626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:50.908350 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1565/3133] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:50.917264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff917d-6306-4012-a04f-cb877756aa35 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:50.917550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff917d-6306-4012-a04f-cb877756aa35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:50.917830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff917d-6306-4012-a04f-cb877756aa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:50.954057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ecff917d-6306-4012-a04f-cb877756aa35 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:50.955398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ecff917d-6306-4012-a04f-cb877756aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:50.978369 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1569/3134] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:50.982551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829159-0c46-4907-9583-965877296626 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.000275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829159-0c46-4907-9583-965877296626 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.012037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.012990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.013897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.014322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:51.015127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:12:51.015782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:51.018169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:51.045165 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1566/3135] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:12:51.055949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff917d-6306-4012-a04f-cb877756aa35 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.102955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff917d-6306-4012-a04f-cb877756aa35 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.132634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.134259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.134679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.134875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:51.136146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:51.140008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:51.149206 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:51.158879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.161504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:51.189142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702eba66-3cd6-427a-be2a-536904a1fd7e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.208091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.209721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.211732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.217590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] PATH_INFO: `/v3/projects/731a310f1e1f4e6a9df50eea1e053259` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:51.221199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=731a310f1e1f4e6a9df50eea1e053259)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:51.227406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:51.261346 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1570/3136] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:12:51 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:12:51.262419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.352479 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:51.383924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731a310f1e1f4e6a9df50eea1e053259', 'request_id': 'req-70d27135-3b18-43d7-a392-274637ce43dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:51.406430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731a310f1e1f4e6a9df50eea1e053259', 'request_id': 'req-70d27135-3b18-43d7-a392-274637ce43dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:51.424468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39635616-beca-4f83-8bed-78f9d6ef3f4c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.428574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731a310f1e1f4e6a9df50eea1e053259', 'request_id': 'req-70d27135-3b18-43d7-a392-274637ce43dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:51.460865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] The token cache is being invalidate because project 731a310f1e1f4e6a9df50eea1e053259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:12:51.461513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:51.464640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:51.476972 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1567/3137] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:12:51 2022] DELETE /identity/v3/projects/731a310f1e1f4e6a9df50eea1e053259 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:51.482985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.494888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:51.644082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.645880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.646409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.647147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:51.648949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:51.651359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:51.701400 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1571/3138] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:12:51 2022] POST /identity/v3/users => generated 288 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:12:51.705811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.709548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:51.731329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe18821-828b-4e1e-938c-3383954f7542 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.735967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.736602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.736964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.737240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:51.738026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:51.740053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:51.759257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1572/3139] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:12:51.766562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.817302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddddefb-2091-4ba0-8f33-e2bc6f39ccde admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.818591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27135-3b18-43d7-a392-274637ce43dc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.831481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.833221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.833511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.834315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.835824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.836075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] PATH_INFO: `/v3/users/31366108b1714a61891a680ea35dcc2e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:51.837536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.838755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:51.839757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:51.841887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31366108b1714a61891a680ea35dcc2e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:51.844453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:51.847227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:51.886198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1573/3140] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:12:51.889779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:51.928854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a69f-9c0d-4008-93c2-473572a1579c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:51.954339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92f94-ced3-4250-908e-91a892d27279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:51.958200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92f94-ced3-4250-908e-91a892d27279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:51.958950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92f94-ced3-4250-908e-91a892d27279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:51.959484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92f94-ced3-4250-908e-91a892d27279 admin admin] PATH_INFO: `/v3/projects/1bb3b5f67cff46e7acf5801b20b86b6a/users/7e70ed082cd2410da37a841838b6eb44/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:52.006246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31366108b1714a61891a680ea35dcc2e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.008335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31366108b1714a61891a680ea35dcc2e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.010145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31366108b1714a61891a680ea35dcc2e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.032363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92f94-ced3-4250-908e-91a892d27279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb3b5f67cff46e7acf5801b20b86b6a, user_id=7e70ed082cd2410da37a841838b6eb44, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:52.039850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92f94-ced3-4250-908e-91a892d27279 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:52.047956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31366108b1714a61891a680ea35dcc2e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.065325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31366108b1714a61891a680ea35dcc2e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.078704 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1574/3141] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:12:51 2022] PUT /identity/v3/projects/1bb3b5f67cff46e7acf5801b20b86b6a/users/7e70ed082cd2410da37a841838b6eb44/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:12:52.085663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:52.086379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:52.088228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:52.108731 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1568/3142] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:12:51 2022] DELETE /identity/v3/users/31366108b1714a61891a680ea35dcc2e => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:52.136876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:52.138331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:52.209960 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:52.264553 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1575/3143] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:52.280741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:52.283314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:52.397319 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:52.403486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:52.408835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:52.428533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9f6ef-4c73-4724-a6ec-55b01f65022e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:52.438346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee15088-3d6a-4a11-be44-c1ad4ee53a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:52.440272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee15088-3d6a-4a11-be44-c1ad4ee53a6b service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:52.440794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee15088-3d6a-4a11-be44-c1ad4ee53a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:52.443689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee15088-3d6a-4a11-be44-c1ad4ee53a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:52.443818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f16e-04ef-4c0b-91ca-234761e50eae None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:52.466795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:52.467841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee15088-3d6a-4a11-be44-c1ad4ee53a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:52.473891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:52.475045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:52.475337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] PATH_INFO: `/v3/projects/2aa8ab9fc4c24171895aeb3367d1be07` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:52.476941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee15088-3d6a-4a11-be44-c1ad4ee53a6b service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:52.478447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa8ab9fc4c24171895aeb3367d1be07)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:52.498084 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1569/3144] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:12:52.499908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:52.607673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa8ab9fc4c24171895aeb3367d1be07', 'request_id': 'req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.617637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa8ab9fc4c24171895aeb3367d1be07', 'request_id': 'req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.637563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa8ab9fc4c24171895aeb3367d1be07', 'request_id': 'req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.682726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] The token cache is being invalidate because project 2aa8ab9fc4c24171895aeb3367d1be07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:12:52.683424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.684288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d9d295d8-e354-4e58-a56e-f9afbf1a87e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:12:52.686607 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1576/3145] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:12:52 2022] DELETE /identity/v3/projects/2aa8ab9fc4c24171895aeb3367d1be07 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:52.692621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286eb8-ec7d-4db3-a628-32a8f99b5d8e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:52.694231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286eb8-ec7d-4db3-a628-32a8f99b5d8e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:52.694553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286eb8-ec7d-4db3-a628-32a8f99b5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:52.720908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fc286eb8-ec7d-4db3-a628-32a8f99b5d8e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:52.722488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fc286eb8-ec7d-4db3-a628-32a8f99b5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:52.840082 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1570/3146] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:52.842068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397197-146c-4f8c-8e38-b80833d1d4b6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:52.842354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397197-146c-4f8c-8e38-b80833d1d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:52.842625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397197-146c-4f8c-8e38-b80833d1d4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:52.901576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fa397197-146c-4f8c-8e38-b80833d1d4b6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:52.901576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa397197-146c-4f8c-8e38-b80833d1d4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:52.944017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc286eb8-ec7d-4db3-a628-32a8f99b5d8e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:52.944142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1577/3147] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:52.959817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc286eb8-ec7d-4db3-a628-32a8f99b5d8e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:52.976276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:52.976902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:52.977213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:52.977481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:52.978138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:12:52.978433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:52.980048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:53.014246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa397197-146c-4f8c-8e38-b80833d1d4b6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:53.021275 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1571/3148] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:12:53.027997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa397197-146c-4f8c-8e38-b80833d1d4b6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:53.038157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:53.039608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:53.039895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:53.040672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:53.041453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:53.043491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:53.132772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:53.133242 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1578/3149] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:12:53 2022] POST /identity/v3/projects => generated 361 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:12:53.143073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adaa75-a934-4bb6-8e72-6daed391ffb8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:53.235188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:53.235797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:53.236071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:53.236339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:53.237260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:53.239143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:53.268534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:53.273215 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1572/3150] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:12:53 2022] POST /identity/v3/users => generated 281 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:12:53.282122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455cad8-20de-4123-8042-aceeff21f729 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:53.287361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:53.288120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:53.288405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:53.288674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:53.289576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:53.291402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:53.307656 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1579/3151] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:12:53.308861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:53.320850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdf35d-7377-4403-873a-f3e7c0bb3ccb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:53.330164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0aca-1465-423e-ac48-8b739fcf6b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:53.330970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0aca-1465-423e-ac48-8b739fcf6b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:53.331328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0aca-1465-423e-ac48-8b739fcf6b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:53.331845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0aca-1465-423e-ac48-8b739fcf6b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:53.333190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d0aca-1465-423e-ac48-8b739fcf6b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:53.335060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d0aca-1465-423e-ac48-8b739fcf6b4a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:53.348582 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1573/3152] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:12:53.352879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:53.364143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15600cb0-b9fa-44cc-9783-095822354521 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:53.374514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:53.375602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:53.376084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:53.376362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] PATH_INFO: `/v3/projects/b6b20c829a644a0b9e74f4bfdcbb4fee/users/e440535442ae4cbcb5ba2ea62d080c9c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:53.401361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b20c829a644a0b9e74f4bfdcbb4fee, user_id=e440535442ae4cbcb5ba2ea62d080c9c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:53.406390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:53.427136 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1580/3153] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:12:53 2022] PUT /identity/v3/projects/b6b20c829a644a0b9e74f4bfdcbb4fee/users/e440535442ae4cbcb5ba2ea62d080c9c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:53.439241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b90d1-d117-4e9f-bc14-e987b13b533c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:53.440564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b90d1-d117-4e9f-bc14-e987b13b533c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:53.441482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b90d1-d117-4e9f-bc14-e987b13b533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:53.515673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6d9b90d1-d117-4e9f-bc14-e987b13b533c None None] MFA Rules not processed for user `e440535442ae4cbcb5ba2ea62d080c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:53.522622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6d9b90d1-d117-4e9f-bc14-e987b13b533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:53.620660 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:53.688069 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1574/3154] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:12:53.692807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:53.767697 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:53.790668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33749-6672-4480-875b-3c2f77853970 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:53.796364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:53.797287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:53.797768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:53.798235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:53.799106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:53.801484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:53.852765 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1581/3155] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:12:53 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:12:53.857154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b90d1-d117-4e9f-bc14-e987b13b533c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:53.874895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b90d1-d117-4e9f-bc14-e987b13b533c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:54.058877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:54.059978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:54.060318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:54.060774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:54.061558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:54.063740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:54.124237 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1575/3156] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:12:53 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:12:54.130977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:54.146316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a606eb-d173-4b8f-ad94-f5c424284239 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:54.154199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:54.155087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:54.155434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:54.155772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:54.156488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:54.158857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:54.180431 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1582/3157] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:12:54.185075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:54.208448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767151-acce-45a0-a7a8-8b1f5c732cfc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:54.216737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:54.217547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:54.218492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:54.218973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] PATH_INFO: `/v3/projects/c6950a83fa594012811cad42478e1fec/users/7a8e3fab98524c5e807823e0f2544bdf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:54.252221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6950a83fa594012811cad42478e1fec, user_id=7a8e3fab98524c5e807823e0f2544bdf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:54.256461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:54.291219 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1576/3158] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:12:54 2022] PUT /identity/v3/projects/c6950a83fa594012811cad42478e1fec/users/7a8e3fab98524c5e807823e0f2544bdf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:54.295249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:54.308864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e92e6-b9f2-4294-bddc-449529424335 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:54.416982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6820d1-409b-41b3-bbde-da68386c1925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:54.420651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6820d1-409b-41b3-bbde-da68386c1925 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:54.422059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6820d1-409b-41b3-bbde-da68386c1925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:54.422779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6820d1-409b-41b3-bbde-da68386c1925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:54.423572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6820d1-409b-41b3-bbde-da68386c1925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:54.427772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6820d1-409b-41b3-bbde-da68386c1925 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:54.448337 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1583/3159] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:12:54.452461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:54.466987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525b9c-ba66-47b4-99b4-b2aab6e9794a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:54.475112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:54.475907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:54.476817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:54.477312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] PATH_INFO: `/v3/projects/c6950a83fa594012811cad42478e1fec/users/7a8e3fab98524c5e807823e0f2544bdf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:54.480169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6950a83fa594012811cad42478e1fec, user_id=7a8e3fab98524c5e807823e0f2544bdf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:54.483443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:54.523502 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1577/3160] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:12:54 2022] PUT /identity/v3/projects/c6950a83fa594012811cad42478e1fec/users/7a8e3fab98524c5e807823e0f2544bdf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:12:54.536329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd60a-341d-451c-8e4e-670e304bcc15 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:54.536730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd60a-341d-451c-8e4e-670e304bcc15 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:54.537308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd60a-341d-451c-8e4e-670e304bcc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:54.607161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-34abd60a-341d-451c-8e4e-670e304bcc15 None None] MFA Rules not processed for user `7a8e3fab98524c5e807823e0f2544bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:54.608477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-34abd60a-341d-451c-8e4e-670e304bcc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:54.820520 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1584/3161] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:12:57.694708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:12:57.696723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:57.846004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1948-6515-4288-baac-f8e6edda46c9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:12:57.884882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f1e16-d059-48be-b5a6-fbf7a3862394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:12:57.886198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f1e16-d059-48be-b5a6-fbf7a3862394 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:57.887452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f1e16-d059-48be-b5a6-fbf7a3862394 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:57.888075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f1e16-d059-48be-b5a6-fbf7a3862394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:57.902085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f1e16-d059-48be-b5a6-fbf7a3862394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:12:57.904550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f1e16-d059-48be-b5a6-fbf7a3862394 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:12:57.927777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1578/3162] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:12:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:12:59.558391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ac156-fd7e-4268-b25e-dad7af12a1c5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:12:59.558862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ac156-fd7e-4268-b25e-dad7af12a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:12:59.558954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ac156-fd7e-4268-b25e-dad7af12a1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:12:59.598113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-431ac156-fd7e-4268-b25e-dad7af12a1c5 None None] MFA Rules not processed for user `7e70ed082cd2410da37a841838b6eb44`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:12:59.599689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-431ac156-fd7e-4268-b25e-dad7af12a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:12:59.645118 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:12:59.698243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1585/3163] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:00.080998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceb0f4-6b2b-4983-8555-cb227eab626d None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:00.081535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceb0f4-6b2b-4983-8555-cb227eab626d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:00.081535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceb0f4-6b2b-4983-8555-cb227eab626d None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:00.083464 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1579/3164] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:13:00.090638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:00.090925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:00.091194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:00.176357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:00.176605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:00.241624 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1586/3165] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:00.256771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceb0f4-6b2b-4983-8555-cb227eab626d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:00.259278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b7ceb0f4-6b2b-4983-8555-cb227eab626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:00.288094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceb0f4-6b2b-4983-8555-cb227eab626d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:00.291900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:00.292505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:00.293206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:00.293399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:00.319551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:00.321427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:00.336528 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1580/3166] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:01.208343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:01.210212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:01.232739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef09e9-f611-41a1-a35b-21a874ee69c3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:01.241010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a9ee5-8540-49fa-8630-4ea3f566557a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:01.242117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9ee5-8540-49fa-8630-4ea3f566557a service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:01.242602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9ee5-8540-49fa-8630-4ea3f566557a service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:01.243058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9ee5-8540-49fa-8630-4ea3f566557a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:01.252587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a9ee5-8540-49fa-8630-4ea3f566557a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:01.258113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a9ee5-8540-49fa-8630-4ea3f566557a service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:01.285728 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1587/3167] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:04.230311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:04.237278 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:04.313928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b3d8-212c-4a11-9a02-18f1755c2b37 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:04.319523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:04.320195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:04.320474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:04.320748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] PATH_INFO: `/v3/users/e440535442ae4cbcb5ba2ea62d080c9c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:04.322128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e440535442ae4cbcb5ba2ea62d080c9c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:04.324042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:04.372553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e440535442ae4cbcb5ba2ea62d080c9c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:04.373164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e440535442ae4cbcb5ba2ea62d080c9c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:04.373778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e440535442ae4cbcb5ba2ea62d080c9c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:04.394736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e440535442ae4cbcb5ba2ea62d080c9c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:04.401700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e440535442ae4cbcb5ba2ea62d080c9c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:04.423824 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1581/3168] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:04 2022] DELETE /identity/v3/users/e440535442ae4cbcb5ba2ea62d080c9c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:04.428312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:04.429324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:04.429751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:04.456386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:04.457877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:04.547569 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1588/3169] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:04.561826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:04.563318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:04.634088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecb96d-f120-46ed-98ee-a0ae2717ddd2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:04.638007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:04.638703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:04.639146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:04.639529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:04.656693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:04.658391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:04.670159 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1582/3170] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:04.957489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:04.959109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:04.974410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919d2a7-154f-454f-beaf-52d7ccbd8357 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:04.980900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:04.981575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:04.981850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:04.982144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] PATH_INFO: `/v3/projects/b6b20c829a644a0b9e74f4bfdcbb4fee` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:04.983417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b20c829a644a0b9e74f4bfdcbb4fee)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:04.985357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:05.036902 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:05.041253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b20c829a644a0b9e74f4bfdcbb4fee', 'request_id': 'req-9464982f-331a-4a71-804c-465e1f293744'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.048376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b20c829a644a0b9e74f4bfdcbb4fee', 'request_id': 'req-9464982f-331a-4a71-804c-465e1f293744'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.057978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b20c829a644a0b9e74f4bfdcbb4fee', 'request_id': 'req-9464982f-331a-4a71-804c-465e1f293744'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.069305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] The token cache is being invalidate because project b6b20c829a644a0b9e74f4bfdcbb4fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:05.069504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.070230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.074489 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1589/3171] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:04 2022] DELETE /identity/v3/projects/b6b20c829a644a0b9e74f4bfdcbb4fee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:05.076501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:05.095905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368076-b381-423c-b345-98ed099030bb service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:05.125982 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:05.170657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:05.171589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:05.172053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:05.172519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] PATH_INFO: `/v3/users/7a8e3fab98524c5e807823e0f2544bdf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:05.173896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8e3fab98524c5e807823e0f2544bdf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:05.176580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:05.244106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:05.245637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:05.267467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8e3fab98524c5e807823e0f2544bdf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.269274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8e3fab98524c5e807823e0f2544bdf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.270399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8e3fab98524c5e807823e0f2544bdf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.292570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8e3fab98524c5e807823e0f2544bdf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.301747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8e3fab98524c5e807823e0f2544bdf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:05.328252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1583/3172] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:05 2022] DELETE /identity/v3/users/7a8e3fab98524c5e807823e0f2544bdf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:05.350986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464982f-331a-4a71-804c-465e1f293744 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:05.474756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bd3a1-65b2-4964-81c9-967db5c26a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:05.475405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bd3a1-65b2-4964-81c9-967db5c26a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:05.475632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bd3a1-65b2-4964-81c9-967db5c26a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:05.475900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bd3a1-65b2-4964-81c9-967db5c26a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:05.477636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c41bd3a1-65b2-4964-81c9-967db5c26a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:05.562726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bd3a1-65b2-4964-81c9-967db5c26a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:05.564690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bd3a1-65b2-4964-81c9-967db5c26a15 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:05.577919 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1590/3173] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:13:05.971370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:05.973582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:05.995501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a2bd-cd61-464a-94e3-62e4ae84b9a5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:06.006058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:06.006829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.007183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.007528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] PATH_INFO: `/v3/projects/c6950a83fa594012811cad42478e1fec` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.009602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6950a83fa594012811cad42478e1fec)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:06.011817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:06.148402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6950a83fa594012811cad42478e1fec', 'request_id': 'req-14385207-0502-47ab-ba69-7a08d7449183'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:06.165109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6950a83fa594012811cad42478e1fec', 'request_id': 'req-14385207-0502-47ab-ba69-7a08d7449183'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:06.178769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6950a83fa594012811cad42478e1fec', 'request_id': 'req-14385207-0502-47ab-ba69-7a08d7449183'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:06.195359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] The token cache is being invalidate because project c6950a83fa594012811cad42478e1fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:06.195964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:06.196804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14385207-0502-47ab-ba69-7a08d7449183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:06.202088 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1584/3174] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:05 2022] DELETE /identity/v3/projects/c6950a83fa594012811cad42478e1fec => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:06.203857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4cef-b866-4f2f-a715-9c372006380f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.204978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4cef-b866-4f2f-a715-9c372006380f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.205365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4cef-b866-4f2f-a715-9c372006380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.257193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-009a4cef-b866-4f2f-a715-9c372006380f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:06.258439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-009a4cef-b866-4f2f-a715-9c372006380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:06.306240 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:06.344833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1591/3175] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:06.354356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81388-7284-43c1-8689-696ef2ff912a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.354890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81388-7284-43c1-8689-696ef2ff912a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.354969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd81388-7284-43c1-8689-696ef2ff912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.376516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7cd81388-7284-43c1-8689-696ef2ff912a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:06.377793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7cd81388-7284-43c1-8689-696ef2ff912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:06.389595 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1585/3176] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:06.394832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4cef-b866-4f2f-a715-9c372006380f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:06.406001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4cef-b866-4f2f-a715-9c372006380f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:06.412231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:06.412855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.413174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.413454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.414109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:06.414414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:06.416440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:06.432401 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1592/3177] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:13:06.433528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd81388-7284-43c1-8689-696ef2ff912a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:06.443397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd81388-7284-43c1-8689-696ef2ff912a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:06.449809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:06.450666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.450944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.452274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.452864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:06.454781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:06.481924 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:06.491027 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1586/3178] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:06 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:06.495230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:06.509889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd61f3-b2c8-4a35-bdf3-3ec6dd3ba916 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:06.615794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:06.616489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.616836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.617206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.617988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:06.620166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:06.649106 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1593/3179] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:06 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:06.651290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:06.663375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601129de-950f-4fa3-b9e2-f5373799e1fd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:06.670132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:06.670752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.671029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.671296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.671934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:06.673631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:06.686274 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1587/3180] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:06.690156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:06.700969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f13d-8ec9-4db3-ad86-d0b781f283c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:06.709868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3392e-1b35-4d9c-a266-2b5a1ebec176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:06.710498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3392e-1b35-4d9c-a266-2b5a1ebec176 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.710772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3392e-1b35-4d9c-a266-2b5a1ebec176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.711135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3392e-1b35-4d9c-a266-2b5a1ebec176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.711786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3392e-1b35-4d9c-a266-2b5a1ebec176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:06.714090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3392e-1b35-4d9c-a266-2b5a1ebec176 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:06.726444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1594/3181] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:06.732007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:06.750551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40c6de-a325-4c46-9a37-f2c21b4c1e33 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:06.756480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:06.757182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.757455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.757725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] PATH_INFO: `/v3/projects/570b0513d8d9436aaa6dca34b7ce53c7/users/0133996879444b61a285203e928bc031/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.775268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570b0513d8d9436aaa6dca34b7ce53c7, user_id=0133996879444b61a285203e928bc031, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:06.777970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:06.806757 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1588/3182] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:06 2022] PUT /identity/v3/projects/570b0513d8d9436aaa6dca34b7ce53c7/users/0133996879444b61a285203e928bc031/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:13:06.817555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28bb50-ee3e-497a-bc40-ef23c81a8a9b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:06.818210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28bb50-ee3e-497a-bc40-ef23c81a8a9b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:06.818210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28bb50-ee3e-497a-bc40-ef23c81a8a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:06.857694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6a28bb50-ee3e-497a-bc40-ef23c81a8a9b None None] MFA Rules not processed for user `0133996879444b61a285203e928bc031`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:06.858936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a28bb50-ee3e-497a-bc40-ef23c81a8a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:06.965493 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1595/3183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:06.969469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:07.064908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7738ca-7f16-4830-99f2-360eef2b2866 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:07.071338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:07.072020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:07.072957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:07.072957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:07.073730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:07.075790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:07.113341 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1589/3184] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:06 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:07.118380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28bb50-ee3e-497a-bc40-ef23c81a8a9b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:07.134293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28bb50-ee3e-497a-bc40-ef23c81a8a9b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:07.171691 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:07.215636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:07.216191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:07.216469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:07.216739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:07.219223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:07.221388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:07.282468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:07.288831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1596/3185] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:07 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:07.298158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80502ea9-b215-46d7-9186-9f5bd0950a4f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:07.311309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:07.312363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:07.312363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:07.312747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:07.317633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:07.317633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:07.350392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1590/3186] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:07.351641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:07.367115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162edbe-533e-441e-931b-e5d48d128bed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:07.377820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:07.380356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:07.380979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:07.382894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] PATH_INFO: `/v3/projects/10c95ab3c2794b4d9c1b9d10c360bcd6/users/b017070c057a464ea405c2cd761fc3c7/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:07.426949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c95ab3c2794b4d9c1b9d10c360bcd6, user_id=b017070c057a464ea405c2cd761fc3c7, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:07.430177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:07.462880 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1597/3187] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:07 2022] PUT /identity/v3/projects/10c95ab3c2794b4d9c1b9d10c360bcd6/users/b017070c057a464ea405c2cd761fc3c7/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:07.467210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:07.480620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca1fa5-dc8f-4c31-bfe5-a29b6e0b8efb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:07.671347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56f042-9dad-4dd9-9309-b087eec4a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:07.672017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56f042-9dad-4dd9-9309-b087eec4a812 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:07.672297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56f042-9dad-4dd9-9309-b087eec4a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:07.672606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56f042-9dad-4dd9-9309-b087eec4a812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:07.673492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56f042-9dad-4dd9-9309-b087eec4a812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:07.675278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56f042-9dad-4dd9-9309-b087eec4a812 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:07.712924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1591/3188] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:07.716648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:07.734818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1b06-11c9-47d8-b101-5d5d1b7b15b9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:07.751147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d61db-c75a-4ee4-8ccd-6eeaea24184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:07.751835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d61db-c75a-4ee4-8ccd-6eeaea24184f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:07.752100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d61db-c75a-4ee4-8ccd-6eeaea24184f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:07.752683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d61db-c75a-4ee4-8ccd-6eeaea24184f admin admin] PATH_INFO: `/v3/projects/10c95ab3c2794b4d9c1b9d10c360bcd6/users/b017070c057a464ea405c2cd761fc3c7/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:07.758959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d61db-c75a-4ee4-8ccd-6eeaea24184f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c95ab3c2794b4d9c1b9d10c360bcd6, user_id=b017070c057a464ea405c2cd761fc3c7, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:07.762803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d61db-c75a-4ee4-8ccd-6eeaea24184f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:07.804502 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1598/3189] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:07 2022] PUT /identity/v3/projects/10c95ab3c2794b4d9c1b9d10c360bcd6/users/b017070c057a464ea405c2cd761fc3c7/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:13:07.805587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:07.806513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:07.807419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:07.862331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] MFA Rules not processed for user `b017070c057a464ea405c2cd761fc3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:07.864584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:07.922714 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:08.028975 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1592/3190] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:08.040274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:08.040606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:08.040799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:08.075656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] MFA Rules not processed for user `0133996879444b61a285203e928bc031`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:08.077395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:08.272819 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1599/3191] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:09.574362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:09.575817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:09.755423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a833c75-bd33-4d29-a272-f66b2ca5596d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:09.769396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594643e-bfeb-49fc-b1b6-835f7d9f4cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:09.780424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594643e-bfeb-49fc-b1b6-835f7d9f4cc8 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:09.780666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594643e-bfeb-49fc-b1b6-835f7d9f4cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:09.781165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594643e-bfeb-49fc-b1b6-835f7d9f4cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:09.801764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594643e-bfeb-49fc-b1b6-835f7d9f4cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:09.804252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594643e-bfeb-49fc-b1b6-835f7d9f4cc8 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:09.845477 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1593/3192] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:10.721906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:10.723900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:10.832905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87006a3-90fd-47ca-9771-d1b8010acfb0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:10.838509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:10.839049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:10.839496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:10.839810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:10.841796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:10.855156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:10.856616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:10.871959 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1600/3193] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:13.739563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22598-fa29-404c-a5be-b0e6c615b930 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:13.740038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22598-fa29-404c-a5be-b0e6c615b930 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:13.740179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22598-fa29-404c-a5be-b0e6c615b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:13.790316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a1e22598-fa29-404c-a5be-b0e6c615b930 None None] MFA Rules not processed for user `b7bda6344ae348648373e6fa9b530bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:13.792383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a1e22598-fa29-404c-a5be-b0e6c615b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:13.882200 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1594/3194] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:14.375830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:14.377403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:14.438373 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:14.561016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e392-e162-4675-bf0a-7158e78fe60d service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:14.617040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:14.619049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:14.619607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:14.638010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] PATH_INFO: `/v3/users/fb2fa7cdc77043e2b9295424759e9863` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:14.647365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2fa7cdc77043e2b9295424759e9863)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:14.653984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:14.796464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2fa7cdc77043e2b9295424759e9863'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:14.799236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2fa7cdc77043e2b9295424759e9863'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:14.800444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2fa7cdc77043e2b9295424759e9863'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:14.811869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2fa7cdc77043e2b9295424759e9863'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:14.841638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2fa7cdc77043e2b9295424759e9863'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:14.892955 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1601/3195] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:14 2022] DELETE /identity/v3/users/fb2fa7cdc77043e2b9295424759e9863 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:15.835266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22598-fa29-404c-a5be-b0e6c615b930 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:15.848265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22598-fa29-404c-a5be-b0e6c615b930 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:15.943931 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:15.955497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:15.957678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:15.958110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:15.958524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] PATH_INFO: `/v3/projects/db5f307682ee47e2880cc5abbe949a58` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:15.960166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5f307682ee47e2880cc5abbe949a58)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:15.962457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:16.042694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5f307682ee47e2880cc5abbe949a58', 'request_id': 'req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.094247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5f307682ee47e2880cc5abbe949a58', 'request_id': 'req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.108187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5f307682ee47e2880cc5abbe949a58', 'request_id': 'req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.143628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] The token cache is being invalidate because project db5f307682ee47e2880cc5abbe949a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:16.145538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.146726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.151098 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1595/3196] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:15 2022] DELETE /identity/v3/projects/db5f307682ee47e2880cc5abbe949a58 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:16.155245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:16.160599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:16.182835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56703c7a-c25e-4d72-85a6-1dd2ff183a9f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:16.284688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:16.285993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:16.286478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:16.286958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] PATH_INFO: `/v3/users/eef984c7dd754336a2afbcc77f5deddb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:16.288485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef984c7dd754336a2afbcc77f5deddb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:16.290998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:16.409820 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:16.416082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef984c7dd754336a2afbcc77f5deddb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.417802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef984c7dd754336a2afbcc77f5deddb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.419087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef984c7dd754336a2afbcc77f5deddb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.441536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef984c7dd754336a2afbcc77f5deddb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.478079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d0c404c-4213-457f-a789-a2e22cfe0ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef984c7dd754336a2afbcc77f5deddb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:16.508295 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1602/3197] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:16 2022] DELETE /identity/v3/users/eef984c7dd754336a2afbcc77f5deddb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:17.337371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:17.338940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:17.353097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96905fe7-2782-4bbf-8d5d-9ddd3c9e3d7d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:17.500220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:17.501492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:17.501980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:17.502454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] PATH_INFO: `/v3/projects/1311a4a380124572a4e273bad5b395b2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:17.504604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1311a4a380124572a4e273bad5b395b2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:17.508471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:17.605568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1311a4a380124572a4e273bad5b395b2', 'request_id': 'req-764483c6-5e67-49e0-be31-015a958056b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:17.616014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1311a4a380124572a4e273bad5b395b2', 'request_id': 'req-764483c6-5e67-49e0-be31-015a958056b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:17.627759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1311a4a380124572a4e273bad5b395b2', 'request_id': 'req-764483c6-5e67-49e0-be31-015a958056b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:17.647565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] The token cache is being invalidate because project 1311a4a380124572a4e273bad5b395b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:17.647859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:17.648504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:17.650024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1596/3198] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:17 2022] DELETE /identity/v3/projects/1311a4a380124572a4e273bad5b395b2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:17.655303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8aa12-fa96-4550-a2f8-bae7cd8fca93 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:17.656191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8aa12-fa96-4550-a2f8-bae7cd8fca93 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:17.656649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8aa12-fa96-4550-a2f8-bae7cd8fca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:17.680197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3eb8aa12-fa96-4550-a2f8-bae7cd8fca93 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:17.681519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3eb8aa12-fa96-4550-a2f8-bae7cd8fca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:17.715613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:17.717291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:17.735787 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:17.773468 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1603/3199] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:17.782096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512084-62a3-4f2a-8ff0-1f50fd1ef5b8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:17.783805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512084-62a3-4f2a-8ff0-1f50fd1ef5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:17.784518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512084-62a3-4f2a-8ff0-1f50fd1ef5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:17.813039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c3512084-62a3-4f2a-8ff0-1f50fd1ef5b8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:17.814771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c3512084-62a3-4f2a-8ff0-1f50fd1ef5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:17.832144 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1604/3200] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:17.836517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3512084-62a3-4f2a-8ff0-1f50fd1ef5b8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:17.837552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764483c6-5e67-49e0-be31-015a958056b0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:17.845596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:17.846231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:17.846515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:17.846807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:17.848366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3512084-62a3-4f2a-8ff0-1f50fd1ef5b8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:17.850375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:17.859141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:17.860296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:17.860899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:17.861404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:17.862145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:17.863125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:17.864999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:17.865363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:17.867418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:17.883353 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1605/3201] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:17.884499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:17.887064 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1597/3202] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:17.914149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f72052-7bfc-4dda-bd91-a70ae165e943 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:17.924698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:17.928477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:17.928477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:17.928477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:17.928949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:17.935889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.004449 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1606/3203] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:17 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:18.009935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.022293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.024074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cff8-6263-41c0-ad8b-e6384be66d4b service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.025153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:18.128226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.129505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.129895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.130441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.131467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.133648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.160397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e648b1a-64e4-4f5e-994f-d3741d04105a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.167541 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1598/3204] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:18 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:18.167943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.168766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.169089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.170300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.170679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.173259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:18.182165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8867f-520e-4a6d-a9c5-d9bdf990293d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.187648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.188495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.188776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.189054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.189528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.189761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.191627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.204815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.223578 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1599/3205] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:18.224632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.225658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1607/3206] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:13:18.235452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f217e-b663-403c-b507-e1b71e279964 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.250707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed497f8-3325-46c8-8e95-b5e2a15fa0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.251433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed497f8-3325-46c8-8e95-b5e2a15fa0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.251813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed497f8-3325-46c8-8e95-b5e2a15fa0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.252180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed497f8-3325-46c8-8e95-b5e2a15fa0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.253002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed497f8-3325-46c8-8e95-b5e2a15fa0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.256400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed497f8-3325-46c8-8e95-b5e2a15fa0ce admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.270778 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1600/3207] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:13:18.274786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.283591 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:18.291161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfa45d-afe4-41f5-9c90-db397a9b0d4f service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.298185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.299055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.299470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.299670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] PATH_INFO: `/v3/projects/727531574a5e497f9b91bdcdeef2256e/users/039808dcf8004742bafe1201ce5f8b5f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.340010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727531574a5e497f9b91bdcdeef2256e, user_id=039808dcf8004742bafe1201ce5f8b5f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.347942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.363512 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1608/3208] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:18 2022] PUT /identity/v3/projects/727531574a5e497f9b91bdcdeef2256e/users/039808dcf8004742bafe1201ce5f8b5f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:18.374239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d050-925a-4bf4-a712-1e5929133880 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.374892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d050-925a-4bf4-a712-1e5929133880 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.374892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d050-925a-4bf4-a712-1e5929133880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.410299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1027d050-925a-4bf4-a712-1e5929133880 None None] MFA Rules not processed for user `039808dcf8004742bafe1201ce5f8b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:18.411563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1027d050-925a-4bf4-a712-1e5929133880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:18.507991 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:18.535621 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1601/3209] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:18.541259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.638893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e425b9-aa5c-4d8c-920b-e2e5104efe46 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.647436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.648153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.648507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.649107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.649787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.653605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.700550 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1609/3210] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:18 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:18.704876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027d050-925a-4bf4-a712-1e5929133880 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.727592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027d050-925a-4bf4-a712-1e5929133880 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.802838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.803466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.803885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.804164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.804802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.806770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.832898 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1602/3211] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:18 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:18.837178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.850887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b80af-c282-4ba2-ac38-511155a364d8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.856225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.856847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.857160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.857439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.858093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.859693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.877204 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1610/3212] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:18.878848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.891975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f85ba-07c2-4b05-ab2e-ac8ba5f7bd69 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:18.897997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:18.898667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:18.898943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:18.899213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] PATH_INFO: `/v3/projects/00d4d69980c748069b9d7c5da76cbb50/users/7313d161531b4751abc4dcdc70d45adf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:18.926932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d4d69980c748069b9d7c5da76cbb50, user_id=7313d161531b4751abc4dcdc70d45adf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:18.929858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:18.945734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1603/3213] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:18 2022] PUT /identity/v3/projects/00d4d69980c748069b9d7c5da76cbb50/users/7313d161531b4751abc4dcdc70d45adf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:18.950250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:18.961743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5536-5474-466b-919d-aea5be817042 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:19.036669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553fde7-a82e-45fd-9c05-07a03ec61bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:19.037589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553fde7-a82e-45fd-9c05-07a03ec61bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:19.038039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553fde7-a82e-45fd-9c05-07a03ec61bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:19.038459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553fde7-a82e-45fd-9c05-07a03ec61bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:19.039257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553fde7-a82e-45fd-9c05-07a03ec61bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:19.041007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553fde7-a82e-45fd-9c05-07a03ec61bbe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:19.053843 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1611/3214] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:19.057642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:19.076058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1a95b-02b9-4032-95bf-aa40195b9be5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:19.080943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:19.082190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:19.082469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:19.082824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] PATH_INFO: `/v3/projects/00d4d69980c748069b9d7c5da76cbb50/users/7313d161531b4751abc4dcdc70d45adf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:19.085197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d4d69980c748069b9d7c5da76cbb50, user_id=7313d161531b4751abc4dcdc70d45adf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:19.087823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:19.100071 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1604/3215] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:19 2022] PUT /identity/v3/projects/00d4d69980c748069b9d7c5da76cbb50/users/7313d161531b4751abc4dcdc70d45adf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:19.109966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928e1f-b583-4116-9fb0-427d1576c9d4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:19.110323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928e1f-b583-4116-9fb0-427d1576c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:19.110656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928e1f-b583-4116-9fb0-427d1576c9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:19.141740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e7928e1f-b583-4116-9fb0-427d1576c9d4 None None] MFA Rules not processed for user `7313d161531b4751abc4dcdc70d45adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:19.143066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7928e1f-b583-4116-9fb0-427d1576c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:19.186202 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:19.228896 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1612/3216] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:19.235606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:19.247468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ccefe-895e-41e2-85e6-ae7d58962fb5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:19.254147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:19.254771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:19.255051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:19.255321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:19.255971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:19.256273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:19.257980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:19.276390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1605/3217] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:13:19.277633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928e1f-b583-4116-9fb0-427d1576c9d4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:19.295101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928e1f-b583-4116-9fb0-427d1576c9d4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:19.300324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:19.301267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:19.301694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:19.302152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:19.303210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:19.306889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:19.370979 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1613/3218] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:19 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:19.374840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:19.387083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fccc4-0d0e-40d4-bead-a50aa4c3f184 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:19.464264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07f29-9e7f-4777-8391-97bfe2046214 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:19.465164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07f29-9e7f-4777-8391-97bfe2046214 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:19.465514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07f29-9e7f-4777-8391-97bfe2046214 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:19.465861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07f29-9e7f-4777-8391-97bfe2046214 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:19.466578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd07f29-9e7f-4777-8391-97bfe2046214 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:19.467169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd07f29-9e7f-4777-8391-97bfe2046214 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:19.469175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd07f29-9e7f-4777-8391-97bfe2046214 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:19.485594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1606/3219] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:20.044239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.183039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d960-0663-4517-9e01-195e5f628d56 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:20.191142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:20.191773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.192170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.192466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.202207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:20.203688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:20.216047 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1614/3220] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:20.239835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fcd6f-d473-4262-9ec1-f4e20f8c7e54 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.240145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fcd6f-d473-4262-9ec1-f4e20f8c7e54 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.240404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fcd6f-d473-4262-9ec1-f4e20f8c7e54 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.242672 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1607/3221] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:20.247372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:20.261989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.274942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71226eb3-ad5c-4f54-9ff7-9432c9d42f30 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:20.287362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fa54f-faa5-4947-8a49-63f924e2b15f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:20.288022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa54f-faa5-4947-8a49-63f924e2b15f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.288303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa54f-faa5-4947-8a49-63f924e2b15f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.288576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa54f-faa5-4947-8a49-63f924e2b15f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/e74ed4f871354123887336971aa24061` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.290573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fa54f-faa5-4947-8a49-63f924e2b15f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=e74ed4f871354123887336971aa24061)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:20.292752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fa54f-faa5-4947-8a49-63f924e2b15f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:20.295619 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1615/3222] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:20 2022] GET /identity/v3/projects/e74ed4f871354123887336971aa24061 => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:20.774788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fcd6f-d473-4262-9ec1-f4e20f8c7e54 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.777966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a52fcd6f-d473-4262-9ec1-f4e20f8c7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:20.818785 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:20.865677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fcd6f-d473-4262-9ec1-f4e20f8c7e54 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:20.866691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382860f-df89-4508-b6cf-5195b9a1e80f None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.867279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382860f-df89-4508-b6cf-5195b9a1e80f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.867684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382860f-df89-4508-b6cf-5195b9a1e80f None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.869180 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1616/3223] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:20.870332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e0fd3-e08e-4273-9ea1-d696138933c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:20.871699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0fd3-e08e-4273-9ea1-d696138933c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.872158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0fd3-e08e-4273-9ea1-d696138933c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.872585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0fd3-e08e-4273-9ea1-d696138933c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.875039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d83e0fd3-e08e-4273-9ea1-d696138933c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:20.875795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382860f-df89-4508-b6cf-5195b9a1e80f None None] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:20.888097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e0fd3-e08e-4273-9ea1-d696138933c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:20.890426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e0fd3-e08e-4273-9ea1-d696138933c1 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:20.905308 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1608/3224] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:20.906444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382860f-df89-4508-b6cf-5195b9a1e80f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:20.918960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382860f-df89-4508-b6cf-5195b9a1e80f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:20.924017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:20.925030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:20.925172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:20.925562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/e74ed4f871354123887336971aa24061` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:20.927550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=e74ed4f871354123887336971aa24061)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:20.929915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:20.932324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1617/3225] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:20 2022] GET /identity/v3/projects/e74ed4f871354123887336971aa24061 => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:13:21.467978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14d5c-7441-4ceb-ab98-4c82b72db89f None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:21.468505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14d5c-7441-4ceb-ab98-4c82b72db89f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:21.469005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14d5c-7441-4ceb-ab98-4c82b72db89f None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:21.470856 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1609/3226] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:21.479656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:21.505155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:21.526031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab863a19-5917-49dd-931c-92fbb5e2086f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:21.548518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c87a3b-e024-46f3-868f-b1686c22b33b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:21.550146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87a3b-e024-46f3-868f-b1686c22b33b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:21.550803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87a3b-e024-46f3-868f-b1686c22b33b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:21.551361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c87a3b-e024-46f3-868f-b1686c22b33b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/e74ed4f871354123887336971aa24061` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:21.553461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c87a3b-e024-46f3-868f-b1686c22b33b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=e74ed4f871354123887336971aa24061)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:21.556793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c87a3b-e024-46f3-868f-b1686c22b33b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:21.558831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1618/3227] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:21 2022] GET /identity/v3/projects/e74ed4f871354123887336971aa24061 => generated 369 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:21.595690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e14d5c-7441-4ceb-ab98-4c82b72db89f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:21.614753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e14d5c-7441-4ceb-ab98-4c82b72db89f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:21.621029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:21.621818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:21.622196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:21.622567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/e74ed4f871354123887336971aa24061` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:21.623875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e74ed4f871354123887336971aa24061)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:21.626885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:21.706523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74ed4f871354123887336971aa24061', 'request_id': 'req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.735936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74ed4f871354123887336971aa24061', 'request_id': 'req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.773925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74ed4f871354123887336971aa24061', 'request_id': 'req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.803690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] The token cache is being invalidate because project e74ed4f871354123887336971aa24061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:21.804810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.806891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:21.809630 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1610/3228] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:21 2022] DELETE /identity/v3/projects/e74ed4f871354123887336971aa24061 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:21.827071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c630d26-2bcd-4d8f-88f0-179128a80efd None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:21.827166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c630d26-2bcd-4d8f-88f0-179128a80efd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:21.827461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c630d26-2bcd-4d8f-88f0-179128a80efd None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:21.829162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1619/3229] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:21.843192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:21.844978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:22.022047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:22.023407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:22.153628 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:22.189601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6e36f-930f-43eb-a638-dffcbb1f6e9f tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:22.202146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:22.204630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:22.205281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:22.205766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/727531574a5e497f9b91bdcdeef2256e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:22.210449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=727531574a5e497f9b91bdcdeef2256e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:22.214782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:22.232116 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1611/3230] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:21 2022] GET /identity/v3/projects/727531574a5e497f9b91bdcdeef2256e => generated 373 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:22.260049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c630d26-2bcd-4d8f-88f0-179128a80efd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:22.306698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c630d26-2bcd-4d8f-88f0-179128a80efd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:22.320090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:22.329178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:22.334863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:22.336132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:22.341182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:22.344245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:22.350501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:22.395132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:22.406592 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1620/3231] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:22.413012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb773f9-225c-4543-b6bd-a172f995f347 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:22.430566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f1ad7-7e52-4354-a450-69337885a253 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:22.431225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f1ad7-7e52-4354-a450-69337885a253 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:22.431514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f1ad7-7e52-4354-a450-69337885a253 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:22.434159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f1ad7-7e52-4354-a450-69337885a253 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:22.436672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f1ad7-7e52-4354-a450-69337885a253 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:22.448257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f1ad7-7e52-4354-a450-69337885a253 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:22.502174 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1612/3232] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:22 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:22.506652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:22.533989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee3a57-ec67-4dc2-917d-dceb52c4ee23 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:22.626652 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:22.636034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:22.638053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:22.638501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:22.638928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:22.639729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:22.640410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:22.642506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:22.675433 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1621/3233] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:23.358942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827825ed-7363-4652-8da7-e945223d0c45 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:23.359480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827825ed-7363-4652-8da7-e945223d0c45 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:23.359480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827825ed-7363-4652-8da7-e945223d0c45 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:23.360822 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1613/3234] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:23.367761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:23.494286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:23.536356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a50120-e008-45cf-88d2-60f5288309cd tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:23.547379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:23.548470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:23.550858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:23.551393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/49c3f9fb87644222a060c6af56c7d071` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:23.553584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=49c3f9fb87644222a060c6af56c7d071)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:23.560027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:23.565541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1622/3235] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:23 2022] GET /identity/v3/projects/49c3f9fb87644222a060c6af56c7d071 => generated 369 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:23.899364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df854-ae30-4282-adca-0d18d6231d8e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:23.899712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df854-ae30-4282-adca-0d18d6231d8e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:23.899984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7df854-ae30-4282-adca-0d18d6231d8e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:23.902598 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1614/3236] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:23.908817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:23.911875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:23.945130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:23.971301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52c6d-4880-462a-8ed8-1016d712507b tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:23.978554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:23.979150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:23.979435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:23.979706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/49c3f9fb87644222a060c6af56c7d071` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:23.981689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=49c3f9fb87644222a060c6af56c7d071)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:23.983730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:23.997320 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1623/3237] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:23 2022] GET /identity/v3/projects/49c3f9fb87644222a060c6af56c7d071 => generated 369 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:24.052806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7df854-ae30-4282-adca-0d18d6231d8e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:24.067750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7df854-ae30-4282-adca-0d18d6231d8e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:24.074148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:24.075040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:24.075938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:24.076643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:24.080098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:24.080822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:24.093691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:24.113456 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1615/3238] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:24.116990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:24.134754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829fa11-1f81-43fc-bcdc-faec101c643a tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:24.140102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a5b9-294a-489e-8a6b-71bb4b6f6fe0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:24.141390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a5b9-294a-489e-8a6b-71bb4b6f6fe0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:24.141820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a5b9-294a-489e-8a6b-71bb4b6f6fe0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:24.142237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a5b9-294a-489e-8a6b-71bb4b6f6fe0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:24.143272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457a5b9-294a-489e-8a6b-71bb4b6f6fe0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:24.147116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457a5b9-294a-489e-8a6b-71bb4b6f6fe0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:24.198225 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1624/3239] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:24 2022] POST /identity/v3/users => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:24.198835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:24.220484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc015c9c-26d3-494e-a5e3-8eccf62d8df1 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:24.228491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:24.229981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:24.230261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:24.230588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:24.232728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:24.232728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:24.235003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:24.260133 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1616/3240] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:24.572235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331c881-e517-4095-87b3-0fc93f4f0924 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:24.572708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331c881-e517-4095-87b3-0fc93f4f0924 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:24.574268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331c881-e517-4095-87b3-0fc93f4f0924 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:24.576000 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1625/3241] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:24.588760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:24.642418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:24.709447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad6249-b5b7-47ad-98cd-f0681e5c8ba9 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:24.724445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:24.725160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:24.727346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:24.727789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/49c3f9fb87644222a060c6af56c7d071` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:24.734080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=49c3f9fb87644222a060c6af56c7d071)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:24.744108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:24.746216 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1617/3242] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:24 2022] GET /identity/v3/projects/49c3f9fb87644222a060c6af56c7d071 => generated 369 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:25.839727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e3603-b495-491f-9a97-449979236fcd None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:25.840715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e3603-b495-491f-9a97-449979236fcd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:25.841232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e3603-b495-491f-9a97-449979236fcd None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:25.842843 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1626/3243] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:25.852540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:25.873601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:25.886878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce26e-49f9-41e2-b287-876ab79b9ce6 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:25.893213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:25.894651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:25.895543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:25.896052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/49c3f9fb87644222a060c6af56c7d071` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:25.897571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=49c3f9fb87644222a060c6af56c7d071)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:25.899979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:25.908871 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1618/3244] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:25 2022] GET /identity/v3/projects/49c3f9fb87644222a060c6af56c7d071 => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:25.946318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e3603-b495-491f-9a97-449979236fcd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:25.975324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e3603-b495-491f-9a97-449979236fcd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:25.989755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:25.990431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:25.990714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:25.990988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/users/a2eac587f5d249f58d0b89ed0824776c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.049274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a2eac587f5d249f58d0b89ed0824776c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:26.051485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:26.127243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2eac587f5d249f58d0b89ed0824776c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.133142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2eac587f5d249f58d0b89ed0824776c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.135942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2eac587f5d249f58d0b89ed0824776c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.149445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2eac587f5d249f58d0b89ed0824776c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.173008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f599350-4f30-4a2d-a068-58cda7611aed tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2eac587f5d249f58d0b89ed0824776c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.213050 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1627/3245] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:25 2022] DELETE /identity/v3/users/a2eac587f5d249f58d0b89ed0824776c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:26.217096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:26.219050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:26.251121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29c990-3364-4e82-bb8d-55dfecfa3938 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:26.332586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:26.333719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.334201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.334627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/49c3f9fb87644222a060c6af56c7d071` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.336008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49c3f9fb87644222a060c6af56c7d071)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:26.337996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:26.437109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c3f9fb87644222a060c6af56c7d071', 'request_id': 'req-36542a55-f992-450d-b087-782d7e606606'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.446896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c3f9fb87644222a060c6af56c7d071', 'request_id': 'req-36542a55-f992-450d-b087-782d7e606606'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.455308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c3f9fb87644222a060c6af56c7d071', 'request_id': 'req-36542a55-f992-450d-b087-782d7e606606'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.480509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] The token cache is being invalidate because project 49c3f9fb87644222a060c6af56c7d071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:26.481392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.482388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:26.484377 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1619/3246] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:26 2022] DELETE /identity/v3/projects/49c3f9fb87644222a060c6af56c7d071 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:26.509948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1837-75d8-4494-ba5e-ef43369c146a None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.510461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1837-75d8-4494-ba5e-ef43369c146a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.510922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1837-75d8-4494-ba5e-ef43369c146a None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.512411 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1628/3247] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:26.518015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:26.520318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:26.553851 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:26.641474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:26.643232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:26.775811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36542a55-f992-450d-b087-782d7e606606 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:26.783395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:26.784795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.785377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.785800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/727531574a5e497f9b91bdcdeef2256e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.788257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=727531574a5e497f9b91bdcdeef2256e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:26.792266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:26.811166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1620/3248] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:26 2022] GET /identity/v3/projects/727531574a5e497f9b91bdcdeef2256e => generated 373 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:26.856362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a20234-bdf2-43ae-a369-2f1e04b71629 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.857325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a20234-bdf2-43ae-a369-2f1e04b71629 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.857783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a20234-bdf2-43ae-a369-2f1e04b71629 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.860155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1629/3249] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:26.865245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:26.889175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:26.912487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb6be-b7b6-44ed-88ea-4d3e0a361294 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:26.934371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eb4f0-65c7-4c42-a432-16e0355462d0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:26.935631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb4f0-65c7-4c42-a432-16e0355462d0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:26.936136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb4f0-65c7-4c42-a432-16e0355462d0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:26.936597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb4f0-65c7-4c42-a432-16e0355462d0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/727531574a5e497f9b91bdcdeef2256e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:26.938282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eb4f0-65c7-4c42-a432-16e0355462d0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=727531574a5e497f9b91bdcdeef2256e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:26.941581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eb4f0-65c7-4c42-a432-16e0355462d0 tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:26.944235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1621/3250] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:26 2022] GET /identity/v3/projects/727531574a5e497f9b91bdcdeef2256e => generated 373 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:27.261332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a20234-bdf2-43ae-a369-2f1e04b71629 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.295955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a20234-bdf2-43ae-a369-2f1e04b71629 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.308498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4e94-fde4-41dc-b45b-ef0241a65672 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.309184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4e94-fde4-41dc-b45b-ef0241a65672 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.309637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4e94-fde4-41dc-b45b-ef0241a65672 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.311279 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1622/3251] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:27.312089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.312750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.314212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.314426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.318301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4e94-fde4-41dc-b45b-ef0241a65672 None None] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:27.320242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:27.320577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e4ea4e94-fde4-41dc-b45b-ef0241a65672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:27.341529 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:27.370373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4e94-fde4-41dc-b45b-ef0241a65672 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.387400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4e94-fde4-41dc-b45b-ef0241a65672 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.393012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7313d161531b4751abc4dcdc70d45adf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d4d69980c748069b9d7c5da76cbb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.397100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.397380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.397654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] PATH_INFO: `/v3/projects/727531574a5e497f9b91bdcdeef2256e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.399128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorizing `identity:get_project(project_id=727531574a5e497f9b91bdcdeef2256e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.414538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.419635 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1623/3252] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:27 2022] GET /identity/v3/projects/727531574a5e497f9b91bdcdeef2256e => generated 373 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:27.454695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.457788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.466308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:27.472858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:27.519972 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1630/3253] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:27.590202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9853cd1-0af5-44f7-a192-ec0f64d52bca tempest-QuotasAdminTestJSON-787051444 tempest-QuotasAdminTestJSON-787051444-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:27.595195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:27.596012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:27.596295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:27.597020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] PATH_INFO: `/v3/users/7e70ed082cd2410da37a841838b6eb44` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:27.598343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e70ed082cd2410da37a841838b6eb44)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:27.600599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:27.668623 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:27.690083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e70ed082cd2410da37a841838b6eb44'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:27.690960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e70ed082cd2410da37a841838b6eb44'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:27.691726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e70ed082cd2410da37a841838b6eb44'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:27.743759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e70ed082cd2410da37a841838b6eb44'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:27.758583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6437919-d6c8-4c19-af15-3fd5ba6197d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e70ed082cd2410da37a841838b6eb44'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:27.787360 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1624/3254] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:27 2022] DELETE /identity/v3/users/7e70ed082cd2410da37a841838b6eb44 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:28.027012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:28.029304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.057586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae6003-fa9e-4d1a-b13c-b6714a5b4e1f service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:28.146685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:28.147428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.147801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.148599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] PATH_INFO: `/v3/users/039808dcf8004742bafe1201ce5f8b5f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.149820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] RBAC: Authorizing `identity:delete_user(user_id=039808dcf8004742bafe1201ce5f8b5f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:28.151735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:28.223654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039808dcf8004742bafe1201ce5f8b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.224457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039808dcf8004742bafe1201ce5f8b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.225051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039808dcf8004742bafe1201ce5f8b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.232688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.233214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039808dcf8004742bafe1201ce5f8b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.233323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.233400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.251948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-74327055-1d4d-4f5c-ba47-f181f1e7185a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039808dcf8004742bafe1201ce5f8b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.257996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] MFA Rules not processed for user `0133996879444b61a285203e928bc031`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:28.259465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.271879 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1631/3255] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:28 2022] DELETE /identity/v3/users/039808dcf8004742bafe1201ce5f8b5f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:28.277253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.277525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.278614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.311805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:28.313280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.357577 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1625/3256] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:28.361287 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:28.382903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:28.385308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.409775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a9a70-27a5-44b3-a11e-3216b51f29bf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:28.448381 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1632/3257] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:28.470353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:28.472111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.546567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:28.547344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.547748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.548130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] PATH_INFO: `/v3/projects/1bb3b5f67cff46e7acf5801b20b86b6a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.549434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb3b5f67cff46e7acf5801b20b86b6a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:28.552154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:28.556846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03bddf-dd71-419a-8a88-626bf844c1f5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:28.561389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c55f60-06ac-4e90-b650-5833337d8659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:28.562001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c55f60-06ac-4e90-b650-5833337d8659 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.562276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c55f60-06ac-4e90-b650-5833337d8659 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.562570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c55f60-06ac-4e90-b650-5833337d8659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.576696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c55f60-06ac-4e90-b650-5833337d8659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:28.578225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c55f60-06ac-4e90-b650-5833337d8659 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:28.594179 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1633/3258] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:28.620970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb3b5f67cff46e7acf5801b20b86b6a', 'request_id': 'req-9d938e5b-e795-4669-9613-f94bf515014b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.632258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb3b5f67cff46e7acf5801b20b86b6a', 'request_id': 'req-9d938e5b-e795-4669-9613-f94bf515014b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.634127 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:28.642378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb3b5f67cff46e7acf5801b20b86b6a', 'request_id': 'req-9d938e5b-e795-4669-9613-f94bf515014b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.665747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] The token cache is being invalidate because project 1bb3b5f67cff46e7acf5801b20b86b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:28.666422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.667457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9d938e5b-e795-4669-9613-f94bf515014b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:28.673258 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1626/3259] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:28 2022] DELETE /identity/v3/projects/1bb3b5f67cff46e7acf5801b20b86b6a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:13:28.675492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041b3d-e54f-4f8b-b849-c8d78472440f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.675837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041b3d-e54f-4f8b-b849-c8d78472440f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.676204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f041b3d-e54f-4f8b-b849-c8d78472440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.703429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7f041b3d-e54f-4f8b-b849-c8d78472440f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:28.704901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7f041b3d-e54f-4f8b-b849-c8d78472440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.804809 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1634/3260] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:28.814177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd00916-6055-4d27-afca-96f347cacf76 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.814177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd00916-6055-4d27-afca-96f347cacf76 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.814177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd00916-6055-4d27-afca-96f347cacf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.863238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cfd00916-6055-4d27-afca-96f347cacf76 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:28.865875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cfd00916-6055-4d27-afca-96f347cacf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:28.882076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1627/3261] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:28.885668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f041b3d-e54f-4f8b-b849-c8d78472440f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:28.900179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f041b3d-e54f-4f8b-b849-c8d78472440f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:28.907218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:28.908601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.908894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.909245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.910064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:28.910427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:28.911936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:28.952007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd00916-6055-4d27-afca-96f347cacf76 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:28.952449 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1635/3262] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:28.970238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd00916-6055-4d27-afca-96f347cacf76 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:28.983133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:28.984038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:28.984863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:28.985179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:28.986090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:28.990487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:29.035659 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1628/3263] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:28 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:29.039850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:29.050816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c0815-4324-412e-9201-39ff001d613b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:29.152046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:29.154116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:29.154406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:29.154695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:29.155495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:29.158440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:29.168369 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:29.192408 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1636/3264] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:29 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:29.193999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:29.209274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d659127-85fd-4e11-ae7e-49634f1ad279 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:29.214704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:29.215720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:29.216102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:29.216482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:29.217265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:29.218951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:29.237597 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1629/3265] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:29.239757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:29.268533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e37946-e514-475a-a088-eba1484be0e8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:29.275379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552b08c-c169-4926-84de-46d4f527ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:29.276641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b08c-c169-4926-84de-46d4f527ded6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:29.277054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b08c-c169-4926-84de-46d4f527ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:29.277579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552b08c-c169-4926-84de-46d4f527ded6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:29.278581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552b08c-c169-4926-84de-46d4f527ded6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:29.280304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552b08c-c169-4926-84de-46d4f527ded6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:29.297301 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1637/3266] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:29.298803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:29.331947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b05d6a-e707-4650-828f-302a8d365841 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:29.339575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:29.340266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:29.340906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:29.340906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] PATH_INFO: `/v3/projects/e6d376ec5b33424ba04ed0424059c2be/users/0fe6b958303c4bc2aa8a5000d8a645db/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:29.390318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d376ec5b33424ba04ed0424059c2be, user_id=0fe6b958303c4bc2aa8a5000d8a645db, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:29.397835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:29.442941 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1630/3267] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:29 2022] PUT /identity/v3/projects/e6d376ec5b33424ba04ed0424059c2be/users/0fe6b958303c4bc2aa8a5000d8a645db/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:29.448468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:29.448830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:29.449039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:29.449338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:29.451354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:29.483064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:29.484446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:29.679087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f1e9-747d-4166-88cd-dce729bbaa15 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:29.682633 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1638/3268] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:29.689978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:29.691003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:29.691480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:29.692173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] PATH_INFO: `/v3/projects/727531574a5e497f9b91bdcdeef2256e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:29.694050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727531574a5e497f9b91bdcdeef2256e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:29.700048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:29.743029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:29.744611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:29.847916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727531574a5e497f9b91bdcdeef2256e', 'request_id': 'req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:29.859414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727531574a5e497f9b91bdcdeef2256e', 'request_id': 'req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:29.868016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727531574a5e497f9b91bdcdeef2256e', 'request_id': 'req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:29.894721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] The token cache is being invalidate because project 727531574a5e497f9b91bdcdeef2256e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:29.895071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:29.902481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:29.904375 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1631/3269] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:29 2022] DELETE /identity/v3/projects/727531574a5e497f9b91bdcdeef2256e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:29.908745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:29.910467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:29.914288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb974cd-7889-4ced-9251-41ff5e02106a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:29.953581 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:30.070032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:30.071222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:30.071821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:30.072257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:30.075279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:30.093840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:30.098057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:30.098869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4e95f-85cd-42ae-bdbb-31d973ef7375 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:30.107025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:30.108775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:30.109477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:30.109944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] PATH_INFO: `/v3/users/7313d161531b4751abc4dcdc70d45adf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:30.112302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7313d161531b4751abc4dcdc70d45adf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:30.115551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:30.127945 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1639/3270] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:30.193122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7313d161531b4751abc4dcdc70d45adf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:30.193987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7313d161531b4751abc4dcdc70d45adf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:30.195248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7313d161531b4751abc4dcdc70d45adf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:30.210034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7313d161531b4751abc4dcdc70d45adf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:30.218234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-deba8443-0e68-48ad-8991-e10c63cee5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7313d161531b4751abc4dcdc70d45adf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:30.234787 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1632/3271] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:29 2022] DELETE /identity/v3/users/7313d161531b4751abc4dcdc70d45adf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:30.983933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:31.000603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a6c37-caaf-442d-b087-725194ed75a4 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:31.106745 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:31.161911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:31.162871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:31.163486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:31.164071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] PATH_INFO: `/v3/projects/00d4d69980c748069b9d7c5da76cbb50` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:31.165483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d4d69980c748069b9d7c5da76cbb50)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:31.167750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:31.237817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d4d69980c748069b9d7c5da76cbb50', 'request_id': 'req-88ec9a3e-73af-4f55-9054-436ab5b7ba07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:31.250009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d4d69980c748069b9d7c5da76cbb50', 'request_id': 'req-88ec9a3e-73af-4f55-9054-436ab5b7ba07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:31.280223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d4d69980c748069b9d7c5da76cbb50', 'request_id': 'req-88ec9a3e-73af-4f55-9054-436ab5b7ba07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:31.342886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] The token cache is being invalidate because project 00d4d69980c748069b9d7c5da76cbb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:31.343574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:31.345451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88ec9a3e-73af-4f55-9054-436ab5b7ba07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:31.354134 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1640/3272] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:30 2022] DELETE /identity/v3/projects/00d4d69980c748069b9d7c5da76cbb50 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:31.364110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a986fcf-cf02-419d-812f-00fee3c6bc00 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:31.364645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a986fcf-cf02-419d-812f-00fee3c6bc00 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:31.365051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a986fcf-cf02-419d-812f-00fee3c6bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:31.433745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4a986fcf-cf02-419d-812f-00fee3c6bc00 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:31.438731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4a986fcf-cf02-419d-812f-00fee3c6bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:31.687050 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1633/3273] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:31.795164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e20ece-6c61-4535-b694-5d9f7be540de None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:31.795826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e20ece-6c61-4535-b694-5d9f7be540de None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:31.796248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e20ece-6c61-4535-b694-5d9f7be540de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:31.831187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-98e20ece-6c61-4535-b694-5d9f7be540de None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:31.833934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-98e20ece-6c61-4535-b694-5d9f7be540de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:31.859348 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1641/3274] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:31.865834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a986fcf-cf02-419d-812f-00fee3c6bc00 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:31.878292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a986fcf-cf02-419d-812f-00fee3c6bc00 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:31.893692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:31.895343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:31.896776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:31.897012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:31.899683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:31.900004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:31.905280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:31.930972 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1634/3275] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:31.936048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e20ece-6c61-4535-b694-5d9f7be540de None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:31.949436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e20ece-6c61-4535-b694-5d9f7be540de None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:31.978178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:31.978815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:31.979094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:31.979366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:31.984456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:31.990279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:32.060415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:32.062326 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1642/3276] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:31 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:32.088710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3187dd-c06c-4ff2-8781-667cac881bab admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:32.140193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:32.255523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:32.256152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:32.256483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:32.256762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:32.257424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:32.260190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:32.303569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:32.304340 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1635/3277] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:32 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:32.317355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df6c8-d5fb-47e0-9274-6682eabd06d5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:32.324863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:32.325703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:32.326057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:32.326906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:32.327624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:32.329609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:32.348135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:32.349653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1643/3278] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:32.364366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b744bcd-af7e-465e-8ea2-b7c4ae7edcb7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:32.373346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceaaba-f944-4222-8b0e-41560fc73d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:32.376549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceaaba-f944-4222-8b0e-41560fc73d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:32.376549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceaaba-f944-4222-8b0e-41560fc73d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:32.376549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceaaba-f944-4222-8b0e-41560fc73d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:32.376549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ceaaba-f944-4222-8b0e-41560fc73d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:32.379513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ceaaba-f944-4222-8b0e-41560fc73d1f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:32.415590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:32.426038 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1636/3279] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:32.433097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632fee5-9c6a-4277-9bc7-909938287496 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:32.450373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:32.451434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:32.451434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:32.451643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] PATH_INFO: `/v3/projects/f38b93478f0c48d0835cfe2524b0c5d2/users/0586aaf1bbf149bb94ad0e4e8fea191f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:32.470803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38b93478f0c48d0835cfe2524b0c5d2, user_id=0586aaf1bbf149bb94ad0e4e8fea191f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:32.473983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:32.513162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1644/3280] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:32 2022] PUT /identity/v3/projects/f38b93478f0c48d0835cfe2524b0c5d2/users/0586aaf1bbf149bb94ad0e4e8fea191f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:32.517121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253236a7-e574-4ad7-a294-1a416a02debf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:32.517412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253236a7-e574-4ad7-a294-1a416a02debf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:32.517699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253236a7-e574-4ad7-a294-1a416a02debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:32.580265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-253236a7-e574-4ad7-a294-1a416a02debf None None] MFA Rules not processed for user `0586aaf1bbf149bb94ad0e4e8fea191f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:32.582790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-253236a7-e574-4ad7-a294-1a416a02debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:32.760754 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1637/3281] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:32.766502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:32.956107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093882-7ee5-4956-91cb-d629585eecbc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:32.962775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:32.963691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:32.963812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:32.965951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:32.966633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:32.968793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.017695 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:33.070373 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1645/3282] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:32 2022] POST /identity/v3/projects => generated 375 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:33.074320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253236a7-e574-4ad7-a294-1a416a02debf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.093620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253236a7-e574-4ad7-a294-1a416a02debf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:33.177619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:33.178613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.181091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.181686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.182551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:33.185184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.248362 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1638/3283] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:33 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:33.252299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.266089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512f158-1e6a-441a-88e2-f88ad953a841 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:33.272386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:33.273012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.273341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.273752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.274440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:33.276099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.289591 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1646/3284] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:33.293561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.305784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44769dd-9232-4fd1-915e-da858bf09df6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:33.312705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:33.313541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.314316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.314316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] PATH_INFO: `/v3/projects/0b0c9320d5bb4055a22a5629a7d0760e/users/c2e28ecbb4ff434ea72fdd38906dbd11/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.332257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0c9320d5bb4055a22a5629a7d0760e, user_id=c2e28ecbb4ff434ea72fdd38906dbd11, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:33.335185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.337784 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:33.358770 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1639/3285] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:33 2022] PUT /identity/v3/projects/0b0c9320d5bb4055a22a5629a7d0760e/users/c2e28ecbb4ff434ea72fdd38906dbd11/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:13:33.363318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.376627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8fcdd-3daa-4716-bc27-3e97c14e2891 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:33.453489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4029e-3143-4395-af6a-88e93400c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:33.454301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4029e-3143-4395-af6a-88e93400c887 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.454586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4029e-3143-4395-af6a-88e93400c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.454856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4029e-3143-4395-af6a-88e93400c887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.455649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4029e-3143-4395-af6a-88e93400c887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:33.457350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4029e-3143-4395-af6a-88e93400c887 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.474696 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1647/3286] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:33.476294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.493734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa135-dc64-4867-9588-959339e53a68 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:33.499624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:33.500432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.500883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.501213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] PATH_INFO: `/v3/projects/0b0c9320d5bb4055a22a5629a7d0760e/users/c2e28ecbb4ff434ea72fdd38906dbd11/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.503816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0c9320d5bb4055a22a5629a7d0760e, user_id=c2e28ecbb4ff434ea72fdd38906dbd11, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:33.506480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.555895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698dc39-f58b-4f37-92e7-5ea0146f8094 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.556228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698dc39-f58b-4f37-92e7-5ea0146f8094 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.556446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698dc39-f58b-4f37-92e7-5ea0146f8094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.559148 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1640/3287] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:33 2022] PUT /identity/v3/projects/0b0c9320d5bb4055a22a5629a7d0760e/users/c2e28ecbb4ff434ea72fdd38906dbd11/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:33.608028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e698dc39-f58b-4f37-92e7-5ea0146f8094 None None] MFA Rules not processed for user `c2e28ecbb4ff434ea72fdd38906dbd11`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:33.618172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e698dc39-f58b-4f37-92e7-5ea0146f8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:33.756120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.765054 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1648/3288] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:33.771829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd237fc1-048d-4e90-a67a-b0b98d39d52d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:33.777384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:33.778459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.778831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.779196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.779942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:33.780343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:33.782849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.825175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698dc39-f58b-4f37-92e7-5ea0146f8094 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.840155 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1641/3289] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:33.841334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698dc39-f58b-4f37-92e7-5ea0146f8094 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:33.847927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:33.848678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:33.849159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:33.849474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:33.850227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:33.852612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:33.972665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:33.987588 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1649/3290] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:33 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:33.996755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b8b4c-1142-4d99-bde7-f26761f4eec8 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:34.136424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff810-5362-41c8-b822-6cd1ce932e08 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:34.137313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff810-5362-41c8-b822-6cd1ce932e08 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:34.137732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff810-5362-41c8-b822-6cd1ce932e08 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:34.138224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff810-5362-41c8-b822-6cd1ce932e08 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:34.138919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff810-5362-41c8-b822-6cd1ce932e08 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:34.139541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff810-5362-41c8-b822-6cd1ce932e08 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:34.141367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff810-5362-41c8-b822-6cd1ce932e08 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:34.170695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1642/3291] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:34.183736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:34.188187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:34.360029 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:34.451846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cad3b2-2029-4955-8c18-5e9637c2daa0 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:34.458338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:34.459381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:34.459759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:34.460127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:34.481647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:34.483952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:34.524093 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1650/3292] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:34.546103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea295-6780-4ce6-b861-e868e482690c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:34.547440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea295-6780-4ce6-b861-e868e482690c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:34.547889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea295-6780-4ce6-b861-e868e482690c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:34.551051 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1643/3293] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:34.559114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:34.577318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:34.598866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533707a3-a0e9-4839-b093-9df941f7cdfb service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:34.614235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:34.616210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:34.620079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:34.620501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/projects/69578f16bf4242689a0ad713a186624b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:34.622676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:get_project(project_id=69578f16bf4242689a0ad713a186624b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:34.628978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:34.631180 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1651/3294] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:34 2022] GET /identity/v3/projects/69578f16bf4242689a0ad713a186624b => generated 371 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:35.148023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c436b-9d4e-4260-8bc1-b1506d1e1be9 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.148256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c436b-9d4e-4260-8bc1-b1506d1e1be9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.148535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c436b-9d4e-4260-8bc1-b1506d1e1be9 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.153488 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1644/3295] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:35.159739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:35.193729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:35.214246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51fde-d17d-470c-a49f-efa685816b6d tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:35.233366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:35.234204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.234612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.235128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/projects/69578f16bf4242689a0ad713a186624b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.238355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:get_project(project_id=69578f16bf4242689a0ad713a186624b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:35.242599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:35.249458 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1652/3296] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:35 2022] GET /identity/v3/projects/69578f16bf4242689a0ad713a186624b => generated 371 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:35.330213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c436b-9d4e-4260-8bc1-b1506d1e1be9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:35.360936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c436b-9d4e-4260-8bc1-b1506d1e1be9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:35.381053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:35.381713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.381993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.382265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.382918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:35.383222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:35.384985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:35.412870 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1645/3297] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:35.418427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:35.436805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b81cf-e4c1-43d6-b183-7d0a07015e26 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:35.449810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c5e37-3049-4515-9506-c40b6c6be8b1 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:35.450805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5e37-3049-4515-9506-c40b6c6be8b1 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.451495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5e37-3049-4515-9506-c40b6c6be8b1 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.452026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5e37-3049-4515-9506-c40b6c6be8b1 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.453326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c5e37-3049-4515-9506-c40b6c6be8b1 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:35.455386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c5e37-3049-4515-9506-c40b6c6be8b1 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:35.510336 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1653/3298] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:35 2022] POST /identity/v3/users => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:35.514720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:35.532083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8738-3413-45f0-9757-5e16fddeba91 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:35.549310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:35.550690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.551122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.551547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.552373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:35.552852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:35.554773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:35.585333 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1646/3299] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:35.618070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9d8d9-ba04-445f-8537-afa34bf9e9b3 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.618361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9d8d9-ba04-445f-8537-afa34bf9e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.618637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9d8d9-ba04-445f-8537-afa34bf9e9b3 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.619978 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1654/3300] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:35.625884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:35.649321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:35.677176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409b69-b2e8-4556-84ad-9bb8956f0106 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:35.694639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:35.695772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.696329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.696469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/projects/69578f16bf4242689a0ad713a186624b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.698627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:get_project(project_id=69578f16bf4242689a0ad713a186624b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:35.700586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:35.723119 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1647/3301] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:35 2022] GET /identity/v3/projects/69578f16bf4242689a0ad713a186624b => generated 371 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:35.906289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2947e-8623-400b-8017-fa459fae0637 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.907171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2947e-8623-400b-8017-fa459fae0637 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.908246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2947e-8623-400b-8017-fa459fae0637 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.911123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1655/3302] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:13:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:13:35.917015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:13:35.919679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:35.947879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:35.959554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cf8a4-8eba-4008-af88-5361452f1c86 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:35.976882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:35.977755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:35.978044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:35.978327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/projects/69578f16bf4242689a0ad713a186624b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:35.979603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:get_project(project_id=69578f16bf4242689a0ad713a186624b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:35.982941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:35.985681 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1648/3303] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:13:35 2022] GET /identity/v3/projects/69578f16bf4242689a0ad713a186624b => generated 371 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:36.035239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2947e-8623-400b-8017-fa459fae0637 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:36.054617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2947e-8623-400b-8017-fa459fae0637 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:36.063862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:36.064751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:36.065295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:36.065782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/users/0e423bf60d7f4978a49dae334def45c4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:36.108792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0e423bf60d7f4978a49dae334def45c4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:36.110885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:36.192077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e423bf60d7f4978a49dae334def45c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.192830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e423bf60d7f4978a49dae334def45c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.193465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e423bf60d7f4978a49dae334def45c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.210942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e423bf60d7f4978a49dae334def45c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.249839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e423bf60d7f4978a49dae334def45c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.294801 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1656/3304] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:36 2022] DELETE /identity/v3/users/0e423bf60d7f4978a49dae334def45c4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:36.298762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:36.301424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:36.320191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d248e-fac8-49eb-9e0a-b97c07340e06 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:36.486750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e28ecbb4ff434ea72fdd38906dbd11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b0c9320d5bb4055a22a5629a7d0760e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:36.494337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:36.494682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:36.494969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] PATH_INFO: `/v3/projects/69578f16bf4242689a0ad713a186624b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:36.497308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69578f16bf4242689a0ad713a186624b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:36.499863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:36.532018 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:36.594564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69578f16bf4242689a0ad713a186624b', 'request_id': 'req-b48ee126-ac49-4049-a138-af6114d583a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.602810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69578f16bf4242689a0ad713a186624b', 'request_id': 'req-b48ee126-ac49-4049-a138-af6114d583a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.615889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69578f16bf4242689a0ad713a186624b', 'request_id': 'req-b48ee126-ac49-4049-a138-af6114d583a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.640193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] The token cache is being invalidate because project 69578f16bf4242689a0ad713a186624b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:36.640492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.641247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b48ee126-ac49-4049-a138-af6114d583a2 tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:36.643873 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1649/3305] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:36 2022] DELETE /identity/v3/projects/69578f16bf4242689a0ad713a186624b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:36.650598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:36.653996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:36.793346 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:36.839179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eea6a5-a496-479e-9d07-50cd69e141da tempest-QuotasAdminTestV236-1360202239 tempest-QuotasAdminTestV236-1360202239-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:37.019321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:37.019908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:37.020177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:37.035037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] PATH_INFO: `/v3/users/0586aaf1bbf149bb94ad0e4e8fea191f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:37.036582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0586aaf1bbf149bb94ad0e4e8fea191f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:37.039824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:37.162644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0586aaf1bbf149bb94ad0e4e8fea191f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:37.166475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0586aaf1bbf149bb94ad0e4e8fea191f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:37.167229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0586aaf1bbf149bb94ad0e4e8fea191f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:37.181909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0586aaf1bbf149bb94ad0e4e8fea191f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:37.263437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0586aaf1bbf149bb94ad0e4e8fea191f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:37.338450 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1657/3306] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:36 2022] DELETE /identity/v3/users/0586aaf1bbf149bb94ad0e4e8fea191f => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:37.343661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:37.344155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:37.344522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:37.389902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:37.391303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:37.566938 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1650/3307] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:37.657357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:37.665485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:37.800640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:37.802498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:37.822456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370411-b1c4-46cf-a8b8-b9d46b5b3e64 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:37.825326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3c407-b58b-45da-99a5-a305f353ee3e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:37.826612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:37.827534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:37.827992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:37.828299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:37.836257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:37.836984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:37.837673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:37.837954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] PATH_INFO: `/v3/users/6b446b7d04ae45b3959fe37fc9dd5177` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:37.840505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b446b7d04ae45b3959fe37fc9dd5177)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:37.842970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:37.844228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:37.856483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:37.891945 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1658/3308] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:37.972799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b446b7d04ae45b3959fe37fc9dd5177'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:37.975128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b446b7d04ae45b3959fe37fc9dd5177'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:37.975986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b446b7d04ae45b3959fe37fc9dd5177'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.013796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b446b7d04ae45b3959fe37fc9dd5177'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.024096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b5e1305-7464-47fe-9fde-949949ef2c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b446b7d04ae45b3959fe37fc9dd5177'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.045603 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1651/3309] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:37 2022] DELETE /identity/v3/users/6b446b7d04ae45b3959fe37fc9dd5177 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:38.373695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:38.384790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380a2c-02d1-4f94-b51d-70ca0d5998e5 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:38.425818 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:38.544826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:38.546203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:38.547456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:38.547881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] PATH_INFO: `/v3/projects/335f86b3bc8c415a9a6619103b14b0b6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:38.549836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] RBAC: Authorizing `identity:delete_project(project_id=335f86b3bc8c415a9a6619103b14b0b6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:38.552180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:38.646140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335f86b3bc8c415a9a6619103b14b0b6', 'request_id': 'req-585924cb-faf6-4411-8c41-e6e1d517191a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.656941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335f86b3bc8c415a9a6619103b14b0b6', 'request_id': 'req-585924cb-faf6-4411-8c41-e6e1d517191a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.670866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335f86b3bc8c415a9a6619103b14b0b6', 'request_id': 'req-585924cb-faf6-4411-8c41-e6e1d517191a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.694145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] The token cache is being invalidate because project 335f86b3bc8c415a9a6619103b14b0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:38.694978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.697241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-585924cb-faf6-4411-8c41-e6e1d517191a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:38.700043 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1659/3310] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:38 2022] DELETE /identity/v3/projects/335f86b3bc8c415a9a6619103b14b0b6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:38.704996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0acba-d353-4d9e-929e-fe6cf3c2b2a2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:38.705323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0acba-d353-4d9e-929e-fe6cf3c2b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:38.707112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0acba-d353-4d9e-929e-fe6cf3c2b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:38.739226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ccf0acba-d353-4d9e-929e-fe6cf3c2b2a2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:38.740797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ccf0acba-d353-4d9e-929e-fe6cf3c2b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:38.765053 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:38.859584 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1652/3311] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:38.869352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fa068-f81a-44de-a122-c1ef0ebbae9c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:38.869851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fa068-f81a-44de-a122-c1ef0ebbae9c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:38.870117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fa068-f81a-44de-a122-c1ef0ebbae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:38.891926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ad8fa068-f81a-44de-a122-c1ef0ebbae9c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:38.893913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad8fa068-f81a-44de-a122-c1ef0ebbae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:38.906368 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1660/3312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:38.910894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0acba-d353-4d9e-929e-fe6cf3c2b2a2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:38.924653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0acba-d353-4d9e-929e-fe6cf3c2b2a2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:38.931573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:38.932570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:38.933639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:38.934120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:38.936086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:38.936993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:38.939681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:38.962341 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1653/3313] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:13:38.966590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fa068-f81a-44de-a122-c1ef0ebbae9c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:38.977978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fa068-f81a-44de-a122-c1ef0ebbae9c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:38.982998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:38.983610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:38.984362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:38.984362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:38.984920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:38.987018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:39.028665 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1661/3314] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:38 2022] POST /identity/v3/projects => generated 413 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:39.029478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:39.043088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721db300-e4be-4702-af91-a54bbc51ea51 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:39.158064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:39.159351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:39.159738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:39.160118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:39.160858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:39.163036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:39.198485 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1654/3315] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:39 2022] POST /identity/v3/users => generated 307 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:39.200806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:39.218594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cd0aa-4d40-48d3-a9da-2f30600d07d5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:39.227253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:39.236497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:39.237350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:39.237635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:39.238942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:39.240572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:39.254120 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1662/3316] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:39.256588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:39.275671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccc9b5-facc-413d-86cd-b73e97648cd2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:39.284462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:39.286138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:39.286265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:39.286702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:39.287895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:39.293401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:39.310123 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1655/3317] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:13:39.314570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:39.344376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3751fe-f103-4b82-97f5-cad627b7a8d9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:39.351259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11670fd3-271a-4fe1-b5ef-6d568ea040a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:39.352229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670fd3-271a-4fe1-b5ef-6d568ea040a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:39.352717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670fd3-271a-4fe1-b5ef-6d568ea040a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:39.353272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11670fd3-271a-4fe1-b5ef-6d568ea040a7 admin admin] PATH_INFO: `/v3/projects/59cce79e458147b3ade6be588988fdd0/users/30b429b7e8d141fcb18c608cbd64f97e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:39.381793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670fd3-271a-4fe1-b5ef-6d568ea040a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cce79e458147b3ade6be588988fdd0, user_id=30b429b7e8d141fcb18c608cbd64f97e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:39.385354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11670fd3-271a-4fe1-b5ef-6d568ea040a7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:39.441031 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1663/3318] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:39 2022] PUT /identity/v3/projects/59cce79e458147b3ade6be588988fdd0/users/30b429b7e8d141fcb18c608cbd64f97e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:39.441367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:39.443948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:39.445831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:39.446191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:39.446413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:39.472505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0537d1c-1eca-4fe7-b12b-5d5e6938c580 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:39.486148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:39.487964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:39.590261 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:39.632268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:39.634747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:39.635556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:39.636307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] PATH_INFO: `/v3/users/0d8390c3ea2843e3ad8065bcfdaf4c83` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:39.640615 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1664/3319] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:39.641366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8390c3ea2843e3ad8065bcfdaf4c83)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:39.646407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:39.716690 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:39.756143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8390c3ea2843e3ad8065bcfdaf4c83'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:39.757032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8390c3ea2843e3ad8065bcfdaf4c83'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:39.763245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8390c3ea2843e3ad8065bcfdaf4c83'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:39.768297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:39.770802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:39.804168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8390c3ea2843e3ad8065bcfdaf4c83'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:39.829294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8390c3ea2843e3ad8065bcfdaf4c83'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:39.881676 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1656/3320] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:39 2022] DELETE /identity/v3/users/0d8390c3ea2843e3ad8065bcfdaf4c83 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:40.063008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecbfb4-10c5-4c84-a459-13725a12a878 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.175543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.176404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.177267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.177688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.179751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:40.294472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.301154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.318625 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1665/3321] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:13:40.483557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:40.485856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:40.535091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255443f9-9771-4fc1-95ad-4c4f2419e173 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.550953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.551737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.552233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.552666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] PATH_INFO: `/v3/projects/f38b93478f0c48d0835cfe2524b0c5d2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.554486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38b93478f0c48d0835cfe2524b0c5d2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.556473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.598874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:40.601217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:40.621636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525a1bb-de6e-4611-91f0-8017eb253630 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.631805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38b93478f0c48d0835cfe2524b0c5d2', 'request_id': 'req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.641426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38b93478f0c48d0835cfe2524b0c5d2', 'request_id': 'req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.651421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38b93478f0c48d0835cfe2524b0c5d2', 'request_id': 'req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.672585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] The token cache is being invalidate because project f38b93478f0c48d0835cfe2524b0c5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:40.673141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.675208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.678046 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1657/3322] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:40 2022] DELETE /identity/v3/projects/f38b93478f0c48d0835cfe2524b0c5d2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:40.681954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:40.683641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:40.710629 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:40.737359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.740270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.740583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.740859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] PATH_INFO: `/v3/users/13cb40a462d047bfb9cdf97a8b18092e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.753519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cb40a462d047bfb9cdf97a8b18092e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.758172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.900937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cb40a462d047bfb9cdf97a8b18092e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.903856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d16b86-72ce-4f84-aeca-fdc48ab1a5a0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:40.904728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cb40a462d047bfb9cdf97a8b18092e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.905641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cb40a462d047bfb9cdf97a8b18092e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.920255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:40.936373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:40.936718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:40.937939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cb40a462d047bfb9cdf97a8b18092e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:40.939820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] PATH_INFO: `/v3/users/c2e28ecbb4ff434ea72fdd38906dbd11` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:40.944085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e28ecbb4ff434ea72fdd38906dbd11)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:40.954337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:40.984189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cb40a462d047bfb9cdf97a8b18092e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.013102 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1666/3323] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:40 2022] DELETE /identity/v3/users/13cb40a462d047bfb9cdf97a8b18092e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:41.047673 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:41.100801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e28ecbb4ff434ea72fdd38906dbd11'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.102326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e28ecbb4ff434ea72fdd38906dbd11'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.102567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.104069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.105028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e28ecbb4ff434ea72fdd38906dbd11'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.141364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e28ecbb4ff434ea72fdd38906dbd11'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.156283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6e3a6fb0-2e67-4ed2-9508-799da922b225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e28ecbb4ff434ea72fdd38906dbd11'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.192763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1658/3324] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:13:40 2022] DELETE /identity/v3/users/c2e28ecbb4ff434ea72fdd38906dbd11 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:41.247722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1b3ae-049c-4142-853c-1b3ff0b2b783 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.328177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.328820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.329126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.329409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] PATH_INFO: `/v3/projects/b4a5b3634e114d0aa9a443d52b710246` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.331220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a5b3634e114d0aa9a443d52b710246)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.333336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.363351 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:41.398655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a5b3634e114d0aa9a443d52b710246', 'request_id': 'req-4f9e1f07-08f7-457b-b180-26b585b1c5cb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.407500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a5b3634e114d0aa9a443d52b710246', 'request_id': 'req-4f9e1f07-08f7-457b-b180-26b585b1c5cb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.421534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a5b3634e114d0aa9a443d52b710246', 'request_id': 'req-4f9e1f07-08f7-457b-b180-26b585b1c5cb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.437397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] The token cache is being invalidate because project b4a5b3634e114d0aa9a443d52b710246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:41.437508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.438375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f9e1f07-08f7-457b-b180-26b585b1c5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.440960 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1667/3325] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:41 2022] DELETE /identity/v3/projects/b4a5b3634e114d0aa9a443d52b710246 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:41.446352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.446602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.447117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.493204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:41.494866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.583824 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1659/3326] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:41.591647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151ef8-3026-42fc-904f-523add6a7687 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.591930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151ef8-3026-42fc-904f-523add6a7687 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.592225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151ef8-3026-42fc-904f-523add6a7687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.616455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-66151ef8-3026-42fc-904f-523add6a7687 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:41.617788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-66151ef8-3026-42fc-904f-523add6a7687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.623511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.625793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.633325 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1668/3327] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:41.633905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151ef8-3026-42fc-904f-523add6a7687 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.638123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb3ec6-125f-4157-a940-a0a0b05c7fdd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.644675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.645177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151ef8-3026-42fc-904f-523add6a7687 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.645968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.646437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.646806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] PATH_INFO: `/v3/projects/59da9491909f47418cd5316b02fcf1ef` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.648159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59da9491909f47418cd5316b02fcf1ef)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.650334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.651052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.651851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.652316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.652847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.653548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:41.653870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.655460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.672091 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1669/3328] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:41.673166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.684731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02c848-897e-494b-98ae-34d93ea176c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.691075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.691799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.692151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.692980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.693751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.696115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.737679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1670/3329] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:41.740828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.764520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59da9491909f47418cd5316b02fcf1ef', 'request_id': 'req-df38fe85-8368-4545-b44c-ca486377e359'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.779529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59da9491909f47418cd5316b02fcf1ef', 'request_id': 'req-df38fe85-8368-4545-b44c-ca486377e359'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.794572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59da9491909f47418cd5316b02fcf1ef', 'request_id': 'req-df38fe85-8368-4545-b44c-ca486377e359'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.825758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] The token cache is being invalidate because project 59da9491909f47418cd5316b02fcf1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:41.826101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.827385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df38fe85-8368-4545-b44c-ca486377e359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:41.829217 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1660/3330] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:41 2022] DELETE /identity/v3/projects/59da9491909f47418cd5316b02fcf1ef => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:41.834910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0cb82-0c44-42bf-9fc5-27f76d01d76c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.836224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0cb82-0c44-42bf-9fc5-27f76d01d76c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.836886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0cb82-0c44-42bf-9fc5-27f76d01d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.871637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2bc0cb82-0c44-42bf-9fc5-27f76d01d76c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:41.873152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2bc0cb82-0c44-42bf-9fc5-27f76d01d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.879572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92757-c2d2-496f-b786-6aa14a391c76 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:41.884220 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1661/3331] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:41.896533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:41.899541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.899541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.899541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.903359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:41.908068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:41.911693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154f34c-129b-44e9-b427-8798da4eb151 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:41.912927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154f34c-129b-44e9-b427-8798da4eb151 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:41.916547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154f34c-129b-44e9-b427-8798da4eb151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:41.969105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f154f34c-129b-44e9-b427-8798da4eb151 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:41.977108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f154f34c-129b-44e9-b427-8798da4eb151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:41.979432 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1671/3332] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:41.980518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:41.984834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:42.000594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1662/3333] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:42.007273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154f34c-129b-44e9-b427-8798da4eb151 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.007735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9b219-37f2-4854-a081-61fb8daf6274 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.013195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.013819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.014099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.014374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.015043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.017820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.035920 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1672/3334] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:42.037863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.057967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154f34c-129b-44e9-b427-8798da4eb151 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.064637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1e8c0-3d99-45a8-b82d-fc05cce2a032 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.069385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.069644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.070249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.070525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.070793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.070908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.071460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.071733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.072132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.073025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.074232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:42.074626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.077641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.088127 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1673/3335] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:42.093388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.109588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1663/3336] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:13:42.111079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.118153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80d8ec-2bef-405e-9455-703b76ffa743 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.125143 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:42.130078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cccba-e036-40e1-990b-ebafaddb9107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.131017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cccba-e036-40e1-990b-ebafaddb9107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.131602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31275f26-9d86-409c-a9d5-40792deb45f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.133832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cccba-e036-40e1-990b-ebafaddb9107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.136515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cccba-e036-40e1-990b-ebafaddb9107 admin admin] PATH_INFO: `/v3/projects/df9db260e6a74bedb2a222c5c6366615/users/e8f23ce10c904dcebac4da773d531dfb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.146472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.147090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.147367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.147634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.150552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.162645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.163824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cccba-e036-40e1-990b-ebafaddb9107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9db260e6a74bedb2a222c5c6366615, user_id=e8f23ce10c904dcebac4da773d531dfb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.169175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cccba-e036-40e1-990b-ebafaddb9107 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.210401 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1674/3337] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:42 2022] PUT /identity/v3/projects/df9db260e6a74bedb2a222c5c6366615/users/e8f23ce10c904dcebac4da773d531dfb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:42.213687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.214232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.214764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.240376 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1664/3338] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:42 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:42.241982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.277212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:42.279181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:42.285692 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:42.396383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62393-bffb-46aa-9b6d-0a14ff0969a2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.405725 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1675/3339] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:42.412532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.413376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.413547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.413812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.414444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.416956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.433880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.436126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:42.477798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1665/3340] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:42 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:42.479401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.500621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356213-8a0f-4ee7-8874-74c2be927065 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.521726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.522355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.522952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.523228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.524163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.536510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.566209 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1666/3341] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:13:42.570372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.589543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f847-e039-4662-8813-c5a3286ffc4d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.597908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a0141-08ff-4d6c-8a68-522d319ccf62 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.599647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.602158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.603121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.603489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.611196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.611196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.611196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.611196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.611859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.614271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.633579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.633579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.653030 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1667/3342] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:42.653030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.653348 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1676/3343] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:13:42.671860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34afc19-e3b4-4347-8758-e6238b8084b1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.680339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8ddac-7ce7-4d1e-b9e5-97c4f4b6e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.681445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ddac-7ce7-4d1e-b9e5-97c4f4b6e72f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.682614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ddac-7ce7-4d1e-b9e5-97c4f4b6e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.683113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ddac-7ce7-4d1e-b9e5-97c4f4b6e72f admin admin] PATH_INFO: `/v3/projects/b4c17859ce2c436ea85485cc60e6959d/users/f1dcb9c93dae470a9f7285f34edf096d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.717319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8ddac-7ce7-4d1e-b9e5-97c4f4b6e72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c17859ce2c436ea85485cc60e6959d, user_id=f1dcb9c93dae470a9f7285f34edf096d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.720284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8ddac-7ce7-4d1e-b9e5-97c4f4b6e72f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.772243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:42.775728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:42.775841 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1668/3344] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:42 2022] PUT /identity/v3/projects/b4c17859ce2c436ea85485cc60e6959d/users/f1dcb9c93dae470a9f7285f34edf096d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:42.779332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792f947-110a-4d7e-b7b8-d74306341a57 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.779894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792f947-110a-4d7e-b7b8-d74306341a57 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.780253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792f947-110a-4d7e-b7b8-d74306341a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.796569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01643f5-0647-46a5-b9c9-f2ca0516dcf9 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:42.819851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e792f947-110a-4d7e-b7b8-d74306341a57 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:42.822135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e792f947-110a-4d7e-b7b8-d74306341a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:42.929126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:42.930708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:42.932683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:42.933520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] PATH_INFO: `/v3/projects/0b0c9320d5bb4055a22a5629a7d0760e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:42.940608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0c9320d5bb4055a22a5629a7d0760e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:42.945772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:42.990565 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1669/3345] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:43.018265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792f947-110a-4d7e-b7b8-d74306341a57 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:43.091026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0c9320d5bb4055a22a5629a7d0760e', 'request_id': 'req-a97b29a7-abdd-4fa9-97b8-618e910ae900'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:43.106055 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:43.106440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0c9320d5bb4055a22a5629a7d0760e', 'request_id': 'req-a97b29a7-abdd-4fa9-97b8-618e910ae900'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:43.110406 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:43.126523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0c9320d5bb4055a22a5629a7d0760e', 'request_id': 'req-a97b29a7-abdd-4fa9-97b8-618e910ae900'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:43.156966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] The token cache is being invalidate because project 0b0c9320d5bb4055a22a5629a7d0760e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:13:43.159823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:43.161677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a97b29a7-abdd-4fa9-97b8-618e910ae900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:13:43.168470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1677/3346] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:13:42 2022] DELETE /identity/v3/projects/0b0c9320d5bb4055a22a5629a7d0760e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:43.174016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454fc99-a578-4b91-aaa7-99bf5795ca55 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.175149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454fc99-a578-4b91-aaa7-99bf5795ca55 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.175788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454fc99-a578-4b91-aaa7-99bf5795ca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.190617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792f947-110a-4d7e-b7b8-d74306341a57 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:43.242039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c454fc99-a578-4b91-aaa7-99bf5795ca55 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:43.245776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c454fc99-a578-4b91-aaa7-99bf5795ca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:43.350123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:43.351837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.352780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.354830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.357496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:43.396205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1678/3347] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:43.396205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0df1d-8428-42f4-a6b7-225a07c1c6cf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.397317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0df1d-8428-42f4-a6b7-225a07c1c6cf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.397317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0df1d-8428-42f4-a6b7-225a07c1c6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.440634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-add0df1d-8428-42f4-a6b7-225a07c1c6cf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:43.442664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-add0df1d-8428-42f4-a6b7-225a07c1c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:43.464881 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1679/3348] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:13:43.469174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0df1d-8428-42f4-a6b7-225a07c1c6cf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:43.485865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0df1d-8428-42f4-a6b7-225a07c1c6cf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:43.503101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:43.503715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.504045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.504318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.504971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:13:43.505295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:43.506895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:43.533509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:43.537823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:43.553742 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1680/3349] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:13:43.556439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:43.575878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d580237-e77b-4001-a9e7-342c1e12e24c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:43.581613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1670/3350] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:13:43.583555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:43.584177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.584452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.584718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.585407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:43.587367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:43.628378 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1681/3351] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:43 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:43.631684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:43.663059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93ed94-a9b2-4c1f-af5b-57d4cd81e610 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:43.789006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:43.790029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.790406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.790785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.791593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:43.793994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:43.831180 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1671/3352] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:43 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:43.835034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:43.847390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0677-bb33-444d-b524-475fbdd3d9b3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:43.852491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:43.853598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.853716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.853972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.854621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:43.856270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:43.868480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1682/3353] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:13:43.873143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:43.921607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00b176-f9e8-4724-a58f-018391e1ee1b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:43.936852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6deb-91ec-4bf2-b3e9-693d406cacbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:43.937532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6deb-91ec-4bf2-b3e9-693d406cacbd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:43.938384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6deb-91ec-4bf2-b3e9-693d406cacbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:43.938642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6deb-91ec-4bf2-b3e9-693d406cacbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:43.939310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef6deb-91ec-4bf2-b3e9-693d406cacbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:43.945297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef6deb-91ec-4bf2-b3e9-693d406cacbd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:43.975358 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1672/3354] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:43.979700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:43.994789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539fea2-b90b-4a9f-b3a7-e377a0d5e708 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:44.014635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:44.015484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:44.019534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:44.019955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] PATH_INFO: `/v3/projects/758e31ae46814d799befd93f7cdb1d54/users/7b3366c1ab9a45d2808cd64aeff6f7d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:44.053154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758e31ae46814d799befd93f7cdb1d54, user_id=7b3366c1ab9a45d2808cd64aeff6f7d4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:44.059865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:44.122590 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1683/3355] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:43 2022] PUT /identity/v3/projects/758e31ae46814d799befd93f7cdb1d54/users/7b3366c1ab9a45d2808cd64aeff6f7d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:13:44.134581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f3614-5887-44fd-93b9-ada692735aee None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:44.135146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f3614-5887-44fd-93b9-ada692735aee None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:44.135146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f3614-5887-44fd-93b9-ada692735aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:44.185773 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:44.198651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-306f3614-5887-44fd-93b9-ada692735aee None None] MFA Rules not processed for user `7b3366c1ab9a45d2808cd64aeff6f7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:44.201553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-306f3614-5887-44fd-93b9-ada692735aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:44.387609 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1673/3356] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:44.388930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:44.500063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ebf0e-4376-4fd2-8f69-762971a59fa0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:44.508039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:44.508935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:44.509094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:44.509397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:44.510221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:44.518761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:44.540090 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:44.569939 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1684/3357] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:13:44 2022] POST /identity/v3/projects => generated 391 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:13:44.570694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f3614-5887-44fd-93b9-ada692735aee None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:44.590246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f3614-5887-44fd-93b9-ada692735aee None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:44.757115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:44.757730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:44.758011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:44.758276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:44.758932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:44.760886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:44.813481 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1674/3358] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:13:44 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:13:44.817758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:44.831805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a893-486e-4364-b535-9c6ec7581d68 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:44.845173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:44.845823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:44.848800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:44.849115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:44.849801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:44.854172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:44.878834 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1685/3359] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:44.883229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:44.901132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778aca-ed0c-4c29-ba7f-f54701c2ad0b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:44.915825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:44.917163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:44.918712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:44.919219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] PATH_INFO: `/v3/projects/7f4461392dca40abbbaaae7fb84b289a/users/0a4e7420aad94819b15128fe0f616450/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:44.959711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4461392dca40abbbaaae7fb84b289a, user_id=0a4e7420aad94819b15128fe0f616450, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:44.962479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:44.994056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1675/3360] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:44 2022] PUT /identity/v3/projects/7f4461392dca40abbbaaae7fb84b289a/users/0a4e7420aad94819b15128fe0f616450/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:44.997527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:45.008669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b738e-1ca9-473c-bc72-7e444b6d63c3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:45.089079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775c0d-0e91-41e2-82dd-9576eec4c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:45.089745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775c0d-0e91-41e2-82dd-9576eec4c317 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:45.090025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775c0d-0e91-41e2-82dd-9576eec4c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:45.090296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775c0d-0e91-41e2-82dd-9576eec4c317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:45.090989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9775c0d-0e91-41e2-82dd-9576eec4c317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:45.092762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9775c0d-0e91-41e2-82dd-9576eec4c317 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:45.107341 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1686/3361] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:13:45.112695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:45.125711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188b4c-62d6-4925-b4ff-17bafa6303d6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:45.142260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:45.143591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:45.143999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:45.144280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] PATH_INFO: `/v3/projects/7f4461392dca40abbbaaae7fb84b289a/users/0a4e7420aad94819b15128fe0f616450/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:45.157040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4461392dca40abbbaaae7fb84b289a, user_id=0a4e7420aad94819b15128fe0f616450, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:45.161013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:45.194567 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1676/3362] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:13:45 2022] PUT /identity/v3/projects/7f4461392dca40abbbaaae7fb84b289a/users/0a4e7420aad94819b15128fe0f616450/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:13:45.195892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:45.196529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:45.197116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:45.261643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] MFA Rules not processed for user `0a4e7420aad94819b15128fe0f616450`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:45.265341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:45.378203 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1687/3363] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:45.446096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:45.448903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:45.575182 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:45.642185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5341634-6b49-4333-b6b0-4bb72f31937a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:45.659161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb54f2-474c-4ae5-9432-fa96afbcec6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:45.660207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb54f2-474c-4ae5-9432-fa96afbcec6e service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:45.660207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb54f2-474c-4ae5-9432-fa96afbcec6e service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:45.660523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb54f2-474c-4ae5-9432-fa96afbcec6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:45.801382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb54f2-474c-4ae5-9432-fa96afbcec6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:45.803493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb54f2-474c-4ae5-9432-fa96afbcec6e service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:45.833955 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1677/3364] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:47.676398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:47.678741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:47.715509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790a3d-c65b-4a61-be17-c4b2d96f93b9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:47.724130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:47.725294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:47.725873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:47.726378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:47.739873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:47.742062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:47.757862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1688/3365] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:49.057002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09cbf7-7935-45d5-ba0c-1451ce4d8dfc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:49.057528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09cbf7-7935-45d5-ba0c-1451ce4d8dfc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:49.057783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09cbf7-7935-45d5-ba0c-1451ce4d8dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:49.169003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7d09cbf7-7935-45d5-ba0c-1451ce4d8dfc None None] MFA Rules not processed for user `0fe6b958303c4bc2aa8a5000d8a645db`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:49.170080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7d09cbf7-7935-45d5-ba0c-1451ce4d8dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:49.363497 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1678/3366] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:49.414220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:49.436585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbbe9e-8743-4128-b302-353542bdd473 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:49.446447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f490-a3ad-4e06-b1a0-449c6b0fa3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:49.447622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f490-a3ad-4e06-b1a0-449c6b0fa3c5 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:49.448211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f490-a3ad-4e06-b1a0-449c6b0fa3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:49.448665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f490-a3ad-4e06-b1a0-449c6b0fa3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:49.461502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f490-a3ad-4e06-b1a0-449c6b0fa3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:49.463110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f490-a3ad-4e06-b1a0-449c6b0fa3c5 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:49.493796 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1689/3367] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:54.819182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6ad2d-6ae3-4ae4-a08b-9e4d8d32c069 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:54.819986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6ad2d-6ae3-4ae4-a08b-9e4d8d32c069 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:54.820591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6ad2d-6ae3-4ae4-a08b-9e4d8d32c069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:54.879959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a9e6ad2d-6ae3-4ae4-a08b-9e4d8d32c069 None None] MFA Rules not processed for user `30b429b7e8d141fcb18c608cbd64f97e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:54.884912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a9e6ad2d-6ae3-4ae4-a08b-9e4d8d32c069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:55.047634 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1679/3368] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:55.058079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6828f02-d6cc-4a5a-8309-f1bd82a7d956 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:55.059478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6828f02-d6cc-4a5a-8309-f1bd82a7d956 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:55.059928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6828f02-d6cc-4a5a-8309-f1bd82a7d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:55.087648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a6828f02-d6cc-4a5a-8309-f1bd82a7d956 None None] MFA Rules not processed for user `30b429b7e8d141fcb18c608cbd64f97e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:55.091360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6828f02-d6cc-4a5a-8309-f1bd82a7d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:55.105589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1690/3369] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:13:55.129823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6ad2d-6ae3-4ae4-a08b-9e4d8d32c069 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:13:55.155186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6ad2d-6ae3-4ae4-a08b-9e4d8d32c069 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:13:55.181651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:13:55.182533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:55.182999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:55.184642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:55.194507 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:55.198045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:13:55.233927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:13:55.279372 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1680/3370] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:13:59.699457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:13:59.699946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:13:59.700211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:13:59.783456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] MFA Rules not processed for user `e8f23ce10c904dcebac4da773d531dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:13:59.785289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:13:59.823323 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:13:59.969405 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1691/3371] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:00.150876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:00.178494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf90-a3eb-41b9-815f-acc924c6363f service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:00.194923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:00.196423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:00.196903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:00.197380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:00.210605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:00.212649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:00.226645 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1681/3372] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:02.479955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:02.491234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:02.752817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1f7d-7533-4085-9171-a5d4b7a68311 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:02.765431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:02.766304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:02.769458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:02.770117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:02.775416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:02.805320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:02.820398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:02.858182 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1692/3373] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:03.781363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:03.782974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:03.943730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04d674-9f5b-4870-8577-73ba2578a2b6 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:03.963520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:03.965882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:03.966412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:03.968735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] PATH_INFO: `/v3/users/b7bda6344ae348648373e6fa9b530bef` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:03.974015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7bda6344ae348648373e6fa9b530bef)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:03.979149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:04.103833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7bda6344ae348648373e6fa9b530bef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.105395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7bda6344ae348648373e6fa9b530bef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.106905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7bda6344ae348648373e6fa9b530bef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.127323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7bda6344ae348648373e6fa9b530bef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.137566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a24944e4-7e76-474d-86c6-a95a3ddb3e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7bda6344ae348648373e6fa9b530bef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.168325 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1682/3374] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:03 2022] DELETE /identity/v3/users/b7bda6344ae348648373e6fa9b530bef => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:04.669530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:04.691206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb57664-11e5-43ba-a2f9-e19367e2a726 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:04.819112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:04.819768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:04.820454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:04.820715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] PATH_INFO: `/v3/projects/9d51175eb36e4047a5f1312d0b9b6059` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:04.823022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d51175eb36e4047a5f1312d0b9b6059)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:04.825870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:04.953537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d51175eb36e4047a5f1312d0b9b6059', 'request_id': 'req-474f44b6-584d-4f38-91a1-49414e2f2b09'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.962164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d51175eb36e4047a5f1312d0b9b6059', 'request_id': 'req-474f44b6-584d-4f38-91a1-49414e2f2b09'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.984318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d51175eb36e4047a5f1312d0b9b6059', 'request_id': 'req-474f44b6-584d-4f38-91a1-49414e2f2b09'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:04.987829 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:05.008787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] The token cache is being invalidate because project 9d51175eb36e4047a5f1312d0b9b6059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:05.009810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:05.012917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-474f44b6-584d-4f38-91a1-49414e2f2b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:05.014844 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1693/3375] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:04 2022] DELETE /identity/v3/projects/9d51175eb36e4047a5f1312d0b9b6059 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:05.020813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dae6b-2fa4-4c38-82ba-848d90c7d1d3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.021388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dae6b-2fa4-4c38-82ba-848d90c7d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.021388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dae6b-2fa4-4c38-82ba-848d90c7d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.047103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8a9dae6b-2fa4-4c38-82ba-848d90c7d1d3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:05.048430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8a9dae6b-2fa4-4c38-82ba-848d90c7d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:05.136736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1683/3376] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:05.144555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2664d-361c-46e7-b9b1-5562cb01b7a2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.144844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2664d-361c-46e7-b9b1-5562cb01b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.145146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2664d-361c-46e7-b9b1-5562cb01b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.174117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-91e2664d-361c-46e7-b9b1-5562cb01b7a2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:05.175535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-91e2664d-361c-46e7-b9b1-5562cb01b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:05.183784 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1694/3377] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:05.188001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dae6b-2fa4-4c38-82ba-848d90c7d1d3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.193052 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:05.199289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dae6b-2fa4-4c38-82ba-848d90c7d1d3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:05.205958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f4d38-42bd-4c5c-8108-f8d30b70716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:05.206666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f4d38-42bd-4c5c-8108-f8d30b70716f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.207028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f4d38-42bd-4c5c-8108-f8d30b70716f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.207380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f4d38-42bd-4c5c-8108-f8d30b70716f admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.208137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f4d38-42bd-4c5c-8108-f8d30b70716f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:05.208453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f4d38-42bd-4c5c-8108-f8d30b70716f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:05.210143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f4d38-42bd-4c5c-8108-f8d30b70716f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:05.222583 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1684/3378] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:14:05.226902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2664d-361c-46e7-b9b1-5562cb01b7a2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.236997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2664d-361c-46e7-b9b1-5562cb01b7a2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:05.242502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:05.243332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.243611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.243875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.244699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:05.246620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:05.275033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec473b6-4e4c-483f-ab34-b6f9bc96c9ce None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.275401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec473b6-4e4c-483f-ab34-b6f9bc96c9ce None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.275736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec473b6-4e4c-483f-ab34-b6f9bc96c9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.292915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1695/3379] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:05 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:05.296926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.325554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dec473b6-4e4c-483f-ab34-b6f9bc96c9ce None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:05.327494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dec473b6-4e4c-483f-ab34-b6f9bc96c9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:05.411610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59cae3-c677-4658-bfa3-712806b7e651 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:05.417173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:05.418103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.418393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.418670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.419316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:05.421689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:05.449142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1696/3380] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:05 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:05.452748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.459301 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1685/3381] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:05.471050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b1b1-7cf2-4140-9b66-8a33924c5cf6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.471470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b1b1-7cf2-4140-9b66-8a33924c5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.471850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b1b1-7cf2-4140-9b66-8a33924c5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.476854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70c4a7-a51e-4da4-bfe2-7fc3f50f7341 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:05.484066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:05.485422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.485713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.486504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.487180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:05.488890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:05.505773 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1697/3382] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:05.508794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.524782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cb71b1b1-7cf2-4140-9b66-8a33924c5cf6 None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:05.529471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb71b1b1-7cf2-4140-9b66-8a33924c5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:05.546917 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1686/3383] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:05.551919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd1c76-2208-47c9-b93e-d82a3fe84c2c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:05.559688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:05.560575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.561338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.561820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.562751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:05.565347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:05.582363 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1698/3384] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:14:05.586371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b1b1-7cf2-4140-9b66-8a33924c5cf6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.613532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.619235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:05.624218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b1b1-7cf2-4140-9b66-8a33924c5cf6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:05.633497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f9f15-c639-4f8c-b422-b56e6c88ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:05.634514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9f15-c639-4f8c-b422-b56e6c88ac5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.634961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9f15-c639-4f8c-b422-b56e6c88ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.635391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f9f15-c639-4f8c-b422-b56e6c88ac5d admin admin] PATH_INFO: `/v3/projects/8a0bc6c6c0054379a3342053d77ed9e0/users/f13dca3bd70b4bb687de462cc3b7356e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.685332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f9f15-c639-4f8c-b422-b56e6c88ac5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0bc6c6c0054379a3342053d77ed9e0, user_id=f13dca3bd70b4bb687de462cc3b7356e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:05.695290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f9f15-c639-4f8c-b422-b56e6c88ac5d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:05.740789 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1687/3385] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:05 2022] PUT /identity/v3/projects/8a0bc6c6c0054379a3342053d77ed9e0/users/f13dca3bd70b4bb687de462cc3b7356e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:05.742918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.743210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.743482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:05.793759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:05.795481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:05.837381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e657ed2-66d4-4b5c-b9f7-72e105b3ab47 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:05.881422 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:05.928981 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1688/3386] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:05.950949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:05.957923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:05.983074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecb6de-c5cf-48a9-9b00-db5b1fd1a9aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:05.987652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecb6de-c5cf-48a9-9b00-db5b1fd1a9aa service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:05.989303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecb6de-c5cf-48a9-9b00-db5b1fd1a9aa service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:05.989687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecb6de-c5cf-48a9-9b00-db5b1fd1a9aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:06.045875 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:06.053023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b9750-7aa6-40dd-9aef-7f4611e382ea None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:06.066021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e3663-625c-45c2-a8e1-16b359861a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:06.066750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e3663-625c-45c2-a8e1-16b359861a41 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:06.067123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e3663-625c-45c2-a8e1-16b359861a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:06.067493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e3663-625c-45c2-a8e1-16b359861a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:06.088366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e3663-625c-45c2-a8e1-16b359861a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:06.093632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e3663-625c-45c2-a8e1-16b359861a41 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:06.116701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1689/3387] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:06.176682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecb6de-c5cf-48a9-9b00-db5b1fd1a9aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:06.179155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecb6de-c5cf-48a9-9b00-db5b1fd1a9aa service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:06.192882 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1699/3388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:06.985196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:06.985510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:06.985808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:07.041033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] MFA Rules not processed for user `e8f23ce10c904dcebac4da773d531dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:07.044327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:07.168857 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1690/3389] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:08.347371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a3c4-814c-43c7-9ad3-3fc200b602cd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:08.347991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a3c4-814c-43c7-9ad3-3fc200b602cd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:08.348230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8a3c4-814c-43c7-9ad3-3fc200b602cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:08.437639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d7e8a3c4-814c-43c7-9ad3-3fc200b602cd None None] MFA Rules not processed for user `0133996879444b61a285203e928bc031`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:08.440514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d7e8a3c4-814c-43c7-9ad3-3fc200b602cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:08.645934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:08.645934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:08.659186 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1700/3390] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:08.668195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed6a6a-9771-4ca8-a9ca-0521096399ed None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:08.688316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:08.689549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:08.689870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:08.690105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] PATH_INFO: `/v3/users/0fe6b958303c4bc2aa8a5000d8a645db` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:08.699331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe6b958303c4bc2aa8a5000d8a645db)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:08.702350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:08.828072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe6b958303c4bc2aa8a5000d8a645db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:08.829341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe6b958303c4bc2aa8a5000d8a645db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:08.830401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe6b958303c4bc2aa8a5000d8a645db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:08.857579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe6b958303c4bc2aa8a5000d8a645db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:08.873618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e73824f6-e425-41aa-b470-fd3ce42f20c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe6b958303c4bc2aa8a5000d8a645db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:08.896512 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1691/3391] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:08 2022] DELETE /identity/v3/users/0fe6b958303c4bc2aa8a5000d8a645db => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:09.435678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a3c4-814c-43c7-9ad3-3fc200b602cd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:09.450691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8a3c4-814c-43c7-9ad3-3fc200b602cd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:09.541847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:09.543714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:09.546315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:09.547533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] PATH_INFO: `/v3/projects/e6d376ec5b33424ba04ed0424059c2be` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:09.554213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d376ec5b33424ba04ed0424059c2be)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:09.557397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:09.600129 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:09.699562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d376ec5b33424ba04ed0424059c2be', 'request_id': 'req-c1e81ce1-0a39-4af5-a035-d327c8e0a286'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:09.708840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d376ec5b33424ba04ed0424059c2be', 'request_id': 'req-c1e81ce1-0a39-4af5-a035-d327c8e0a286'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:09.733254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d376ec5b33424ba04ed0424059c2be', 'request_id': 'req-c1e81ce1-0a39-4af5-a035-d327c8e0a286'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:09.761716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] The token cache is being invalidate because project e6d376ec5b33424ba04ed0424059c2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:09.762011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:09.763591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c1e81ce1-0a39-4af5-a035-d327c8e0a286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:09.765752 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1701/3392] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:09 2022] DELETE /identity/v3/projects/e6d376ec5b33424ba04ed0424059c2be => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:09.773021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c539bf9-a89d-42ca-8446-87ffc8ebe2d8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:09.773574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c539bf9-a89d-42ca-8446-87ffc8ebe2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:09.773907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c539bf9-a89d-42ca-8446-87ffc8ebe2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:09.833430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8c539bf9-a89d-42ca-8446-87ffc8ebe2d8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:09.837329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c539bf9-a89d-42ca-8446-87ffc8ebe2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:10.037944 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1692/3393] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:10.047114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ff0b-f6a4-46eb-8091-639984cb18ba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.047770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ff0b-f6a4-46eb-8091-639984cb18ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.048336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ff0b-f6a4-46eb-8091-639984cb18ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.091995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c676ff0b-f6a4-46eb-8091-639984cb18ba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:10.093388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c676ff0b-f6a4-46eb-8091-639984cb18ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:10.103772 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1702/3394] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:10.107880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c539bf9-a89d-42ca-8446-87ffc8ebe2d8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:10.121232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c539bf9-a89d-42ca-8446-87ffc8ebe2d8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:10.136240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:10.137041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.137270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.137468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.138081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:10.138396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:10.140017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:10.157623 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:10.182611 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1693/3395] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:14:10.183454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ff0b-f6a4-46eb-8091-639984cb18ba None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:10.197602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ff0b-f6a4-46eb-8091-639984cb18ba None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:10.209134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:10.213292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.217625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.218041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.218779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:10.222320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:10.342332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:10.347943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1703/3396] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:10 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:10.356996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd924a2-6841-46ab-8580-fd405eabeef6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:10.577325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:10.578051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.578383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.578932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.579742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:10.581968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:10.634771 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1694/3397] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:10 2022] POST /identity/v3/users => generated 299 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:10.635610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:10.651048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f89d6-50b1-495a-a417-a644b7106c36 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:10.659577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:10.661582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.662119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.663189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.664190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:10.668974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:10.689670 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1704/3398] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:14:10.695301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:10.710720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a9baa-2772-45e8-81e0-f92452fed3f8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:10.726430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bccb16-08f1-4a41-a267-4e9c4e22dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:10.727404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bccb16-08f1-4a41-a267-4e9c4e22dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.727957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bccb16-08f1-4a41-a267-4e9c4e22dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.728465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bccb16-08f1-4a41-a267-4e9c4e22dd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.730594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bccb16-08f1-4a41-a267-4e9c4e22dd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:10.736592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bccb16-08f1-4a41-a267-4e9c4e22dd30 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:10.774692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:10.776649 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1695/3399] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:10.790448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e658e-0073-4c86-965d-3d0003e5b7e6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:10.825881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:10.826837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.827294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.827713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] PATH_INFO: `/v3/projects/c5c0ee812f634c2b8cb0722c4e9c22dd/users/c981049441a641ce8d68d792e8840222/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.865269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c0ee812f634c2b8cb0722c4e9c22dd, user_id=c981049441a641ce8d68d792e8840222, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:10.870102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:10.898904 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1705/3400] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:10 2022] PUT /identity/v3/projects/c5c0ee812f634c2b8cb0722c4e9c22dd/users/c981049441a641ce8d68d792e8840222/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:10.913709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:10.914212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:10.914647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:10.993945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] MFA Rules not processed for user `c981049441a641ce8d68d792e8840222`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:10.997894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:11.105882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:11.109894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:11.305295 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1696/3401] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:11.316206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:11.319598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:11.405029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ec0d0-6c3d-49a1-9a55-14a724ec2b87 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:11.424588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:11.427550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:11.427849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:11.428146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] PATH_INFO: `/v3/users/7b3366c1ab9a45d2808cd64aeff6f7d4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:11.435039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3366c1ab9a45d2808cd64aeff6f7d4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:11.436854 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:11.436990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:11.449513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61863ace-55ec-4af8-8516-1024e7bc28bc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:11.457743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a116b-3c1f-446e-aff3-3d6330221ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:11.458357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a116b-3c1f-446e-aff3-3d6330221ef3 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:11.458743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a116b-3c1f-446e-aff3-3d6330221ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:11.460793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a116b-3c1f-446e-aff3-3d6330221ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:11.481406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a116b-3c1f-446e-aff3-3d6330221ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:11.483184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a116b-3c1f-446e-aff3-3d6330221ef3 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:11.514692 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1697/3402] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:11.608379 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:11.633768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3366c1ab9a45d2808cd64aeff6f7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:11.635288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3366c1ab9a45d2808cd64aeff6f7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:11.635839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3366c1ab9a45d2808cd64aeff6f7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:11.647902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3366c1ab9a45d2808cd64aeff6f7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:11.665397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3366c1ab9a45d2808cd64aeff6f7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:11.724221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:11.724221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:11.724221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:11.734451 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1706/3403] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:11 2022] DELETE /identity/v3/users/7b3366c1ab9a45d2808cd64aeff6f7d4 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:11.767244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:11.772776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:11.979726 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1698/3404] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:11.984567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:11.987811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:12.011676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:12.014063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:12.068063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb40d-0f4f-44c0-8921-c3df3f982b9c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:12.086556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:12.087413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:12.087588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:12.087857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] PATH_INFO: `/v3/users/c981049441a641ce8d68d792e8840222` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:12.091341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c981049441a641ce8d68d792e8840222)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:12.102676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:12.153162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb5efc-8a5a-4306-a019-6b22699b5439 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:12.163787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4519133-63c5-43cc-bcb0-2dca7025cc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:12.164205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4519133-63c5-43cc-bcb0-2dca7025cc32 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:12.164670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4519133-63c5-43cc-bcb0-2dca7025cc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:12.165186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4519133-63c5-43cc-bcb0-2dca7025cc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:12.191266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4519133-63c5-43cc-bcb0-2dca7025cc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:12.194602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4519133-63c5-43cc-bcb0-2dca7025cc32 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:12.218581 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1707/3405] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:12.252581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c981049441a641ce8d68d792e8840222'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:12.253361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c981049441a641ce8d68d792e8840222'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:12.254969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c981049441a641ce8d68d792e8840222'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:12.298760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c981049441a641ce8d68d792e8840222'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:12.315775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c981049441a641ce8d68d792e8840222'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:12.357644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1699/3406] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:12 2022] DELETE /identity/v3/users/c981049441a641ce8d68d792e8840222 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:12.367697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:12.369802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:12.370374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:12.414242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:12.418323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:12.596905 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1708/3407] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:12.609986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:12.611598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:12.805222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10cd8f-3e34-4636-b880-acda93102256 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:12.822754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:12.825557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:12.826006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:12.826431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:12.871095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:12.873301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:12.887715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:12.893875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:12.906194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece09403-fa8e-4249-831f-546e84d07b8d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:12.927544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:12.928334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:12.928520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:12.930024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] PATH_INFO: `/v3/projects/758e31ae46814d799befd93f7cdb1d54` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:12.933689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] RBAC: Authorizing `identity:delete_project(project_id=758e31ae46814d799befd93f7cdb1d54)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:12.938152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:12.945535 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1700/3408] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:13.060013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758e31ae46814d799befd93f7cdb1d54', 'request_id': 'req-a45f14f6-73a3-466d-a847-dbc66280600d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.071229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758e31ae46814d799befd93f7cdb1d54', 'request_id': 'req-a45f14f6-73a3-466d-a847-dbc66280600d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.073520 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:13.094394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758e31ae46814d799befd93f7cdb1d54', 'request_id': 'req-a45f14f6-73a3-466d-a847-dbc66280600d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.122096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] The token cache is being invalidate because project 758e31ae46814d799befd93f7cdb1d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:13.122644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.124411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.126160 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1709/3409] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:12 2022] DELETE /identity/v3/projects/758e31ae46814d799befd93f7cdb1d54 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:13.131032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:13.139627 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:13.150618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8ed74-9acb-4c91-905b-4f66175e8839 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:13.309826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:13.310561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:13.311838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:13.312295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] PATH_INFO: `/v3/users/0a4e7420aad94819b15128fe0f616450` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:13.316011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4e7420aad94819b15128fe0f616450)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:13.320952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:13.456209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4e7420aad94819b15128fe0f616450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.457306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4e7420aad94819b15128fe0f616450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.458706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4e7420aad94819b15128fe0f616450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.484875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4e7420aad94819b15128fe0f616450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.496522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f0a6ae0-219a-4656-80fc-3ed7e49d8dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4e7420aad94819b15128fe0f616450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:13.524716 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1701/3410] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:13 2022] DELETE /identity/v3/users/0a4e7420aad94819b15128fe0f616450 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:13.582895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:13.584416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:13.609990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f14f6-73a3-466d-a847-dbc66280600d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:13.895647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:13.896651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:13.896940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:13.899412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] PATH_INFO: `/v3/projects/c5c0ee812f634c2b8cb0722c4e9c22dd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:13.901887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c0ee812f634c2b8cb0722c4e9c22dd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:13.911976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:14.093581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c0ee812f634c2b8cb0722c4e9c22dd', 'request_id': 'req-c0b45404-778b-470b-a57f-dd3c59f918a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.107489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c0ee812f634c2b8cb0722c4e9c22dd', 'request_id': 'req-c0b45404-778b-470b-a57f-dd3c59f918a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.135118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c0ee812f634c2b8cb0722c4e9c22dd', 'request_id': 'req-c0b45404-778b-470b-a57f-dd3c59f918a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.166799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] The token cache is being invalidate because project c5c0ee812f634c2b8cb0722c4e9c22dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:14.168761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.181772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0b45404-778b-470b-a57f-dd3c59f918a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.184335 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1710/3411] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:13 2022] DELETE /identity/v3/projects/c5c0ee812f634c2b8cb0722c4e9c22dd => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:14.192228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7c1a0-c292-42bc-bd72-b0cdeceba3a9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:14.194400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7c1a0-c292-42bc-bd72-b0cdeceba3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:14.195538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7c1a0-c292-42bc-bd72-b0cdeceba3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:14.272691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fec7c1a0-c292-42bc-bd72-b0cdeceba3a9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:14.275151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fec7c1a0-c292-42bc-bd72-b0cdeceba3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:14.527290 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1702/3412] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:14.535816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:14.536125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:14.536389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:14.573698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:14.575224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:14.588281 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1711/3413] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:14.589824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7c1a0-c292-42bc-bd72-b0cdeceba3a9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:14.609916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7c1a0-c292-42bc-bd72-b0cdeceba3a9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:14.624110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:14.624832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:14.625432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:14.625713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:14.628429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:14.628984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:14.632440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:14.640697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:14.643812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:14.678068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582be1-1226-418b-9e51-d0eb8053c589 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:14.698511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1703/3414] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:14:14.699762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:14.700614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:14.701749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:14.702216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:14.703455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] PATH_INFO: `/v3/projects/7f4461392dca40abbbaaae7fb84b289a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:14.705276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4461392dca40abbbaaae7fb84b289a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:14.707508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:14.753118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80f58a-e374-45a3-9182-f4ae24aae07b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:14.766650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:14.768734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:14.770191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:14.772030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:14.774607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:14.779729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:14.782487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4461392dca40abbbaaae7fb84b289a', 'request_id': 'req-dd72b42a-05a7-4eb9-bc55-315701ff684e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.791734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4461392dca40abbbaaae7fb84b289a', 'request_id': 'req-dd72b42a-05a7-4eb9-bc55-315701ff684e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.809402 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:14.823213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4461392dca40abbbaaae7fb84b289a', 'request_id': 'req-dd72b42a-05a7-4eb9-bc55-315701ff684e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.825708 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=3,keystone:DELETE=15,keystone:SELECT=82 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:14.846216 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1704/3415] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:14 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:14.851425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:14.858380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] The token cache is being invalidate because project 7f4461392dca40abbbaaae7fb84b289a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:14.860703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.863304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd72b42a-05a7-4eb9-bc55-315701ff684e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:14.868642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1712/3416] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:14 2022] DELETE /identity/v3/projects/7f4461392dca40abbbaaae7fb84b289a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:14.876015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f4be-19d0-4d9e-8934-4787c19afa4d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:14.878157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f4be-19d0-4d9e-8934-4787c19afa4d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:14.879422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f4be-19d0-4d9e-8934-4787c19afa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:14.933721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5a26f4be-19d0-4d9e-8934-4787c19afa4d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:14.937025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5a26f4be-19d0-4d9e-8934-4787c19afa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:15.012892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed62ce-ee5a-4cfc-81e7-de49d851c523 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.019541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.020473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.020816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.021579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.022306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.026911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.083141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1705/3417] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:14 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:15.084187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.089632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:15.126064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897be18-65a0-42d1-a01a-e41941818629 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.134465 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1713/3418] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:15.142734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632031a2-17b0-43e5-ae1c-1f0ea692f766 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.143634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632031a2-17b0-43e5-ae1c-1f0ea692f766 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.144112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632031a2-17b0-43e5-ae1c-1f0ea692f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.150508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.151139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.151456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.151701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.152466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.158781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.188389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-632031a2-17b0-43e5-ae1c-1f0ea692f766 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:15.188617 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1706/3419] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:15.188752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-632031a2-17b0-43e5-ae1c-1f0ea692f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:15.190227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.208347 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1714/3420] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:15.209136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d797cf-bd6a-4768-8c48-cfd1bd0e9378 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.213833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632031a2-17b0-43e5-ae1c-1f0ea692f766 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.219837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.221691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.223205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.225099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.225509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.227817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.231052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632031a2-17b0-43e5-ae1c-1f0ea692f766 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.246389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.247573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.249606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.250122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.251510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:15.252700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.255316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.255855 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1707/3421] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:15.259121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.288087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a9b9-eddb-4cac-98a3-8a907b361549 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.301806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866beed-6ed9-4916-a875-386f7e7e6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.302233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866beed-6ed9-4916-a875-386f7e7e6641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.302506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866beed-6ed9-4916-a875-386f7e7e6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.302781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866beed-6ed9-4916-a875-386f7e7e6641 admin admin] PATH_INFO: `/v3/projects/c01f89f9fa76496ba87539f083bdba8a/users/ef1a60fe1cad4ebf848f7d3b2af1476b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.304868 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1715/3422] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:14:15.307485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.345886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866beed-6ed9-4916-a875-386f7e7e6641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01f89f9fa76496ba87539f083bdba8a, user_id=ef1a60fe1cad4ebf848f7d3b2af1476b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.351851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be623e-9212-4f0d-9fdc-c8e2871b56d5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.353558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866beed-6ed9-4916-a875-386f7e7e6641 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.369612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.373758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.374175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.375211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.376143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.384596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.412582 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1708/3423] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:15 2022] PUT /identity/v3/projects/c01f89f9fa76496ba87539f083bdba8a/users/ef1a60fe1cad4ebf848f7d3b2af1476b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:15.426782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.428231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.428231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.478114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1716/3424] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:15 2022] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:15.479991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.485133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] MFA Rules not processed for user `ef1a60fe1cad4ebf848f7d3b2af1476b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:15.487254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:15.624564 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1709/3425] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:15.659184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.662037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:15.702477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c2b7-bd33-4f3f-97cd-be18c25730c3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.714610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.716560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.716856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.717173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.717835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.719824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.729235 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:15.773139 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1717/3426] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:15 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:15.776828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.806142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506a6bc-310c-4354-8de8-def51f2221c5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.813472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.814297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.814581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.814860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.816392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.818683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.834510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1718/3427] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:15.835488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.860861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c0b5-5436-4de5-889b-2564aab693c1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.862204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9704c-3529-4e9a-be34-84f0a37e4961 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.874733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.875702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.876029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.876786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.880829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.882083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.882083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.882083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.882754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.885858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.898367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.899914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:15.909941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1719/3428] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:15.911461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:15.926431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296eca6-acbb-4bd8-bcc2-a360bc4f3604 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:15.933526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95f581-3212-4e96-b206-1a86f5e6961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:15.934793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95f581-3212-4e96-b206-1a86f5e6961a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:15.935401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95f581-3212-4e96-b206-1a86f5e6961a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:15.935401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95f581-3212-4e96-b206-1a86f5e6961a admin admin] PATH_INFO: `/v3/projects/90171a8c0f134339b51bed2267929f41/users/8633d067632949a7b4cf90a4ffcacb15/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:15.941691 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1710/3429] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:14:15.955667 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:15.980337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95f581-3212-4e96-b206-1a86f5e6961a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90171a8c0f134339b51bed2267929f41, user_id=8633d067632949a7b4cf90a4ffcacb15, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:15.989339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95f581-3212-4e96-b206-1a86f5e6961a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:16.003257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:16.022968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2547c3f-f5dd-4742-8f13-7cb15b3d30fc service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:16.027783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1720/3430] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:15 2022] PUT /identity/v3/projects/90171a8c0f134339b51bed2267929f41/users/8633d067632949a7b4cf90a4ffcacb15/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:16.044550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc231180-4dd7-4bd6-b27a-b776d756f698 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.045119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc231180-4dd7-4bd6-b27a-b776d756f698 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.045669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc231180-4dd7-4bd6-b27a-b776d756f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.107447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cc231180-4dd7-4bd6-b27a-b776d756f698 None None] MFA Rules not processed for user `8633d067632949a7b4cf90a4ffcacb15`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:16.108693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cc231180-4dd7-4bd6-b27a-b776d756f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:16.225984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:16.227100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.227212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.228737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] PATH_INFO: `/v3/users/ef1a60fe1cad4ebf848f7d3b2af1476b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.233406 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1721/3431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:16.233579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1a60fe1cad4ebf848f7d3b2af1476b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:16.235827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:16.239388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc231180-4dd7-4bd6-b27a-b776d756f698 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:16.269138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc231180-4dd7-4bd6-b27a-b776d756f698 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:16.290641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:16.291281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.291565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.291945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.292594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:16.297700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:16.357614 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1722/3432] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:16 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:14:16.362621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:16.364264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1a60fe1cad4ebf848f7d3b2af1476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:16.365082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1a60fe1cad4ebf848f7d3b2af1476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:16.365814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1a60fe1cad4ebf848f7d3b2af1476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:16.408131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1a60fe1cad4ebf848f7d3b2af1476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:16.424047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2ca3ea8-578c-4ed2-acd3-d460c19f2eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1a60fe1cad4ebf848f7d3b2af1476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:16.454023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1711/3433] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:16 2022] DELETE /identity/v3/users/ef1a60fe1cad4ebf848f7d3b2af1476b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:16.455876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.456270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.456826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.481497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:16.483336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:16.520430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42571912-adcd-45d7-8fc1-ab1b74e2919c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:16.521840 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:16.645021 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1712/3434] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:16.666129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:16.666766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.667048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.667321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.668259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:16.671510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:16.672942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:16.679716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:16.721016 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:16.749113 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1723/3435] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:16 2022] POST /identity/v3/users => generated 303 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:16.753437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:16.756211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:16.797356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0daac2-4491-4de8-aac3-10ea57fa89aa admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:16.818066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:16.818637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.818927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.819202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.819946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:16.821591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:16.841501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1724/3436] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:16.845474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:16.850090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515afee7-ee2a-4063-9962-1a640ebebf2c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:16.868087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97429-7389-4c88-b4c3-d981f7c2f571 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:16.870434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:16.872142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.873280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.873790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.877772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:16.878544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:16.878835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:16.879116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] PATH_INFO: `/v3/projects/25d6132cfb074399b270e38505524d3f/users/13424442ea3e471ebfbe7b1b957db325/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:16.906375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:16.908518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:16.921017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d6132cfb074399b270e38505524d3f, user_id=13424442ea3e471ebfbe7b1b957db325, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:16.924428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:16.926477 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1713/3437] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:14:16.952073 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1725/3438] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:16 2022] PUT /identity/v3/projects/25d6132cfb074399b270e38505524d3f/users/13424442ea3e471ebfbe7b1b957db325/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:16.956660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:16.982547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bb289-f11a-40d2-b910-dde52f3472fa service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:17.255144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f33bd3-bf1b-4c35-b371-cb58e1080c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:17.255923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33bd3-bf1b-4c35-b371-cb58e1080c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:17.256615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33bd3-bf1b-4c35-b371-cb58e1080c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:17.256891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33bd3-bf1b-4c35-b371-cb58e1080c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:17.257781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f33bd3-bf1b-4c35-b371-cb58e1080c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:17.259350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f33bd3-bf1b-4c35-b371-cb58e1080c17 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:17.289891 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1714/3439] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:17.290886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:17.307725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065037f3-1017-47f9-a79b-e005907d3cc6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:17.321664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:17.323064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:17.324058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:17.324339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] PATH_INFO: `/v3/projects/25d6132cfb074399b270e38505524d3f/users/13424442ea3e471ebfbe7b1b957db325/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:17.328480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d6132cfb074399b270e38505524d3f, user_id=13424442ea3e471ebfbe7b1b957db325, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:17.333098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:17.373901 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1726/3440] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:17 2022] PUT /identity/v3/projects/25d6132cfb074399b270e38505524d3f/users/13424442ea3e471ebfbe7b1b957db325/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:17.378554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:17.378845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:17.379123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:17.444570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] MFA Rules not processed for user `13424442ea3e471ebfbe7b1b957db325`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:17.446331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:17.604161 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:17.664283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1715/3441] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:17.736353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:17.739212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:17.978587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a183ac-8dd6-4147-a163-269ce788bcd1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:17.990210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cedc56-fbc0-40b3-bcda-def72097e3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:17.990991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedc56-fbc0-40b3-bcda-def72097e3dc service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:18.006652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedc56-fbc0-40b3-bcda-def72097e3dc service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:18.007643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedc56-fbc0-40b3-bcda-def72097e3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:18.028771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cedc56-fbc0-40b3-bcda-def72097e3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:18.032331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cedc56-fbc0-40b3-bcda-def72097e3dc service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:18.105190 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1727/3442] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:18.668222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:18.670252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:18.762149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae610e5b-d8e5-464f-9a69-678f7e690bb1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:18.773735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:18.774394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:18.774669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:18.774938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] PATH_INFO: `/v3/projects/c01f89f9fa76496ba87539f083bdba8a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:18.785823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01f89f9fa76496ba87539f083bdba8a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:18.787895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:18.982301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01f89f9fa76496ba87539f083bdba8a', 'request_id': 'req-8e164d9b-97ca-4941-91b9-47f05c9e11d7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:18.991203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01f89f9fa76496ba87539f083bdba8a', 'request_id': 'req-8e164d9b-97ca-4941-91b9-47f05c9e11d7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:19.001847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01f89f9fa76496ba87539f083bdba8a', 'request_id': 'req-8e164d9b-97ca-4941-91b9-47f05c9e11d7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:19.035089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] The token cache is being invalidate because project c01f89f9fa76496ba87539f083bdba8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:19.036419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:19.037245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8e164d9b-97ca-4941-91b9-47f05c9e11d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:19.040514 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1716/3443] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:18 2022] DELETE /identity/v3/projects/c01f89f9fa76496ba87539f083bdba8a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:19.044458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094f24-68b6-4c85-a529-a2146a5e74b4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.045628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094f24-68b6-4c85-a529-a2146a5e74b4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.046016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094f24-68b6-4c85-a529-a2146a5e74b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.096668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1e094f24-68b6-4c85-a529-a2146a5e74b4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:19.099466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1e094f24-68b6-4c85-a529-a2146a5e74b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:19.241610 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1728/3444] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:19.245945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cbe9-b479-43bd-bc48-c83c1be3d783 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.246585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cbe9-b479-43bd-bc48-c83c1be3d783 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.246943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cbe9-b479-43bd-bc48-c83c1be3d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.289873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3d18cbe9-b479-43bd-bc48-c83c1be3d783 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:19.294021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d18cbe9-b479-43bd-bc48-c83c1be3d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:19.318495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1717/3445] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:19.322529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094f24-68b6-4c85-a529-a2146a5e74b4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:19.336694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094f24-68b6-4c85-a529-a2146a5e74b4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:19.362835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:19.363478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.363762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.364038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.364699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:19.365003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:19.366647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:19.404580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1729/3446] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:14:19.412486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18cbe9-b479-43bd-bc48-c83c1be3d783 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:19.428899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18cbe9-b479-43bd-bc48-c83c1be3d783 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:19.443563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:19.445749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.446095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.446373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.447026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:19.449482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:19.565232 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1718/3447] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:19 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:19.568151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:19.583126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94965b9-89d3-4e04-aff9-c0a5045800f5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:19.630534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:19.634882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:19.654319 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:19.754252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:19.754802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.755084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.755351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.755726 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:19.756322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:19.758991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:19.798446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30610f-1187-4835-a6dc-1b50cdc48ccf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:19.816058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea5223-2fb0-45ed-8cc8-0cf377088b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:19.816058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5223-2fb0-45ed-8cc8-0cf377088b34 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.816058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5223-2fb0-45ed-8cc8-0cf377088b34 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.816058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea5223-2fb0-45ed-8cc8-0cf377088b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.817444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1730/3448] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:19 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:19.821152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:19.822252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9aea5223-2fb0-45ed-8cc8-0cf377088b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:19.832617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a7b97-edf7-41ec-87c9-b9f91991b69a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:19.837532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:19.838148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.838418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.838688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.839595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:19.840940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:19.857366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1731/3449] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:14:19.858124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:19.872171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a34e-4049-4419-bad5-5b0f295f488e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:19.876997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:19.877707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.877988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.878259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.879394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:19.881228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:19.895861 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1732/3450] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:19.897793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:19.916317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7b22-0439-4db1-817d-a2af2ec95500 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:19.929507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:19.930685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.932180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.932610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] PATH_INFO: `/v3/projects/46ae591a28644430bb5dea1e015b4d77/users/5b9d54b44d5144fb91a91abc8106c5c0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:19.952668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ae591a28644430bb5dea1e015b4d77, user_id=5b9d54b44d5144fb91a91abc8106c5c0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:19.955636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea5223-2fb0-45ed-8cc8-0cf377088b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:19.956904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:19.957252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea5223-2fb0-45ed-8cc8-0cf377088b34 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:19.984453 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1719/3452] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:19.985441 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1733/3452] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:19 2022] PUT /identity/v3/projects/46ae591a28644430bb5dea1e015b4d77/users/5b9d54b44d5144fb91a91abc8106c5c0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:19.987315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb060b-d1ed-42fd-b4b3-ce8e06b24ce0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:19.987616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb060b-d1ed-42fd-b4b3-ce8e06b24ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:19.987868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb060b-d1ed-42fd-b4b3-ce8e06b24ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:20.006850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:20.008739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:20.043797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-39cb060b-d1ed-42fd-b4b3-ce8e06b24ce0 None None] MFA Rules not processed for user `5b9d54b44d5144fb91a91abc8106c5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:20.045021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-39cb060b-d1ed-42fd-b4b3-ce8e06b24ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:20.127254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fce25-604e-4ef8-9731-474603b68bd7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:20.139986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:20.140748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:20.141221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:20.142324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] PATH_INFO: `/v3/users/8633d067632949a7b4cf90a4ffcacb15` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:20.144284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8633d067632949a7b4cf90a4ffcacb15)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:20.148367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:20.228857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8633d067632949a7b4cf90a4ffcacb15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:20.229638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8633d067632949a7b4cf90a4ffcacb15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:20.236846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8633d067632949a7b4cf90a4ffcacb15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:20.241168 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1720/3453] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:20.259801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8633d067632949a7b4cf90a4ffcacb15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:20.287378 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:20.311565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8633d067632949a7b4cf90a4ffcacb15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:20.355277 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1734/3454] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:20 2022] DELETE /identity/v3/users/8633d067632949a7b4cf90a4ffcacb15 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:20.358985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:20.359269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:20.359556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:20.394708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:20.395970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:20.553214 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1721/3455] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:20.584401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:20.591724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:20.740332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:20.742820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:20.781308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3af91-819c-4f23-9027-f681a8388790 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:20.786169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:20.786878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:20.787235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:20.787596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:20.795963 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:20.802646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:20.803930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:20.826582 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1735/3456] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:20.878682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606d621-c4dd-4aa8-9e99-e7e18537ed47 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:20.886967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:20.887618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:20.887991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:20.888336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:20.904953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:21.052568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:21.054453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:21.067412 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1722/3457] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:14:22.010551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:22.030284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038332b-9504-400a-8fe3-cfd2066da25c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:22.038704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:22.039468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:22.039854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:22.040249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:22.042593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:22.074145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:22.086011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:22.104278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1736/3458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:22.262686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:22.264335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:22.285937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0bd9-fb77-45b3-b141-197be2d65a86 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:22.295099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:22.295998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:22.296433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:22.296852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] PATH_INFO: `/v3/projects/90171a8c0f134339b51bed2267929f41` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:22.298766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=90171a8c0f134339b51bed2267929f41)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:22.301418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:22.396431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90171a8c0f134339b51bed2267929f41', 'request_id': 'req-7af209f4-cde8-4996-a3b9-676c4031c9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.405336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90171a8c0f134339b51bed2267929f41', 'request_id': 'req-7af209f4-cde8-4996-a3b9-676c4031c9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.422339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90171a8c0f134339b51bed2267929f41', 'request_id': 'req-7af209f4-cde8-4996-a3b9-676c4031c9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.453181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] The token cache is being invalidate because project 90171a8c0f134339b51bed2267929f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:22.453473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.455206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.458368 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1723/3459] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:22 2022] DELETE /identity/v3/projects/90171a8c0f134339b51bed2267929f41 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:22.462139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:22.478901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0ce0-9b01-4c76-a843-f4003080c6f6 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:22.601079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:22.601866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:22.602247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:22.602623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] PATH_INFO: `/v3/users/13424442ea3e471ebfbe7b1b957db325` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:22.604117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13424442ea3e471ebfbe7b1b957db325)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:22.606603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:22.722152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13424442ea3e471ebfbe7b1b957db325'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.723147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13424442ea3e471ebfbe7b1b957db325'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.723818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13424442ea3e471ebfbe7b1b957db325'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.736249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13424442ea3e471ebfbe7b1b957db325'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.753541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44cca36f-57d7-48e3-a6c9-f9b1ae696244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13424442ea3e471ebfbe7b1b957db325'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:22.755672 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:22.807907 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1737/3460] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:22 2022] DELETE /identity/v3/users/13424442ea3e471ebfbe7b1b957db325 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:23.164091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:23.165790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:23.192549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af209f4-cde8-4996-a3b9-676c4031c9bb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:23.254548 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:23.294336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:23.295280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:23.295673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:23.296048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] PATH_INFO: `/v3/projects/25d6132cfb074399b270e38505524d3f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:23.297641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d6132cfb074399b270e38505524d3f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:23.300705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:23.397026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d6132cfb074399b270e38505524d3f', 'request_id': 'req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:23.415688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d6132cfb074399b270e38505524d3f', 'request_id': 'req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:23.429586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d6132cfb074399b270e38505524d3f', 'request_id': 'req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:23.458862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] The token cache is being invalidate because project 25d6132cfb074399b270e38505524d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:23.459159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:23.461430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2bb827e8-ff73-437d-bbf2-1bc0a08a5596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:23.466072 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1724/3461] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:23 2022] DELETE /identity/v3/projects/25d6132cfb074399b270e38505524d3f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:23.472367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e83fd-cc18-485e-8833-42b5ec7ac24e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:23.473242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e83fd-cc18-485e-8833-42b5ec7ac24e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:23.473630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e83fd-cc18-485e-8833-42b5ec7ac24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:23.503393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e07e83fd-cc18-485e-8833-42b5ec7ac24e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:23.511761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e07e83fd-cc18-485e-8833-42b5ec7ac24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:23.632915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1738/3462] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:23.642858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3083c-5589-4806-857c-3f45447adc1b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:23.643291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3083c-5589-4806-857c-3f45447adc1b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:23.643578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3083c-5589-4806-857c-3f45447adc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:23.672383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3dc3083c-5589-4806-857c-3f45447adc1b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:23.676544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3dc3083c-5589-4806-857c-3f45447adc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:23.701315 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1725/3463] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:23.705574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e83fd-cc18-485e-8833-42b5ec7ac24e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:23.734274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e83fd-cc18-485e-8833-42b5ec7ac24e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:23.740535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:23.742796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:23.743296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:23.743780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:23.745351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:23.746517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:23.749699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:23.770617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1739/3464] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:14:23.774856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3083c-5589-4806-857c-3f45447adc1b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:23.790251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3083c-5589-4806-857c-3f45447adc1b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:23.798455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:23.799089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:23.799410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:23.799633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:23.800285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:23.806558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:23.855147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:23.855462 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1726/3465] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:23 2022] POST /identity/v3/projects => generated 399 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:23.871604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199817f-742f-4814-b34f-407c3a1f027f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:24.015922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:24.016815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.017117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.017421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.018062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:24.019997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:24.081805 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1740/3466] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:23 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:14:24.085038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:24.100170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4007e-91ac-433f-a1f6-b8fac051c66b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:24.107223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:24.108396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.108818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.109340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.110115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:24.113054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:24.127098 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1727/3467] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:14:24.130998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:24.146552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48be1-9bdc-4216-9270-ca12c6fc288a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:24.159401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689aa89-99c9-4cfc-9701-fe930880d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:24.160119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689aa89-99c9-4cfc-9701-fe930880d045 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.160405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689aa89-99c9-4cfc-9701-fe930880d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.160733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689aa89-99c9-4cfc-9701-fe930880d045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.161442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689aa89-99c9-4cfc-9701-fe930880d045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:24.163485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689aa89-99c9-4cfc-9701-fe930880d045 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:24.180189 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1741/3468] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:24.184652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:24.197799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9b721-ef18-40df-b4e7-7dbd23e643bf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:24.210806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:24.211487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.211767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.212035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] PATH_INFO: `/v3/projects/478e6900c2ca41568f8c78d0fd25de98/users/3d568ef3a7304df4b44b9e09173779c7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.233557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478e6900c2ca41568f8c78d0fd25de98, user_id=3d568ef3a7304df4b44b9e09173779c7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:24.236725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:24.286261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1728/3469] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:24 2022] PUT /identity/v3/projects/478e6900c2ca41568f8c78d0fd25de98/users/3d568ef3a7304df4b44b9e09173779c7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:24.288444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.289739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.289872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.323301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:24.325327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:24.427232 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:24.449507 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1742/3470] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:24.456812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:24.458819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:24.535153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d2ed2-a282-4c4d-99ed-c7e8c33c10f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:24.541619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5c2ba-67da-4706-80f6-184e2385e3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:24.542311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c2ba-67da-4706-80f6-184e2385e3fc service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.542658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c2ba-67da-4706-80f6-184e2385e3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.543532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c2ba-67da-4706-80f6-184e2385e3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.556895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5c2ba-67da-4706-80f6-184e2385e3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:24.558783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5c2ba-67da-4706-80f6-184e2385e3fc service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:24.576784 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1729/3471] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:24.596426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:24.597954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:24.618290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b02ec-bae3-4a68-91ee-b866c175a488 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:24.623862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:24.624843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.625152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.625593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] PATH_INFO: `/v3/users/5b9d54b44d5144fb91a91abc8106c5c0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.627545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9d54b44d5144fb91a91abc8106c5c0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:24.631188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:24.695654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9d54b44d5144fb91a91abc8106c5c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:24.696893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9d54b44d5144fb91a91abc8106c5c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:24.699600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9d54b44d5144fb91a91abc8106c5c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:24.711817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9d54b44d5144fb91a91abc8106c5c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:24.727510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4be032fd-0760-4a2e-9b7f-192b92842e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9d54b44d5144fb91a91abc8106c5c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:24.745749 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1743/3472] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:14:24 2022] DELETE /identity/v3/users/5b9d54b44d5144fb91a91abc8106c5c0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:24.751857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.752461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.752848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.789101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:24.792993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:24.800275 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:24.934284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ec88-aea1-4db0-9194-0cf7c81170e2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:24.934477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ec88-aea1-4db0-9194-0cf7c81170e2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:24.934728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ec88-aea1-4db0-9194-0cf7c81170e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:24.965561 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1730/3473] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:24.977894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:24.980865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:25.022483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6fb0ec88-aea1-4db0-9194-0cf7c81170e2 None None] MFA Rules not processed for user `f13dca3bd70b4bb687de462cc3b7356e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:25.026053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6fb0ec88-aea1-4db0-9194-0cf7c81170e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:25.160908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fed48f-287b-4907-b820-6beec5d9805a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:25.180562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:25.181250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:25.181537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:25.181812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:25.205779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:25.209697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:25.221130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1744/3474] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:25.229221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:25.230233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:25.231494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:25.246211 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1731/3475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:25.272954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] MFA Rules not processed for user `f13dca3bd70b4bb687de462cc3b7356e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:25.275655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:25.293126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1745/3476] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:25.300242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:25.302877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:25.414520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0560b7-8fb8-4103-bfa0-6e3f5debfebc service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:25.424714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b708c4b-71bd-4e77-9b31-10c8e484ed10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:25.425634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b708c4b-71bd-4e77-9b31-10c8e484ed10 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:25.426014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b708c4b-71bd-4e77-9b31-10c8e484ed10 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:25.426467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b708c4b-71bd-4e77-9b31-10c8e484ed10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:25.440700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b708c4b-71bd-4e77-9b31-10c8e484ed10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:25.442983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b708c4b-71bd-4e77-9b31-10c8e484ed10 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:25.458537 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1732/3477] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:25.945567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:25.947430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:25.975552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd3742-40b2-4c3e-8ef1-440004bb484f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:25.997267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:25.997267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.001844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.001844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] PATH_INFO: `/v3/projects/46ae591a28644430bb5dea1e015b4d77` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.006606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ae591a28644430bb5dea1e015b4d77)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:26.008801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:26.091705 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:26.093174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ae591a28644430bb5dea1e015b4d77', 'request_id': 'req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:26.106607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ae591a28644430bb5dea1e015b4d77', 'request_id': 'req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:26.128982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ae591a28644430bb5dea1e015b4d77', 'request_id': 'req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:26.150376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] The token cache is being invalidate because project 46ae591a28644430bb5dea1e015b4d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:14:26.151027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:26.152915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:14:26.155388 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1746/3478] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:14:25 2022] DELETE /identity/v3/projects/46ae591a28644430bb5dea1e015b4d77 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:14:26.162221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e32a7-d427-4835-82b9-1ff1c4dd4b54 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.162517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e32a7-d427-4835-82b9-1ff1c4dd4b54 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.162768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e32a7-d427-4835-82b9-1ff1c4dd4b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.239794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-043e32a7-d427-4835-82b9-1ff1c4dd4b54 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:26.241135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-043e32a7-d427-4835-82b9-1ff1c4dd4b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:26.332066 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:26.339718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:26.341688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:26.428207 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1733/3479] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:26.429975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917d72-7198-4aed-bf5d-304c3b1dcdd7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.432019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917d72-7198-4aed-bf5d-304c3b1dcdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.432491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917d72-7198-4aed-bf5d-304c3b1dcdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.487641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-90917d72-7198-4aed-bf5d-304c3b1dcdd7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:26.491578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-90917d72-7198-4aed-bf5d-304c3b1dcdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:26.503262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b81ea-17a4-4048-a8df-dcc1fd14cf72 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:26.510572 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1734/3480] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:26.515061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90917d72-7198-4aed-bf5d-304c3b1dcdd7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:26.516221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:26.517743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.518014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.519229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.525372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:26.540617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90917d72-7198-4aed-bf5d-304c3b1dcdd7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:26.553718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:26.555421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:26.557261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:26.557890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.558169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.558437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.559091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:14:26.559390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:26.567511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:26.579722 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1747/3481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:26.592658 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1735/3482] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:14:26.597919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:26.621305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505695-863a-4b60-abfb-fbb899aa2785 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:26.645327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:26.646360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.646852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.647323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.648180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:26.654703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:26.724661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1748/3483] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:14:26 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:14:26.728708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:26.744753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee570c64-b425-4b2f-bbc0-8d10d82f77d3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:26.845546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:26.847922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.848427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.848864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.850683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:26.857149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:26.916571 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1736/3484] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:14:26 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:14:26.921688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:26.938684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf807c4-6c3e-433b-a09e-ec8596366b71 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:26.954589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:26.954589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:26.955407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:26.955407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:26.956791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:26.960990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:26.987983 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1749/3485] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:26.992366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:27.010326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6e3cd-060a-476d-84a1-d94157217681 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:27.026632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd0a5-1856-48f3-beb7-d9206cceda73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:27.029383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd0a5-1856-48f3-beb7-d9206cceda73 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:27.029665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd0a5-1856-48f3-beb7-d9206cceda73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:27.030342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd0a5-1856-48f3-beb7-d9206cceda73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:27.033153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd0a5-1856-48f3-beb7-d9206cceda73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:27.035740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd0a5-1856-48f3-beb7-d9206cceda73 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:27.073993 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1737/3486] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:14:27.077209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:27.099024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3e41-ef6a-4cc1-9d2f-54500e5678a3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:27.114817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:27.117807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:27.118866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:27.119556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] PATH_INFO: `/v3/projects/d6ef59b7262942809c210d1d0e6fab44/users/48d1e8f642494770bfe64752178bf4b6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:27.165392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ef59b7262942809c210d1d0e6fab44, user_id=48d1e8f642494770bfe64752178bf4b6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:27.179445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:27.220446 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1750/3487] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:14:27 2022] PUT /identity/v3/projects/d6ef59b7262942809c210d1d0e6fab44/users/48d1e8f642494770bfe64752178bf4b6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:14:27.227101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e49af-1aad-4981-a679-eb90b8cf00a3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:27.227445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e49af-1aad-4981-a679-eb90b8cf00a3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:27.227968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e49af-1aad-4981-a679-eb90b8cf00a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:27.302418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7a1e49af-1aad-4981-a679-eb90b8cf00a3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:27.312587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7a1e49af-1aad-4981-a679-eb90b8cf00a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:27.509387 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1738/3488] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:14:27.561639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:27.747646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6ab16-5e62-4477-b25e-14b8bd217625 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:27.755110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7fbf4-b58e-4f97-b835-b26c356e9a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:27.756035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fbf4-b58e-4f97-b835-b26c356e9a59 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:27.757741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fbf4-b58e-4f97-b835-b26c356e9a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:27.758236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fbf4-b58e-4f97-b835-b26c356e9a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:27.786833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7fbf4-b58e-4f97-b835-b26c356e9a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:27.816495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7fbf4-b58e-4f97-b835-b26c356e9a59 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:27.841806 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1751/3489] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:28.256277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e49af-1aad-4981-a679-eb90b8cf00a3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:28.272447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e49af-1aad-4981-a679-eb90b8cf00a3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:28.280276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb72f2-bfbd-4a4f-94b2-ff2cbd292834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:28.280972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb72f2-bfbd-4a4f-94b2-ff2cbd292834 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:28.281348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb72f2-bfbd-4a4f-94b2-ff2cbd292834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:28.281622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb72f2-bfbd-4a4f-94b2-ff2cbd292834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:28.286419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cbdb72f2-bfbd-4a4f-94b2-ff2cbd292834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:28.315018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb72f2-bfbd-4a4f-94b2-ff2cbd292834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:28.319120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb72f2-bfbd-4a4f-94b2-ff2cbd292834 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:28.363097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1739/3490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:35.696599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:35.697485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:35.697485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:35.775186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] MFA Rules not processed for user `3d568ef3a7304df4b44b9e09173779c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:35.776436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:35.817498 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:35.934864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11d9b-c34b-411a-adec-51fd6e3376ab None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:35.935479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11d9b-c34b-411a-adec-51fd6e3376ab None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:35.935612 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1752/3491] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:35.935722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11d9b-c34b-411a-adec-51fd6e3376ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:35.975098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-03b11d9b-c34b-411a-adec-51fd6e3376ab None None] MFA Rules not processed for user `3d568ef3a7304df4b44b9e09173779c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:35.976659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-03b11d9b-c34b-411a-adec-51fd6e3376ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:35.999904 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1740/3492] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:36.890968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:36.894044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:37.118184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67931fc4-5347-4f51-8abe-667e1c5a1e81 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:37.134436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20a21d-ded5-487a-8875-191650735e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:37.135966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a21d-ded5-487a-8875-191650735e89 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:37.138003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a21d-ded5-487a-8875-191650735e89 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:37.138883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a21d-ded5-487a-8875-191650735e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:37.162357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20a21d-ded5-487a-8875-191650735e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:37.164232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20a21d-ded5-487a-8875-191650735e89 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:37.193471 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1753/3493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:43.103580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea10b-4118-4a8e-904b-6c27318e3404 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:43.104573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea10b-4118-4a8e-904b-6c27318e3404 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:43.105111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ea10b-4118-4a8e-904b-6c27318e3404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:43.148604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b80ea10b-4118-4a8e-904b-6c27318e3404 None None] MFA Rules not processed for user `48d1e8f642494770bfe64752178bf4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:43.156548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b80ea10b-4118-4a8e-904b-6c27318e3404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:43.163251 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:14:43.247047 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1741/3494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:43.851920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427147ec-c923-4b2d-b080-dc9c525ec4db None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:43.852470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427147ec-c923-4b2d-b080-dc9c525ec4db None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:43.852470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427147ec-c923-4b2d-b080-dc9c525ec4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:43.910945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-427147ec-c923-4b2d-b080-dc9c525ec4db None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:43.913505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-427147ec-c923-4b2d-b080-dc9c525ec4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:44.112205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1754/3495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:44.452306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ea10b-4118-4a8e-904b-6c27318e3404 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:14:44.476627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ea10b-4118-4a8e-904b-6c27318e3404 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:14:44.493676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd8aaa-d064-4d33-9f69-8d276e071739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:14:44.494393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd8aaa-d064-4d33-9f69-8d276e071739 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:44.494961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd8aaa-d064-4d33-9f69-8d276e071739 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:44.495331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd8aaa-d064-4d33-9f69-8d276e071739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:44.512888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd8aaa-d064-4d33-9f69-8d276e071739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:14:44.515028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd8aaa-d064-4d33-9f69-8d276e071739 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:14:44.536134 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1742/3496] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:14:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:14:49.191037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:49.191534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:49.191777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:49.255522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] MFA Rules not processed for user `48d1e8f642494770bfe64752178bf4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:49.258314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:49.296378 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1755/3497] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:51.507123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:14:51.507852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:14:51.508371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:14:51.565580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] MFA Rules not processed for user `0133996879444b61a285203e928bc031`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:14:51.568058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:14:51.715260 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1743/3498] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:14:59.239282 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:01.696272 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=55 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:02.228045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:02.231574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:02.250323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073730e-1261-48eb-b7cd-19861d6cd8d7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:02.258332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:02.259174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:02.259610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:02.260075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:02.262048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:02.374877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:02.374877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:02.408887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1756/3499] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:07.035157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:07.036597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:07.052320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df815454-ba40-48c4-b94b-65a082c17ff6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:07.058245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:07.058917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:07.059198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:07.059471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] PATH_INFO: `/v3/users/30b429b7e8d141fcb18c608cbd64f97e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:07.060994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b429b7e8d141fcb18c608cbd64f97e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:07.063873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:07.120092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b429b7e8d141fcb18c608cbd64f97e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.121327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b429b7e8d141fcb18c608cbd64f97e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.122232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b429b7e8d141fcb18c608cbd64f97e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.137882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b429b7e8d141fcb18c608cbd64f97e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.146525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-806b8512-1ee8-4245-b557-de51dbe31d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b429b7e8d141fcb18c608cbd64f97e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.163503 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1744/3500] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:15:07 2022] DELETE /identity/v3/users/30b429b7e8d141fcb18c608cbd64f97e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:15:07.376668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:07.401437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca7def-fe99-48cb-af46-da28cd2ec17c service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:07.491418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:07.492276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:07.492655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:07.493033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] PATH_INFO: `/v3/projects/59cce79e458147b3ade6be588988fdd0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:07.494321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cce79e458147b3ade6be588988fdd0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:07.496591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:07.573108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cce79e458147b3ade6be588988fdd0', 'request_id': 'req-e2b64308-5a53-4cff-8595-a648b9e58d07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.584427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cce79e458147b3ade6be588988fdd0', 'request_id': 'req-e2b64308-5a53-4cff-8595-a648b9e58d07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.597303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cce79e458147b3ade6be588988fdd0', 'request_id': 'req-e2b64308-5a53-4cff-8595-a648b9e58d07'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.613643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] The token cache is being invalidate because project 59cce79e458147b3ade6be588988fdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:15:07.614181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.615110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e2b64308-5a53-4cff-8595-a648b9e58d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:07.617158 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1757/3501] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:15:07 2022] DELETE /identity/v3/projects/59cce79e458147b3ade6be588988fdd0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:07.622056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b546b-ea8b-4f50-a389-8bb952dfbba3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:07.622919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b546b-ea8b-4f50-a389-8bb952dfbba3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:07.623611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b546b-ea8b-4f50-a389-8bb952dfbba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:07.648294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-187b546b-ea8b-4f50-a389-8bb952dfbba3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:07.649690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-187b546b-ea8b-4f50-a389-8bb952dfbba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:07.745095 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1745/3502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:15:07.747170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0593-d174-4371-b6e6-519829842a93 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:07.747615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0593-d174-4371-b6e6-519829842a93 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:07.748052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0593-d174-4371-b6e6-519829842a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:07.771757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6b4f0593-d174-4371-b6e6-519829842a93 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:07.773453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b4f0593-d174-4371-b6e6-519829842a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:07.787119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1758/3503] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:15:07.788407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b546b-ea8b-4f50-a389-8bb952dfbba3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:07.807401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b546b-ea8b-4f50-a389-8bb952dfbba3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:07.814459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:07.815946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:07.816230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:07.817200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:07.818657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:15:07.819302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:07.828571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:07.849605 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1746/3504] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:15:07.853860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f0593-d174-4371-b6e6-519829842a93 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:07.869946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f0593-d174-4371-b6e6-519829842a93 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:07.908728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:07.912746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:07.914041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:07.914398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:07.915666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:07.918981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:07.994559 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:08.007833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1759/3505] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:15:07 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:15:08.011820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:08.027078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc34f2-a3a8-4be5-a5d5-201693593a09 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:08.151026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:08.151974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:08.152285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:08.152863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:08.153658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:08.156353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:08.167637 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:08.195750 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1747/3506] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:15:08 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:15:08.199701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:08.223166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215fbc9-bb5a-4a6b-a44b-2281fab65eb4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:08.242512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:08.242512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:08.242512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:08.242512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:08.244348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:08.249022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:08.281952 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1760/3507] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:15:08.284598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:08.300162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc25aa3-ae71-4c15-9cfb-8ec22c220805 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:08.317923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c0727-419c-4d3f-a784-90eba5b17c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:08.318543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0727-419c-4d3f-a784-90eba5b17c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:08.318880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0727-419c-4d3f-a784-90eba5b17c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:08.319078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0727-419c-4d3f-a784-90eba5b17c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:08.319860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c0727-419c-4d3f-a784-90eba5b17c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:08.321512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c0727-419c-4d3f-a784-90eba5b17c86 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:08.344093 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1748/3508] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:15:08.348423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:08.365431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704af5e-a1c8-42a2-aa41-4f54d1cca8e1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:08.372569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:08.373738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:08.373934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:08.374398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] PATH_INFO: `/v3/projects/a52b2bf76c8f4e188878e9058c9f67f1/users/c8e6339f921449c780521852bba1e34e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:08.398991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52b2bf76c8f4e188878e9058c9f67f1, user_id=c8e6339f921449c780521852bba1e34e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:08.403868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:08.434048 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1761/3509] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:15:08 2022] PUT /identity/v3/projects/a52b2bf76c8f4e188878e9058c9f67f1/users/c8e6339f921449c780521852bba1e34e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:08.458625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:08.458905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:08.459183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:08.524173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] MFA Rules not processed for user `c8e6339f921449c780521852bba1e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:08.525655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:08.705408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1749/3510] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:09.347089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:09.349506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:09.541691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab253-91da-4417-9b85-4cdf7cdbad86 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:09.559164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:09.559815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:09.560096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:09.560363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:09.587572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:09.589497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:09.601202 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1762/3511] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:09.926878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:09.928882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:10.098412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479459-5dfd-4cce-bdce-c730fdf3d5c4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:10.112747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:10.115326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:10.116373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:10.117151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] PATH_INFO: `/v3/users/f13dca3bd70b4bb687de462cc3b7356e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:10.118875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13dca3bd70b4bb687de462cc3b7356e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:10.122996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:10.230384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13dca3bd70b4bb687de462cc3b7356e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:10.231282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13dca3bd70b4bb687de462cc3b7356e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:10.233965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13dca3bd70b4bb687de462cc3b7356e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:10.262151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13dca3bd70b4bb687de462cc3b7356e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:10.272996 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:10.280037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6970ead-be72-40c3-baf6-fd18413bac84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13dca3bd70b4bb687de462cc3b7356e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:10.312893 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1750/3512] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:15:09 2022] DELETE /identity/v3/users/f13dca3bd70b4bb687de462cc3b7356e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:11.441421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:11.458591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12317a9a-1af5-42f1-9b2b-2f6ba309bacb service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:11.607942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:11.608606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:11.608930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:11.609229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] PATH_INFO: `/v3/projects/8a0bc6c6c0054379a3342053d77ed9e0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:11.611479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0bc6c6c0054379a3342053d77ed9e0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:11.619141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:11.752004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0bc6c6c0054379a3342053d77ed9e0', 'request_id': 'req-a6bb456b-f711-457c-bd64-213abc0cb387'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:11.754418 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:11.762085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0bc6c6c0054379a3342053d77ed9e0', 'request_id': 'req-a6bb456b-f711-457c-bd64-213abc0cb387'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:11.779238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0bc6c6c0054379a3342053d77ed9e0', 'request_id': 'req-a6bb456b-f711-457c-bd64-213abc0cb387'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:11.800502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] The token cache is being invalidate because project 8a0bc6c6c0054379a3342053d77ed9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:15:11.800796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:11.801964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a6bb456b-f711-457c-bd64-213abc0cb387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:11.808558 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1763/3513] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:15:11 2022] DELETE /identity/v3/projects/8a0bc6c6c0054379a3342053d77ed9e0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:11.809802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119420a-cc4c-472a-a6be-1e268e7a6b48 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:11.810295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119420a-cc4c-472a-a6be-1e268e7a6b48 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:11.810539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119420a-cc4c-472a-a6be-1e268e7a6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:11.849981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8119420a-cc4c-472a-a6be-1e268e7a6b48 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:11.851605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8119420a-cc4c-472a-a6be-1e268e7a6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:12.006810 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1751/3514] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:15:12.008170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4ec89-540a-40f4-98b9-54dfaad6c9da None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.008458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4ec89-540a-40f4-98b9-54dfaad6c9da None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.008879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4ec89-540a-40f4-98b9-54dfaad6c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.078429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-37f4ec89-540a-40f4-98b9-54dfaad6c9da None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:12.080078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-37f4ec89-540a-40f4-98b9-54dfaad6c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:12.099073 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1764/3515] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:15:12.103338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119420a-cc4c-472a-a6be-1e268e7a6b48 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:12.120099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119420a-cc4c-472a-a6be-1e268e7a6b48 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:12.128774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:12.129767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.130288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.130772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.131641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:15:12.132159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:12.134190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:12.168125 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1752/3516] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:15:12.169265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4ec89-540a-40f4-98b9-54dfaad6c9da None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:12.180651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4ec89-540a-40f4-98b9-54dfaad6c9da None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:12.186120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:12.186742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.187407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.187755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.188402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:12.190338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:12.272789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1765/3517] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:15:12 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:15:12.273256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:12.286360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a352b3-be57-4b36-9d6f-1aec33ce1d58 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:12.399704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:12.400756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.401472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.401928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.403626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:12.406446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:12.438598 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1753/3518] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:15:12 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:15:12.442396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:12.455525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d0808-3256-4a55-8276-fec81a38bc2c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:12.461269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:12.462087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.462771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.463321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.464144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:12.469020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:12.491942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:12.498562 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1766/3519] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:15:12.503945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f45a-296c-4f01-8552-fddb36d17b14 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:12.511234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930354a-e4f0-40bd-a61c-703be90419ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:12.511904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930354a-e4f0-40bd-a61c-703be90419ee admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.512301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930354a-e4f0-40bd-a61c-703be90419ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.512631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930354a-e4f0-40bd-a61c-703be90419ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.513618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930354a-e4f0-40bd-a61c-703be90419ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:12.515370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930354a-e4f0-40bd-a61c-703be90419ee admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:12.532852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:12.540157 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1754/3520] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:15:12.544266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e0b4-2751-4302-8468-d88e936b6d33 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:12.549803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:12.550692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.551069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.551343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] PATH_INFO: `/v3/projects/4d6496a2377246d59c133af48d1dfe05/users/07c2ba4d7c9f4e3e9f5125b305130689/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.582825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6496a2377246d59c133af48d1dfe05, user_id=07c2ba4d7c9f4e3e9f5125b305130689, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:12.586710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:12.614282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.614642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.614987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.618431 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1767/3521] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:15:12 2022] PUT /identity/v3/projects/4d6496a2377246d59c133af48d1dfe05/users/07c2ba4d7c9f4e3e9f5125b305130689/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:12.639538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:12.641004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:12.738591 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:12.781551 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1755/3522] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:12.801025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:12.803221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:12.946918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626ac66-dd4b-4250-872b-5224d578fb57 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:12.955047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574206e-3c93-4871-b064-605722ba7e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:12.957595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574206e-3c93-4871-b064-605722ba7e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:12.957886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574206e-3c93-4871-b064-605722ba7e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:12.958164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574206e-3c93-4871-b064-605722ba7e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:12.982964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574206e-3c93-4871-b064-605722ba7e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:12.984958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574206e-3c93-4871-b064-605722ba7e2b service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:13.001765 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1768/3523] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:14.865181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:14.869513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:14.909105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95a198-9d4f-4aa2-b39b-c5673e34c970 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:14.936502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:14.936502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:14.936502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:14.938837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] PATH_INFO: `/v3/users/c8e6339f921449c780521852bba1e34e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:14.942444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e6339f921449c780521852bba1e34e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:14.944405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:15.042974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e6339f921449c780521852bba1e34e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:15.043845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e6339f921449c780521852bba1e34e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:15.044672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e6339f921449c780521852bba1e34e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:15.062613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e6339f921449c780521852bba1e34e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:15.085204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e6339f921449c780521852bba1e34e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:15.100763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1756/3524] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:15:14 2022] DELETE /identity/v3/users/c8e6339f921449c780521852bba1e34e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:15.106283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:15.106801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:15.107214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:15.178844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:15.184137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:15.282489 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1769/3525] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:15.344716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:15.346276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:15.477896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae974a-3693-4a51-939e-37320cb7fbf6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:15.490587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12908013-4695-4a48-a178-583899d89ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:15.490587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12908013-4695-4a48-a178-583899d89ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:15.490587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12908013-4695-4a48-a178-583899d89ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:15.490587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12908013-4695-4a48-a178-583899d89ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:15.519180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12908013-4695-4a48-a178-583899d89ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:15.520729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12908013-4695-4a48-a178-583899d89ccf service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:15.539646 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1757/3526] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:17.572427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:17.578491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:17.602313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a17a4-5d0c-41da-8264-f7e1dc3da922 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:17.623974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:17.625443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:17.625744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:17.626197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] PATH_INFO: `/v3/projects/a52b2bf76c8f4e188878e9058c9f67f1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:17.630062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52b2bf76c8f4e188878e9058c9f67f1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:17.634577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:17.668048 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:17.734555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52b2bf76c8f4e188878e9058c9f67f1', 'request_id': 'req-5a6839d3-405c-41d1-80f2-aaee350284bf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:17.742586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52b2bf76c8f4e188878e9058c9f67f1', 'request_id': 'req-5a6839d3-405c-41d1-80f2-aaee350284bf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:17.755798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52b2bf76c8f4e188878e9058c9f67f1', 'request_id': 'req-5a6839d3-405c-41d1-80f2-aaee350284bf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:17.770734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] The token cache is being invalidate because project a52b2bf76c8f4e188878e9058c9f67f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:15:17.771079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:17.771743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a6839d3-405c-41d1-80f2-aaee350284bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:17.778526 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1770/3527] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:15:17 2022] DELETE /identity/v3/projects/a52b2bf76c8f4e188878e9058c9f67f1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:17.779475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239232c8-81ba-4155-b694-5d7d0dbbcbba None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:17.779955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239232c8-81ba-4155-b694-5d7d0dbbcbba None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:17.780328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239232c8-81ba-4155-b694-5d7d0dbbcbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:17.812385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-239232c8-81ba-4155-b694-5d7d0dbbcbba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:17.814082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-239232c8-81ba-4155-b694-5d7d0dbbcbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:17.965321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10f01-7702-48b2-a39b-9eb321fe5614 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:17.965643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10f01-7702-48b2-a39b-9eb321fe5614 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:17.965907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10f01-7702-48b2-a39b-9eb321fe5614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:17.974190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1758/3528] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:18.028176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6bd10f01-7702-48b2-a39b-9eb321fe5614 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:18.032507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6bd10f01-7702-48b2-a39b-9eb321fe5614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:18.059004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1771/3529] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:18.064714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239232c8-81ba-4155-b694-5d7d0dbbcbba None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:18.079975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239232c8-81ba-4155-b694-5d7d0dbbcbba None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:18.086907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:18.088149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:18.088602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:18.089318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:18.090140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:15:18.090599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:18.098085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:18.102106 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:18.135079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1759/3530] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:15:18.139787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10f01-7702-48b2-a39b-9eb321fe5614 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:18.174641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10f01-7702-48b2-a39b-9eb321fe5614 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:18.181587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:18.182559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:18.182909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:18.183784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:18.184554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:18.186563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:18.301951 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1772/3531] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:15:18 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:15:18.306532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:18.359554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54382084-5b4a-4359-ba28-b913496069e1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:18.550826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:18.551674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:18.552206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:18.552638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:18.553964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:18.556328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:18.621677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:18.629556 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1760/3532] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:15:18 2022] POST /identity/v3/users => generated 296 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:15:18.639005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00677d2f-75ad-4543-8782-61d257fc365e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:18.650809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:18.652109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:18.652869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:18.653383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:18.654294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:18.657160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:18.682984 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1773/3533] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:15:18.687397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:18.704203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41f8b-0a62-4560-985f-3396e3bee19d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:18.720936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82788a-319b-443d-8c08-9dac2e3a5c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:18.721594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82788a-319b-443d-8c08-9dac2e3a5c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:18.721871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82788a-319b-443d-8c08-9dac2e3a5c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:18.722144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82788a-319b-443d-8c08-9dac2e3a5c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:18.722791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82788a-319b-443d-8c08-9dac2e3a5c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:18.724404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82788a-319b-443d-8c08-9dac2e3a5c28 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:18.750230 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1761/3534] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:15:18.753917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:18.768897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2acdc1-3e4a-4a05-bf55-f8dc4c04a2e7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:18.782216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:18.782902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:18.783704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:18.784000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] PATH_INFO: `/v3/projects/a73245714752452fbdb380c34457ea5a/users/e93a9ec05da3403a97c06a156c3c39d9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:18.819543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73245714752452fbdb380c34457ea5a, user_id=e93a9ec05da3403a97c06a156c3c39d9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:18.822398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:18.856214 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1774/3535] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:15:18 2022] PUT /identity/v3/projects/a73245714752452fbdb380c34457ea5a/users/e93a9ec05da3403a97c06a156c3c39d9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:18.861647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635766-807a-4722-8021-db81aafcb3a4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:18.862177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635766-807a-4722-8021-db81aafcb3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:18.864307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635766-807a-4722-8021-db81aafcb3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:18.947912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1b635766-807a-4722-8021-db81aafcb3a4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:18.952970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b635766-807a-4722-8021-db81aafcb3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:19.113952 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1762/3536] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:19.127939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:19.131422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:19.295335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437339-e89d-4a0d-bbb8-16c988ba49a1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:19.302725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75b469-fdaa-4f16-8c8e-0a03b313a584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:19.303466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b469-fdaa-4f16-8c8e-0a03b313a584 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:19.303778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b469-fdaa-4f16-8c8e-0a03b313a584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:19.304057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75b469-fdaa-4f16-8c8e-0a03b313a584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:19.347739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75b469-fdaa-4f16-8c8e-0a03b313a584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:19.349228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75b469-fdaa-4f16-8c8e-0a03b313a584 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:19.375630 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1775/3537] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:20.086780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:20.087199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:20.087372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:20.116884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] MFA Rules not processed for user `0133996879444b61a285203e928bc031`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:20.118367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:20.211274 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1763/3538] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:27.526887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c086a4-bac0-4e33-91f8-135f26382da1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:27.528160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c086a4-bac0-4e33-91f8-135f26382da1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:27.528606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c086a4-bac0-4e33-91f8-135f26382da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:27.623684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f5c086a4-bac0-4e33-91f8-135f26382da1 None None] MFA Rules not processed for user `07c2ba4d7c9f4e3e9f5125b305130689`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:27.634656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f5c086a4-bac0-4e33-91f8-135f26382da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:27.712989 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:27.801996 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1776/3539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:27.811140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:27.814621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:27.888287 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:28.095491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa16b5-4cfd-494c-a881-dbeb96956e2b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:28.118555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0c9c-82f9-4aa4-be3d-a1b8d7489332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:28.119189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0c9c-82f9-4aa4-be3d-a1b8d7489332 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:28.119647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0c9c-82f9-4aa4-be3d-a1b8d7489332 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:28.120070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0c9c-82f9-4aa4-be3d-a1b8d7489332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:28.141187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0c9c-82f9-4aa4-be3d-a1b8d7489332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:28.145116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0c9c-82f9-4aa4-be3d-a1b8d7489332 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:28.171725 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1764/3540] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:33.118731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c8f2-8ee2-4257-b3ff-59f6c7d3ea2d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:33.119807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c8f2-8ee2-4257-b3ff-59f6c7d3ea2d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:33.120445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c8f2-8ee2-4257-b3ff-59f6c7d3ea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:33.163134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2131c8f2-8ee2-4257-b3ff-59f6c7d3ea2d None None] MFA Rules not processed for user `3d568ef3a7304df4b44b9e09173779c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:33.166459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2131c8f2-8ee2-4257-b3ff-59f6c7d3ea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:33.303928 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1777/3541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:34.636617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:34.637116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:34.637213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:34.713034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] MFA Rules not processed for user `e93a9ec05da3403a97c06a156c3c39d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:34.714577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:34.855460 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1765/3542] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:34.866145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:34.866679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:34.866679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:34.905562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] MFA Rules not processed for user `e93a9ec05da3403a97c06a156c3c39d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:34.906823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:34.923865 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1778/3543] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:34.986956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:34.989601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:35.041109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ffb0-90fa-45be-90e8-214fb1a27745 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:35.060478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:35.061552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:35.062255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:35.062743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:35.079508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:35.083851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:35.109744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1766/3544] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:36.906550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:36.908876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:36.933361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2048fa0-e752-4909-bb33-a09c5d0c30c0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:36.942100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:36.942900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:36.943296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:36.943681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] PATH_INFO: `/v3/users/07c2ba4d7c9f4e3e9f5125b305130689` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:36.945328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c2ba4d7c9f4e3e9f5125b305130689)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:36.950517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:37.054683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c2ba4d7c9f4e3e9f5125b305130689'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.055491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c2ba4d7c9f4e3e9f5125b305130689'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.056110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c2ba4d7c9f4e3e9f5125b305130689'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.083761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c2ba4d7c9f4e3e9f5125b305130689'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.106166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-649069be-47b1-45ae-85f8-e76addb181e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c2ba4d7c9f4e3e9f5125b305130689'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.136111 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1779/3545] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:15:36 2022] DELETE /identity/v3/users/07c2ba4d7c9f4e3e9f5125b305130689 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:37.424262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:37.442658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1ac30-b308-487d-beb4-1c82154f7a8c service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:37.608312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:37.609493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:37.609929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:37.610350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] PATH_INFO: `/v3/projects/4d6496a2377246d59c133af48d1dfe05` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:37.613233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6496a2377246d59c133af48d1dfe05)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:37.615353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:37.682184 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:37.733706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6496a2377246d59c133af48d1dfe05', 'request_id': 'req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.757318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6496a2377246d59c133af48d1dfe05', 'request_id': 'req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.771108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6496a2377246d59c133af48d1dfe05', 'request_id': 'req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.804541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] The token cache is being invalidate because project 4d6496a2377246d59c133af48d1dfe05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:15:37.805022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.806401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e199be3-a4fe-4b78-9b10-b24cc59ba17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:15:37.812879 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1767/3546] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:15:37 2022] DELETE /identity/v3/projects/4d6496a2377246d59c133af48d1dfe05 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:37.814670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85b06f-9575-43bc-a407-4568dc091d76 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:37.815062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85b06f-9575-43bc-a407-4568dc091d76 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:37.815403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85b06f-9575-43bc-a407-4568dc091d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:37.839427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ed85b06f-9575-43bc-a407-4568dc091d76 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:37.840911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ed85b06f-9575-43bc-a407-4568dc091d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:37.911319 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:37.954071 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1780/3547] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:37.963245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ead2-7385-4b5c-9eb8-bcc8026ef965 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:37.964026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ead2-7385-4b5c-9eb8-bcc8026ef965 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:37.964655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ead2-7385-4b5c-9eb8-bcc8026ef965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.055081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c553ead2-7385-4b5c-9eb8-bcc8026ef965 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:38.058855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c553ead2-7385-4b5c-9eb8-bcc8026ef965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:38.088435 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1768/3548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:38.094771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85b06f-9575-43bc-a407-4568dc091d76 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:38.109734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85b06f-9575-43bc-a407-4568dc091d76 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:38.118232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:38.120060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.120505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:38.120925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.121973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:15:38.123082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:38.127263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:38.158416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1781/3549] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:15:38.162872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ead2-7385-4b5c-9eb8-bcc8026ef965 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:38.183523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ead2-7385-4b5c-9eb8-bcc8026ef965 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:38.212900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:38.213622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.214137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:38.214577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.215428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:38.218063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:38.315476 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1769/3550] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:15:38 2022] POST /identity/v3/projects => generated 395 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:15:38.319216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:38.345435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309c07-41b8-4a90-8775-caf391702222 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:38.477481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:38.478133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.478414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:38.478683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.479324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:38.481408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:38.518736 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1782/3551] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:15:38 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:15:38.522649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:38.545178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1ca3-2ede-410f-9a88-6d151e719de3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:38.553755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:38.554718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.555457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:38.556092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.557195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:38.559053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:38.585575 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1770/3552] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:15:38.586547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:38.617159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6fa0a-78e2-4c0b-98e0-f775c2ef1cfb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:38.624827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146390f-4313-4583-bb5e-127d5ace6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:38.625328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146390f-4313-4583-bb5e-127d5ace6fec admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.625624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146390f-4313-4583-bb5e-127d5ace6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:38.625969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146390f-4313-4583-bb5e-127d5ace6fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.626735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146390f-4313-4583-bb5e-127d5ace6fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:38.628489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146390f-4313-4583-bb5e-127d5ace6fec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:38.644313 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1783/3553] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:15:38.648207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:38.660480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253544-7bf1-4ade-b9ed-51c2ff635b82 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:38.670306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:38.671997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.672534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:38.673104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] PATH_INFO: `/v3/projects/7b32c7059c7948109cce493a274e0670/users/dc161986c260466786692614d1cac9ba/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.692941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b32c7059c7948109cce493a274e0670, user_id=dc161986c260466786692614d1cac9ba, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:38.695686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:38.714118 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1771/3554] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:15:38 2022] PUT /identity/v3/projects/7b32c7059c7948109cce493a274e0670/users/dc161986c260466786692614d1cac9ba/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:15:38.720193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d48bd-8b24-45e0-96b9-c2052189803a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.720481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d48bd-8b24-45e0-96b9-c2052189803a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:38.720760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d48bd-8b24-45e0-96b9-c2052189803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:38.773922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8b4d48bd-8b24-45e0-96b9-c2052189803a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:38.775826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b4d48bd-8b24-45e0-96b9-c2052189803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:38.875732 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1784/3555] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:15:38.887494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:38.891891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:38.992050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cb1ad-ea20-4aea-83ee-1992af634ce0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:38.997965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20c936-55ef-4645-afb0-a480354fb83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:38.999213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c936-55ef-4645-afb0-a480354fb83f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:38.999713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c936-55ef-4645-afb0-a480354fb83f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:39.000133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20c936-55ef-4645-afb0-a480354fb83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:39.020356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c936-55ef-4645-afb0-a480354fb83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:39.022023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20c936-55ef-4645-afb0-a480354fb83f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:39.036498 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1772/3556] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:15:43.331946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:43.332803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:43.333436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:43.363539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] MFA Rules not processed for user `0133996879444b61a285203e928bc031`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:43.365714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:43.432062 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:43.457780 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1785/3557] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:43.757288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:43.757868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:43.758011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:43.786941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:43.788436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:43.893228 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:43.922082 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1773/3558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:49.801294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:49.802739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:50.017850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8dd0e-4195-4bf5-8f20-aea454cb7d17 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:50.030720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696615b3-ef57-4938-8532-f260fdb9063d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:50.032889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696615b3-ef57-4938-8532-f260fdb9063d service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:50.033250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696615b3-ef57-4938-8532-f260fdb9063d service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:50.033536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696615b3-ef57-4938-8532-f260fdb9063d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:50.036225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-696615b3-ef57-4938-8532-f260fdb9063d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:50.039349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:50.043227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:50.089623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6aba43-fdca-4b5b-8e93-52556282904f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:50.096335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696615b3-ef57-4938-8532-f260fdb9063d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:50.099272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696615b3-ef57-4938-8532-f260fdb9063d service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:50.106507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0be586-6840-4143-85b1-f02a6b847a9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:50.108253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be586-6840-4143-85b1-f02a6b847a9a service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:50.111179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be586-6840-4143-85b1-f02a6b847a9a service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:50.111634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0be586-6840-4143-85b1-f02a6b847a9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:50.116203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb0be586-6840-4143-85b1-f02a6b847a9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:50.128512 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1786/3559] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:50.137667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0be586-6840-4143-85b1-f02a6b847a9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:50.140837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0be586-6840-4143-85b1-f02a6b847a9a service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:50.179641 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1774/3560] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:15:51.357237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:51.358402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:51.358402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:51.398525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] MFA Rules not processed for user `dc161986c260466786692614d1cac9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:51.401196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:51.560813 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1787/3561] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:51.575312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bea91-bd46-4aa0-8480-cec5e5be91f6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:51.576483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bea91-bd46-4aa0-8480-cec5e5be91f6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:51.577012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bea91-bd46-4aa0-8480-cec5e5be91f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:51.601592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff4bea91-bd46-4aa0-8480-cec5e5be91f6 None None] MFA Rules not processed for user `dc161986c260466786692614d1cac9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:51.603091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff4bea91-bd46-4aa0-8480-cec5e5be91f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:51.617820 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1775/3562] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:15:51.630527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:15:51.632249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:51.757647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac93d5-982e-47c3-b237-739ecea06444 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:15:51.765791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:15:51.766553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:51.767549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:51.767549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:51.792631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:15:51.795787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:15:51.802359 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:15:51.813079 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1788/3563] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:15:52.269773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:15:52.270162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:15:52.270572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:15:52.300596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:15:52.302843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:15:52.315287 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1776/3564] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:01.815245 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:02.293463 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=14 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:08.304049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:08.324124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6b2b-20a1-4380-8e22-628132e7393f service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:08.332876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:08.334292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:08.350499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:08.351708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:08.351985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:08.352253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:08.362679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:08.368884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ed539-bd7d-4767-b145-e2e7572eb21e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:08.398393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:08.399044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:08.400055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:08.400332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] PATH_INFO: `/v3/users/e93a9ec05da3403a97c06a156c3c39d9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:08.403792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93a9ec05da3403a97c06a156c3c39d9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:08.406365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:08.425197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:08.426802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:08.489092 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1789/3565] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:08.569644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93a9ec05da3403a97c06a156c3c39d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:08.570470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93a9ec05da3403a97c06a156c3c39d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:08.575701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93a9ec05da3403a97c06a156c3c39d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:08.622750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93a9ec05da3403a97c06a156c3c39d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:08.637941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afcc6e2e-9823-4586-ac4d-e7c5704fc485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93a9ec05da3403a97c06a156c3c39d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:08.680530 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1777/3566] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:08 2022] DELETE /identity/v3/users/e93a9ec05da3403a97c06a156c3c39d9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:08.992797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.015671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ac53-c33d-4b34-9077-a1e516571f96 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.104968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.105723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.106095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.106647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] PATH_INFO: `/v3/projects/a73245714752452fbdb380c34457ea5a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.109513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73245714752452fbdb380c34457ea5a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:09.111672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:09.195595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73245714752452fbdb380c34457ea5a', 'request_id': 'req-616b3418-b622-42e0-bd2b-019f4e47be40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:09.203485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73245714752452fbdb380c34457ea5a', 'request_id': 'req-616b3418-b622-42e0-bd2b-019f4e47be40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:09.219135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73245714752452fbdb380c34457ea5a', 'request_id': 'req-616b3418-b622-42e0-bd2b-019f4e47be40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:09.231438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] The token cache is being invalidate because project a73245714752452fbdb380c34457ea5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:09.231727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:09.232551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-616b3418-b622-42e0-bd2b-019f4e47be40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:09.241096 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1790/3567] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:08 2022] DELETE /identity/v3/projects/a73245714752452fbdb380c34457ea5a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:09.241292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac5406-2251-4ffe-b41c-832560ecf2df None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.241292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac5406-2251-4ffe-b41c-832560ecf2df None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.241292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac5406-2251-4ffe-b41c-832560ecf2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.264010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e3ac5406-2251-4ffe-b41c-832560ecf2df None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:09.265679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e3ac5406-2251-4ffe-b41c-832560ecf2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:09.331130 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1778/3568] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:09.339009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9adb6-c30e-4817-9a16-51e361697ef5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.339854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9adb6-c30e-4817-9a16-51e361697ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.340129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9adb6-c30e-4817-9a16-51e361697ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.361389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0db9adb6-c30e-4817-9a16-51e361697ef5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:09.362608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0db9adb6-c30e-4817-9a16-51e361697ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:09.371271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1791/3569] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:09.375851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac5406-2251-4ffe-b41c-832560ecf2df None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.386163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac5406-2251-4ffe-b41c-832560ecf2df None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.391110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.391711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.391990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.392262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.392904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:16:09.393247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:09.394933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:09.408543 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1779/3570] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:16:09.412864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9adb6-c30e-4817-9a16-51e361697ef5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.423382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9adb6-c30e-4817-9a16-51e361697ef5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.429389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.429389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.429389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.429772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.430275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:09.432203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:09.465803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1792/3571] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:16:09 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:09.468389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.478592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92324ff-4fd8-4224-87e2-eef0cb5d3646 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.566395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.567430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.567910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.568489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.569516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:09.571476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:09.581900 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:09.602639 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1780/3572] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:16:09 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:09.607086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.618841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8787cd7-922d-4c4d-ba6d-48f7a7a31906 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.625473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.625726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.626009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.626283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.633431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:09.634990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:09.653015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1793/3573] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:09.657966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.671582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a96bd5-b2d2-4ba2-a599-361eb4bb5bc6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.679933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ea6d0-f91e-40fd-99bb-a301416d1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.680851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ea6d0-f91e-40fd-99bb-a301416d1c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.681481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ea6d0-f91e-40fd-99bb-a301416d1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.681923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ea6d0-f91e-40fd-99bb-a301416d1c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.682936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ea6d0-f91e-40fd-99bb-a301416d1c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:09.685916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ea6d0-f91e-40fd-99bb-a301416d1c18 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:09.707464 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1781/3574] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:09.708317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.719386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb26ff-cfb3-4db1-ab95-22cf934cdf1e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.724615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.725338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.725621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.725899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] PATH_INFO: `/v3/projects/0d16a0642e894a649982fa2eb4de6ada/users/11ed1b2234c74d959fade2577a34a8a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.743429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d16a0642e894a649982fa2eb4de6ada, user_id=11ed1b2234c74d959fade2577a34a8a8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:09.746641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:09.772760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1794/3575] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:16:09 2022] PUT /identity/v3/projects/0d16a0642e894a649982fa2eb4de6ada/users/11ed1b2234c74d959fade2577a34a8a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:09.778236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.779007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.779576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:09.805539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:09.806826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:09.889207 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1782/3576] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:16:09.900508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:09.902704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:09.918450 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:09.987073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f782f-c856-415a-bf3e-4778fdd27629 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:09.991598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a720f5-759d-4ea5-ae9b-fe9bf8116276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:09.992214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a720f5-759d-4ea5-ae9b-fe9bf8116276 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:09.992488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a720f5-759d-4ea5-ae9b-fe9bf8116276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:09.992952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a720f5-759d-4ea5-ae9b-fe9bf8116276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:10.005390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a720f5-759d-4ea5-ae9b-fe9bf8116276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:10.007105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a720f5-759d-4ea5-ae9b-fe9bf8116276 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:10.030972 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1795/3577] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:16:11.725342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:11.727918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:11.744002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b56ab2-0acb-42a0-9baa-d1862a287ca0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:11.749530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d0d0f-7d14-4a45-ae04-98b0e13b2295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:11.750995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d0d0f-7d14-4a45-ae04-98b0e13b2295 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:11.751588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d0d0f-7d14-4a45-ae04-98b0e13b2295 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:11.752022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d0d0f-7d14-4a45-ae04-98b0e13b2295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:11.754187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d30d0d0f-7d14-4a45-ae04-98b0e13b2295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:11.770496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d0d0f-7d14-4a45-ae04-98b0e13b2295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:11.773676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d0d0f-7d14-4a45-ae04-98b0e13b2295 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:11.789463 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1783/3578] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:14.068340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc01703-754d-4123-ba6a-355f98449210 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:14.068799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc01703-754d-4123-ba6a-355f98449210 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:14.068898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc01703-754d-4123-ba6a-355f98449210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:14.114040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7cc01703-754d-4123-ba6a-355f98449210 None None] MFA Rules not processed for user `dc161986c260466786692614d1cac9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:14.115343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7cc01703-754d-4123-ba6a-355f98449210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:14.155677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf83a3-0836-47c3-817f-a844ecc80b60 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:14.156195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf83a3-0836-47c3-817f-a844ecc80b60 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:14.156195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf83a3-0836-47c3-817f-a844ecc80b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:14.193331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-99bf83a3-0836-47c3-817f-a844ecc80b60 None None] MFA Rules not processed for user `3d568ef3a7304df4b44b9e09173779c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:14.194803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-99bf83a3-0836-47c3-817f-a844ecc80b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:14.271300 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1784/3579] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:16:14.287785 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1796/3580] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:14.776076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7290f-4a96-46f8-afe3-727db7b27c85 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:14.776456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7290f-4a96-46f8-afe3-727db7b27c85 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:14.776829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7290f-4a96-46f8-afe3-727db7b27c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:14.813475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bdc7290f-4a96-46f8-afe3-727db7b27c85 None None] MFA Rules not processed for user `dc161986c260466786692614d1cac9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:14.818585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bdc7290f-4a96-46f8-afe3-727db7b27c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:14.837511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1785/3581] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:14.893184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490f16-4e7e-4c83-9ed6-55fda35119ba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:14.893773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490f16-4e7e-4c83-9ed6-55fda35119ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:14.894319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc490f16-4e7e-4c83-9ed6-55fda35119ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:14.936417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cc490f16-4e7e-4c83-9ed6-55fda35119ba None None] MFA Rules not processed for user `dc161986c260466786692614d1cac9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:14.939559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cc490f16-4e7e-4c83-9ed6-55fda35119ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:14.986715 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1797/3582] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:15.014378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b963-ec96-44c8-bbd5-beca8c5c6c95 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:15.014901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b963-ec96-44c8-bbd5-beca8c5c6c95 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:15.015239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b963-ec96-44c8-bbd5-beca8c5c6c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:15.051941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a557b963-ec96-44c8-bbd5-beca8c5c6c95 None None] MFA Rules not processed for user `dc161986c260466786692614d1cac9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:15.053626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a557b963-ec96-44c8-bbd5-beca8c5c6c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:15.065614 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1786/3583] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:15.233265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735c21-16b8-4568-8d76-6f9440fdc5a5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:15.234374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735c21-16b8-4568-8d76-6f9440fdc5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:15.234888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735c21-16b8-4568-8d76-6f9440fdc5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:15.276829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-13735c21-16b8-4568-8d76-6f9440fdc5a5 None None] MFA Rules not processed for user `dc161986c260466786692614d1cac9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:15.281827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-13735c21-16b8-4568-8d76-6f9440fdc5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:15.293380 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1798/3584] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:22.742345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:22.743275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:22.743790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:22.779384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] MFA Rules not processed for user `11ed1b2234c74d959fade2577a34a8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:22.781313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:22.837743 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:22.882427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65d3c-2b5b-456f-aacf-d2a9a180d2ac None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:22.882930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65d3c-2b5b-456f-aacf-d2a9a180d2ac None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:22.883122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac65d3c-2b5b-456f-aacf-d2a9a180d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:22.893161 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1787/3585] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:22.907910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eac65d3c-2b5b-456f-aacf-d2a9a180d2ac None None] MFA Rules not processed for user `11ed1b2234c74d959fade2577a34a8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:22.909191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eac65d3c-2b5b-456f-aacf-d2a9a180d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:22.922488 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1799/3586] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:23.021289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:23.022678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:23.188192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2533f5-bf55-4f29-998a-d7cef0aafedd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:23.203267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:23.205605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:23.205903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:23.207503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:23.232591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:23.237935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:23.273924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1788/3587] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:30.114876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adad11e-9110-4dad-8c0c-8573df8f625f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:30.115369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adad11e-9110-4dad-8c0c-8573df8f625f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:30.115875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adad11e-9110-4dad-8c0c-8573df8f625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:30.150409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6adad11e-9110-4dad-8c0c-8573df8f625f None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:30.151888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6adad11e-9110-4dad-8c0c-8573df8f625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:30.241676 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1800/3588] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:33.252888 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=40 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:35.763813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:35.766036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:35.792004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13795dd-d78e-4695-a8f1-3e6f8331156b service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:35.805672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:35.806352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:35.806654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:35.806992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] PATH_INFO: `/v3/users/559b3d4a02af42bd98dacd08b9e45a4c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:35.820944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559b3d4a02af42bd98dacd08b9e45a4c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:35.831425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:35.980215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559b3d4a02af42bd98dacd08b9e45a4c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:35.981617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559b3d4a02af42bd98dacd08b9e45a4c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:35.982661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559b3d4a02af42bd98dacd08b9e45a4c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:36.045920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559b3d4a02af42bd98dacd08b9e45a4c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:36.061322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559b3d4a02af42bd98dacd08b9e45a4c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:36.112262 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1789/3589] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:35 2022] DELETE /identity/v3/users/559b3d4a02af42bd98dacd08b9e45a4c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:37.472115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adad11e-9110-4dad-8c0c-8573df8f625f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:37.485759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adad11e-9110-4dad-8c0c-8573df8f625f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:37.588440 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:37.627011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:37.628369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:37.628951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:37.629497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] PATH_INFO: `/v3/projects/353ea3efb7ad4cf1a92b0b434b662d52` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:37.630986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353ea3efb7ad4cf1a92b0b434b662d52)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:37.633459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:37.738521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353ea3efb7ad4cf1a92b0b434b662d52', 'request_id': 'req-c706a11e-a083-4817-af14-249d5791c478'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:37.749416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353ea3efb7ad4cf1a92b0b434b662d52', 'request_id': 'req-c706a11e-a083-4817-af14-249d5791c478'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:37.765529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353ea3efb7ad4cf1a92b0b434b662d52', 'request_id': 'req-c706a11e-a083-4817-af14-249d5791c478'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:37.788753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] The token cache is being invalidate because project 353ea3efb7ad4cf1a92b0b434b662d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:37.789539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:37.790776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:37.792864 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1801/3590] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:37 2022] DELETE /identity/v3/projects/353ea3efb7ad4cf1a92b0b434b662d52 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:37.797512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:37.798970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:37.830107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71534c-8614-478c-a619-9dc9f58e9476 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:37.967478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:37.968544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:37.969191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:37.969679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] PATH_INFO: `/v3/users/1063c72a527541fe8d43af7b3f283ee8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:37.971392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1063c72a527541fe8d43af7b3f283ee8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:37.973725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:38.065927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1063c72a527541fe8d43af7b3f283ee8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:38.067863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1063c72a527541fe8d43af7b3f283ee8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:38.068910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1063c72a527541fe8d43af7b3f283ee8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:38.087624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1063c72a527541fe8d43af7b3f283ee8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:38.100744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ea084403-e022-44bf-a24b-baaaa2668160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1063c72a527541fe8d43af7b3f283ee8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:38.104733 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:38.144447 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1790/3591] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:37 2022] DELETE /identity/v3/users/1063c72a527541fe8d43af7b3f283ee8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:39.757936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:39.759426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:39.805812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706a11e-a083-4817-af14-249d5791c478 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:39.958791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:39.959753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:39.963455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:39.964771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] PATH_INFO: `/v3/projects/930ce6a4c444491381df5e31a737cf64` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:39.966558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930ce6a4c444491381df5e31a737cf64)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:39.971851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.089002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930ce6a4c444491381df5e31a737cf64', 'request_id': 'req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:40.102209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930ce6a4c444491381df5e31a737cf64', 'request_id': 'req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:40.127773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930ce6a4c444491381df5e31a737cf64', 'request_id': 'req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:40.145735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] The token cache is being invalidate because project 930ce6a4c444491381df5e31a737cf64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:40.146033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:40.146734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42346e6e-18ad-48f9-8d35-f3b8aee0d9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:40.151000 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1802/3592] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:39 2022] DELETE /identity/v3/projects/930ce6a4c444491381df5e31a737cf64 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:40.156590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721c87-cf03-4a80-9b2e-afdb752d80e0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.157225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721c87-cf03-4a80-9b2e-afdb752d80e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.157468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721c87-cf03-4a80-9b2e-afdb752d80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.184124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-80721c87-cf03-4a80-9b2e-afdb752d80e0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:40.186956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80721c87-cf03-4a80-9b2e-afdb752d80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:40.371242 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1791/3593] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:40.379628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec303-19c0-40ee-a1d1-4af7dc553680 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.380124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec303-19c0-40ee-a1d1-4af7dc553680 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.380600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec303-19c0-40ee-a1d1-4af7dc553680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.422930 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:40.432795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c89ec303-19c0-40ee-a1d1-4af7dc553680 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:40.435185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c89ec303-19c0-40ee-a1d1-4af7dc553680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:40.447959 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1803/3594] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:40.454452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80721c87-cf03-4a80-9b2e-afdb752d80e0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:40.483598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80721c87-cf03-4a80-9b2e-afdb752d80e0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:40.488952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:40.489641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.489921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.490269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.490936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:16:40.491236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:40.493043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.530796 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1792/3595] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:16:40.535571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec303-19c0-40ee-a1d1-4af7dc553680 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:40.551612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec303-19c0-40ee-a1d1-4af7dc553680 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:40.558461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:40.561462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.561462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.561665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.562323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:40.564320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.607668 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1804/3596] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:16:40 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:16:40.618673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:40.630762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2be1-8705-4f77-88f4-f7002dec968e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:40.726118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:40.726687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.726963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.727233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.727858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:40.729920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.757234 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1793/3597] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:16:40 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:40.761423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:40.779806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7386c-b6a2-44b7-910a-c33e8dfbb6e0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:40.784905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:40.785811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.786238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.786666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.788062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:40.790350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.812972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:40.818617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1805/3598] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:16:40.829925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5fa64-811f-41f0-83c1-2dc9bfbe6438 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:40.836375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:40.837616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.838244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.838717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.840123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:40.842074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.860725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:40.862731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:40.862888 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1794/3599] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:40.863875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:40.884297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289f167-87e4-4327-903d-634be6c43f1f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:40.888460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad69fdc-5b86-4947-91a6-5e08c7256e2e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:40.890665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:40.891296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.891566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.892054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] PATH_INFO: `/v3/users/e8f23ce10c904dcebac4da773d531dfb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.893446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f23ce10c904dcebac4da773d531dfb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:40.895536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.899989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d71757-9d0e-4943-9e88-b4a5911818d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:40.900665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d71757-9d0e-4943-9e88-b4a5911818d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.900939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d71757-9d0e-4943-9e88-b4a5911818d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.901236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d71757-9d0e-4943-9e88-b4a5911818d0 admin admin] PATH_INFO: `/v3/projects/12b47ef0ebd54d5689a0e1aba68c1977/users/5bc0dbec293b45f9a97c56a8f3a1798c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.941859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d71757-9d0e-4943-9e88-b4a5911818d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b47ef0ebd54d5689a0e1aba68c1977, user_id=5bc0dbec293b45f9a97c56a8f3a1798c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:40.944713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d71757-9d0e-4943-9e88-b4a5911818d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:40.969824 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1795/3600] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:16:40 2022] PUT /identity/v3/projects/12b47ef0ebd54d5689a0e1aba68c1977/users/5bc0dbec293b45f9a97c56a8f3a1798c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:40.972455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:40.973255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:40.973867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:40.987257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f23ce10c904dcebac4da773d531dfb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:40.988167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f23ce10c904dcebac4da773d531dfb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:40.989051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f23ce10c904dcebac4da773d531dfb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.000318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f23ce10c904dcebac4da773d531dfb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.003053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:41.006268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:41.027623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f23ce10c904dcebac4da773d531dfb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.051622 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1806/3601] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:40 2022] DELETE /identity/v3/users/e8f23ce10c904dcebac4da773d531dfb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:41.062068 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:41.111207 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1796/3602] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:41.139332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:41.141378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:41.205640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad998c-9ddd-4abe-b877-67c823a8969f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:41.209733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:41.210417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:41.210765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:41.211102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:41.275958 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:41.285121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:41.287175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:41.302566 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1807/3603] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:41.668038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:41.670247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:41.705351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef0ea-12d3-4b4c-867d-1c0dc5c4a9de None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:41.712703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:41.713514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:41.713806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:41.714254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] PATH_INFO: `/v3/users/dc161986c260466786692614d1cac9ba` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:41.715933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc161986c260466786692614d1cac9ba)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:41.718583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:41.804258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc161986c260466786692614d1cac9ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.805267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc161986c260466786692614d1cac9ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.805922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc161986c260466786692614d1cac9ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.822265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc161986c260466786692614d1cac9ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.830004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2894c03d-6336-4a25-9392-25e3b5f5b8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc161986c260466786692614d1cac9ba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:41.853845 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1797/3604] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:41 2022] DELETE /identity/v3/users/dc161986c260466786692614d1cac9ba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:42.368721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:42.370628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:42.408545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b1d9e-2b53-419f-86cb-bf0e05bdfad2 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:42.552729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:42.567772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:42.568154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:42.568930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] PATH_INFO: `/v3/projects/df9db260e6a74bedb2a222c5c6366615` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:42.573054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9db260e6a74bedb2a222c5c6366615)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:42.577776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:42.750963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9db260e6a74bedb2a222c5c6366615', 'request_id': 'req-a9c43093-caf8-4740-8d72-ae171db75537'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:42.783780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9db260e6a74bedb2a222c5c6366615', 'request_id': 'req-a9c43093-caf8-4740-8d72-ae171db75537'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:42.810977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9db260e6a74bedb2a222c5c6366615', 'request_id': 'req-a9c43093-caf8-4740-8d72-ae171db75537'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:42.845599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] The token cache is being invalidate because project df9db260e6a74bedb2a222c5c6366615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:42.845848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:42.849138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c43093-caf8-4740-8d72-ae171db75537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:42.852549 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1808/3605] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:42 2022] DELETE /identity/v3/projects/df9db260e6a74bedb2a222c5c6366615 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:42.858596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084641cb-0773-4a97-ab66-f196e5e0e286 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:42.859134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084641cb-0773-4a97-ab66-f196e5e0e286 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:42.859134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084641cb-0773-4a97-ab66-f196e5e0e286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:42.901772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-084641cb-0773-4a97-ab66-f196e5e0e286 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:42.904209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-084641cb-0773-4a97-ab66-f196e5e0e286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:43.014452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4ea9-8ac6-402b-a7a2-22bd00924ca8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.014914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4ea9-8ac6-402b-a7a2-22bd00924ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.015990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4ea9-8ac6-402b-a7a2-22bd00924ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.024770 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1798/3606] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:43.088850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bb1d4ea9-8ac6-402b-a7a2-22bd00924ca8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:43.092971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bb1d4ea9-8ac6-402b-a7a2-22bd00924ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:43.120290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084641cb-0773-4a97-ab66-f196e5e0e286 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.127731 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1809/3607] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:16:43.165159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084641cb-0773-4a97-ab66-f196e5e0e286 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.201760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.206596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.207252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.207743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.209527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:16:43.210330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.218241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.237921 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1799/3608] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:16:43.239091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4ea9-8ac6-402b-a7a2-22bd00924ca8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.256969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4ea9-8ac6-402b-a7a2-22bd00924ca8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.274906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.276081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.276592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.277146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.278455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.281858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.340667 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1810/3609] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:16:43 2022] POST /identity/v3/projects => generated 395 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:43.345013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.357645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1fc4a-d2ee-49d6-9759-6852d1a22edf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.363657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.365947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:43.465893 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:43.478787 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:43.501463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431564f-e146-42f7-96da-1755f7652763 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.517096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.518426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.518735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.519058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] PATH_INFO: `/v3/projects/7b32c7059c7948109cce493a274e0670` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.522901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b32c7059c7948109cce493a274e0670)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.523416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.524552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.524834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.525264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.525898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.528341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.531860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.560802 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1800/3610] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:16:43 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:43.562633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.577674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2342a-8961-4d57-90b3-6b69cf7f40ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.591853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.592701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.593361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.593946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.594748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.596884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.617459 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1801/3611] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:43.618818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.634484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8199a-f971-49ab-a241-8df940a6256a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.635263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b32c7059c7948109cce493a274e0670', 'request_id': 'req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:43.644955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b32c7059c7948109cce493a274e0670', 'request_id': 'req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:43.659321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b32c7059c7948109cce493a274e0670', 'request_id': 'req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:43.675898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] The token cache is being invalidate because project 7b32c7059c7948109cce493a274e0670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:43.676278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:43.677001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f0820b5b-6ec6-4d7f-b413-f8ebe4122bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:43.680552 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1811/3612] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:43 2022] DELETE /identity/v3/projects/7b32c7059c7948109cce493a274e0670 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:16:43.687320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396fe8-52a7-42ec-a3b1-4eb301579e03 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.687784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396fe8-52a7-42ec-a3b1-4eb301579e03 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.688209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396fe8-52a7-42ec-a3b1-4eb301579e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.736156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.737542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.738183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.738644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.739454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.741326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.745938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eb396fe8-52a7-42ec-a3b1-4eb301579e03 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:43.753146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb396fe8-52a7-42ec-a3b1-4eb301579e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:43.773271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1812/3613] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:16:43.780259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f219-a320-4cb2-9409-60487d38e890 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.780637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f219-a320-4cb2-9409-60487d38e890 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.780982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f219-a320-4cb2-9409-60487d38e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.782332 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1802/3614] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:43.786292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.788484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:43.808730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d8f4-936b-4f19-ab72-65cff2176f41 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.821765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a604f219-a320-4cb2-9409-60487d38e890 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:43.824069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470c3b-4772-4445-ac20-647ec4bb9ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.825703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470c3b-4772-4445-ac20-647ec4bb9ada admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.826569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470c3b-4772-4445-ac20-647ec4bb9ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.827257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470c3b-4772-4445-ac20-647ec4bb9ada admin admin] PATH_INFO: `/v3/projects/f79009cd055e4c01b6bc5aa45ba24dcc/users/5eb18aaa82404c3c93dcc0ec182f4bd7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.828230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a604f219-a320-4cb2-9409-60487d38e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:43.867886 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1813/3615] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:16:43.872701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f219-a320-4cb2-9409-60487d38e890 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.885623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da470c3b-4772-4445-ac20-647ec4bb9ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79009cd055e4c01b6bc5aa45ba24dcc, user_id=5eb18aaa82404c3c93dcc0ec182f4bd7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.891677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f219-a320-4cb2-9409-60487d38e890 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.892809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da470c3b-4772-4445-ac20-647ec4bb9ada admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.901521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:43.902146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.902704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.904686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.905607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:16:43.905924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:43.907949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:43.924118 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1814/3616] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:16:43.928292 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1803/3617] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:16:43 2022] PUT /identity/v3/projects/f79009cd055e4c01b6bc5aa45ba24dcc/users/5eb18aaa82404c3c93dcc0ec182f4bd7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:16:43.928886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:43.929968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:43.930324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:43.930667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:43.943522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70651-923a-41ed-b88c-1387d65896aa admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:43.974215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:43.976783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:44.011399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:44.012283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.012874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.013381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.014137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:44.017171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:44.065254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1815/3618] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:16:43 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:44.069829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:44.108431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1804/3619] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:44.119614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:44.122339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:44.193874 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:44.208553 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:44.250333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e031e-e815-4380-8312-d684ee3d628c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:44.257524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:44.258421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.258714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.258979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.259629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:44.268156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:44.269612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d5bb-14f5-41e7-8760-9c27aa59e2fa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:44.344113 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1816/3620] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:16:44 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:16:44.348422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:44.355509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:44.356290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.356780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.357159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.368677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:44.370023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:44.380049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dd3e4-c14a-4242-93b7-c0ae35b2a117 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:44.382197 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1805/3621] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:44.397456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:44.398227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.398508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.399044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.399714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:44.401548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:44.417654 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1817/3622] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:44.419421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:44.433093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a6df-8642-4760-848d-700a269ad6eb service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:44.448984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1f2bd-c923-4970-b7d3-96bcdfea54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:44.450765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1f2bd-c923-4970-b7d3-96bcdfea54bf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.452571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1f2bd-c923-4970-b7d3-96bcdfea54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.453262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1f2bd-c923-4970-b7d3-96bcdfea54bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.455633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1f2bd-c923-4970-b7d3-96bcdfea54bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:44.458923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1f2bd-c923-4970-b7d3-96bcdfea54bf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:44.490449 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1806/3623] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:16:44.495287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:44.514353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f1965-ff9d-43cc-8787-770fd12ead3a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:44.530718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:44.531366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.531649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.531921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] PATH_INFO: `/v3/projects/451fe9691d984c8fa8e48279584a5eb3/users/9f722129f5a74400a3ddbbbf65ea81bd/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.563433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451fe9691d984c8fa8e48279584a5eb3, user_id=9f722129f5a74400a3ddbbbf65ea81bd, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:44.566050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:44.591794 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1818/3624] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:16:44 2022] PUT /identity/v3/projects/451fe9691d984c8fa8e48279584a5eb3/users/9f722129f5a74400a3ddbbbf65ea81bd/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:44.594885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1f7e-bfdd-415c-a4b3-66537ee32e13 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.595115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1f7e-bfdd-415c-a4b3-66537ee32e13 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.595324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a1f7e-bfdd-415c-a4b3-66537ee32e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.634768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dc9a1f7e-bfdd-415c-a4b3-66537ee32e13 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:44.636498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dc9a1f7e-bfdd-415c-a4b3-66537ee32e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:44.749854 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1807/3625] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:44.769936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:44.772103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:44.887084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72287-5113-4a2a-bbab-553a54716706 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:44.906380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baefb78-2290-405e-bb62-4c6a3414efb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:44.907369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefb78-2290-405e-bb62-4c6a3414efb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:44.907798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefb78-2290-405e-bb62-4c6a3414efb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:44.908209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefb78-2290-405e-bb62-4c6a3414efb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:44.924760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baefb78-2290-405e-bb62-4c6a3414efb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:44.926808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baefb78-2290-405e-bb62-4c6a3414efb3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:44.968974 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1819/3626] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:53.508867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:53.509852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:53.510325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:53.562555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] MFA Rules not processed for user `5bc0dbec293b45f9a97c56a8f3a1798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:53.563733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:53.686580 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1808/3627] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:53.696692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:53.697255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:53.697600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:53.735346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] MFA Rules not processed for user `5bc0dbec293b45f9a97c56a8f3a1798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:53.738916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:53.780451 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1820/3628] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:54.209360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:54.212842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:54.224868 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:54.233703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:54.235500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:54.269933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4b62c-4c94-43f8-ad68-5a6c943e36e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:54.283503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:54.284741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:54.284741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:54.284741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] PATH_INFO: `/v3/users/0133996879444b61a285203e928bc031` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:54.292748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0133996879444b61a285203e928bc031)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:54.294852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:54.407928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0133996879444b61a285203e928bc031'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:54.408706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0133996879444b61a285203e928bc031'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:54.411119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0133996879444b61a285203e928bc031'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:54.431440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0133996879444b61a285203e928bc031'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:54.461694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eae6a-a213-455a-9f77-2b284af9bbe0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:54.468079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-278d078f-c00a-46d9-a99c-38ca9a91468c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0133996879444b61a285203e928bc031'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:54.473763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:54.474389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:54.474664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:54.475511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:54.481620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:54.504282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1821/3629] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:54 2022] DELETE /identity/v3/users/0133996879444b61a285203e928bc031 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:54.505539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:54.505829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:54.506279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:54.514636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:54.516241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:54.534969 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:54.542397 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1809/3630] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:54.564756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:54.568112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:54.761029 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1822/3631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:54.775062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:54.776697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:54.800900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a021a-af1c-46e8-aa68-a8b76d9cbf46 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:54.946205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:54.947013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:54.947306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:54.947584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:54.974829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:54.976727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:55.003932 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1810/3632] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:16:55.920720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:55.922659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:55.951082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512803b-89a9-4efa-ab03-1711faec6024 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:55.963764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:55.964647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:55.966080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:55.967263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] PATH_INFO: `/v3/projects/570b0513d8d9436aaa6dca34b7ce53c7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:55.968766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570b0513d8d9436aaa6dca34b7ce53c7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:55.974036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:56.054246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570b0513d8d9436aaa6dca34b7ce53c7', 'request_id': 'req-e3a386c6-84c7-442b-a30e-23aaabb07290'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.075485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570b0513d8d9436aaa6dca34b7ce53c7', 'request_id': 'req-e3a386c6-84c7-442b-a30e-23aaabb07290'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.092481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570b0513d8d9436aaa6dca34b7ce53c7', 'request_id': 'req-e3a386c6-84c7-442b-a30e-23aaabb07290'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.128499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] The token cache is being invalidate because project 570b0513d8d9436aaa6dca34b7ce53c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:56.128804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.129686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.140194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1823/3633] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:55 2022] DELETE /identity/v3/projects/570b0513d8d9436aaa6dca34b7ce53c7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:56.141235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:56.157355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbebfc4-a1c8-4251-a284-661d2f3fdc23 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:56.292167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:56.293541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:56.294218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:56.294839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] PATH_INFO: `/v3/users/b017070c057a464ea405c2cd761fc3c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:56.296982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b017070c057a464ea405c2cd761fc3c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:56.308719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:56.389426 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:56.419560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b017070c057a464ea405c2cd761fc3c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.420285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b017070c057a464ea405c2cd761fc3c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.420911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b017070c057a464ea405c2cd761fc3c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.440965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b017070c057a464ea405c2cd761fc3c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.453527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e226d631-579c-4aac-9576-9faef785a22e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b017070c057a464ea405c2cd761fc3c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:56.483675 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1811/3634] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:16:56 2022] DELETE /identity/v3/users/b017070c057a464ea405c2cd761fc3c7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:16:57.239734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:57.241642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:57.262472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a386c6-84c7-442b-a30e-23aaabb07290 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:57.401889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:57.403439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:57.403714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:57.404163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] PATH_INFO: `/v3/projects/10c95ab3c2794b4d9c1b9d10c360bcd6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:57.405750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c95ab3c2794b4d9c1b9d10c360bcd6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:57.407675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:57.522635 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:57.564082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c95ab3c2794b4d9c1b9d10c360bcd6', 'request_id': 'req-d75d8f8b-2a95-4821-bddc-aa05d904e99a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:57.580290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c95ab3c2794b4d9c1b9d10c360bcd6', 'request_id': 'req-d75d8f8b-2a95-4821-bddc-aa05d904e99a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:57.586955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf53dd1-3056-44dc-950e-11e6c4bdde5c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:57.587362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf53dd1-3056-44dc-950e-11e6c4bdde5c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:57.587693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf53dd1-3056-44dc-950e-11e6c4bdde5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:57.602413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c95ab3c2794b4d9c1b9d10c360bcd6', 'request_id': 'req-d75d8f8b-2a95-4821-bddc-aa05d904e99a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:57.631534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] The token cache is being invalidate because project 10c95ab3c2794b4d9c1b9d10c360bcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:16:57.633494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:57.634421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d75d8f8b-2a95-4821-bddc-aa05d904e99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:16:57.639469 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1824/3635] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:16:57 2022] DELETE /identity/v3/projects/10c95ab3c2794b4d9c1b9d10c360bcd6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:57.654828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708f60d-5518-4e42-9263-b472d3cf6d1d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:57.660010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708f60d-5518-4e42-9263-b472d3cf6d1d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:57.660540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708f60d-5518-4e42-9263-b472d3cf6d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:57.679675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-daf53dd1-3056-44dc-950e-11e6c4bdde5c None None] MFA Rules not processed for user `9f722129f5a74400a3ddbbbf65ea81bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:57.684101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-daf53dd1-3056-44dc-950e-11e6c4bdde5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:57.712475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2708f60d-5518-4e42-9263-b472d3cf6d1d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:57.716380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2708f60d-5518-4e42-9263-b472d3cf6d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:57.901222 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1825/3636] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:57.909304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0feccb-495d-4e33-903e-621b67cebe74 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:57.909599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0feccb-495d-4e33-903e-621b67cebe74 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:57.909926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0feccb-495d-4e33-903e-621b67cebe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:57.942429 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1812/3637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:57.955082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376c339-3ec1-43a8-86f2-d144d8f5e5c0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:57.955704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376c339-3ec1-43a8-86f2-d144d8f5e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:57.956346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376c339-3ec1-43a8-86f2-d144d8f5e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:57.959393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7a0feccb-495d-4e33-903e-621b67cebe74 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:57.973695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a0feccb-495d-4e33-903e-621b67cebe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:58.008771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1826/3638] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:16:58.014205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0feccb-495d-4e33-903e-621b67cebe74 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:58.040031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0feccb-495d-4e33-903e-621b67cebe74 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:58.059902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:58.060173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:58.060271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:58.060466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:58.061264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:16:58.061555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:58.063099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:58.074738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8376c339-3ec1-43a8-86f2-d144d8f5e5c0 None None] MFA Rules not processed for user `9f722129f5a74400a3ddbbbf65ea81bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:58.076017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8376c339-3ec1-43a8-86f2-d144d8f5e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:58.090992 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1813/3639] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:58.102344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1827/3640] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:16:58.106755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376c339-3ec1-43a8-86f2-d144d8f5e5c0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:58.128045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376c339-3ec1-43a8-86f2-d144d8f5e5c0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:58.139002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:58.139624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:58.139903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:58.140171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:58.140814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:58.153420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:58.242943 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1814/3641] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:16:58 2022] POST /identity/v3/projects => generated 395 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:58.243721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:58.263933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb52a2-04d5-4e0e-a397-28cf4f89c7a4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:58.408817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:58.409577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:58.409855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:58.410349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:58.411169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:58.415519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:58.509607 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1828/3642] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:16:58 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:16:58.515812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:58.538975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c64faf-50a8-444f-8d37-b5d90357aa21 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:58.551600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:58.552240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:58.552518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:58.552791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:58.553535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:58.566924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:58.568867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:58.573929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:58.604627 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1815/3643] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:58.613764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:58.642404 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:58.643237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491f656-408f-495d-b956-4f4195527b51 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:58.657101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:58.658130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:58.658573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:58.659047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:58.659933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:58.663213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:58.696737 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1816/3644] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:58.699658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:58.726555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7614-851a-42db-9faf-a79b28cb12fa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:58.742133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83e8e-92d1-4e6a-9055-a90c56dffa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:58.743166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83e8e-92d1-4e6a-9055-a90c56dffa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:58.743447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83e8e-92d1-4e6a-9055-a90c56dffa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:58.743721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83e8e-92d1-4e6a-9055-a90c56dffa6f admin admin] PATH_INFO: `/v3/projects/00a64c1b2e5e469cb3adf045821504f5/users/bc38576a00d149768a966c922f71df7f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:58.786127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83e8e-92d1-4e6a-9055-a90c56dffa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a64c1b2e5e469cb3adf045821504f5, user_id=bc38576a00d149768a966c922f71df7f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:58.791386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83e8e-92d1-4e6a-9055-a90c56dffa6f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:58.839869 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1817/3645] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:16:58 2022] PUT /identity/v3/projects/00a64c1b2e5e469cb3adf045821504f5/users/bc38576a00d149768a966c922f71df7f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:58.841483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318d085-7781-4b2f-9061-b1a6f9d5959b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:58.841774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318d085-7781-4b2f-9061-b1a6f9d5959b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:58.842054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318d085-7781-4b2f-9061-b1a6f9d5959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:58.843432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b611ba-ac02-4c5d-9a8d-4ba19ad66156 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:58.963701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0318d085-7781-4b2f-9061-b1a6f9d5959b None None] MFA Rules not processed for user `bc38576a00d149768a966c922f71df7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:16:58.965505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0318d085-7781-4b2f-9061-b1a6f9d5959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:16:58.987349 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:59.005168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:59.006394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:59.006673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:59.006942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:59.118190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1818/3646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:16:59.119354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318d085-7781-4b2f-9061-b1a6f9d5959b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:59.163043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:59.166377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:59.194308 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1829/3647] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:16:59.272154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318d085-7781-4b2f-9061-b1a6f9d5959b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:59.292004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:59.292692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:59.293519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:59.293920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:59.294555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:59.296575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:59.383429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:59.395499 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1819/3648] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:16:59 2022] POST /identity/v3/projects => generated 393 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:59.397527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86d3e6-9d23-4471-bad4-afc8875b8598 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:59.588488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:59.589195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:59.597236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:59.597765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:59.598635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:59.600776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:59.623257 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:16:59.651149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1830/3649] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:16:59 2022] POST /identity/v3/users => generated 303 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:16:59.656592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:59.681313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a36f-93ac-47cc-9305-d67121049602 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:59.700380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:59.704150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:59.704565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:59.707311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:59.708434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:59.711970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:59.749556 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1820/3650] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:16:59.750913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:59.776670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b11862-93ef-4934-a82d-9802cc3fd640 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:16:59.782442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:16:59.783202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:16:59.783542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:16:59.783877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] PATH_INFO: `/v3/projects/951bac9bef9c41b5bbb2612ed5b1a82a/users/e8615008d4d74342946f026d1337c0c2/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:16:59.819646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951bac9bef9c41b5bbb2612ed5b1a82a, user_id=e8615008d4d74342946f026d1337c0c2, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:16:59.822410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:16:59.847944 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1831/3651] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:16:59 2022] PUT /identity/v3/projects/951bac9bef9c41b5bbb2612ed5b1a82a/users/e8615008d4d74342946f026d1337c0c2/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:16:59.850246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:16:59.870232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5115c-dd05-4198-8d4c-4d196bce2759 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:00.010601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:00.011922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:00.012219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:00.014896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:00.016954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:00.022373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:00.050615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:00.052736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:00.056384 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1821/3652] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:00.061111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:00.081168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a043f-8a7a-4a5b-9c18-bbca5f9eb980 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:00.083489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4cb5d-0a5d-4705-a2e9-446bac53b1e0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:00.088613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:00.091063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:00.091063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:00.091063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] PATH_INFO: `/v3/users/3d568ef3a7304df4b44b9e09173779c7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:00.091880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d568ef3a7304df4b44b9e09173779c7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:00.096011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:00.107774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9817259-256c-4ff3-a5a7-9dfe8a5027ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:00.111981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9817259-256c-4ff3-a5a7-9dfe8a5027ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:00.112338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9817259-256c-4ff3-a5a7-9dfe8a5027ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:00.112616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9817259-256c-4ff3-a5a7-9dfe8a5027ab admin admin] PATH_INFO: `/v3/projects/951bac9bef9c41b5bbb2612ed5b1a82a/users/e8615008d4d74342946f026d1337c0c2/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:00.118943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9817259-256c-4ff3-a5a7-9dfe8a5027ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=951bac9bef9c41b5bbb2612ed5b1a82a, user_id=e8615008d4d74342946f026d1337c0c2, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:00.124788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9817259-256c-4ff3-a5a7-9dfe8a5027ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:00.154542 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1822/3653] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:17:00 2022] PUT /identity/v3/projects/951bac9bef9c41b5bbb2612ed5b1a82a/users/e8615008d4d74342946f026d1337c0c2/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:17:00.167094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b4f3-2c0c-4f83-a82e-3d7806d47824 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:00.167435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b4f3-2c0c-4f83-a82e-3d7806d47824 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:00.167732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013b4f3-2c0c-4f83-a82e-3d7806d47824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:00.223782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d568ef3a7304df4b44b9e09173779c7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:00.225672 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:00.226171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d568ef3a7304df4b44b9e09173779c7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:00.228001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d568ef3a7304df4b44b9e09173779c7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:00.251803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d568ef3a7304df4b44b9e09173779c7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:00.256487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b013b4f3-2c0c-4f83-a82e-3d7806d47824 None None] MFA Rules not processed for user `e8615008d4d74342946f026d1337c0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:00.259542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b013b4f3-2c0c-4f83-a82e-3d7806d47824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:00.291568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d568ef3a7304df4b44b9e09173779c7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:00.327733 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1832/3654] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:17:00 2022] DELETE /identity/v3/users/3d568ef3a7304df4b44b9e09173779c7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:17:00.405131 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1823/3655] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:17:00.771136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:00.774197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:00.967729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e431b-1e7d-4bc1-8093-34985cd709bb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:00.984215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:00.984883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:00.985260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:00.985537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] PATH_INFO: `/v3/projects/478e6900c2ca41568f8c78d0fd25de98` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:00.986717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478e6900c2ca41568f8c78d0fd25de98)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:00.988623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:01.062055 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=4,keystone:SELECT=83,keystone:DELETE=13 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:01.086570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478e6900c2ca41568f8c78d0fd25de98', 'request_id': 'req-1444eb70-2e85-4379-a066-676461821301'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:01.097523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478e6900c2ca41568f8c78d0fd25de98', 'request_id': 'req-1444eb70-2e85-4379-a066-676461821301'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:01.143545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478e6900c2ca41568f8c78d0fd25de98', 'request_id': 'req-1444eb70-2e85-4379-a066-676461821301'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:01.160962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] The token cache is being invalidate because project 478e6900c2ca41568f8c78d0fd25de98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:17:01.162419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:01.163595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1444eb70-2e85-4379-a066-676461821301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:01.170763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1833/3656] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:17:00 2022] DELETE /identity/v3/projects/478e6900c2ca41568f8c78d0fd25de98 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:01.177329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280552f-18ed-41d7-a8e6-0bca7f9fb9fd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:01.177971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280552f-18ed-41d7-a8e6-0bca7f9fb9fd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:01.177971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280552f-18ed-41d7-a8e6-0bca7f9fb9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:01.231830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3280552f-18ed-41d7-a8e6-0bca7f9fb9fd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:01.238660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3280552f-18ed-41d7-a8e6-0bca7f9fb9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:01.395672 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1824/3657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:01.397792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96f60-0797-40c6-8116-f6017fa5939f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:01.398080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96f60-0797-40c6-8116-f6017fa5939f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:01.398355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb96f60-0797-40c6-8116-f6017fa5939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:01.459814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6eb96f60-0797-40c6-8116-f6017fa5939f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:01.462327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6eb96f60-0797-40c6-8116-f6017fa5939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:01.493345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280552f-18ed-41d7-a8e6-0bca7f9fb9fd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:01.493961 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1834/3658] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:01.506400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280552f-18ed-41d7-a8e6-0bca7f9fb9fd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:01.528336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:01.530613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:01.531132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:01.531617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:01.532511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:17:01.533030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:01.537619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:01.560251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb96f60-0797-40c6-8116-f6017fa5939f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:01.572051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb96f60-0797-40c6-8116-f6017fa5939f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:01.573153 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1825/3659] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:17:01.593381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:01.595305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:01.597262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:01.597791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:01.598644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:01.603647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:01.645535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:01.654400 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1835/3660] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:17:01 2022] POST /identity/v3/projects => generated 405 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:01.660100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980092f7-c1e5-45ff-9dea-d07a92123527 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:01.712722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:01.721714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:01.845813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:01.846575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:01.848802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:01.849164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:01.849848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:01.858634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:01.942806 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1826/3661] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:17:01 2022] POST /identity/v3/users => generated 303 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:01.945819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8955-9fe6-42da-b8e7-21b377299ff9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:01.952750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:01.981686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:01.982328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:01.982609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:01.982882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:01.989470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:02.030004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147d9d2-6b0b-4c6c-b8e6-bcedbf201038 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:02.083956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:02.088496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:02.089294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:02.091397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:02.095799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:02.101842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:02.144436 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1827/3662] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:02.148396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:02.198957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:02.206791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:02.217165 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:02.234747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d7790-8c16-407c-a0a0-44bfc6b0ec10 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:02.254699 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1836/3663] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:02.278455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe360ee-a7e0-4975-910d-b727e2e505a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:02.279755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe360ee-a7e0-4975-910d-b727e2e505a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:02.280046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe360ee-a7e0-4975-910d-b727e2e505a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:02.280327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe360ee-a7e0-4975-910d-b727e2e505a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:02.280988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe360ee-a7e0-4975-910d-b727e2e505a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:02.282643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe360ee-a7e0-4975-910d-b727e2e505a3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:02.341868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:02.350195 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1828/3664] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:02.361281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3b8fd-9052-4c9c-9f2d-44ac43745da5 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:02.373346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:02.374185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:02.374533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:02.375036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] PATH_INFO: `/v3/projects/3f75d49409e541d099d90c42b470f36f/users/17492e3ec2dd42669f657ca506665b5f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:02.432426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f75d49409e541d099d90c42b470f36f, user_id=17492e3ec2dd42669f657ca506665b5f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:02.435728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:02.474011 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1837/3665] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:17:02 2022] PUT /identity/v3/projects/3f75d49409e541d099d90c42b470f36f/users/17492e3ec2dd42669f657ca506665b5f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:02.478849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:02.479371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:02.479818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:02.536585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:02.541004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:02.816822 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1829/3666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:02.857892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:02.860352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:02.883576 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:03.037183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c03e76-39aa-4a81-95a5-bece53ab01e9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:03.051843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:03.052478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:03.052758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:03.053031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:03.082830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:03.094755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:03.126097 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1838/3667] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:03.642263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:03.644027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:03.813597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34865f-7209-4ec4-a0a2-3f54e71917f9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:03.833641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80459f36-b6f8-4cd6-9bd6-181602b12981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:03.834458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80459f36-b6f8-4cd6-9bd6-181602b12981 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:03.834891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80459f36-b6f8-4cd6-9bd6-181602b12981 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:03.835308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80459f36-b6f8-4cd6-9bd6-181602b12981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:03.841639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80459f36-b6f8-4cd6-9bd6-181602b12981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:04.063477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80459f36-b6f8-4cd6-9bd6-181602b12981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:04.065466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80459f36-b6f8-4cd6-9bd6-181602b12981 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:04.085689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1830/3668] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:04.107241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:04.108713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:04.148115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ff9f7-bc0d-4470-a06f-8f87ee641148 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:04.159248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:04.160223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:04.160508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:04.160783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] PATH_INFO: `/v3/users/bc38576a00d149768a966c922f71df7f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:04.166537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc38576a00d149768a966c922f71df7f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:04.180053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:04.296463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc38576a00d149768a966c922f71df7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:04.297338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc38576a00d149768a966c922f71df7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:04.298225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc38576a00d149768a966c922f71df7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:04.309281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc38576a00d149768a966c922f71df7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:04.330040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc38576a00d149768a966c922f71df7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:04.383578 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1839/3669] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:17:04 2022] DELETE /identity/v3/users/bc38576a00d149768a966c922f71df7f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:04.384955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473e597-4e29-4e6a-84c1-7a79c8ec5b39 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:04.385272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473e597-4e29-4e6a-84c1-7a79c8ec5b39 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:04.385560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473e597-4e29-4e6a-84c1-7a79c8ec5b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:04.424274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2473e597-4e29-4e6a-84c1-7a79c8ec5b39 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:04.426450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2473e597-4e29-4e6a-84c1-7a79c8ec5b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:04.513938 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:04.582814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1831/3670] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:17:04.634168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:04.640059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:04.830919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb87a31-6ca2-4b10-86df-bfd0d7309e86 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:04.836130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698d2a7-a247-4714-b4e1-96ff74b2747e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:04.836880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d2a7-a247-4714-b4e1-96ff74b2747e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:04.837253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d2a7-a247-4714-b4e1-96ff74b2747e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:04.838155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d2a7-a247-4714-b4e1-96ff74b2747e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:04.852883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698d2a7-a247-4714-b4e1-96ff74b2747e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:04.854850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698d2a7-a247-4714-b4e1-96ff74b2747e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:04.905617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1840/3671] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:05.435485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:05.436037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:05.437537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:05.550075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] MFA Rules not processed for user `5eb18aaa82404c3c93dcc0ec182f4bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:05.554016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:05.825204 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1832/3672] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:05.840039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:05.841442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:05.842380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:05.883773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] MFA Rules not processed for user `5eb18aaa82404c3c93dcc0ec182f4bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:05.888610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:05.907747 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1841/3673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:06.160171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:06.162034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:06.296171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfdb9c-f4b1-4b4a-8a13-6fb855a06608 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:06.309458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:06.311521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:06.313111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:06.313729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:06.338460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:06.341684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:06.369630 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1833/3674] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:07.001409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:07.004013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:07.032084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6967bf-429f-4e18-80a8-346bcb051aa5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:07.045757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:07.048624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:07.049402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:07.049913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] PATH_INFO: `/v3/projects/00a64c1b2e5e469cb3adf045821504f5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:07.052048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a64c1b2e5e469cb3adf045821504f5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:07.061443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:07.090821 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:07.176607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a64c1b2e5e469cb3adf045821504f5', 'request_id': 'req-d93065a5-1211-4a67-87ac-99ac8d012bf8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.187828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a64c1b2e5e469cb3adf045821504f5', 'request_id': 'req-d93065a5-1211-4a67-87ac-99ac8d012bf8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.205744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a64c1b2e5e469cb3adf045821504f5', 'request_id': 'req-d93065a5-1211-4a67-87ac-99ac8d012bf8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.222638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] The token cache is being invalidate because project 00a64c1b2e5e469cb3adf045821504f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:17:07.223216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.224481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.227704 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1842/3675] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:17:06 2022] DELETE /identity/v3/projects/00a64c1b2e5e469cb3adf045821504f5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:07.231773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:07.264443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025130-f09e-4247-9b73-59c97d34fd88 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:07.376788 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:07.424940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:07.425642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:07.425921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:07.426198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] PATH_INFO: `/v3/users/e8615008d4d74342946f026d1337c0c2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:07.429961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8615008d4d74342946f026d1337c0c2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:07.445233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:07.605043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8615008d4d74342946f026d1337c0c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.606636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8615008d4d74342946f026d1337c0c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.608889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8615008d4d74342946f026d1337c0c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.632305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8615008d4d74342946f026d1337c0c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.656328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb59f5e4-6df0-4622-8683-46204e2fc991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8615008d4d74342946f026d1337c0c2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:07.700039 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1834/3676] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:17:07 2022] DELETE /identity/v3/users/e8615008d4d74342946f026d1337c0c2 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:09.622165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:09.623648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:09.650548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93065a5-1211-4a67-87ac-99ac8d012bf8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:09.841118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:09.841845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:09.842209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:09.852881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] PATH_INFO: `/v3/projects/951bac9bef9c41b5bbb2612ed5b1a82a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:09.871509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951bac9bef9c41b5bbb2612ed5b1a82a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:09.885382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:10.035979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951bac9bef9c41b5bbb2612ed5b1a82a', 'request_id': 'req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:10.066722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951bac9bef9c41b5bbb2612ed5b1a82a', 'request_id': 'req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:10.091372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951bac9bef9c41b5bbb2612ed5b1a82a', 'request_id': 'req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:10.122474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] The token cache is being invalidate because project 951bac9bef9c41b5bbb2612ed5b1a82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:17:10.122960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:10.123631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d3b2cd3-96e6-4ae3-8c84-3fd601b07d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:10.125454 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1843/3677] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:17:09 2022] DELETE /identity/v3/projects/951bac9bef9c41b5bbb2612ed5b1a82a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:10.132199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c1a33-5639-4fe1-a77d-3b0902ab10c9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:10.132756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c1a33-5639-4fe1-a77d-3b0902ab10c9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:10.133055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c1a33-5639-4fe1-a77d-3b0902ab10c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:10.206537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f88c1a33-5639-4fe1-a77d-3b0902ab10c9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:10.207821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f88c1a33-5639-4fe1-a77d-3b0902ab10c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:10.409032 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1835/3678] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:10.412125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656f178-fd6d-4576-97be-f29980fe44e4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:10.412423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656f178-fd6d-4576-97be-f29980fe44e4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:10.412751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656f178-fd6d-4576-97be-f29980fe44e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:10.477681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0656f178-fd6d-4576-97be-f29980fe44e4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:10.478962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0656f178-fd6d-4576-97be-f29980fe44e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:10.538943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1844/3679] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:10.545283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c1a33-5639-4fe1-a77d-3b0902ab10c9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:10.565904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c1a33-5639-4fe1-a77d-3b0902ab10c9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:10.587095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:10.588031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:10.588494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:10.588779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:10.590080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:17:10.590481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:10.592275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:10.656503 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1836/3680] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:17:10.661210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656f178-fd6d-4576-97be-f29980fe44e4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:10.673500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656f178-fd6d-4576-97be-f29980fe44e4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:10.697683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:10.702761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:10.703429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:10.703706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:10.708062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:10.716428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:10.834094 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1845/3681] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:17:10 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:10.838227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:10.881332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe88d-6c77-4c22-961a-aa4d460686e9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:11.062934 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:11.083986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:11.085005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:11.086292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:11.087025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:11.088028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:11.092962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:11.165337 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1837/3682] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:17:10 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:11.168491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:11.177947 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:11.186734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579a30-8a83-4356-90fd-ac31b3715f06 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:11.204520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:11.205798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:11.208760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:11.209277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:11.213962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:11.219895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:11.249344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1846/3683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:11.253274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:11.277634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd60de-aabc-44dc-9e19-f5b549b0a749 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:11.287061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:11.290620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:11.298711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:11.302841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:11.303146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:11.307253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:11.311527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:11.316386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2532-8bb1-4c6f-b222-375bcdad91fb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:11.323633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:11.333813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:11.334584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:11.334866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:11.335134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] PATH_INFO: `/v3/users/48d1e8f642494770bfe64752178bf4b6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:11.340978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d1e8f642494770bfe64752178bf4b6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:11.343065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:11.370736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1838/3684] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:11.373332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:11.403488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92501-4301-4579-97ec-222577ff346c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:11.416414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6f182-3f47-4bc6-9af3-bdad6f5d6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:11.421300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6f182-3f47-4bc6-9af3-bdad6f5d6579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:11.421902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6f182-3f47-4bc6-9af3-bdad6f5d6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:11.423193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6f182-3f47-4bc6-9af3-bdad6f5d6579 admin admin] PATH_INFO: `/v3/projects/3da56c27fa70412585b4a14c3488b700/users/dd6e83da2af04abd80a11ffe43f10d7d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:11.459093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6f182-3f47-4bc6-9af3-bdad6f5d6579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da56c27fa70412585b4a14c3488b700, user_id=dd6e83da2af04abd80a11ffe43f10d7d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:11.463773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6f182-3f47-4bc6-9af3-bdad6f5d6579 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:11.488345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d1e8f642494770bfe64752178bf4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:11.491709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d1e8f642494770bfe64752178bf4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:11.494045 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1839/3685] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:17:11 2022] PUT /identity/v3/projects/3da56c27fa70412585b4a14c3488b700/users/dd6e83da2af04abd80a11ffe43f10d7d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:11.497592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:11.498579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:11.499536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:11.504760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d1e8f642494770bfe64752178bf4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:11.526461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:11.528284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:11.537428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d1e8f642494770bfe64752178bf4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:11.585892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d1e8f642494770bfe64752178bf4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:11.616844 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1847/3686] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:17:11 2022] DELETE /identity/v3/users/48d1e8f642494770bfe64752178bf4b6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:17:11.706865 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1840/3687] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:11.827413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:11.829207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:12.035467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7407804-3c58-4e5e-bd9c-fc22d439cc2d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:12.050507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28148-0949-4bcf-9823-f0a463d7fe97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:12.051352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28148-0949-4bcf-9823-f0a463d7fe97 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:12.051799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28148-0949-4bcf-9823-f0a463d7fe97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:12.052228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28148-0949-4bcf-9823-f0a463d7fe97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:12.188999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28148-0949-4bcf-9823-f0a463d7fe97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:12.190826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28148-0949-4bcf-9823-f0a463d7fe97 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:12.218585 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1848/3688] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:13.546450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:13.554193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:13.574694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ba706-cf10-4669-85d3-24bc59e7fa69 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:13.581530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:13.582736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:13.583300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:13.584006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] PATH_INFO: `/v3/projects/d6ef59b7262942809c210d1d0e6fab44` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:13.585721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ef59b7262942809c210d1d0e6fab44)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:13.588075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:13.710618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ef59b7262942809c210d1d0e6fab44', 'request_id': 'req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:13.729253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ef59b7262942809c210d1d0e6fab44', 'request_id': 'req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:13.766914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ef59b7262942809c210d1d0e6fab44', 'request_id': 'req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:13.847068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] The token cache is being invalidate because project d6ef59b7262942809c210d1d0e6fab44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:17:13.847568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:13.848444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c95bf2b2-363f-40b3-9b0d-75bfbfb546b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:13.853047 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1841/3689] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:17:13 2022] DELETE /identity/v3/projects/d6ef59b7262942809c210d1d0e6fab44 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:13.858147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c7aa-9ab0-4457-acf8-247594a4ba78 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:13.858612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c7aa-9ab0-4457-acf8-247594a4ba78 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:13.858719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c7aa-9ab0-4457-acf8-247594a4ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:13.897982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5502c7aa-9ab0-4457-acf8-247594a4ba78 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:13.899576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5502c7aa-9ab0-4457-acf8-247594a4ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:13.924854 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:14.075690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb337a0-27c6-4e07-b1b9-476d18c002cf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.075982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb337a0-27c6-4e07-b1b9-476d18c002cf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.076257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb337a0-27c6-4e07-b1b9-476d18c002cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.081623 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1849/3690] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:14.102605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-adb337a0-27c6-4e07-b1b9-476d18c002cf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:14.104128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-adb337a0-27c6-4e07-b1b9-476d18c002cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:14.117347 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1842/3691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:14.119279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c7aa-9ab0-4457-acf8-247594a4ba78 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:14.132038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c7aa-9ab0-4457-acf8-247594a4ba78 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:14.139695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:14.140785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.141333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.141850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.142735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:17:14.143279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:14.145651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:14.166472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1850/3692] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:17:14.167468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb337a0-27c6-4e07-b1b9-476d18c002cf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:14.184312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb337a0-27c6-4e07-b1b9-476d18c002cf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:14.209581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:14.209581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.209581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.209581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.213178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:14.214046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:14.315545 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:14.324136 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1843/3693] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:17:14 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:17:14.328038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:14.346452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f8fb-4b9c-4213-9ad3-95e4bdf7ed7c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:14.536194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:14.537011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.537496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.537930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.538908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:14.541003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:14.596753 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1851/3694] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:17:14 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:14.600613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:14.615640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9447754-a822-4339-b81a-f1062f4933b8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:14.629706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:14.630335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.630802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.631231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.632085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:14.633953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:14.662123 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1844/3695] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:14.666005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:14.682687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338355-6986-4500-9884-50cc5befe9d9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:14.693785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325248a-ff91-4297-961c-8385b14cac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:14.694745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325248a-ff91-4297-961c-8385b14cac49 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.695274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325248a-ff91-4297-961c-8385b14cac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.695748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325248a-ff91-4297-961c-8385b14cac49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.696595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325248a-ff91-4297-961c-8385b14cac49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:14.701640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325248a-ff91-4297-961c-8385b14cac49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:14.722727 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1852/3696] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:17:14.726994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:14.744464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce868aa-b152-4684-9353-a2a5feeddb47 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:14.754407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:14.755427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.755908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.756363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] PATH_INFO: `/v3/projects/89240e2456784a5fbbb3b5d7c8ddb2ad/users/b061026cc5d644d1a3fe41b2fe05c7bc/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.815210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89240e2456784a5fbbb3b5d7c8ddb2ad, user_id=b061026cc5d644d1a3fe41b2fe05c7bc, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:14.818235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:14.854229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1845/3697] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:17:14 2022] PUT /identity/v3/projects/89240e2456784a5fbbb3b5d7c8ddb2ad/users/b061026cc5d644d1a3fe41b2fe05c7bc/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:17:14.856771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b3ef-1956-404e-a01e-63288f6bd6fc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:14.856977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b3ef-1956-404e-a01e-63288f6bd6fc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:14.857276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b3ef-1956-404e-a01e-63288f6bd6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:14.914270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5501b3ef-1956-404e-a01e-63288f6bd6fc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:14.915519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5501b3ef-1956-404e-a01e-63288f6bd6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:15.054292 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1853/3698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:15.101525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:15.104585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:15.261636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d8a5-08e5-4954-9b1a-b7df30b41a63 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:15.272004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:15.273204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:15.274305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:15.274788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:15.293104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:15.295813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:15.316490 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1846/3699] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:19.772968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbea69-f2ec-4a4a-8f43-202f91069d17 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:19.773941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbea69-f2ec-4a4a-8f43-202f91069d17 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:19.775039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbea69-f2ec-4a4a-8f43-202f91069d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:19.838702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b6dbea69-f2ec-4a4a-8f43-202f91069d17 None None] MFA Rules not processed for user `17492e3ec2dd42669f657ca506665b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:19.840923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b6dbea69-f2ec-4a4a-8f43-202f91069d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:19.873294 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:20.031805 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1854/3700] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:21.145414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:21.154331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:21.357726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49fe17-49c8-4638-8b08-e54d2f2ee3a2 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:21.366225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:21.367094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:21.367594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:21.368060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:21.384423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:21.386640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:21.404426 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1847/3701] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:21 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:25.601697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48805aa-d3ec-4e12-aff1-c05f31fa5c70 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:25.602592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48805aa-d3ec-4e12-aff1-c05f31fa5c70 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:25.603095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48805aa-d3ec-4e12-aff1-c05f31fa5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:25.640893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e48805aa-d3ec-4e12-aff1-c05f31fa5c70 None None] MFA Rules not processed for user `dd6e83da2af04abd80a11ffe43f10d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:25.642280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e48805aa-d3ec-4e12-aff1-c05f31fa5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:25.722245 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1855/3702] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:26.053406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:26.055209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:26.080557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ce40-f33f-4da2-b536-89c1682a6cab service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:26.087891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:26.088595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:26.088905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:26.089264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:26.100537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:26.102241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:26.114046 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1848/3703] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:28.935404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:28.935404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:28.935404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:29.000917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] MFA Rules not processed for user `b061026cc5d644d1a3fe41b2fe05c7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:29.002584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:29.135350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1856/3704] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:30.511961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:30.539951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acce5-b92a-443a-ab84-bb31019347c1 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:30.551869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:30.552695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:30.553225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:30.553880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:30.564387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:30.567094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:30.635471 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1849/3705] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:33.223318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:33.224855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:33.249967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377777f0-e7fb-407f-8ae8-162f361a32df None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:33.256842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:33.266970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:33.273221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:33.273763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] PATH_INFO: `/v3/users/11ed1b2234c74d959fade2577a34a8a8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:33.275322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ed1b2234c74d959fade2577a34a8a8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:33.278108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:33.317848 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:33.362848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ed1b2234c74d959fade2577a34a8a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:33.363971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ed1b2234c74d959fade2577a34a8a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:33.364917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ed1b2234c74d959fade2577a34a8a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:33.375640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ed1b2234c74d959fade2577a34a8a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:33.393677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85647f50-6c4e-44ad-a74e-77445f28617c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ed1b2234c74d959fade2577a34a8a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:33.426162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1857/3706] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:17:33 2022] DELETE /identity/v3/users/11ed1b2234c74d959fade2577a34a8a8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:33.889545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:33.922628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b61309-bd5c-4a23-a95a-9f44c4ffdb8c service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:34.005309 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:34.101164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:34.109273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:34.109653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:34.109933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] PATH_INFO: `/v3/projects/0d16a0642e894a649982fa2eb4de6ada` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:34.113708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d16a0642e894a649982fa2eb4de6ada)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:34.119706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:34.254080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d16a0642e894a649982fa2eb4de6ada', 'request_id': 'req-520c2548-461e-47c1-934b-7198fae74a6f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:34.284078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d16a0642e894a649982fa2eb4de6ada', 'request_id': 'req-520c2548-461e-47c1-934b-7198fae74a6f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:34.299125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d16a0642e894a649982fa2eb4de6ada', 'request_id': 'req-520c2548-461e-47c1-934b-7198fae74a6f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:34.333928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] The token cache is being invalidate because project 0d16a0642e894a649982fa2eb4de6ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:17:34.334239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:34.336028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-520c2548-461e-47c1-934b-7198fae74a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:34.338051 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1850/3707] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:17:33 2022] DELETE /identity/v3/projects/0d16a0642e894a649982fa2eb4de6ada => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:34.343518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803519a-321a-4078-9ed3-b2038698772a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:34.344020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803519a-321a-4078-9ed3-b2038698772a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:34.344129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803519a-321a-4078-9ed3-b2038698772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:34.404309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6803519a-321a-4078-9ed3-b2038698772a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:34.406454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6803519a-321a-4078-9ed3-b2038698772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:34.556160 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1858/3708] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:17:34.564574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6be68-748d-42be-8601-29446991b6db None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:34.565271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6be68-748d-42be-8601-29446991b6db None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:34.565863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6be68-748d-42be-8601-29446991b6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:34.610241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-63e6be68-748d-42be-8601-29446991b6db None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:34.612069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-63e6be68-748d-42be-8601-29446991b6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:34.624140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1851/3709] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:34.628561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803519a-321a-4078-9ed3-b2038698772a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:34.642614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803519a-321a-4078-9ed3-b2038698772a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:34.657872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:34.658976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:34.659486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:34.659940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:34.660864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:17:34.673904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:34.676756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:34.720229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1859/3710] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:17:34.722165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6be68-748d-42be-8601-29446991b6db None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:34.742023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6be68-748d-42be-8601-29446991b6db None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:34.755887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729caf2-69d1-45b5-8c7f-d51429ff8bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:34.756888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729caf2-69d1-45b5-8c7f-d51429ff8bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:34.757617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729caf2-69d1-45b5-8c7f-d51429ff8bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:34.757617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729caf2-69d1-45b5-8c7f-d51429ff8bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:34.758331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729caf2-69d1-45b5-8c7f-d51429ff8bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:34.760248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729caf2-69d1-45b5-8c7f-d51429ff8bd0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:34.851285 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1852/3711] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:17:34 2022] POST /identity/v3/projects => generated 397 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:34.855952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:34.871277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98324207-1e8a-4028-a515-97a33cad3392 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:34.918214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e9b-9254-4e3e-b2f8-5dcf85c480e7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:34.918737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e9b-9254-4e3e-b2f8-5dcf85c480e7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:34.918737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e9b-9254-4e3e-b2f8-5dcf85c480e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:34.943504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-73e23e9b-9254-4e3e-b2f8-5dcf85c480e7 None None] MFA Rules not processed for user `b061026cc5d644d1a3fe41b2fe05c7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:34.946012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-73e23e9b-9254-4e3e-b2f8-5dcf85c480e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:35.012099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:35.012739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:35.013023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:35.013341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:35.014154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:35.019471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:35.041382 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1853/3712] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:35.071877 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1860/3713] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:17:34 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:17:35.076640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23e9b-9254-4e3e-b2f8-5dcf85c480e7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:35.104157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23e9b-9254-4e3e-b2f8-5dcf85c480e7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:35.117930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:35.118660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:35.118940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:35.119211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:35.121671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:35.124312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:35.140092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1854/3714] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:35.144707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:35.158242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac64f-378b-4858-b87a-394452d81265 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:35.168072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e27b-a3a9-4b93-a4da-44a3315f038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:35.168774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e27b-a3a9-4b93-a4da-44a3315f038d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:35.169006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e27b-a3a9-4b93-a4da-44a3315f038d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:35.169267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e27b-a3a9-4b93-a4da-44a3315f038d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:35.170269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8e27b-a3a9-4b93-a4da-44a3315f038d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:35.171969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8e27b-a3a9-4b93-a4da-44a3315f038d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:35.197135 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1861/3715] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:35.201582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:35.236396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccf349-e632-45a7-beaf-abb009d60d77 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:35.250605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca186f91-7c0f-4344-a433-cf76753d847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:35.254436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186f91-7c0f-4344-a433-cf76753d847e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:35.255094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186f91-7c0f-4344-a433-cf76753d847e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:35.255634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186f91-7c0f-4344-a433-cf76753d847e admin admin] PATH_INFO: `/v3/projects/3a38782dd4e04460a9846b4602917021/users/233cabef7d7646f0944127d5f9e72ef5/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:35.313380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca186f91-7c0f-4344-a433-cf76753d847e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a38782dd4e04460a9846b4602917021, user_id=233cabef7d7646f0944127d5f9e72ef5, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:35.319150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca186f91-7c0f-4344-a433-cf76753d847e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:35.338825 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:35.360823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:35.361408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:35.361989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:35.368101 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1855/3716] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:17:35 2022] PUT /identity/v3/projects/3a38782dd4e04460a9846b4602917021/users/233cabef7d7646f0944127d5f9e72ef5/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:35.402689 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:35.419145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] MFA Rules not processed for user `233cabef7d7646f0944127d5f9e72ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:35.421529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:35.594738 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1862/3717] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:17:35.692622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b843bc-3ce5-4e44-b203-8e9eeb786c7e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:35.692915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b843bc-3ce5-4e44-b203-8e9eeb786c7e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:35.693238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b843bc-3ce5-4e44-b203-8e9eeb786c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:35.729054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f0b843bc-3ce5-4e44-b203-8e9eeb786c7e None None] MFA Rules not processed for user `233cabef7d7646f0944127d5f9e72ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:35.734662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f0b843bc-3ce5-4e44-b203-8e9eeb786c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:35.759548 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1856/3718] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:38.661359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:38.663844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:38.812669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d712-0079-4325-a480-60b62f8aaa2f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:38.821133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c57f8-2b63-4fc3-90b9-fd2e83863017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:38.822429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c57f8-2b63-4fc3-90b9-fd2e83863017 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:38.822779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c57f8-2b63-4fc3-90b9-fd2e83863017 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:38.823839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c57f8-2b63-4fc3-90b9-fd2e83863017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:38.835298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c57f8-2b63-4fc3-90b9-fd2e83863017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:38.837133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c57f8-2b63-4fc3-90b9-fd2e83863017 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:38.850759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1863/3719] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:38.880081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:38.881312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:38.881589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:38.907966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] MFA Rules not processed for user `233cabef7d7646f0944127d5f9e72ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:38.909722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:38.926235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1857/3720] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:39.281351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d2637-83f9-414f-a7d4-ee21f6d5daf1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:39.281640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d2637-83f9-414f-a7d4-ee21f6d5daf1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:39.281919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d2637-83f9-414f-a7d4-ee21f6d5daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:39.307501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7f5d2637-83f9-414f-a7d4-ee21f6d5daf1 None None] MFA Rules not processed for user `233cabef7d7646f0944127d5f9e72ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:39.309097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7f5d2637-83f9-414f-a7d4-ee21f6d5daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:39.322272 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1864/3721] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:39.875766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:39.883258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec3230-0de2-40ba-96cb-613c9f2b0fe3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:39.885154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec3230-0de2-40ba-96cb-613c9f2b0fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:39.886756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec3230-0de2-40ba-96cb-613c9f2b0fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:39.887615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:39.989024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9dec3230-0de2-40ba-96cb-613c9f2b0fe3 None None] MFA Rules not processed for user `233cabef7d7646f0944127d5f9e72ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:39.990399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9dec3230-0de2-40ba-96cb-613c9f2b0fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:40.007606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1865/3722] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:40.089593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad7235-4118-40d1-8b40-d97b8cfc3563 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:40.096622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:40.097967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:40.098533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:40.099024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] PATH_INFO: `/v3/users/5bc0dbec293b45f9a97c56a8f3a1798c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:40.101630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc0dbec293b45f9a97c56a8f3a1798c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:40.103810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:40.204849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc0dbec293b45f9a97c56a8f3a1798c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.205988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc0dbec293b45f9a97c56a8f3a1798c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.207071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc0dbec293b45f9a97c56a8f3a1798c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.227977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc0dbec293b45f9a97c56a8f3a1798c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.238920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7076070d-fc0f-41ac-8e86-e5a6fa004444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc0dbec293b45f9a97c56a8f3a1798c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.260853 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1858/3723] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:17:39 2022] DELETE /identity/v3/users/5bc0dbec293b45f9a97c56a8f3a1798c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:40.664820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec3230-0de2-40ba-96cb-613c9f2b0fe3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:40.678552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec3230-0de2-40ba-96cb-613c9f2b0fe3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:40.754132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:40.755068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:40.755347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:40.755818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] PATH_INFO: `/v3/projects/12b47ef0ebd54d5689a0e1aba68c1977` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:40.757899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b47ef0ebd54d5689a0e1aba68c1977)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:40.759984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:40.787815 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:40.833108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b47ef0ebd54d5689a0e1aba68c1977', 'request_id': 'req-39abdceb-4442-4822-ac80-3d8165ca43b8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.845315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b47ef0ebd54d5689a0e1aba68c1977', 'request_id': 'req-39abdceb-4442-4822-ac80-3d8165ca43b8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.858716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b47ef0ebd54d5689a0e1aba68c1977', 'request_id': 'req-39abdceb-4442-4822-ac80-3d8165ca43b8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.877313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] The token cache is being invalidate because project 12b47ef0ebd54d5689a0e1aba68c1977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:17:40.877576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.879130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-39abdceb-4442-4822-ac80-3d8165ca43b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:40.884655 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1866/3724] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:17:40 2022] DELETE /identity/v3/projects/12b47ef0ebd54d5689a0e1aba68c1977 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:40.887310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cf9bf-978f-41d4-a9f5-9155e3dc6812 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:40.887597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cf9bf-978f-41d4-a9f5-9155e3dc6812 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:40.887870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cf9bf-978f-41d4-a9f5-9155e3dc6812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:40.922724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ab5cf9bf-978f-41d4-a9f5-9155e3dc6812 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:40.924191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ab5cf9bf-978f-41d4-a9f5-9155e3dc6812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:41.001718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbdb66-a63c-45f5-bfa0-e549b2217f1d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.003319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbdb66-a63c-45f5-bfa0-e549b2217f1d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.003958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbdb66-a63c-45f5-bfa0-e549b2217f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.009760 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1859/3725] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:41.018018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2a619-6aad-4b5f-9d7c-ab9bca4b0351 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.018973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2a619-6aad-4b5f-9d7c-ab9bca4b0351 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.019539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2a619-6aad-4b5f-9d7c-ab9bca4b0351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.033881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1dfbdb66-a63c-45f5-bfa0-e549b2217f1d None None] MFA Rules not processed for user `233cabef7d7646f0944127d5f9e72ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:41.036880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1dfbdb66-a63c-45f5-bfa0-e549b2217f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:41.047885 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:41.096197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0aa2a619-6aad-4b5f-9d7c-ab9bca4b0351 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:41.097839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0aa2a619-6aad-4b5f-9d7c-ab9bca4b0351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:41.113723 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1860/3726] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:17:41.118604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2a619-6aad-4b5f-9d7c-ab9bca4b0351 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.155379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1867/3727] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:41.161404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2a619-6aad-4b5f-9d7c-ab9bca4b0351 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:41.166646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:41.168239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.168239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.168488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.170764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:17:41.171250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:41.173780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:41.192753 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1861/3728] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:17:41.196920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbdb66-a63c-45f5-bfa0-e549b2217f1d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.216360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbdb66-a63c-45f5-bfa0-e549b2217f1d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:41.228975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:41.230206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.230639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.230921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.235233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:41.238779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:41.284738 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1868/3729] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:17:41 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:41.288878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.305700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155760b-2b0e-4e88-948d-cdbd528ebf2b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:41.447361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:41.448732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.449197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.449962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.451131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:41.453683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:41.486860 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1862/3730] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:17:41 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:17:41.492144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.507074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46f8af-6c15-4c7c-96ac-8745479f4a01 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:41.523307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:41.523944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.524223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.524492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.525162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:41.533169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:41.545568 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1869/3731] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:41.549188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.565964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec270-c377-4533-b1f5-12ef94e9a55a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:41.573745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2896-f52e-493f-bd50-6550fd58c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:41.574372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2896-f52e-493f-bd50-6550fd58c56c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.575139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2896-f52e-493f-bd50-6550fd58c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.575139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2896-f52e-493f-bd50-6550fd58c56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.575550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a2896-f52e-493f-bd50-6550fd58c56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:41.577204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a2896-f52e-493f-bd50-6550fd58c56c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:41.589283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1863/3732] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:41.593098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.605937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01e8c2-4710-438d-a58f-c456fede3df0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:41.611750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:41.612943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.613444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.613917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] PATH_INFO: `/v3/projects/e5bb4d2328dc41fda5e7b41f3b256228/users/88323815130e4b7bbb0b66d4e1e3044b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.631745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bb4d2328dc41fda5e7b41f3b256228, user_id=88323815130e4b7bbb0b66d4e1e3044b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:41.634838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:41.667422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1870/3733] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:17:41 2022] PUT /identity/v3/projects/e5bb4d2328dc41fda5e7b41f3b256228/users/88323815130e4b7bbb0b66d4e1e3044b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:41.672426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.672752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.673001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.701180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:41.702401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:41.778711 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1864/3734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:41.790192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.792115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:41.875099 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:41.880214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245eca3-838b-4aaf-97ab-110ad1107e3d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:41.886671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936e9d7-22e9-412a-9e23-bea7bbb59c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:41.887611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936e9d7-22e9-412a-9e23-bea7bbb59c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:41.888372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936e9d7-22e9-412a-9e23-bea7bbb59c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:41.888723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936e9d7-22e9-412a-9e23-bea7bbb59c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:41.906878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936e9d7-22e9-412a-9e23-bea7bbb59c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:41.908596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936e9d7-22e9-412a-9e23-bea7bbb59c85 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:41.920323 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1871/3735] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:41.977840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:41.981326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:42.000798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e6862-153c-46a1-93a4-69bcc46addcf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:42.010033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:42.011067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:42.011338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:42.011866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] PATH_INFO: `/v3/users/233cabef7d7646f0944127d5f9e72ef5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:42.013469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233cabef7d7646f0944127d5f9e72ef5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:42.015999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:42.074072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233cabef7d7646f0944127d5f9e72ef5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:42.075307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233cabef7d7646f0944127d5f9e72ef5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:42.076137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233cabef7d7646f0944127d5f9e72ef5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:42.089022 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:42.097323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233cabef7d7646f0944127d5f9e72ef5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:42.113118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233cabef7d7646f0944127d5f9e72ef5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:42.133142 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1865/3736] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:17:41 2022] DELETE /identity/v3/users/233cabef7d7646f0944127d5f9e72ef5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:42.138303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:42.139523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:42.140329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:42.166792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:42.168877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:42.275416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1872/3737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:42.287184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:42.289786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:42.435419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3fbc0-f282-437a-b681-91dc0058e8d7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:42.440593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d8ed-5c0f-4e07-a839-91bc83616d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:42.441617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d8ed-5c0f-4e07-a839-91bc83616d5e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:42.442129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d8ed-5c0f-4e07-a839-91bc83616d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:42.442500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d8ed-5c0f-4e07-a839-91bc83616d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:42.453917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d8ed-5c0f-4e07-a839-91bc83616d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:42.456676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d8ed-5c0f-4e07-a839-91bc83616d5e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:42.468847 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1866/3738] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:17:43.189928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:43.192083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:43.205808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfb56c-f02b-4f7b-bbbe-f2dd3aaf92b7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:43.211417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:43.212257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.212730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.213006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] PATH_INFO: `/v3/projects/3a38782dd4e04460a9846b4602917021` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.215414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a38782dd4e04460a9846b4602917021)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:43.217816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:43.271138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a38782dd4e04460a9846b4602917021', 'request_id': 'req-6f83ecaf-5bb8-4a15-a2e6-745478f33052'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:43.278368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a38782dd4e04460a9846b4602917021', 'request_id': 'req-6f83ecaf-5bb8-4a15-a2e6-745478f33052'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:43.286624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a38782dd4e04460a9846b4602917021', 'request_id': 'req-6f83ecaf-5bb8-4a15-a2e6-745478f33052'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:43.299206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] The token cache is being invalidate because project 3a38782dd4e04460a9846b4602917021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:17:43.300370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:43.301252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f83ecaf-5bb8-4a15-a2e6-745478f33052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:17:43.303172 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1873/3739] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:17:43 2022] DELETE /identity/v3/projects/3a38782dd4e04460a9846b4602917021 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:43.308055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f3fd0-e954-4ae7-9fb9-b4b97597195f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.308544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f3fd0-e954-4ae7-9fb9-b4b97597195f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.308820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f3fd0-e954-4ae7-9fb9-b4b97597195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.328408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-779f3fd0-e954-4ae7-9fb9-b4b97597195f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:43.329636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-779f3fd0-e954-4ae7-9fb9-b4b97597195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:43.412156 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1867/3740] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:17:43.414764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc1199-6e16-4092-9afb-c446922bcf3e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.415091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc1199-6e16-4092-9afb-c446922bcf3e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.415364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc1199-6e16-4092-9afb-c446922bcf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.437914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-13bc1199-6e16-4092-9afb-c446922bcf3e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:43.439320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-13bc1199-6e16-4092-9afb-c446922bcf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:43.448444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1874/3741] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:43.452537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f3fd0-e954-4ae7-9fb9-b4b97597195f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:43.464836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f3fd0-e954-4ae7-9fb9-b4b97597195f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:43.470432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:43.471248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.471522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.471796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.472597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:17:43.472898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:43.474557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:43.489181 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1868/3742] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:17:43.492626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc1199-6e16-4092-9afb-c446922bcf3e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:43.504344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc1199-6e16-4092-9afb-c446922bcf3e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:43.521832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:43.522818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.523032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.523449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.524057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:43.532818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:43.569318 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1875/3743] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:17:43 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:17:43.573287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:43.589411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9c1c-50dd-4653-8c77-5c66235311fd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:43.662313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:43.662927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.663214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.663466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.664088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:43.666016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:43.683643 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:43.710272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:43.710552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1869/3744] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:17:43 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:17:43.729858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77705a-abc1-48a5-b627-abfee82b51e2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:43.738762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:43.739796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.739796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.739796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.741156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:43.743053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:43.767653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:43.779305 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1876/3745] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:17:43.781380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b039f-efb0-4a89-ae0c-e2d114a9e274 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:43.789047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1266f89-05a6-4569-b424-595d84f6f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:43.789773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1266f89-05a6-4569-b424-595d84f6f10a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.790126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1266f89-05a6-4569-b424-595d84f6f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.790580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1266f89-05a6-4569-b424-595d84f6f10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.792613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1266f89-05a6-4569-b424-595d84f6f10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:43.795238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1266f89-05a6-4569-b424-595d84f6f10a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:43.820330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:43.828624 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1870/3746] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:17:43.835269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24dea-cd36-47cc-86b2-1fa32c055a19 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:43.851683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:43.852798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.853328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.853855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] PATH_INFO: `/v3/projects/4cdc10240472419796efddcb58d626c7/users/807dad83f719457a8c83fbf239756ca6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.888032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdc10240472419796efddcb58d626c7, user_id=807dad83f719457a8c83fbf239756ca6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:43.890908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:43.911146 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1877/3747] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:17:43 2022] PUT /identity/v3/projects/4cdc10240472419796efddcb58d626c7/users/807dad83f719457a8c83fbf239756ca6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:17:43.914408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:43.914740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:43.915017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:43.937839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:43.938843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:44.061957 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1871/3748] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:44.079245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:44.081375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:44.115084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:44.119220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:44.124502 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:44.236760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9299a-9f43-4db4-87c5-a1c760646a41 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:44.246398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9af4b-a3d7-4733-884a-8fb3843a406a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:44.250580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:44.251195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:44.251320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02a95f-477e-486a-bb86-4adf1de7a770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:44.251452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:44.251740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:44.252534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a95f-477e-486a-bb86-4adf1de7a770 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:44.253031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a95f-477e-486a-bb86-4adf1de7a770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:44.253750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:44.256180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a95f-477e-486a-bb86-4adf1de7a770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:44.280244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02a95f-477e-486a-bb86-4adf1de7a770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:44.285577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02a95f-477e-486a-bb86-4adf1de7a770 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:44.314743 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1878/3749] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:44.350442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41a8a-2aea-448f-a3c8-bb182067a515 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:44.350861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41a8a-2aea-448f-a3c8-bb182067a515 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:44.351209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41a8a-2aea-448f-a3c8-bb182067a515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:44.352938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:44.355090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:44.369441 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1872/3750] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:17:44.475502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-73e41a8a-2aea-448f-a3c8-bb182067a515 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:44.477328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-73e41a8a-2aea-448f-a3c8-bb182067a515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:44.608726 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1879/3751] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:17:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 11 01:17:44.668966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:44.670844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:44.720335 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:17:44.818376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895309fe-c623-4205-b4d5-335eeb08b50e service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:44.826996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053ceab-f132-4f54-b46e-be45197ff367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:44.827921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ceab-f132-4f54-b46e-be45197ff367 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:44.828143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ceab-f132-4f54-b46e-be45197ff367 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:44.828422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053ceab-f132-4f54-b46e-be45197ff367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:44.850315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053ceab-f132-4f54-b46e-be45197ff367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:44.858182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053ceab-f132-4f54-b46e-be45197ff367 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:44.905510 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1873/3752] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:17:49.148096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41a8a-2aea-448f-a3c8-bb182067a515 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:49.163536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41a8a-2aea-448f-a3c8-bb182067a515 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:49.171072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e633b-efe9-46c8-94e1-601285ba39c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:49.171709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e633b-efe9-46c8-94e1-601285ba39c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:49.171985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e633b-efe9-46c8-94e1-601285ba39c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:49.172252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e633b-efe9-46c8-94e1-601285ba39c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:49.176302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b13e633b-efe9-46c8-94e1-601285ba39c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:49.212851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e633b-efe9-46c8-94e1-601285ba39c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:49.214920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e633b-efe9-46c8-94e1-601285ba39c9 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:49.236189 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1880/3753] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:17:53.637014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:53.637541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:53.637541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:53.719230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] MFA Rules not processed for user `88323815130e4b7bbb0b66d4e1e3044b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:53.720790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:53.969040 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1874/3754] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:17:53.981170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:53.981684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:53.981684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:54.018852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] MFA Rules not processed for user `88323815130e4b7bbb0b66d4e1e3044b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:17:54.020062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:54.048676 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1881/3755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 11 01:17:55.208045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:17:55.210085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:17:55.242656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d63205-e2ae-4f65-afcf-61a4d655b5cf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:17:55.258645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:17:55.260762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:17:55.261269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:17:55.261572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:17:55.283440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:17:55.286990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:17:55.325591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1875/3756] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:17:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:01.145345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:01.146848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:01.204018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242cbbb-411b-4f0e-8b80-06f261f28aec None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:01.221791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:01.223153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:01.225571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:01.226016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] PATH_INFO: `/v3/users/17492e3ec2dd42669f657ca506665b5f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:01.228364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17492e3ec2dd42669f657ca506665b5f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:01.235288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:01.381902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17492e3ec2dd42669f657ca506665b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:01.382791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17492e3ec2dd42669f657ca506665b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:01.383905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17492e3ec2dd42669f657ca506665b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:01.406792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17492e3ec2dd42669f657ca506665b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:01.418112 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:01.439129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19b2a41c-2462-4095-b730-a67dca5f9069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17492e3ec2dd42669f657ca506665b5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:01.491109 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1882/3757] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:01 2022] DELETE /identity/v3/users/17492e3ec2dd42669f657ca506665b5f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:02.427547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:02.448238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73470c8-e93c-4d80-a84c-da1e4eedd557 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:02.623852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:02.624637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:02.626035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:02.626035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] PATH_INFO: `/v3/projects/3f75d49409e541d099d90c42b470f36f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:02.627933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f75d49409e541d099d90c42b470f36f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:02.630237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:02.664473 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:02.780786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f75d49409e541d099d90c42b470f36f', 'request_id': 'req-eef01e24-2c10-4d24-847b-58b9e71e624e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:02.807616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f75d49409e541d099d90c42b470f36f', 'request_id': 'req-eef01e24-2c10-4d24-847b-58b9e71e624e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:02.825739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f75d49409e541d099d90c42b470f36f', 'request_id': 'req-eef01e24-2c10-4d24-847b-58b9e71e624e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:02.873319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] The token cache is being invalidate because project 3f75d49409e541d099d90c42b470f36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:02.879712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:02.882190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eef01e24-2c10-4d24-847b-58b9e71e624e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:02.888063 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1876/3758] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:02 2022] DELETE /identity/v3/projects/3f75d49409e541d099d90c42b470f36f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:02.893459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d531433-828c-428c-ba85-c4a63132c138 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:02.894577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d531433-828c-428c-ba85-c4a63132c138 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:02.895054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d531433-828c-428c-ba85-c4a63132c138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:02.934182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6d531433-828c-428c-ba85-c4a63132c138 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:02.938655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6d531433-828c-428c-ba85-c4a63132c138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:03.129810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1883/3759] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:18:03.138670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032840e8-7c77-4a7f-9b7b-a16cec101440 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:03.138947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032840e8-7c77-4a7f-9b7b-a16cec101440 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:03.139221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032840e8-7c77-4a7f-9b7b-a16cec101440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:03.208354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-032840e8-7c77-4a7f-9b7b-a16cec101440 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:03.210077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-032840e8-7c77-4a7f-9b7b-a16cec101440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:03.234550 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1877/3760] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:03.238211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d531433-828c-428c-ba85-c4a63132c138 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:03.257499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d531433-828c-428c-ba85-c4a63132c138 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:03.290434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:03.291968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:03.292506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:03.292987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:03.303229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:03.304054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:03.306559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:03.337153 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1884/3761] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:18:03.341817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032840e8-7c77-4a7f-9b7b-a16cec101440 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:03.352910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032840e8-7c77-4a7f-9b7b-a16cec101440 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:03.375626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:03.376318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:03.376591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:03.376857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:03.379899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:03.381704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:03.450069 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1878/3762] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:03 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:03.454466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:03.476135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb965e-cd97-43bf-8769-2697a3907c3f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:03.657260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:03.662811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:03.663462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:03.664003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:03.665963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:03.671726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:03.745515 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1885/3763] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:03 2022] POST /identity/v3/users => generated 280 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:03.749375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:03.777023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e86f2-f090-497d-becd-6fc6e783e830 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:03.797242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:03.798433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:03.800361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:03.802779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:03.804204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:03.806315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:03.843503 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1879/3764] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:18:03.847668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:03.862840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac18d4-668d-4418-8466-34040d2e5f0b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:03.871743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392451e-194f-47a2-b15d-341d9b65873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:03.887697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392451e-194f-47a2-b15d-341d9b65873d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:03.888180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392451e-194f-47a2-b15d-341d9b65873d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:03.889597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392451e-194f-47a2-b15d-341d9b65873d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:03.893400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392451e-194f-47a2-b15d-341d9b65873d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:03.895393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392451e-194f-47a2-b15d-341d9b65873d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:03.923717 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1886/3765] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:03.928368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:03.943310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f20bf-4bd2-446d-b767-2bb39f2d55a0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:03.954256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:03.955215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:03.955664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:03.956091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] PATH_INFO: `/v3/projects/7bf92075a8174e05ba1f4c16af2a1021/users/f9a9307e13874ea8bf2b9a217eeaf814/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:03.986899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf92075a8174e05ba1f4c16af2a1021, user_id=f9a9307e13874ea8bf2b9a217eeaf814, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:03.993629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:04.027396 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1880/3766] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:03 2022] PUT /identity/v3/projects/7bf92075a8174e05ba1f4c16af2a1021/users/f9a9307e13874ea8bf2b9a217eeaf814/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:04.040603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10b22-56f1-4ce5-89ed-613f663c1045 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:04.041394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10b22-56f1-4ce5-89ed-613f663c1045 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:04.041977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10b22-56f1-4ce5-89ed-613f663c1045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:04.137188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2ce10b22-56f1-4ce5-89ed-613f663c1045 None None] MFA Rules not processed for user `f9a9307e13874ea8bf2b9a217eeaf814`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:04.141641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2ce10b22-56f1-4ce5-89ed-613f663c1045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:04.237302 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:04.324508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1887/3767] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:04.337422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:04.341316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:04.552378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ebd6f-1fd6-4f59-846b-bd7337067154 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:04.563996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a0b6c-01e8-48cc-b1d9-dc5774b3619e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:04.567254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0b6c-01e8-48cc-b1d9-dc5774b3619e service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:04.567775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0b6c-01e8-48cc-b1d9-dc5774b3619e service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:04.568201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0b6c-01e8-48cc-b1d9-dc5774b3619e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:04.585440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a0b6c-01e8-48cc-b1d9-dc5774b3619e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:04.588253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a0b6c-01e8-48cc-b1d9-dc5774b3619e service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:04.626784 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1881/3768] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:04.685962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10b22-56f1-4ce5-89ed-613f663c1045 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:04.835522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10b22-56f1-4ce5-89ed-613f663c1045 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:04.842612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:04.845764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:04.846044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:04.846324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] PATH_INFO: `/v3/users/f9a9307e13874ea8bf2b9a217eeaf814` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:04.847646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a9307e13874ea8bf2b9a217eeaf814)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:04.849923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:04.969560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a9307e13874ea8bf2b9a217eeaf814'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:04.971656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a9307e13874ea8bf2b9a217eeaf814'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:04.972741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a9307e13874ea8bf2b9a217eeaf814'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:05.003189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a9307e13874ea8bf2b9a217eeaf814'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:05.033283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a9307e13874ea8bf2b9a217eeaf814'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:05.073001 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1888/3769] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:04 2022] DELETE /identity/v3/users/f9a9307e13874ea8bf2b9a217eeaf814 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:05.075894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74261c-f9a6-4b75-ac8d-e0a88cf4d25a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:05.076477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74261c-f9a6-4b75-ac8d-e0a88cf4d25a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:05.077079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74261c-f9a6-4b75-ac8d-e0a88cf4d25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:05.116884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8f74261c-f9a6-4b75-ac8d-e0a88cf4d25a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:05.119654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8f74261c-f9a6-4b75-ac8d-e0a88cf4d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:05.172709 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:05.262619 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1882/3770] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:05.316624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:05.318153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:05.610156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e649b7-218d-4ba2-9db9-96d65471590b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:05.618901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:05.619575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:05.619848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:05.620143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:05.658549 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:05.674949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:05.679700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:05.727282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1889/3771] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:06.402109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:06.402945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:06.403150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:06.439454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] MFA Rules not processed for user `807dad83f719457a8c83fbf239756ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:06.441273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:06.599334 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1883/3772] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:06.612358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:06.613924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:06.809634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d602-423b-47c7-bdc2-b67ca625978f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:06.828297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:06.829249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:06.829720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:06.830158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:06.845123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:06.852991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:06.872933 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1890/3773] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:07.706256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:07.708105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:07.927105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd8c11-b966-458b-8d8a-a6a16438948d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:07.945620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:07.946401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:07.946869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:07.947989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:07.957842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:07.985359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:07.986466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:08.020335 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1884/3774] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:08.098281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:08.100389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:08.124226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d0cfd-dcdc-4a03-93c1-825831fbdf8c service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:08.141626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:08.142603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:08.143103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:08.143602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] PATH_INFO: `/v3/users/dd6e83da2af04abd80a11ffe43f10d7d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:08.147405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6e83da2af04abd80a11ffe43f10d7d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:08.149605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:08.272441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6e83da2af04abd80a11ffe43f10d7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.273600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6e83da2af04abd80a11ffe43f10d7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.277555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6e83da2af04abd80a11ffe43f10d7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.312260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6e83da2af04abd80a11ffe43f10d7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.354212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3de15558-f2ba-4303-a6ea-75d53a77a155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6e83da2af04abd80a11ffe43f10d7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.376784 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1891/3775] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:08 2022] DELETE /identity/v3/users/dd6e83da2af04abd80a11ffe43f10d7d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:08.559971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:08.563102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:08.597932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a0d7-ed6c-4f5e-b04b-505fb7a1f4c1 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:08.705751 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:08.755332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:08.757009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:08.757577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:08.758126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] PATH_INFO: `/v3/projects/7bf92075a8174e05ba1f4c16af2a1021` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:08.760741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf92075a8174e05ba1f4c16af2a1021)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:08.765349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:08.881440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf92075a8174e05ba1f4c16af2a1021', 'request_id': 'req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.894444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf92075a8174e05ba1f4c16af2a1021', 'request_id': 'req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.908670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf92075a8174e05ba1f4c16af2a1021', 'request_id': 'req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.937945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] The token cache is being invalidate because project 7bf92075a8174e05ba1f4c16af2a1021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:08.938590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.941951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf71f5c3-8c66-4f07-b18c-63e44ec0c3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:08.948126 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1885/3776] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:08 2022] DELETE /identity/v3/projects/7bf92075a8174e05ba1f4c16af2a1021 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:08.951422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07afbf9-6766-478a-a559-6af4c0ad4858 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:08.951744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07afbf9-6766-478a-a559-6af4c0ad4858 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:08.953105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07afbf9-6766-478a-a559-6af4c0ad4858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.007391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d07afbf9-6766-478a-a559-6af4c0ad4858 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:09.008942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d07afbf9-6766-478a-a559-6af4c0ad4858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:09.150443 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:09.196839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28c607-c36a-40e0-8f64-b77283c0aced None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:09.197302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28c607-c36a-40e0-8f64-b77283c0aced None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:09.197578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28c607-c36a-40e0-8f64-b77283c0aced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.200583 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1892/3777] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:09.244880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-de28c607-c36a-40e0-8f64-b77283c0aced None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:09.246510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-de28c607-c36a-40e0-8f64-b77283c0aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:09.274416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07afbf9-6766-478a-a559-6af4c0ad4858 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:09.280682 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1886/3778] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:09.290561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07afbf9-6766-478a-a559-6af4c0ad4858 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:09.311726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:09.315782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:09.316325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:09.316764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.317640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:09.319695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:09.321612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:09.369584 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1893/3779] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:18:09.371265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28c607-c36a-40e0-8f64-b77283c0aced None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:09.384215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28c607-c36a-40e0-8f64-b77283c0aced None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:09.404388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:09.405331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:09.405798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:09.406236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.407085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:09.409292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:09.482918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1887/3780] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:09 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:18:09.484325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:09.503839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f6ef4-0ed0-4708-b524-8c182dd28201 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:09.675571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:09.676446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:09.676893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:09.677369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.679093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:09.681242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:09.737078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:09.749159 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1894/3781] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:09 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:09.756840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c331e-0fc7-431d-ba55-bf2d6026ae10 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:09.786875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:09.788185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:09.791332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:09.791898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.793762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:09.798126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:09.801991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:09.804273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:09.834619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5fd8-3e6f-4afb-ab9f-e6968e90c851 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:09.851289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1888/3782] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:09.853810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:09.856897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:09.857905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:09.861735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:09.866567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] PATH_INFO: `/v3/projects/3da56c27fa70412585b4a14c3488b700` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.871211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da56c27fa70412585b4a14c3488b700)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:09.873794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:09.895850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed529-2934-40f7-8de3-ff61235bc7ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:09.915355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:09.916572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:09.916855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:09.925226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:09.928133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:09.933990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:09.982839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1889/3783] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:09.985837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:10.015237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444198a-b136-4fc2-9d87-989a8bc58b7e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:10.057638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da56c27fa70412585b4a14c3488b700', 'request_id': 'req-cb37833c-4885-462e-88c2-a53fb081f668'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:10.089595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da56c27fa70412585b4a14c3488b700', 'request_id': 'req-cb37833c-4885-462e-88c2-a53fb081f668'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:10.115677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da56c27fa70412585b4a14c3488b700', 'request_id': 'req-cb37833c-4885-462e-88c2-a53fb081f668'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:10.161592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] The token cache is being invalidate because project 3da56c27fa70412585b4a14c3488b700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:10.162279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:10.165575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb37833c-4885-462e-88c2-a53fb081f668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:10.176142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1895/3784] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:09 2022] DELETE /identity/v3/projects/3da56c27fa70412585b4a14c3488b700 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:18:10.187338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653987-6c6d-4ec0-988a-7a07b9eca30d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:10.187623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653987-6c6d-4ec0-988a-7a07b9eca30d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:10.190098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653987-6c6d-4ec0-988a-7a07b9eca30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:10.288919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e4653987-6c6d-4ec0-988a-7a07b9eca30d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:10.294204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4653987-6c6d-4ec0-988a-7a07b9eca30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:10.297634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79286-df75-4e81-ae4d-ef776f2ff843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:10.298307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79286-df75-4e81-ae4d-ef776f2ff843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:10.298594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79286-df75-4e81-ae4d-ef776f2ff843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:10.298900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79286-df75-4e81-ae4d-ef776f2ff843 admin admin] PATH_INFO: `/v3/projects/6978a4495b634054befbe0ae0b06634e/users/727349587bce493c9325266e31895db9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:10.335009 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1896/3785] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:10.340739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44809-744c-45ce-bc50-77eb4aa6f80b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:10.344712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44809-744c-45ce-bc50-77eb4aa6f80b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:10.345244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44809-744c-45ce-bc50-77eb4aa6f80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:10.377489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79286-df75-4e81-ae4d-ef776f2ff843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6978a4495b634054befbe0ae0b06634e, user_id=727349587bce493c9325266e31895db9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:10.386658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79286-df75-4e81-ae4d-ef776f2ff843 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:10.453827 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1890/3786] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:09 2022] PUT /identity/v3/projects/6978a4495b634054befbe0ae0b06634e/users/727349587bce493c9325266e31895db9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:10.455504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf2def-77d7-411a-8330-31f7b2da731a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:10.455828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf2def-77d7-411a-8330-31f7b2da731a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:10.456108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf2def-77d7-411a-8330-31f7b2da731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:10.457331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-76d44809-744c-45ce-bc50-77eb4aa6f80b None None] MFA Rules not processed for user `807dad83f719457a8c83fbf239756ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:10.466266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-76d44809-744c-45ce-bc50-77eb4aa6f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:10.522812 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:10.553479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dadf2def-77d7-411a-8330-31f7b2da731a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:10.554932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dadf2def-77d7-411a-8330-31f7b2da731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:10.606707 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:10.652011 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1897/3787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:10.652011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8506627-35c3-42f1-9d9a-5864df0c0317 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:10.652011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8506627-35c3-42f1-9d9a-5864df0c0317 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:10.652011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8506627-35c3-42f1-9d9a-5864df0c0317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:10.710812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c8506627-35c3-42f1-9d9a-5864df0c0317 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:10.711861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8506627-35c3-42f1-9d9a-5864df0c0317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:10.836397 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1891/3788] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:10.841837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf2def-77d7-411a-8330-31f7b2da731a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:10.872770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf2def-77d7-411a-8330-31f7b2da731a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:10.884104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:10.887737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:10.888736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:10.889690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:10.890865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:10.892543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:10.897079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:10.904123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1898/3789] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:10.941846 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1892/3790] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:18:10.942908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8506627-35c3-42f1-9d9a-5864df0c0317 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:10.953929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:10.955323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8506627-35c3-42f1-9d9a-5864df0c0317 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:10.956866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:10.967414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:10.968022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:10.968297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:10.968566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:10.975512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:10.977604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:11.057918 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1899/3791] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:18:11.058368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:11.111149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ddf8-c6ba-4b87-8e16-ca25ebb335fe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:11.199540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125e1d9-8d1e-4d8e-9e59-88ad0eff3463 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:11.220187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:11.221003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:11.221447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:11.221833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:11.223620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:11.228054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:11.238531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:11.239457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:11.239742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:11.240010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:11.271768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:11.273236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:11.278798 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1900/3792] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:11 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:18:11.280013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:11.299699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593690-8385-446a-9914-d256f602bfd5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:11.309995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:11.311377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:11.311989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:11.312593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:11.313560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:11.315829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:11.329511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1893/3793] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:18:11.344957 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1901/3794] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:11.345900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:11.365967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1089c-0e64-46b4-a97c-00cc0ca58a9c service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:11.378851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691bec-7952-4413-a186-9355d5e452f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:11.379485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691bec-7952-4413-a186-9355d5e452f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:11.379763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691bec-7952-4413-a186-9355d5e452f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:11.380032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691bec-7952-4413-a186-9355d5e452f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:11.380679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691bec-7952-4413-a186-9355d5e452f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:11.391012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691bec-7952-4413-a186-9355d5e452f7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:11.432677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:11.440583 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1894/3795] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:11.455249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6438-1bb9-4ce0-a514-e0176b4a2250 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:11.472953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:11.473789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:11.474135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:11.474647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] PATH_INFO: `/v3/projects/5b874a08ad8c45c2b647b23282421231/users/194661158e4f4ead963fc5b11e7c5730/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:11.541514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b874a08ad8c45c2b647b23282421231, user_id=194661158e4f4ead963fc5b11e7c5730, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:11.544196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:11.615025 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1902/3796] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:11 2022] PUT /identity/v3/projects/5b874a08ad8c45c2b647b23282421231/users/194661158e4f4ead963fc5b11e7c5730/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:11.618196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067d36-2779-425b-bfb7-7724eb2a4a31 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:11.618487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067d36-2779-425b-bfb7-7724eb2a4a31 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:11.618789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067d36-2779-425b-bfb7-7724eb2a4a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:11.719193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-28067d36-2779-425b-bfb7-7724eb2a4a31 None None] MFA Rules not processed for user `194661158e4f4ead963fc5b11e7c5730`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:11.724973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-28067d36-2779-425b-bfb7-7724eb2a4a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:11.859953 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:12.000494 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1895/3797] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:12.013753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:12.018697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:12.114862 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:12.265244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99069d-9bd9-4cc6-876e-12ab24952e46 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:12.271113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:12.271890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:12.272240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:12.272619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:12.287114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:12.289079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:12.303131 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1903/3798] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:12.566278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:12.566704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:12.567159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:12.601374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:12.603147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:12.703419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1896/3799] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:18:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:12.721143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:12.722895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:12.760055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:12.762234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:12.816590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1598e-1066-4566-981c-e450fd4a0ca9 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:12.822185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78186488-f317-4603-a41c-dae2efcd492e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:12.823131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78186488-f317-4603-a41c-dae2efcd492e service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:12.823484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78186488-f317-4603-a41c-dae2efcd492e service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:12.823837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78186488-f317-4603-a41c-dae2efcd492e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:12.833209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78186488-f317-4603-a41c-dae2efcd492e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:12.834831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78186488-f317-4603-a41c-dae2efcd492e service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:12.852589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1904/3800] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:18:12.864256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4337e7-30e2-4343-9991-948ca42f375e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:12.883617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d429c-8bfd-404c-bf47-fc0855c8b923 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:12.886319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d429c-8bfd-404c-bf47-fc0855c8b923 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:12.886716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d429c-8bfd-404c-bf47-fc0855c8b923 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:12.887206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d429c-8bfd-404c-bf47-fc0855c8b923 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:12.890001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6b9d429c-8bfd-404c-bf47-fc0855c8b923 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:12.906780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d429c-8bfd-404c-bf47-fc0855c8b923 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:12.908965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d429c-8bfd-404c-bf47-fc0855c8b923 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:12.933438 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1897/3801] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:13.396454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0d67-4cf4-4207-ba7b-03f4ba6dbcdb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:13.397642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0d67-4cf4-4207-ba7b-03f4ba6dbcdb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:13.398175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0d67-4cf4-4207-ba7b-03f4ba6dbcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:13.473101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-addc0d67-4cf4-4207-ba7b-03f4ba6dbcdb None None] MFA Rules not processed for user `727349587bce493c9325266e31895db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:13.475536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-addc0d67-4cf4-4207-ba7b-03f4ba6dbcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:13.673705 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1905/3802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:13.686669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:13.686669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:13.686669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:13.710965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] MFA Rules not processed for user `727349587bce493c9325266e31895db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:13.712364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:13.732654 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1898/3803] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:13.734772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:13.735069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:13.735350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:13.761811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] MFA Rules not processed for user `727349587bce493c9325266e31895db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:13.763497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:13.776812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1906/3804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:13.789072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:13.791267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:13.894923 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:13.935714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e43f4c-d1e4-49ba-a792-9f66b3e555a5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:13.943877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:13.944504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:13.944772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:13.945321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:13.963445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:13.964694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:13.965346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:13.967151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:13.991240 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1899/3805] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:14.003549 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:14.079932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37d096-6ffa-4874-a7b3-b58328a8418d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:14.085543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:14.086226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:14.086557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:14.086730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] PATH_INFO: `/v3/users/9f722129f5a74400a3ddbbbf65ea81bd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:14.088540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f722129f5a74400a3ddbbbf65ea81bd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:14.093030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:14.192508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f722129f5a74400a3ddbbbf65ea81bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:14.194319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f722129f5a74400a3ddbbbf65ea81bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:14.196023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f722129f5a74400a3ddbbbf65ea81bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:14.208187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f722129f5a74400a3ddbbbf65ea81bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:14.233524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-62cbc67f-2981-4693-9d8a-88920a971b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f722129f5a74400a3ddbbbf65ea81bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:14.258063 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1907/3806] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:13 2022] DELETE /identity/v3/users/9f722129f5a74400a3ddbbbf65ea81bd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:14.990190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:15.014543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e6c05-029f-4bc8-9355-30fa3cc51a41 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:15.110034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:15.110744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:15.111212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:15.111641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] PATH_INFO: `/v3/projects/451fe9691d984c8fa8e48279584a5eb3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:15.113516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451fe9691d984c8fa8e48279584a5eb3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:15.116030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:15.199458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451fe9691d984c8fa8e48279584a5eb3', 'request_id': 'req-62460f81-2403-443a-97dd-4e3d67a555b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:15.207823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e79f-42da-4e9d-a919-d5bb4f188d37 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:15.208258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e79f-42da-4e9d-a919-d5bb4f188d37 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:15.208404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333e79f-42da-4e9d-a919-d5bb4f188d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:15.218601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451fe9691d984c8fa8e48279584a5eb3', 'request_id': 'req-62460f81-2403-443a-97dd-4e3d67a555b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:15.234901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451fe9691d984c8fa8e48279584a5eb3', 'request_id': 'req-62460f81-2403-443a-97dd-4e3d67a555b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:15.258245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] The token cache is being invalidate because project 451fe9691d984c8fa8e48279584a5eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:15.259024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:15.260838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62460f81-2403-443a-97dd-4e3d67a555b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:15.283836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4333e79f-42da-4e9d-a919-d5bb4f188d37 None None] MFA Rules not processed for user `727349587bce493c9325266e31895db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:15.283991 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1900/3807] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:14 2022] DELETE /identity/v3/projects/451fe9691d984c8fa8e48279584a5eb3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:15.285100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4333e79f-42da-4e9d-a919-d5bb4f188d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:15.285748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318399-9cd5-4f22-836f-f3e99f32e81a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:15.286240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318399-9cd5-4f22-836f-f3e99f32e81a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:15.295023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318399-9cd5-4f22-836f-f3e99f32e81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:15.332111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-35318399-9cd5-4f22-836f-f3e99f32e81a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:15.333670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35318399-9cd5-4f22-836f-f3e99f32e81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:15.454462 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1908/3808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:18:15.475437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1901/3809] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:15.483543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e605c-b9dd-4687-ad1a-34974f6d1953 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:15.483841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e605c-b9dd-4687-ad1a-34974f6d1953 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:15.484117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e605c-b9dd-4687-ad1a-34974f6d1953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:15.533974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7b6e605c-b9dd-4687-ad1a-34974f6d1953 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:15.535206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7b6e605c-b9dd-4687-ad1a-34974f6d1953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:15.563484 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1909/3810] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:15.567538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35318399-9cd5-4f22-836f-f3e99f32e81a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:15.581574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35318399-9cd5-4f22-836f-f3e99f32e81a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:15.626805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:15.627432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:15.627703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:15.627965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:15.628616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:15.628916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:15.630523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:15.708774 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1902/3811] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:18:15.713414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e605c-b9dd-4687-ad1a-34974f6d1953 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:15.725508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e605c-b9dd-4687-ad1a-34974f6d1953 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:15.732586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:15.733443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:15.733571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:15.733817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:15.734452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:15.736420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:15.805671 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1910/3812] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:15 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:15.808799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:15.818327 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:15.834506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf09c-b381-4bf2-93ec-3b6c7875f641 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:16.001178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:16.004092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:16.004389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:16.006958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:16.010204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:16.019780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:16.086608 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1903/3813] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:15 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:16.091626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:16.105801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d15fe-e4af-4834-9845-25f85f6e5ffc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:16.111476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:16.112420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:16.114024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:16.114642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:16.115856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:16.118751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:16.132483 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1911/3814] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:16.136842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:16.151753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec966431-2340-4398-aa34-ad32252d7d11 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:16.162968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785779b-bd87-4374-8927-07a186bc92fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:16.164059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785779b-bd87-4374-8927-07a186bc92fa admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:16.164619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785779b-bd87-4374-8927-07a186bc92fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:16.165196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785779b-bd87-4374-8927-07a186bc92fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:16.167406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785779b-bd87-4374-8927-07a186bc92fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:16.169769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785779b-bd87-4374-8927-07a186bc92fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:16.227277 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1904/3815] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:16.232930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:16.241230 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:16.250437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13276d-f8e8-4024-a143-6a04eacd4cb0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:16.261712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:16.262534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:16.262825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:16.263173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] PATH_INFO: `/v3/projects/bec277c86f7749cebd0635dcfde3518d/users/eefc130baa41461584a6e497329381ba/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:16.342947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec277c86f7749cebd0635dcfde3518d, user_id=eefc130baa41461584a6e497329381ba, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:16.353932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:16.386565 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1912/3816] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:16 2022] PUT /identity/v3/projects/bec277c86f7749cebd0635dcfde3518d/users/eefc130baa41461584a6e497329381ba/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:16.391736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d551ab-3295-4967-b2fa-dba76e938920 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:16.392384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d551ab-3295-4967-b2fa-dba76e938920 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:16.392857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d551ab-3295-4967-b2fa-dba76e938920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:16.423497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-83d551ab-3295-4967-b2fa-dba76e938920 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:16.424148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-83d551ab-3295-4967-b2fa-dba76e938920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:16.564796 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1905/3817] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:16.608524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:16.610491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:16.747078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50cfd1-b9ca-4783-85cd-5647a0c274d5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:16.754972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:16.756904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:16.757345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:16.757850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:16.783612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:16.785276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:16.800114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1913/3818] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:17.023480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f1aa-b2bf-406b-b96a-efc207e4763d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:17.025279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f1aa-b2bf-406b-b96a-efc207e4763d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:17.026004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f1aa-b2bf-406b-b96a-efc207e4763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:17.089797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-73f1f1aa-b2bf-406b-b96a-efc207e4763d None None] MFA Rules not processed for user `727349587bce493c9325266e31895db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:17.098146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-73f1f1aa-b2bf-406b-b96a-efc207e4763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:17.236729 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1906/3819] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:18.978868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:18.981047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:19.186721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde38aff-cadc-4c84-873a-6839e356ca9c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:19.199533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:19.199943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:19.200323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:19.200744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:19.204056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:19.220964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:19.223803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:19.254781 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1914/3820] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:21.737680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f1aa-b2bf-406b-b96a-efc207e4763d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:21.775513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f1aa-b2bf-406b-b96a-efc207e4763d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:21.792175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266ccd1-fa78-42b7-9544-f364a3b569cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:21.793285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266ccd1-fa78-42b7-9544-f364a3b569cd service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:21.793716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266ccd1-fa78-42b7-9544-f364a3b569cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:21.794166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266ccd1-fa78-42b7-9544-f364a3b569cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:21.796166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7266ccd1-fa78-42b7-9544-f364a3b569cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:21.807581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266ccd1-fa78-42b7-9544-f364a3b569cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:21.809358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266ccd1-fa78-42b7-9544-f364a3b569cd service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:21.822290 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1907/3821] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:21.865088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:21.866575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:21.885137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc8f79-921f-448c-bf0b-34278e6151c4 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:21.889717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:21.890406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:21.890946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:21.891316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:21.904540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:21.906402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:21.923359 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1915/3822] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:22.173521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:22.174350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:22.175038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:22.204445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:22.206245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:22.217282 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:22.280816 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1908/3823] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:22.295236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:22.296804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:22.383672 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:22.412566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca86af3-29a9-4b54-bff1-56d64e678805 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:22.419165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:22.420159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:22.420659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:22.421291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:22.432253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:22.434957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:22.445790 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1916/3824] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:18:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:18:23.223778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:23.225362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:23.262946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8cf4d-ded6-412a-8b5c-3dace5881e5d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:23.268855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508ea14-d2ba-4656-83cc-e1d99e21c317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:23.269520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508ea14-d2ba-4656-83cc-e1d99e21c317 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:23.269797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508ea14-d2ba-4656-83cc-e1d99e21c317 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:23.270063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508ea14-d2ba-4656-83cc-e1d99e21c317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:23.272124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c508ea14-d2ba-4656-83cc-e1d99e21c317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:23.289153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508ea14-d2ba-4656-83cc-e1d99e21c317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:23.293387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508ea14-d2ba-4656-83cc-e1d99e21c317 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:23.307839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1909/3825] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:24.453134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:24.455605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:24.561719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eadc6d-2ed8-4ddc-a651-ade4a4fcda01 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:24.567379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfabcf-fb57-4742-8c4d-84717cfba598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:24.567969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfabcf-fb57-4742-8c4d-84717cfba598 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:24.568277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfabcf-fb57-4742-8c4d-84717cfba598 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:24.568522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfabcf-fb57-4742-8c4d-84717cfba598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:24.570376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23dfabcf-fb57-4742-8c4d-84717cfba598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:24.586490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfabcf-fb57-4742-8c4d-84717cfba598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:24.589242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfabcf-fb57-4742-8c4d-84717cfba598 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:24.610064 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1917/3826] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:26.117366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564116-661c-47e5-ae00-f10bf6017100 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:26.117928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564116-661c-47e5-ae00-f10bf6017100 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:26.118158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564116-661c-47e5-ae00-f10bf6017100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:26.158690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-53564116-661c-47e5-ae00-f10bf6017100 None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:26.160530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-53564116-661c-47e5-ae00-f10bf6017100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:26.266103 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1910/3827] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:29.898333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8648d-974a-4671-bc47-f9f37ba6712c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:29.898919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8648d-974a-4671-bc47-f9f37ba6712c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:29.898919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8648d-974a-4671-bc47-f9f37ba6712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:30.000102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8bf8648d-974a-4671-bc47-f9f37ba6712c None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:30.002550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8bf8648d-974a-4671-bc47-f9f37ba6712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:30.162723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1918/3828] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:30.173947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583537e-5d58-4a96-92d7-25c9f6538161 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:30.174471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583537e-5d58-4a96-92d7-25c9f6538161 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:30.174729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583537e-5d58-4a96-92d7-25c9f6538161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:30.228828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f583537e-5d58-4a96-92d7-25c9f6538161 None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:30.233492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f583537e-5d58-4a96-92d7-25c9f6538161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:30.258287 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1911/3829] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:31.181082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8648d-974a-4671-bc47-f9f37ba6712c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:31.199975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8648d-974a-4671-bc47-f9f37ba6712c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:31.206153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:31.206937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:31.207212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:31.207482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:31.220179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:31.221817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:31.232948 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1919/3830] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:32.775117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:32.775651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:32.775651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:32.811228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:32.812920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:32.843683 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1912/3831] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:32.858796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:32.874754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d95b-e8ca-4d2d-b681-05c0fcf15e91 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:32.882799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f4d9d-92a5-46cf-9336-6e9b3be3717c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:32.884090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f4d9d-92a5-46cf-9336-6e9b3be3717c service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:32.885198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f4d9d-92a5-46cf-9336-6e9b3be3717c service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:32.886152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f4d9d-92a5-46cf-9336-6e9b3be3717c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:32.898352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f4d9d-92a5-46cf-9336-6e9b3be3717c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:32.902109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f4d9d-92a5-46cf-9336-6e9b3be3717c service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:32.915359 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1920/3832] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:18:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:18:33.078127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:33.080347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:33.119918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680820c-01f2-48d8-843e-217de6353b20 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:33.128233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:33.128888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:33.129459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:33.129929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] PATH_INFO: `/v3/users/194661158e4f4ead963fc5b11e7c5730` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:33.131506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194661158e4f4ead963fc5b11e7c5730)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:33.135019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:33.213546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194661158e4f4ead963fc5b11e7c5730'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:33.214322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194661158e4f4ead963fc5b11e7c5730'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:33.214840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194661158e4f4ead963fc5b11e7c5730'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:33.235935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194661158e4f4ead963fc5b11e7c5730'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:33.246091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194661158e4f4ead963fc5b11e7c5730'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:33.272364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1913/3833] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:33 2022] DELETE /identity/v3/users/194661158e4f4ead963fc5b11e7c5730 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:33.277521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:33.278022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:33.279131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:33.315973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:33.317287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:33.368480 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:33.406573 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1921/3834] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:33.417010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:33.418557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:33.434371 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:33.539858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85ff2-06ea-42f9-94f6-60fb3a9ef0e6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:33.544809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240d715-e11e-4734-afc1-fa226cf0141a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:33.545798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240d715-e11e-4734-afc1-fa226cf0141a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:33.546246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240d715-e11e-4734-afc1-fa226cf0141a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:33.546831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240d715-e11e-4734-afc1-fa226cf0141a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:33.560223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240d715-e11e-4734-afc1-fa226cf0141a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:33.562134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240d715-e11e-4734-afc1-fa226cf0141a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:33.575956 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1914/3835] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:34.117789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:34.120207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:34.161107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ff4e0-925e-416f-9cc4-5f186df4dc07 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:34.170373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:34.172301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.173016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.173534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] PATH_INFO: `/v3/projects/5b874a08ad8c45c2b647b23282421231` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.183370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b874a08ad8c45c2b647b23282421231)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:34.187330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:34.257828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b874a08ad8c45c2b647b23282421231', 'request_id': 'req-6716696d-445f-430f-a98a-ec68f9bfa348'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:34.269570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b874a08ad8c45c2b647b23282421231', 'request_id': 'req-6716696d-445f-430f-a98a-ec68f9bfa348'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:34.280816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b874a08ad8c45c2b647b23282421231', 'request_id': 'req-6716696d-445f-430f-a98a-ec68f9bfa348'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:34.298656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] The token cache is being invalidate because project 5b874a08ad8c45c2b647b23282421231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:34.298945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:34.299921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6716696d-445f-430f-a98a-ec68f9bfa348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:34.301751 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1922/3836] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:34 2022] DELETE /identity/v3/projects/5b874a08ad8c45c2b647b23282421231 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:34.307608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb4fe5-1f8f-47ed-97c7-10085036630b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.308712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb4fe5-1f8f-47ed-97c7-10085036630b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.309010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb4fe5-1f8f-47ed-97c7-10085036630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.332454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a1fb4fe5-1f8f-47ed-97c7-10085036630b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:34.333697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a1fb4fe5-1f8f-47ed-97c7-10085036630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:34.416079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1915/3837] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:34.424479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5e789-2cf2-46d8-8a71-abf8de8e8bb2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.424764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5e789-2cf2-46d8-8a71-abf8de8e8bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.425442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5e789-2cf2-46d8-8a71-abf8de8e8bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.449773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-84e5e789-2cf2-46d8-8a71-abf8de8e8bb2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:34.451372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-84e5e789-2cf2-46d8-8a71-abf8de8e8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:34.465638 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1923/3838] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:34.467361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb4fe5-1f8f-47ed-97c7-10085036630b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:34.479476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb4fe5-1f8f-47ed-97c7-10085036630b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:34.484302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:34.484927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.485246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.485717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.486515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:34.486820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:34.488415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:34.512570 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1916/3839] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:18:34.516878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5e789-2cf2-46d8-8a71-abf8de8e8bb2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:34.534365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5e789-2cf2-46d8-8a71-abf8de8e8bb2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:34.542341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:34.544143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.544608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.545799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.546612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:34.550916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:34.625321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:34.637117 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1924/3840] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:34 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:34.639563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34e0b-2c29-48a6-a6e3-65e4ffc36cf7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:34.767536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:34.768559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.769285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.770338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.771535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:34.773739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:34.822188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:34.829787 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1917/3841] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:34 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:34.834116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d7c46-ab6d-41cb-a337-c5c5e721fd24 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:34.840031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:34.841273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.841517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.841857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.842623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:34.859211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:34.888538 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1925/3842] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:34.893574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:34.907946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a133a-f257-49a2-801f-297f0368173f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:34.919471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0106aa-5f8c-4fbe-ab95-97ff6b62f9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:34.922578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0106aa-5f8c-4fbe-ab95-97ff6b62f9de admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.922972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0106aa-5f8c-4fbe-ab95-97ff6b62f9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.923355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0106aa-5f8c-4fbe-ab95-97ff6b62f9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:34.924929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0106aa-5f8c-4fbe-ab95-97ff6b62f9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:34.927895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0106aa-5f8c-4fbe-ab95-97ff6b62f9de admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:34.954826 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1918/3843] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:34.955596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:34.974560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb273c1-0630-4e73-b6fb-c9dde3d74cb1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:34.991951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:34.992656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:34.993653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:34.994078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] PATH_INFO: `/v3/projects/af6dc4665bf44c09881985fcd63117e5/users/9fdb77980af84574812088ed93c00f25/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:35.026044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6dc4665bf44c09881985fcd63117e5, user_id=9fdb77980af84574812088ed93c00f25, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:35.030892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:35.054282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1926/3844] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:34 2022] PUT /identity/v3/projects/af6dc4665bf44c09881985fcd63117e5/users/9fdb77980af84574812088ed93c00f25/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:18:35.060902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c6b0-5722-4034-9a23-59d969f5e51e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:35.061225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c6b0-5722-4034-9a23-59d969f5e51e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:35.061713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2c6b0-5722-4034-9a23-59d969f5e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:35.129550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-36e2c6b0-5722-4034-9a23-59d969f5e51e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:35.131491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-36e2c6b0-5722-4034-9a23-59d969f5e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:35.157589 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:35.327271 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1919/3845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:35.429985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:35.433308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:35.503613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12e73-98bf-46fe-8b06-8223d2d4e476 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:35.507627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d609de-ca96-48c7-b2a7-d620ea7bb48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:35.508506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d609de-ca96-48c7-b2a7-d620ea7bb48f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:35.510328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d609de-ca96-48c7-b2a7-d620ea7bb48f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:35.511355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d609de-ca96-48c7-b2a7-d620ea7bb48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:35.523844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d609de-ca96-48c7-b2a7-d620ea7bb48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:35.530014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d609de-ca96-48c7-b2a7-d620ea7bb48f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:35.544173 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:35.549777 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1927/3846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:43.616354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:43.619525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:43.620027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:43.666389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] MFA Rules not processed for user `9fdb77980af84574812088ed93c00f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:43.667862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:43.820066 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1920/3847] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:43.832968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:43.833610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:43.833610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:43.859616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] MFA Rules not processed for user `9fdb77980af84574812088ed93c00f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:43.860872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:43.873689 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1928/3848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:44.355015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:44.356587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:44.547779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32e7ba-df81-441f-88f9-3097067e7970 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:44.556701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35808e1e-db31-4a38-a2e6-d2ff755e09b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:44.557367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808e1e-db31-4a38-a2e6-d2ff755e09b8 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:44.557659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808e1e-db31-4a38-a2e6-d2ff755e09b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:44.557924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808e1e-db31-4a38-a2e6-d2ff755e09b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:44.579481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35808e1e-db31-4a38-a2e6-d2ff755e09b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:44.581365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35808e1e-db31-4a38-a2e6-d2ff755e09b8 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:44.597278 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1921/3849] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:50.692876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:50.695526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:50.717301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7c9f3-6532-4690-a20e-22df6a5b6e11 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:50.725544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:50.726503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:50.726919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:50.727435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] PATH_INFO: `/v3/users/88323815130e4b7bbb0b66d4e1e3044b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:50.729050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88323815130e4b7bbb0b66d4e1e3044b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:50.732620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:50.831615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88323815130e4b7bbb0b66d4e1e3044b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:50.832517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88323815130e4b7bbb0b66d4e1e3044b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:50.833178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88323815130e4b7bbb0b66d4e1e3044b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:50.843534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88323815130e4b7bbb0b66d4e1e3044b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:50.860482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88323815130e4b7bbb0b66d4e1e3044b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:50.886067 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1929/3850] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:50 2022] DELETE /identity/v3/users/88323815130e4b7bbb0b66d4e1e3044b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:51.544960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4ba5-f82b-4248-ad40-915473ff4822 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:51.544960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4ba5-f82b-4248-ad40-915473ff4822 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:51.544960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4ba5-f82b-4248-ad40-915473ff4822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:51.573454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a5ed4ba5-f82b-4248-ad40-915473ff4822 None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:51.574802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a5ed4ba5-f82b-4248-ad40-915473ff4822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:51.643510 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:51.716662 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1922/3851] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:52.308812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:52.310869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:52.514120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953aa60-5374-468a-82f8-47aca6891633 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:52.522570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:52.523538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:52.524086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:52.524535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] PATH_INFO: `/v3/projects/e5bb4d2328dc41fda5e7b41f3b256228` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:52.526121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bb4d2328dc41fda5e7b41f3b256228)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:52.533673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:52.608055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bb4d2328dc41fda5e7b41f3b256228', 'request_id': 'req-c4fba769-114b-4451-ad85-d81ef8c53156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:52.616119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bb4d2328dc41fda5e7b41f3b256228', 'request_id': 'req-c4fba769-114b-4451-ad85-d81ef8c53156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:52.631109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bb4d2328dc41fda5e7b41f3b256228', 'request_id': 'req-c4fba769-114b-4451-ad85-d81ef8c53156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:52.639303 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:52.648693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] The token cache is being invalidate because project e5bb4d2328dc41fda5e7b41f3b256228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:52.649373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:52.650754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c4fba769-114b-4451-ad85-d81ef8c53156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:52.658994 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1930/3852] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:52 2022] DELETE /identity/v3/projects/e5bb4d2328dc41fda5e7b41f3b256228 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:52.660490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5099ad-2b73-4846-bba4-330a0912ccf0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:52.660966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5099ad-2b73-4846-bba4-330a0912ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:52.661986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5099ad-2b73-4846-bba4-330a0912ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:52.687248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ca5099ad-2b73-4846-bba4-330a0912ccf0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:52.688748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ca5099ad-2b73-4846-bba4-330a0912ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:52.770094 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1923/3853] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:52.779708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b31623-11fa-4b75-9d3e-ce34831d86d0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:52.780032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b31623-11fa-4b75-9d3e-ce34831d86d0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:52.780308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b31623-11fa-4b75-9d3e-ce34831d86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:52.804003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a7b31623-11fa-4b75-9d3e-ce34831d86d0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:52.807360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7b31623-11fa-4b75-9d3e-ce34831d86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:52.817797 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1931/3854] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:18:52.822873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5099ad-2b73-4846-bba4-330a0912ccf0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:52.838054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5099ad-2b73-4846-bba4-330a0912ccf0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:52.853984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:52.855073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:52.855571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:52.857334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:52.858563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:52.859080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:52.868160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:52.890433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1924/3855] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:18:52.891679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b31623-11fa-4b75-9d3e-ce34831d86d0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:52.902738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b31623-11fa-4b75-9d3e-ce34831d86d0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:52.916419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:52.918241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:52.918758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:52.919270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:52.920356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:52.922534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:52.982675 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1932/3856] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:52 2022] POST /identity/v3/projects => generated 403 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:52.986720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:52.999440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4332-f440-445f-8b18-f97c0c2c0e9b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:53.073021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:53.074019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:53.074368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:53.074712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:53.075726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:53.077727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:53.123954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:53.126676 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1925/3857] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:52 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:53.142988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cc500-4068-4179-93f2-0b837468aa08 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:53.154621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:53.155340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:53.155688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:53.156035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:53.156784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:53.158492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:53.185659 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1933/3858] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:53.188110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:53.203739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770e52-72e4-4328-884b-9abf8b25e05c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:53.217900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:53.218519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:53.218805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:53.219080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:53.220698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:53.222121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:53.247685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1926/3859] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:53.251373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:53.277003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:53.281673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:53.290869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8b86-e073-4069-8a4a-3627197551c1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:53.305898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b852ca-ac82-4219-812f-c64a4f4111df admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:53.306685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b59c-080c-4b3e-89f1-2db0d2315724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:53.310768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b59c-080c-4b3e-89f1-2db0d2315724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:53.312007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b59c-080c-4b3e-89f1-2db0d2315724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:53.312688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b59c-080c-4b3e-89f1-2db0d2315724 admin admin] PATH_INFO: `/v3/projects/9c674545992644d693a7975428ff935e/users/26b1a22a65d345ab9e0b89060409d55c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:53.323588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:53.324249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:53.324501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:53.324799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] PATH_INFO: `/v3/users/5eb18aaa82404c3c93dcc0ec182f4bd7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:53.325987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb18aaa82404c3c93dcc0ec182f4bd7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:53.327934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:53.359035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4b59c-080c-4b3e-89f1-2db0d2315724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c674545992644d693a7975428ff935e, user_id=26b1a22a65d345ab9e0b89060409d55c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:53.366776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4b59c-080c-4b3e-89f1-2db0d2315724 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:53.409190 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1934/3860] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:53 2022] PUT /identity/v3/projects/9c674545992644d693a7975428ff935e/users/26b1a22a65d345ab9e0b89060409d55c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:53.412811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf736fc-ff23-4a19-b1fe-be7d9473afe9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:53.413241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf736fc-ff23-4a19-b1fe-be7d9473afe9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:53.413760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf736fc-ff23-4a19-b1fe-be7d9473afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:53.425253 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:53.441344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb18aaa82404c3c93dcc0ec182f4bd7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:53.442267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb18aaa82404c3c93dcc0ec182f4bd7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:53.452562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb18aaa82404c3c93dcc0ec182f4bd7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:53.493728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb18aaa82404c3c93dcc0ec182f4bd7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:53.495494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3cf736fc-ff23-4a19-b1fe-be7d9473afe9 None None] MFA Rules not processed for user `26b1a22a65d345ab9e0b89060409d55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:53.497408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3cf736fc-ff23-4a19-b1fe-be7d9473afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:53.522440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb18aaa82404c3c93dcc0ec182f4bd7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:53.562103 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1927/3861] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:53 2022] DELETE /identity/v3/users/5eb18aaa82404c3c93dcc0ec182f4bd7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:53.679685 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1935/3862] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:53.684644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:53.686276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:53.897499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe15ad0-1a10-4df9-95d2-25954c50f244 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:53.904228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:53.904647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:53.905279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:53.905746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:53.907359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:53.912895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:53.990916 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1928/3863] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:53 2022] POST /identity/v3/projects => generated 401 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:53.995998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf736fc-ff23-4a19-b1fe-be7d9473afe9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.031333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.033317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.182547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf736fc-ff23-4a19-b1fe-be7d9473afe9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.184858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb3ce7-ee07-4298-98c6-fe422ec93151 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.187588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.188384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.188641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.188928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.189595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.192219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.192583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.193466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.193847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.194217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] PATH_INFO: `/v3/projects/f79009cd055e4c01b6bc5aa45ba24dcc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.195661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79009cd055e4c01b6bc5aa45ba24dcc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.197993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.218198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1936/3864] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:53 2022] POST /identity/v3/users => generated 307 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:54.219198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.222386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.238659 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:54.289908 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:54.296227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79009cd055e4c01b6bc5aa45ba24dcc', 'request_id': 'req-9f13e96f-b21a-4a56-badf-8e70add91c18'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:54.309983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79009cd055e4c01b6bc5aa45ba24dcc', 'request_id': 'req-9f13e96f-b21a-4a56-badf-8e70add91c18'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:54.319371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79009cd055e4c01b6bc5aa45ba24dcc', 'request_id': 'req-9f13e96f-b21a-4a56-badf-8e70add91c18'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:54.322490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa77f1-d669-4082-99cb-18a76d669c06 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.348137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] The token cache is being invalidate because project f79009cd055e4c01b6bc5aa45ba24dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:54.348477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:54.349255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:54.356185 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1929/3865] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:54 2022] DELETE /identity/v3/projects/f79009cd055e4c01b6bc5aa45ba24dcc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:54.356185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.356796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.418597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.419640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.420091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.420660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.423333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.437577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.439140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.451161 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1937/3866] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:54.452018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.453529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.463176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13e96f-b21a-4a56-badf-8e70add91c18 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.470011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248c79b-9a9c-4952-a264-388d55a02145 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.470701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248c79b-9a9c-4952-a264-388d55a02145 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.470985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248c79b-9a9c-4952-a264-388d55a02145 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.471260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248c79b-9a9c-4952-a264-388d55a02145 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.473209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9248c79b-9a9c-4952-a264-388d55a02145 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.487039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248c79b-9a9c-4952-a264-388d55a02145 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.488643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248c79b-9a9c-4952-a264-388d55a02145 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.501037 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1930/3867] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:54.513864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3c77-3718-4876-9e6f-9d8a8b0f4eac None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.514469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3c77-3718-4876-9e6f-9d8a8b0f4eac None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.514469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3c77-3718-4876-9e6f-9d8a8b0f4eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.567280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df17cfd-6688-4d4a-9dc7-1f3d6bf7dd58 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.572856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe702-7b2d-4b97-9557-4ea5b165ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.573521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe702-7b2d-4b97-9557-4ea5b165ae75 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.573800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe702-7b2d-4b97-9557-4ea5b165ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.574228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe702-7b2d-4b97-9557-4ea5b165ae75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.574519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f9ef3c77-3718-4876-9e6f-9d8a8b0f4eac None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:54.574878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fe702-7b2d-4b97-9557-4ea5b165ae75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.576199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f9ef3c77-3718-4876-9e6f-9d8a8b0f4eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.576534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fe702-7b2d-4b97-9557-4ea5b165ae75 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.594519 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1931/3868] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:54.594737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1938/3869] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:54.594861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3c77-3718-4876-9e6f-9d8a8b0f4eac None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.596148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb374d76-2368-4817-ae0d-796324d92704 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.596442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb374d76-2368-4817-ae0d-796324d92704 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.596719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb374d76-2368-4817-ae0d-796324d92704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.609929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3c77-3718-4876-9e6f-9d8a8b0f4eac None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.616417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.618010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.618525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.619007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] PATH_INFO: `/v3/projects/27d9baddd2264c4cad9a6ea3ced09c7a/users/89b0ffdd6d8147e885c1f3d5c211321b/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.625587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eb374d76-2368-4817-ae0d-796324d92704 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:54.626932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb374d76-2368-4817-ae0d-796324d92704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.640967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d9baddd2264c4cad9a6ea3ced09c7a, user_id=89b0ffdd6d8147e885c1f3d5c211321b, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.649352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.649577 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1939/3870] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:54.651130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb374d76-2368-4817-ae0d-796324d92704 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.663982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb374d76-2368-4817-ae0d-796324d92704 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.669162 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1932/3871] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:54 2022] PUT /identity/v3/projects/27d9baddd2264c4cad9a6ea3ced09c7a/users/89b0ffdd6d8147e885c1f3d5c211321b/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:54.672381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.712537 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:54.791511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084677e-09af-41be-88e1-dac20f41b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.792574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084677e-09af-41be-88e1-dac20f41b649 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.793580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084677e-09af-41be-88e1-dac20f41b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.794169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084677e-09af-41be-88e1-dac20f41b649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.795526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084677e-09af-41be-88e1-dac20f41b649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:54.796164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084677e-09af-41be-88e1-dac20f41b649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.802104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084677e-09af-41be-88e1-dac20f41b649 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.807574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491775e3-3060-4a47-98e1-c77305b2cf7e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.820155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.821530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.821938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.822372 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1940/3872] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:18:54.824358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b27d-d31a-4da9-af1b-7a828bece414 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.824642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b27d-d31a-4da9-af1b-7a828bece414 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.824986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b27d-d31a-4da9-af1b-7a828bece414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.825740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.826728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.828773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.842902 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1933/3873] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:54.843436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.848371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4857b27d-d31a-4da9-af1b-7a828bece414 None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:54.849799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4857b27d-d31a-4da9-af1b-7a828bece414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:54.862292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385f57-8ba6-4dbd-9ea8-1ed6885a1c99 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:54.869731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:54.870805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:54.872015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:54.872292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:54.872915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:54.875863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:54.916243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1934/3874] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:54 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:54.916243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.924276 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:54.927250 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1941/3875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:54.933902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857b27d-d31a-4da9-af1b-7a828bece414 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:54.958607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857b27d-d31a-4da9-af1b-7a828bece414 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.028998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8570599-768a-45cb-8d72-d6c4fbbb8f2f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.053955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74645f1d-a142-4727-a64b-69e0ed7d4759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.054654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645f1d-a142-4727-a64b-69e0ed7d4759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.055123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645f1d-a142-4727-a64b-69e0ed7d4759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.055309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645f1d-a142-4727-a64b-69e0ed7d4759 admin admin] PATH_INFO: `/v3/projects/27d9baddd2264c4cad9a6ea3ced09c7a/users/89b0ffdd6d8147e885c1f3d5c211321b/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.062732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.063424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.063776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.064056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.064693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.066743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74645f1d-a142-4727-a64b-69e0ed7d4759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d9baddd2264c4cad9a6ea3ced09c7a, user_id=89b0ffdd6d8147e885c1f3d5c211321b, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.066918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.069401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74645f1d-a142-4727-a64b-69e0ed7d4759 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.098503 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1935/3876] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:54 2022] PUT /identity/v3/projects/27d9baddd2264c4cad9a6ea3ced09c7a/users/89b0ffdd6d8147e885c1f3d5c211321b/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:55.110474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca434f-4307-4a68-933d-8e27776bf81a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.110982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca434f-4307-4a68-933d-8e27776bf81a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.111275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca434f-4307-4a68-933d-8e27776bf81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.112833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1942/3877] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:54 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:55.117008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:55.137753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99d401-4e34-4531-a76e-ab606ac2ca8d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.165192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e6ca434f-4307-4a68-933d-8e27776bf81a None None] MFA Rules not processed for user `89b0ffdd6d8147e885c1f3d5c211321b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:55.167158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e6ca434f-4307-4a68-933d-8e27776bf81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:55.231532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.232168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.232450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.232724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.233402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.235008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.247463 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:55.267659 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1943/3878] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:55.270614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:55.298901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2043f1-a338-46ce-a6df-dc434fa21e1b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.307746 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1936/3879] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:18:55.311555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca434f-4307-4a68-933d-8e27776bf81a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:55.315377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.316094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.317308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.317673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.320529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.322763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.334358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca434f-4307-4a68-933d-8e27776bf81a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.343646 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1944/3880] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:18:55.347398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b0ffdd6d8147e885c1f3d5c211321b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27d9baddd2264c4cad9a6ea3ced09c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.348115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.348467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.348832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.349608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.351421 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:18:55.351421 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:18:55.351421 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:18:55.352086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:55.353473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.369216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd795d-7918-459b-84bf-a1162e4af8df admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.383651 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1937/3881] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:18:55 2022] POST /identity/v3/roles => generated 239 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:55.384536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591d25b-a410-439a-a987-aa144050dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.385394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d25b-a410-439a-a987-aa144050dc41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.385925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d25b-a410-439a-a987-aa144050dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.386329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591d25b-a410-439a-a987-aa144050dc41 admin admin] PATH_INFO: `/v3/projects/5e482bb6669345ee89472fa739a9cc9f/users/5570c8ed79ec4196aa73b96a03ee17c7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.387783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:55.408731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d791c-0d40-469a-8caf-58cd973c185d tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.420731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b0ffdd6d8147e885c1f3d5c211321b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27d9baddd2264c4cad9a6ea3ced09c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.421371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.422898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.424271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] PATH_INFO: `/v3/projects/9c674545992644d693a7975428ff935e/users/26b1a22a65d345ab9e0b89060409d55c/roles/71a95fc0bfa243439e35e46bebed03ec` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.426735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9c674545992644d693a7975428ff935e, user_id=26b1a22a65d345ab9e0b89060409d55c, role_id=71a95fc0bfa243439e35e46bebed03ec)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.428842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591d25b-a410-439a-a987-aa144050dc41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e482bb6669345ee89472fa739a9cc9f, user_id=5570c8ed79ec4196aa73b96a03ee17c7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.429588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.435439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591d25b-a410-439a-a987-aa144050dc41 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.464656 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1938/3882] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:55 2022] PUT /identity/v3/projects/9c674545992644d693a7975428ff935e/users/26b1a22a65d345ab9e0b89060409d55c/roles/71a95fc0bfa243439e35e46bebed03ec => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:55.465919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:55.470697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:55.472787 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1945/3883] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:55 2022] PUT /identity/v3/projects/5e482bb6669345ee89472fa739a9cc9f/users/5570c8ed79ec4196aa73b96a03ee17c7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:55.480475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.480788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.481014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.510848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:55.512910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:55.579018 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:55.587611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d466cd-4d61-4855-8b3c-c24afc433607 tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.598180 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1946/3884] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:55.608098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:55.609829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:55.682166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b1a22a65d345ab9e0b89060409d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c674545992644d693a7975428ff935e', 'project_domain_id': 'default', 'roles': ['tempest-test_role-259114992', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.684372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.684372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.684372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] PATH_INFO: `/v3/users/26b1a22a65d345ab9e0b89060409d55c/application_credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.687788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] RBAC: Authorizing `identity:create_application_credential(user_id=26b1a22a65d345ab9e0b89060409d55c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.688942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.744152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a3cad-5a36-4c97-b76d-a53371c04d7b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:55.760836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bed00-bf07-4fa3-a46c-f732f0e74855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:55.761364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bed00-bf07-4fa3-a46c-f732f0e74855 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.761627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bed00-bf07-4fa3-a46c-f732f0e74855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.762261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bed00-bf07-4fa3-a46c-f732f0e74855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.780421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bed00-bf07-4fa3-a46c-f732f0e74855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:55.787491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bed00-bf07-4fa3-a46c-f732f0e74855 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:55.811981 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1947/3885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:55.850244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1939/3886] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 11 01:18:55 2022] POST /identity/v3/users/26b1a22a65d345ab9e0b89060409d55c/application_credentials => generated 658 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:55.855378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a18fa-a366-4071-917d-792102b8825a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:55.855685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a18fa-a366-4071-917d-792102b8825a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:55.856058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a18fa-a366-4071-917d-792102b8825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:55.895553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fe4a18fa-a366-4071-917d-792102b8825a None None] MFA Rules not processed for user `26b1a22a65d345ab9e0b89060409d55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:55.896814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fe4a18fa-a366-4071-917d-792102b8825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:55.973360 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:56.069663 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1948/3887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 11 01:18:56.071099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:56.085548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cb9c5-d9c7-4e2c-8afc-0a8743f9464a tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:56.099763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b1a22a65d345ab9e0b89060409d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c674545992644d693a7975428ff935e', 'project_domain_id': 'default', 'roles': ['tempest-test_role-259114992', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:56.100837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:56.101444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:56.101937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] PATH_INFO: `/v3/users/26b1a22a65d345ab9e0b89060409d55c/application_credentials/7a562bf4f1b24389a19e42663abded44` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:56.104054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=26b1a22a65d345ab9e0b89060409d55c, application_credential_id=7a562bf4f1b24389a19e42663abded44)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:56.106241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:56.157630 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1940/3888] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:18:56 2022] DELETE /identity/v3/users/26b1a22a65d345ab9e0b89060409d55c/application_credentials/7a562bf4f1b24389a19e42663abded44 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:56.159501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a18fa-a366-4071-917d-792102b8825a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:56.268591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a18fa-a366-4071-917d-792102b8825a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:56.286091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b0ffdd6d8147e885c1f3d5c211321b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27d9baddd2264c4cad9a6ea3ced09c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:56.287064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:56.287582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:56.298249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] PATH_INFO: `/v3/roles/71a95fc0bfa243439e35e46bebed03ec` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:56.301016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: Authorizing `identity:delete_role(role_id=71a95fc0bfa243439e35e46bebed03ec)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:56.302809 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:18:56.302809 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:18:56.302809 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:18:56.304111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:56.399350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Invalidating the token cache because role 71a95fc0bfa243439e35e46bebed03ec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:56.401125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:56.403484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-27363609-3464-4d4a-8817-dcc9c66ad30f tempest-ApplicationCredentialsV3AdminTest-776921627 tempest-ApplicationCredentialsV3AdminTest-776921627-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:56.412027 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1949/3889] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:56 2022] DELETE /identity/v3/roles/71a95fc0bfa243439e35e46bebed03ec => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:56.413775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:56.416459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:56.453881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba140f88-d759-4049-bde2-60428de62ee7 tempest-ApplicationCredentialsV3AdminTest-1703924024 tempest-ApplicationCredentialsV3AdminTest-1703924024-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:56.570836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:56.571543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:56.572154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:56.572154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] PATH_INFO: `/v3/users/26b1a22a65d345ab9e0b89060409d55c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:56.573362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b1a22a65d345ab9e0b89060409d55c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:56.576484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:56.622815 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:56.684114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b1a22a65d345ab9e0b89060409d55c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:56.685163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b1a22a65d345ab9e0b89060409d55c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:56.689518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b1a22a65d345ab9e0b89060409d55c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:56.708186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b1a22a65d345ab9e0b89060409d55c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:56.718286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b1a22a65d345ab9e0b89060409d55c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:56.746381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1941/3890] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:56 2022] DELETE /identity/v3/users/26b1a22a65d345ab9e0b89060409d55c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:56.751106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135f12-e722-4d85-9268-6af483187428 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:56.751559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135f12-e722-4d85-9268-6af483187428 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:56.752339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135f12-e722-4d85-9268-6af483187428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:56.789028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-86135f12-e722-4d85-9268-6af483187428 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:56.790796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-86135f12-e722-4d85-9268-6af483187428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:56.925454 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1950/3891] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:56.978656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:56.980203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:57.192205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adbcd2-945e-49ab-ae55-e7ee24b9c335 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:57.225527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:57.227656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:57.228132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:57.229805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:57.250235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:57.252465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:57.275052 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1942/3892] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:18:57.871624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135f12-e722-4d85-9268-6af483187428 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:57.873644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-86135f12-e722-4d85-9268-6af483187428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:57.890473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135f12-e722-4d85-9268-6af483187428 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:57.896252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:57.897457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:57.898224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:57.898942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] PATH_INFO: `/v3/users/807dad83f719457a8c83fbf239756ca6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:57.900549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=807dad83f719457a8c83fbf239756ca6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:57.903197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:57.907891 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:57.971885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807dad83f719457a8c83fbf239756ca6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:57.973149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807dad83f719457a8c83fbf239756ca6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:57.973999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807dad83f719457a8c83fbf239756ca6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:57.984971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807dad83f719457a8c83fbf239756ca6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.001505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807dad83f719457a8c83fbf239756ca6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.021993 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1951/3893] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:57 2022] DELETE /identity/v3/users/807dad83f719457a8c83fbf239756ca6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:58.529590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:58.566124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65161838-2329-4dda-a36b-cd9c665ec482 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:58.621338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:58.623025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:58.685351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:58.686419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:58.686912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:58.687235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] PATH_INFO: `/v3/projects/4cdc10240472419796efddcb58d626c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:58.689636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdc10240472419796efddcb58d626c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:58.692921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:58.760499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec43c-df3f-4e45-afb4-7242f2f9a08c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:58.772722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:58.773553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:58.774143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:58.774143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] PATH_INFO: `/v3/projects/9c674545992644d693a7975428ff935e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:58.775478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c674545992644d693a7975428ff935e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:58.777708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:58.821996 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:58.833082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdc10240472419796efddcb58d626c7', 'request_id': 'req-378c3636-362d-4ca7-b63b-3f2c28f92640'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.850365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdc10240472419796efddcb58d626c7', 'request_id': 'req-378c3636-362d-4ca7-b63b-3f2c28f92640'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.863667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdc10240472419796efddcb58d626c7', 'request_id': 'req-378c3636-362d-4ca7-b63b-3f2c28f92640'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.900645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] The token cache is being invalidate because project 4cdc10240472419796efddcb58d626c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:58.900926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.901650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-378c3636-362d-4ca7-b63b-3f2c28f92640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.913199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c674545992644d693a7975428ff935e', 'request_id': 'req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.921738 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1943/3894] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:58 2022] DELETE /identity/v3/projects/4cdc10240472419796efddcb58d626c7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:58.924956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1076-b868-422e-8a15-08da1398860c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:58.925299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1076-b868-422e-8a15-08da1398860c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:58.925543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1076-b868-422e-8a15-08da1398860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:58.940648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c674545992644d693a7975428ff935e', 'request_id': 'req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.957540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c674545992644d693a7975428ff935e', 'request_id': 'req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.979733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fe3a1076-b868-422e-8a15-08da1398860c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:58.980948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fe3a1076-b868-422e-8a15-08da1398860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:58.981702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] The token cache is being invalidate because project 9c674545992644d693a7975428ff935e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:18:58.982524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.984100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:58.988476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1952/3895] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:18:58 2022] DELETE /identity/v3/projects/9c674545992644d693a7975428ff935e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:59.005917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:59.009978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:59.040724 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:59.153694 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1944/3896] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:59.157575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57f2ef-242b-43b9-a06c-d77b13ec7e1d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.157893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57f2ef-242b-43b9-a06c-d77b13ec7e1d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.159118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57f2ef-242b-43b9-a06c-d77b13ec7e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.192823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f2d74-f2fa-43ed-93a3-8dd726b64a43 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:59.206551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7e57f2ef-242b-43b9-a06c-d77b13ec7e1d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:18:59.208180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7e57f2ef-242b-43b9-a06c-d77b13ec7e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:59.212294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:59.213527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.213812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.214178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] PATH_INFO: `/v3/users/89b0ffdd6d8147e885c1f3d5c211321b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.215738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b0ffdd6d8147e885c1f3d5c211321b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:59.218641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:59.224785 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1945/3897] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:18:59.229386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57f2ef-242b-43b9-a06c-d77b13ec7e1d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:59.280882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57f2ef-242b-43b9-a06c-d77b13ec7e1d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:59.303609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:59.307917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.308408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.310988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.313622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:18:59.313998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:59.325578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:59.369658 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1946/3898] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:18:59.375224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:59.399949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7a0c-0afd-4213-91b2-4bb2767327d4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:59.401687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b0ffdd6d8147e885c1f3d5c211321b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:59.402841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b0ffdd6d8147e885c1f3d5c211321b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:59.403908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b0ffdd6d8147e885c1f3d5c211321b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:59.413295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:59.415302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.415680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.415909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.416744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:59.420595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:59.427305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b0ffdd6d8147e885c1f3d5c211321b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:59.460289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b0ffdd6d8147e885c1f3d5c211321b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:18:59.511966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1953/3899] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:18:59 2022] DELETE /identity/v3/users/89b0ffdd6d8147e885c1f3d5c211321b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:59.534849 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1947/3900] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:18:59 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:59.539118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:59.541013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:18:59.662998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2943-aa67-4db3-8b71-dbc02ff33dbc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:59.703529 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:18:59.753376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:59.756015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.756015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.756371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.757318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:59.760710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:59.797371 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1954/3901] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:18:59 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:18:59.800748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:59.815753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67114-fab2-4c80-9810-153f6a1a6d14 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:59.823175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:59.824276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.824779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.825322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.826803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:59.829990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:59.854020 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1948/3902] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:18:59.858087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:59.881652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffa7e3-ffb8-412c-b9fd-162ced195a19 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:59.881652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815690e5-f398-4846-b2d6-a1ed7dcd2eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:59.881652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815690e5-f398-4846-b2d6-a1ed7dcd2eea admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.881652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815690e5-f398-4846-b2d6-a1ed7dcd2eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.882241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815690e5-f398-4846-b2d6-a1ed7dcd2eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.882241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815690e5-f398-4846-b2d6-a1ed7dcd2eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:59.883490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815690e5-f398-4846-b2d6-a1ed7dcd2eea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:59.896328 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1955/3903] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:18:59.901305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:18:59.915686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442217f-42ec-48b2-b2cd-be0bd3e66dc0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:18:59.923755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f095124-e276-4229-a279-99eb6b8bc3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:18:59.924589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095124-e276-4229-a279-99eb6b8bc3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.924994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095124-e276-4229-a279-99eb6b8bc3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.925421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f095124-e276-4229-a279-99eb6b8bc3b3 admin admin] PATH_INFO: `/v3/projects/dfb80684ae754fd28265862cb51302e6/users/10d97cc298004c52a1b959c3f6e096b0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:18:59.952069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f095124-e276-4229-a279-99eb6b8bc3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb80684ae754fd28265862cb51302e6, user_id=10d97cc298004c52a1b959c3f6e096b0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:18:59.957407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f095124-e276-4229-a279-99eb6b8bc3b3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:18:59.989599 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1949/3904] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:18:59 2022] PUT /identity/v3/projects/dfb80684ae754fd28265862cb51302e6/users/10d97cc298004c52a1b959c3f6e096b0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:18:59.993188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:18:59.994181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:18:59.994709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:00.032662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] MFA Rules not processed for user `10d97cc298004c52a1b959c3f6e096b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:00.034595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:00.157502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:00.158372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:00.158817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:00.160399 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1956/3905] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:00.201476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] MFA Rules not processed for user `10d97cc298004c52a1b959c3f6e096b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:00.204533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:00.220344 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1950/3906] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:00.232921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:00.234742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:00.441975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b649a-7615-4ab7-bc0f-4736efd23926 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:00.456490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466c907-3ccb-44ae-9e21-a11a8e0a6eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:00.463293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466c907-3ccb-44ae-9e21-a11a8e0a6eff service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:00.463891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466c907-3ccb-44ae-9e21-a11a8e0a6eff service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:00.464392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466c907-3ccb-44ae-9e21-a11a8e0a6eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:00.476963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466c907-3ccb-44ae-9e21-a11a8e0a6eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:00.480185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466c907-3ccb-44ae-9e21-a11a8e0a6eff service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:00.493555 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1957/3907] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:00.759763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:00.761120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:00.899605 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:00.924538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a607eb1-46a5-4426-a444-c4919733738d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:00.959471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:00.980580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:00.981483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:00.981774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] PATH_INFO: `/v3/projects/27d9baddd2264c4cad9a6ea3ced09c7a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:00.989558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d9baddd2264c4cad9a6ea3ced09c7a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:00.991832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:01.093045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d9baddd2264c4cad9a6ea3ced09c7a', 'request_id': 'req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:01.114928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d9baddd2264c4cad9a6ea3ced09c7a', 'request_id': 'req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:01.129800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d9baddd2264c4cad9a6ea3ced09c7a', 'request_id': 'req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:01.155125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] The token cache is being invalidate because project 27d9baddd2264c4cad9a6ea3ced09c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:01.155564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:01.157659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-555a3dbf-b1d4-43f9-80dd-2bb65a86a438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:01.161728 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1951/3908] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:00 2022] DELETE /identity/v3/projects/27d9baddd2264c4cad9a6ea3ced09c7a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:01.167257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89859273-5e75-4924-b534-e021bd5f4bf0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:01.168342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89859273-5e75-4924-b534-e021bd5f4bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:01.168803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89859273-5e75-4924-b534-e021bd5f4bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:01.206646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-89859273-5e75-4924-b534-e021bd5f4bf0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:01.208885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-89859273-5e75-4924-b534-e021bd5f4bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:01.282452 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:01.365308 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1958/3909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:01.367089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3453c8-dfb1-4394-8aaf-ae3061589961 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:01.367896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3453c8-dfb1-4394-8aaf-ae3061589961 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:01.368207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3453c8-dfb1-4394-8aaf-ae3061589961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:01.413977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ce3453c8-dfb1-4394-8aaf-ae3061589961 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:01.417375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ce3453c8-dfb1-4394-8aaf-ae3061589961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:01.438291 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1952/3910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:01.438540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89859273-5e75-4924-b534-e021bd5f4bf0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:01.453367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89859273-5e75-4924-b534-e021bd5f4bf0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:01.462849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:01.463693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:01.464215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:01.464539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:01.466820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:01.467597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:01.471390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:01.501661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1959/3911] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:01.503925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3453c8-dfb1-4394-8aaf-ae3061589961 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:01.534597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3453c8-dfb1-4394-8aaf-ae3061589961 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:01.547803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:01.548528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:01.548909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:01.549335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:01.550243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:01.556654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:01.615284 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1953/3912] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:01 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:01.619530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:01.638182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a67a-8a86-46cd-8966-d0c7e8368dac admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:01.796947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:01.797799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:01.798245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:01.798873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:01.799839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:01.801994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:01.871085 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1960/3913] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:01 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:01.875509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:01.891132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae172b1e-2f08-4e5b-ba91-4098bdbbd5ac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:01.896489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:01.897761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:01.899192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:01.899839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:01.901526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:01.904667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:01.922659 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1954/3914] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:01.928091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:01.944265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba0ecd-3922-4aed-9fda-64b1338b9619 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:01.954258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5a4a1-7c03-4baf-bec8-6eb1f28906ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:01.955007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5a4a1-7c03-4baf-bec8-6eb1f28906ea admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:01.955410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5a4a1-7c03-4baf-bec8-6eb1f28906ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:01.955790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5a4a1-7c03-4baf-bec8-6eb1f28906ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:01.956577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5a4a1-7c03-4baf-bec8-6eb1f28906ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:01.958736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5a4a1-7c03-4baf-bec8-6eb1f28906ea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:01.976060 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1961/3915] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:01.978093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:02.010906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d3079-82a7-4286-88fd-6e5a068690ff admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:02.020422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:02.021752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:02.022352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:02.023234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] PATH_INFO: `/v3/projects/3d50a5bfd7474f3db70d7ae667f895de/users/957f26fd53b143a9a3423806afa8ce47/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:02.051077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d50a5bfd7474f3db70d7ae667f895de, user_id=957f26fd53b143a9a3423806afa8ce47, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:02.074385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:02.121008 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1955/3916] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:01 2022] PUT /identity/v3/projects/3d50a5bfd7474f3db70d7ae667f895de/users/957f26fd53b143a9a3423806afa8ce47/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:02.134904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f4033-837b-4445-9b57-c73de345a7e3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:02.136062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f4033-837b-4445-9b57-c73de345a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:02.136254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f4033-837b-4445-9b57-c73de345a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:02.176145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-024f4033-837b-4445-9b57-c73de345a7e3 None None] MFA Rules not processed for user `957f26fd53b143a9a3423806afa8ce47`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:02.178288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-024f4033-837b-4445-9b57-c73de345a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:02.355012 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1962/3917] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:02.356841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:02.501029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020be7-dc1e-4771-93b6-8152f9253dfd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:02.506409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:02.507517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:02.508396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:02.509008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:02.509691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:02.517078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:02.562898 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1956/3918] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:02 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:02.563261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f4033-837b-4445-9b57-c73de345a7e3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:02.575796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f4033-837b-4445-9b57-c73de345a7e3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:02.623589 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:02.682611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:02.683570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:02.684066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:02.684440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:02.685510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:02.690226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:02.724873 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1963/3919] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:02 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:02.729379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:02.735995 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:02.760957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0dfd-713a-4fdc-8ddc-b9237e0c4a0f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:02.773679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:02.776128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:02.778568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:02.779743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:02.780659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:02.783332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:02.798689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1957/3920] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:02.802666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:02.821135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d212b4-1b79-4349-a227-b35bd082b7ce admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:02.851676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:02.854622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:02.854849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:02.855782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] PATH_INFO: `/v3/projects/02b6e3f38d3f4822a0f7cf0af7467258/users/8c0cecbf0e1a4b8f933677ca3d4c8849/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:02.895889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b6e3f38d3f4822a0f7cf0af7467258, user_id=8c0cecbf0e1a4b8f933677ca3d4c8849, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:02.899317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:02.940474 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1964/3921] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:02 2022] PUT /identity/v3/projects/02b6e3f38d3f4822a0f7cf0af7467258/users/8c0cecbf0e1a4b8f933677ca3d4c8849/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:02.942401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:02.962328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7f7c-6972-4960-a494-c76092a55b92 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:03.084820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51967ff2-beb4-43c8-9cba-e3a901f9c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:03.086839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967ff2-beb4-43c8-9cba-e3a901f9c3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.087121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967ff2-beb4-43c8-9cba-e3a901f9c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.087394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967ff2-beb4-43c8-9cba-e3a901f9c3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.088046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51967ff2-beb4-43c8-9cba-e3a901f9c3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:03.090606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51967ff2-beb4-43c8-9cba-e3a901f9c3ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:03.111395 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1958/3922] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:03.117426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:03.128524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d9397-407c-48ff-b394-896470e31f58 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:03.134973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:03.135714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.136207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.136334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] PATH_INFO: `/v3/projects/02b6e3f38d3f4822a0f7cf0af7467258/users/8c0cecbf0e1a4b8f933677ca3d4c8849/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.138388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b6e3f38d3f4822a0f7cf0af7467258, user_id=8c0cecbf0e1a4b8f933677ca3d4c8849, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:03.141014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:03.163229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1965/3923] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:03 2022] PUT /identity/v3/projects/02b6e3f38d3f4822a0f7cf0af7467258/users/8c0cecbf0e1a4b8f933677ca3d4c8849/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:03.166863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77464-7399-44fa-8f19-4c1d1c068573 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.167154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77464-7399-44fa-8f19-4c1d1c068573 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.167432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77464-7399-44fa-8f19-4c1d1c068573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.209117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6ba77464-7399-44fa-8f19-4c1d1c068573 None None] MFA Rules not processed for user `8c0cecbf0e1a4b8f933677ca3d4c8849`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:03.212058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6ba77464-7399-44fa-8f19-4c1d1c068573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:03.395448 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1959/3924] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:03.401738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:03.415489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbba6d-e1a6-40a4-a0f8-3f7285f5b538 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:03.424087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:03.424683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.425178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.425579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.426358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:03.427483 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:03.427483 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:03.427483 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:03.429883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:03.451559 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1966/3925] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:19:03 2022] POST /identity/v3/domains => generated 276 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:03.456882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba77464-7399-44fa-8f19-4c1d1c068573 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:03.472413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba77464-7399-44fa-8f19-4c1d1c068573 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:03.566219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:03.567253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.567740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.568231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.569413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:03.572243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:03.604384 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:03.627141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1960/3926] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:03 2022] POST /identity/v3/users => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:03.628007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:03.659792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0299c-dd8b-4931-9e2d-ae6000a9b9b8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:03.693987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:03.694752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.695273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.695883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.697134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:03.700465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:03.702691 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.server.flask.common [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 01:19:03.767841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1967/3927] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:03 2022] POST /identity/v3/users => generated 322 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:03.774592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:03.802053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71415eea-5197-499f-a6f8-e579d871ff33 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:03.817703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:03.821124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.821650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.822135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users/1fd4b8224f854d21ba5c771eefba1f2b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.860371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:get_user(user_id=1fd4b8224f854d21ba5c771eefba1f2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:03.869430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:03.880026 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1961/3928] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:19:03 2022] GET /identity/v3/users/1fd4b8224f854d21ba5c771eefba1f2b => generated 346 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:03.880764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:03.906380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b60d9a-345d-4dc3-a273-ee0d8d83fac8 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:03.924080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:03.925560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:03.925905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:03.926245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:03.929659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Adding query filter params (domain_id=45ae5f3d53c1453d8cb3a26481f5f3fd) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:03.932350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:03.950372 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:03.950372 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:03.950372 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:03.950372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:04.008900 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1968/3929] 10.222.0.16 () {58 vars in 1207 bytes} [Sun Sep 11 01:19:03 2022] GET /identity/v3/users?domain_id=45ae5f3d53c1453d8cb3a26481f5f3fd => generated 483 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:04.014187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.025855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97c79e-2d8a-4d52-8b2a-ccd2517ac30a tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:04.053934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:04.057241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:04.057479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:04.058267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:04.060779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:04.063169 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:04.063169 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:04.063169 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:04.067147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:04.141579 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1962/3930] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:04 2022] GET /identity/v3/users => generated 8277 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:04.142388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.158632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ed404-e8c2-4ed2-9309-500da86e4a1e tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:04.169494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:04.170513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:04.171033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:04.171864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:04.173135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Adding query filter params (name=tempest-test_user-230787850) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:04.173629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:04.176098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:04.235388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.245900 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1969/3931] 10.222.0.16 () {58 vars in 1187 bytes} [Sun Sep 11 01:19:04 2022] GET /identity/v3/users?name=tempest-test_user-230787850 => generated 473 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:04.250500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e367-c26d-4796-94ca-ce18b81466cf tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:04.265413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:04.266335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:04.266760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:04.268145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:04.270043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:04.271802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:04.277676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:04.338360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.348884 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1963/3932] 10.222.0.16 () {58 vars in 1149 bytes} [Sun Sep 11 01:19:04 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:04.350024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0367370-ddbe-4e5f-af2c-eceb684bd599 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:04.357404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.361091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:04.372408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:04.374296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:04.374588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:04.375384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users/419f9a33794942c4b36c174666fb885b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:04.433396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:delete_user(user_id=419f9a33794942c4b36c174666fb885b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:04.449705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:04.553821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419f9a33794942c4b36c174666fb885b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.557312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419f9a33794942c4b36c174666fb885b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.559401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419f9a33794942c4b36c174666fb885b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.576512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17e4ef-8353-42cd-856c-9220f26b7fc2 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:04.585312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c33278-dc0a-4478-ad86-38d42b09a0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:04.586923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c33278-dc0a-4478-ad86-38d42b09a0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:04.587420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419f9a33794942c4b36c174666fb885b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.587762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c33278-dc0a-4478-ad86-38d42b09a0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:04.588273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c33278-dc0a-4478-ad86-38d42b09a0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:04.593546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-22c33278-dc0a-4478-ad86-38d42b09a0a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:04.609130 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:INSERT=9,keystone:DELETE=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:04.615353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c33278-dc0a-4478-ad86-38d42b09a0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:04.619378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c33278-dc0a-4478-ad86-38d42b09a0a9 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:04.630947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419f9a33794942c4b36c174666fb885b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.646166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1964/3933] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:04.647749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518948b-520a-42c3-8788-dbbf2b2ac46a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:04.660015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518948b-520a-42c3-8788-dbbf2b2ac46a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:04.661719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518948b-520a-42c3-8788-dbbf2b2ac46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:04.670541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1970/3934] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:04 2022] DELETE /identity/v3/users/419f9a33794942c4b36c174666fb885b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:04.674968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.676598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:04.724712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5518948b-520a-42c3-8788-dbbf2b2ac46a None None] MFA Rules not processed for user `5570c8ed79ec4196aa73b96a03ee17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:04.726129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5518948b-520a-42c3-8788-dbbf2b2ac46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:04.807402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d91bd8-06a9-44a8-b025-0a291c4ba2b6 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:04.814407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:04.815067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:04.815356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:04.815638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/users/1fd4b8224f854d21ba5c771eefba1f2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:04.817085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1fd4b8224f854d21ba5c771eefba1f2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:04.819400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:04.884902 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1965/3935] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:04.900943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd4b8224f854d21ba5c771eefba1f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.901716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd4b8224f854d21ba5c771eefba1f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.902668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd4b8224f854d21ba5c771eefba1f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.911096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd4b8224f854d21ba5c771eefba1f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.925839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd4b8224f854d21ba5c771eefba1f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:04.946943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1971/3936] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:04 2022] DELETE /identity/v3/users/1fd4b8224f854d21ba5c771eefba1f2b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:04.953301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518948b-520a-42c3-8788-dbbf2b2ac46a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.977336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518948b-520a-42c3-8788-dbbf2b2ac46a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:04.990568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:04.993024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:05.092489 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:05.129003 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:05.129553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:05.130203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:05.130481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:05.130758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/domains/45ae5f3d53c1453d8cb3a26481f5f3fd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:05.134880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=45ae5f3d53c1453d8cb3a26481f5f3fd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:05.135910 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:05.135910 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:05.135910 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:05.138942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:05.158263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4e97-bfaf-4993-86e5-9d8f4224ab12 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:05.170142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:05.171792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:05.172331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.172467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:05.173607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:05.173737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.176445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:05.232847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.234123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.239191 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1966/3937] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:19:04 2022] PATCH /identity/v3/domains/45ae5f3d53c1453d8cb3a26481f5f3fd => generated 277 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:05.243469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:05.247834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:05.311874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:05.313519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:05.346901 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1972/3938] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:05.415134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d160a6-b11d-45ce-8eb2-920949c1f0dd tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:05.420967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0cecbf0e1a4b8f933677ca3d4c8849', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b6e3f38d3f4822a0f7cf0af7467258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:05.421654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:05.421933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:05.422208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] PATH_INFO: `/v3/domains/45ae5f3d53c1453d8cb3a26481f5f3fd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:05.480045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=45ae5f3d53c1453d8cb3a26481f5f3fd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:05.481233 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:05.481233 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:05.481233 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:05.482029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:05.569289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.642061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.770635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd', 'request_id': 'req-ec3a0d92-222c-4734-82b5-026ee25e35b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.784557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd', 'request_id': 'req-ec3a0d92-222c-4734-82b5-026ee25e35b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.794068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd', 'request_id': 'req-ec3a0d92-222c-4734-82b5-026ee25e35b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.855577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] The token cache is being invalidate because project 45ae5f3d53c1453d8cb3a26481f5f3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:05.855845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.862671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.889199 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:05.891758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd', 'request_id': 'req-ec3a0d92-222c-4734-82b5-026ee25e35b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.897750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd', 'request_id': 'req-ec3a0d92-222c-4734-82b5-026ee25e35b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.900326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ec3a0d92-222c-4734-82b5-026ee25e35b9 tempest-UsersV3TestJSON-804139578 tempest-UsersV3TestJSON-804139578-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '45ae5f3d53c1453d8cb3a26481f5f3fd', 'request_id': 'req-ec3a0d92-222c-4734-82b5-026ee25e35b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:05.945817 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1967/3939] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:05 2022] DELETE /identity/v3/domains/45ae5f3d53c1453d8cb3a26481f5f3fd => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:05.950051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:05.951642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:06.089983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9d52d-ab91-4008-9d9e-01512f0e06e5 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:06.188399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:06.189425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:06.189807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:06.190306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] PATH_INFO: `/v3/users/957f26fd53b143a9a3423806afa8ce47` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:06.191853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=957f26fd53b143a9a3423806afa8ce47)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:06.194049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:06.308093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957f26fd53b143a9a3423806afa8ce47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:06.308931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957f26fd53b143a9a3423806afa8ce47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:06.311591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957f26fd53b143a9a3423806afa8ce47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:06.313088 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:06.328840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957f26fd53b143a9a3423806afa8ce47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:06.356798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957f26fd53b143a9a3423806afa8ce47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:06.385789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1973/3940] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:05 2022] DELETE /identity/v3/users/957f26fd53b143a9a3423806afa8ce47 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:06.389435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:06.389940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:06.389940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:06.423449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:06.438427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:06.553966 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1968/3941] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:06.564163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:06.566113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:06.651972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677dfe-66a5-439e-ac1f-89014b217fb5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:06.659198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:06.659983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:06.660339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:06.660690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:06.671445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:06.672869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:06.701217 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1974/3942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:06.925486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:06.928594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:07.081098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8ee6-3e21-402d-861b-581b64b127b2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:07.092306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df2aad-0927-4041-9906-89bb38798510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:07.093122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2aad-0927-4041-9906-89bb38798510 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:07.093680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2aad-0927-4041-9906-89bb38798510 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:07.093964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2aad-0927-4041-9906-89bb38798510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:07.096125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a2df2aad-0927-4041-9906-89bb38798510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:07.182793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:07.184202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df2aad-0927-4041-9906-89bb38798510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:07.184364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:07.186174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df2aad-0927-4041-9906-89bb38798510 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:07.200896 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1969/3943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:07.203425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5412-7ac6-4792-846b-4fbb9c0b4080 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:07.211226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:07.212540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:07.213320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:07.213926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] PATH_INFO: `/v3/projects/3d50a5bfd7474f3db70d7ae667f895de` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:07.215961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d50a5bfd7474f3db70d7ae667f895de)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:07.218434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:07.342057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d50a5bfd7474f3db70d7ae667f895de', 'request_id': 'req-604451d9-36fc-4045-b467-8f2757b57ace'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.365209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d50a5bfd7474f3db70d7ae667f895de', 'request_id': 'req-604451d9-36fc-4045-b467-8f2757b57ace'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.379553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648c1e-8bec-4f9a-9c47-4650648d9b19 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:07.379912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648c1e-8bec-4f9a-9c47-4650648d9b19 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:07.380252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648c1e-8bec-4f9a-9c47-4650648d9b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:07.393487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d50a5bfd7474f3db70d7ae667f895de', 'request_id': 'req-604451d9-36fc-4045-b467-8f2757b57ace'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.412952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] The token cache is being invalidate because project 3d50a5bfd7474f3db70d7ae667f895de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:07.413291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.414390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.417100 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1975/3944] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:07 2022] DELETE /identity/v3/projects/3d50a5bfd7474f3db70d7ae667f895de => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:07.421172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:07.423678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:07.425655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ba648c1e-8bec-4f9a-9c47-4650648d9b19 None None] MFA Rules not processed for user `5570c8ed79ec4196aa73b96a03ee17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:07.427908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba648c1e-8bec-4f9a-9c47-4650648d9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:07.479428 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:07.511541 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:07.532639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604451d9-36fc-4045-b467-8f2757b57ace admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:07.542632 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1970/3945] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:07.543084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:07.543749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:07.544060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:07.546862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] PATH_INFO: `/v3/users/8c0cecbf0e1a4b8f933677ca3d4c8849` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:07.548702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0cecbf0e1a4b8f933677ca3d4c8849)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:07.551306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:07.611076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0cecbf0e1a4b8f933677ca3d4c8849'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.611726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0cecbf0e1a4b8f933677ca3d4c8849'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.612454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0cecbf0e1a4b8f933677ca3d4c8849'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.624226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0cecbf0e1a4b8f933677ca3d4c8849'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.642791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-825abd14-53a8-4646-9f5e-5cbe4ee391a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0cecbf0e1a4b8f933677ca3d4c8849'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:07.674416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1976/3946] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:07 2022] DELETE /identity/v3/users/8c0cecbf0e1a4b8f933677ca3d4c8849 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:08.332053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648c1e-8bec-4f9a-9c47-4650648d9b19 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:08.343867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648c1e-8bec-4f9a-9c47-4650648d9b19 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:08.440453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:08.441518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:08.441928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:08.442295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] PATH_INFO: `/v3/projects/02b6e3f38d3f4822a0f7cf0af7467258` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:08.443997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b6e3f38d3f4822a0f7cf0af7467258)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:08.446684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:08.526158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b6e3f38d3f4822a0f7cf0af7467258', 'request_id': 'req-920ab907-7ddb-4f2d-8262-47c2350574ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:08.533092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b6e3f38d3f4822a0f7cf0af7467258', 'request_id': 'req-920ab907-7ddb-4f2d-8262-47c2350574ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:08.540709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b6e3f38d3f4822a0f7cf0af7467258', 'request_id': 'req-920ab907-7ddb-4f2d-8262-47c2350574ab'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:08.561013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] The token cache is being invalidate because project 02b6e3f38d3f4822a0f7cf0af7467258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:08.561467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:08.562188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-920ab907-7ddb-4f2d-8262-47c2350574ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:08.564051 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1971/3947] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:08 2022] DELETE /identity/v3/projects/02b6e3f38d3f4822a0f7cf0af7467258 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:08.568827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff393be3-8cb1-4a96-9c0c-5b112bc55a09 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:08.569357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff393be3-8cb1-4a96-9c0c-5b112bc55a09 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:08.569472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff393be3-8cb1-4a96-9c0c-5b112bc55a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:08.600787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ff393be3-8cb1-4a96-9c0c-5b112bc55a09 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:08.604120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff393be3-8cb1-4a96-9c0c-5b112bc55a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:08.692595 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1977/3948] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:08.701049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c061e3-c281-4d6c-87a2-1ddc447a66d0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:08.701374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c061e3-c281-4d6c-87a2-1ddc447a66d0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:08.701623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c061e3-c281-4d6c-87a2-1ddc447a66d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:08.731110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f8c061e3-c281-4d6c-87a2-1ddc447a66d0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:08.732110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f8c061e3-c281-4d6c-87a2-1ddc447a66d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:08.742425 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1972/3949] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:08.746821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff393be3-8cb1-4a96-9c0c-5b112bc55a09 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:08.759156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff393be3-8cb1-4a96-9c0c-5b112bc55a09 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:08.763860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:08.764480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:08.764761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:08.765034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:08.765739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:08.766046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:08.767623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:08.785108 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1978/3950] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:08.787086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c061e3-c281-4d6c-87a2-1ddc447a66d0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:08.798415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c061e3-c281-4d6c-87a2-1ddc447a66d0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:08.806386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:08.807224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:08.807608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:08.807972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:08.808716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:08.811153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:08.854368 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1973/3951] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:08 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:08.858245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:08.871171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df030d-f893-4712-b23c-042197bf0321 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:08.963527 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:08.976885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:08.979068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:08.979833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:08.980261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:08.981459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:08.993086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:09.022447 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1979/3952] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:08 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:09.026696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:09.046921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21ef28-5d4d-4121-8e30-7b6ad4ee781d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:09.054093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:09.055176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.055462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.055734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:09.056493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:09.058213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:09.078929 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1974/3953] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:09.090205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:09.100689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6229d-5c77-42db-9c20-ffc42032f4ad admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:09.117888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46517749-83eb-4acd-bcfa-51d0011d7294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:09.120873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517749-83eb-4acd-bcfa-51d0011d7294 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.120873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517749-83eb-4acd-bcfa-51d0011d7294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.120873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517749-83eb-4acd-bcfa-51d0011d7294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:09.120873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46517749-83eb-4acd-bcfa-51d0011d7294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:09.121508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46517749-83eb-4acd-bcfa-51d0011d7294 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:09.143647 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1980/3954] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:09.147677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:09.160137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858ae2-4b05-41e8-bbdb-abef1d0c2ca1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:09.166403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:09.167356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.167637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.167912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] PATH_INFO: `/v3/projects/0aa4da7b69a746238f64a505db6e329f/users/823d8731a84c42f6a826e5ce08e566bd/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:09.189198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa4da7b69a746238f64a505db6e329f, user_id=823d8731a84c42f6a826e5ce08e566bd, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:09.205006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:09.222932 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:09.231229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1975/3955] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:09 2022] PUT /identity/v3/projects/0aa4da7b69a746238f64a505db6e329f/users/823d8731a84c42f6a826e5ce08e566bd/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:09.243487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1427d-0a59-4827-925e-00620510937a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.243753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1427d-0a59-4827-925e-00620510937a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.244079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1427d-0a59-4827-925e-00620510937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:09.304592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f7d1427d-0a59-4827-925e-00620510937a None None] MFA Rules not processed for user `823d8731a84c42f6a826e5ce08e566bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:09.306477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f7d1427d-0a59-4827-925e-00620510937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:09.463246 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1981/3956] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:09.468552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:09.686492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c0b78-0967-4c6e-81d3-525bf03d4c4c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:09.691884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:09.692825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.693354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.693874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:09.694723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:09.698929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:09.747954 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1976/3957] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:09 2022] POST /identity/v3/projects => generated 375 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:09.749362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1427d-0a59-4827-925e-00620510937a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:09.765539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1427d-0a59-4827-925e-00620510937a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:09.884098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:09.884713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.884989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.885283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:09.885932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:09.887996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:09.923992 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1982/3958] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:09 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:09.927957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:09.940347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6246b7-09ec-4677-8e11-c95a4751e024 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:09.945989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:09.946822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.947373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.947657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:09.948297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:09.950215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:09.963467 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1977/3959] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:09.967808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:09.979381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008d8c-d3b4-4377-b17b-b7a8119b1cc5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:09.987885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:09.988646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:09.988921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:09.989224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] PATH_INFO: `/v3/projects/a0fb8d91b7e246f0bdfe40713671874f/users/bda801771c6c45c1a14f63bbd5ea7014/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.011783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fb8d91b7e246f0bdfe40713671874f, user_id=bda801771c6c45c1a14f63bbd5ea7014, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.014744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.033633 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1983/3960] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:09 2022] PUT /identity/v3/projects/a0fb8d91b7e246f0bdfe40713671874f/users/bda801771c6c45c1a14f63bbd5ea7014/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:10.037760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.049615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083286d-3d9b-4563-8362-5212d0d9d635 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.120628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9e95-fb2c-4958-9d6d-0ddc5f08818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.121594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9e95-fb2c-4958-9d6d-0ddc5f08818a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.122029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9e95-fb2c-4958-9d6d-0ddc5f08818a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.122462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9e95-fb2c-4958-9d6d-0ddc5f08818a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.124945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d9e95-fb2c-4958-9d6d-0ddc5f08818a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.127182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d9e95-fb2c-4958-9d6d-0ddc5f08818a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.160309 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1978/3961] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:10.162893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.188533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517e6eb-a0b9-4c72-af18-e2316ccccf5a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.195247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.195934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.196638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.196922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] PATH_INFO: `/v3/projects/a0fb8d91b7e246f0bdfe40713671874f/users/bda801771c6c45c1a14f63bbd5ea7014/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.198990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fb8d91b7e246f0bdfe40713671874f, user_id=bda801771c6c45c1a14f63bbd5ea7014, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.212048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.228421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1984/3962] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:10 2022] PUT /identity/v3/projects/a0fb8d91b7e246f0bdfe40713671874f/users/bda801771c6c45c1a14f63bbd5ea7014/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:10.242981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea1a06-5782-4167-9965-2c885f0b08e2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.243349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea1a06-5782-4167-9965-2c885f0b08e2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.243698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea1a06-5782-4167-9965-2c885f0b08e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.281236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dcea1a06-5782-4167-9965-2c885f0b08e2 None None] MFA Rules not processed for user `bda801771c6c45c1a14f63bbd5ea7014`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:10.282552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dcea1a06-5782-4167-9965-2c885f0b08e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:10.353640 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:10.368093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.368406 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1979/3963] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:10.388925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af24e4f-f92d-4c10-9d99-5fd46feb83c4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.399476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.400833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.401170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.401455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.402398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.403450 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:10.403450 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:10.403450 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:10.404340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.430129 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1985/3964] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 11 01:19:10 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 264 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:10.434563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea1a06-5782-4167-9965-2c885f0b08e2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.447220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea1a06-5782-4167-9965-2c885f0b08e2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.457330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.458510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.459482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.460341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e4f7376d61274c73ace627fd04c9f067` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.462333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e4f7376d61274c73ace627fd04c9f067)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.464261 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:10.464261 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:10.464261 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:10.466316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.475628 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1980/3965] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 11 01:19:10 2022] GET /identity/v3/OS-OAUTH1/consumers/e4f7376d61274c73ace627fd04c9f067 => generated 218 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:10.480548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.487264 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:10.491794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612be125-d330-4289-972b-88f6b22ed1a7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.505767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.506520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.506874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.507218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e4f7376d61274c73ace627fd04c9f067` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.508790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e4f7376d61274c73ace627fd04c9f067)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.509712 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:10.509712 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:10.509712 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:10.510825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.517191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invalidating token cache because consumer e4f7376d61274c73ace627fd04c9f067 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:10.520133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:10.520982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:10.558641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e4f7376d61274c73ace627fd04c9f067', 'request_id': 'req-8064e2e3-919f-4b9d-b375-2d6e969e90bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:10.612648 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1986/3966] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 11 01:19:10 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e4f7376d61274c73ace627fd04c9f067 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:10.613417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.618581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:10.633283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591f1f7-26ff-4ddf-9154-af07010ea2c1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.639624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.640235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.640517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.641411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.642257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.643262 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:10.643262 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:10.643262 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:10.644152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.677113 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1981/3967] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 11 01:19:10 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:10.681346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.717812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e2e3-919f-4b9d-b375-2d6e969e90bd tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.728997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.729689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.730031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.730247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.730841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=81d4e0058f6842a4abbb9e0b2bf77418)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.731845 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:10.731845 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:10.731845 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:10.732725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.755932 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1987/3968] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 11 01:19:10 2022] GET /identity/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418 => generated 221 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:10.756543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.769021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60db66-eb6c-4163-8e9b-9fc0cb1f0ca1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.782721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.784461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.784461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.784678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.785474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=81d4e0058f6842a4abbb9e0b2bf77418)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.786692 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:10.786692 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:10.786692 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:10.792571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.793045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invalidating token cache because consumer 81d4e0058f6842a4abbb9e0b2bf77418 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:10.793789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:10.794709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:10.840575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '81d4e0058f6842a4abbb9e0b2bf77418', 'request_id': 'req-18840169-d10e-4792-a333-2ac906083219'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:10.880582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.881092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1982/3969] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 11 01:19:10 2022] DELETE /identity/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:10.884405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:10.905392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2c63-d371-4efb-a78f-21934d2a06de tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.911399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.912336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.912839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.913374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.914475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=81d4e0058f6842a4abbb9e0b2bf77418)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.916305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Sep 11 01:19:10.948383 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 11 01:19:10.949792 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:19:10.955095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1988/3970] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 11 01:19:10 2022] GET /identity/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418 => generated 74 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 01:19:10.958872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:10.973837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840169-d10e-4792-a333-2ac906083219 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:10.988246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:10.989119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:10.989593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:10.990054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:10.990812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=81d4e0058f6842a4abbb9e0b2bf77418)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:10.994643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:10.995138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invalidating token cache because consumer 81d4e0058f6842a4abbb9e0b2bf77418 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:10.996038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:10.998258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Sep 11 01:19:11.033543 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 11 01:19:11.034999 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:11.037903 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1983/3971] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 11 01:19:10 2022] DELETE /identity/v3/OS-OAUTH1/consumers/81d4e0058f6842a4abbb9e0b2bf77418 => generated 74 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 01:19:11.045279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.048121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:11.071970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f33b-2777-48d5-b96d-145a7342e1d7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.098859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.098859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.099163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.099531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.101077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.103353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.127508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1989/3972] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 11 01:19:11 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:11.131709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.145675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971157a-9036-48e9-9c02-015c33039614 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.152642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.153276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.153559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.153918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.154732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.156161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.177115 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1984/3973] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 11 01:19:11 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:11.179079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.192246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca29152-2bc4-4905-b06f-accee48af0f5 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.197479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.198163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.198391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.198750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.199229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.200736 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:11.200736 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:11.200736 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:11.201636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.225124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1990/3974] 10.222.0.16 () {58 vars in 1164 bytes} [Sun Sep 11 01:19:11 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:11.228256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.239201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a6d9c-7684-4123-a71c-8d6e1b288cd2 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.247731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.248588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.249087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.249505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/04d00836512d413e9597cc0c71a84e0b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.250236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=04d00836512d413e9597cc0c71a84e0b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.252433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.252745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invalidating token cache because consumer 04d00836512d413e9597cc0c71a84e0b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:11.253031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.254204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.270471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '04d00836512d413e9597cc0c71a84e0b', 'request_id': 'req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.302027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.302469 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1985/3975] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 11 01:19:11 2022] DELETE /identity/v3/OS-OAUTH1/consumers/04d00836512d413e9597cc0c71a84e0b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:11.304268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:11.339596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579668c-32ae-4345-947a-6d05a4b95cf1 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.344858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.345557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.345837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.346108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5d6febf3fa9d4e01a88578b60b14fda7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.346692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5d6febf3fa9d4e01a88578b60b14fda7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.348272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.348585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invalidating token cache because consumer 5d6febf3fa9d4e01a88578b60b14fda7 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:11.348865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.349569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.369893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5d6febf3fa9d4e01a88578b60b14fda7', 'request_id': 'req-78fe9318-8dc6-40e4-97aa-7845d20f3b27'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.391591 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1991/3976] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 11 01:19:11 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5d6febf3fa9d4e01a88578b60b14fda7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:11.397767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.413447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9bb9b-d7c5-4c05-8fad-d099b614f8d0 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.419880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.420655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.421040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.421451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.422214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.423914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.472076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1986/3977] 10.222.0.16 () {60 vars in 1185 bytes} [Sun Sep 11 01:19:11 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:11.474314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.476520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:11.495555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe9318-8dc6-40e4-97aa-7845d20f3b27 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.508449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.509341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.509624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.509895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a3a7e5a4258b4b18bf325427d2c12c0e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.510558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=a3a7e5a4258b4b18bf325427d2c12c0e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.518358 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:11.518358 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:11.518358 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:11.519285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.549165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1992/3978] 10.222.0.16 () {60 vars in 1285 bytes} [Sun Sep 11 01:19:11 2022] PATCH /identity/v3/OS-OAUTH1/consumers/a3a7e5a4258b4b18bf325427d2c12c0e => generated 220 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:11.553014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.564817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeaac-d978-47ea-84c0-3972e1277bd7 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.571275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.571940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.572551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.572805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a3a7e5a4258b4b18bf325427d2c12c0e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.573432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a3a7e5a4258b4b18bf325427d2c12c0e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.575026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.594662 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1987/3979] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 11 01:19:11 2022] GET /identity/v3/OS-OAUTH1/consumers/a3a7e5a4258b4b18bf325427d2c12c0e => generated 220 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:11.595812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.609975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e5cf9-e822-426a-b037-f7baa042a205 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.615304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda801771c6c45c1a14f63bbd5ea7014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0fb8d91b7e246f0bdfe40713671874f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.616230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.616364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.616591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a3a7e5a4258b4b18bf325427d2c12c0e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.617271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a3a7e5a4258b4b18bf325427d2c12c0e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.619227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.619227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invalidating token cache because consumer a3a7e5a4258b4b18bf325427d2c12c0e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:11.619447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.620088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.636681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a3a7e5a4258b4b18bf325427d2c12c0e', 'request_id': 'req-be6818fa-c2c6-41bf-bc19-bce8fc2fb17c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.653699 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1993/3980] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 11 01:19:11 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a3a7e5a4258b4b18bf325427d2c12c0e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:11.659450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.661440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:11.740997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85276033-2a4f-45c0-9fc4-2f634ef30cd6 tempest-OAUTHConsumersV3Test-882120331 tempest-OAUTHConsumersV3Test-882120331-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:11.746570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:11.747338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.747711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.748052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] PATH_INFO: `/v3/users/823d8731a84c42f6a826e5ce08e566bd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.749344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=823d8731a84c42f6a826e5ce08e566bd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:11.751395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:11.805360 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:11.816943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823d8731a84c42f6a826e5ce08e566bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.818010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823d8731a84c42f6a826e5ce08e566bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.818987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823d8731a84c42f6a826e5ce08e566bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.832118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823d8731a84c42f6a826e5ce08e566bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.840074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823d8731a84c42f6a826e5ce08e566bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:11.858935 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1988/3981] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:11 2022] DELETE /identity/v3/users/823d8731a84c42f6a826e5ce08e566bd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:11.860758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:11.861311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:11.861311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:11.881275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:11.882547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:11.962610 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1994/3982] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:11.972956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:11.974699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:12.068304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a0fa-1caf-46b9-a0a1-57d3870453d8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:12.074206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:12.075236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:12.075683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:12.076121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:12.090776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:12.092871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:12.104844 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1989/3983] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:12.415389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:12.416824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:12.434457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0c29c-5997-45e6-a933-605025a53e25 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:12.439535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:12.440175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:12.440455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:12.440863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] PATH_INFO: `/v3/projects/0aa4da7b69a746238f64a505db6e329f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:12.442499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa4da7b69a746238f64a505db6e329f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:12.444486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:12.633463 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:12.668803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa4da7b69a746238f64a505db6e329f', 'request_id': 'req-a869b64a-a12a-4c7a-b359-644d41586fff'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.676432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa4da7b69a746238f64a505db6e329f', 'request_id': 'req-a869b64a-a12a-4c7a-b359-644d41586fff'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.686527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa4da7b69a746238f64a505db6e329f', 'request_id': 'req-a869b64a-a12a-4c7a-b359-644d41586fff'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.698042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] The token cache is being invalidate because project 0aa4da7b69a746238f64a505db6e329f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:12.698336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.698980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.700481 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1995/3984] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:12 2022] DELETE /identity/v3/projects/0aa4da7b69a746238f64a505db6e329f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:12.704768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:12.715820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd5882-9bd9-4964-92e8-d0b31fac4e2c service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:12.778653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:12.779335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:12.779613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:12.779882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] PATH_INFO: `/v3/users/bda801771c6c45c1a14f63bbd5ea7014` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:12.781085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda801771c6c45c1a14f63bbd5ea7014)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:12.783050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:12.844494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda801771c6c45c1a14f63bbd5ea7014'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.845225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda801771c6c45c1a14f63bbd5ea7014'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.845845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda801771c6c45c1a14f63bbd5ea7014'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.866125 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:12.877121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda801771c6c45c1a14f63bbd5ea7014'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.887890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0491916-1e74-470d-a90f-fdbca31bd28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda801771c6c45c1a14f63bbd5ea7014'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:12.901040 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1990/3985] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:12 2022] DELETE /identity/v3/users/bda801771c6c45c1a14f63bbd5ea7014 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:13.315877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:13.317599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:13.334965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869b64a-a12a-4c7a-b359-644d41586fff admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:13.406232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:13.406693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.406975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.407250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] PATH_INFO: `/v3/projects/a0fb8d91b7e246f0bdfe40713671874f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.408407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0fb8d91b7e246f0bdfe40713671874f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:13.410587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:13.470392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0fb8d91b7e246f0bdfe40713671874f', 'request_id': 'req-eab392b8-e61a-4fc4-84f3-ac3063ad539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:13.478325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0fb8d91b7e246f0bdfe40713671874f', 'request_id': 'req-eab392b8-e61a-4fc4-84f3-ac3063ad539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:13.486957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0fb8d91b7e246f0bdfe40713671874f', 'request_id': 'req-eab392b8-e61a-4fc4-84f3-ac3063ad539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:13.498236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] The token cache is being invalidate because project a0fb8d91b7e246f0bdfe40713671874f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:13.498523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:13.499197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eab392b8-e61a-4fc4-84f3-ac3063ad539e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:13.500753 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1996/3986] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:13 2022] DELETE /identity/v3/projects/a0fb8d91b7e246f0bdfe40713671874f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:13.505827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae8a5a-407b-4e32-bfcb-9211135ad430 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.506171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae8a5a-407b-4e32-bfcb-9211135ad430 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.506458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae8a5a-407b-4e32-bfcb-9211135ad430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.538430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-65ae8a5a-407b-4e32-bfcb-9211135ad430 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:13.540733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-65ae8a5a-407b-4e32-bfcb-9211135ad430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:13.624805 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1991/3987] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:13.635312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667d49-f756-45a3-af11-a4e71f4cf168 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.635312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667d49-f756-45a3-af11-a4e71f4cf168 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.635815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667d49-f756-45a3-af11-a4e71f4cf168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.665578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-25667d49-f756-45a3-af11-a4e71f4cf168 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:13.667151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-25667d49-f756-45a3-af11-a4e71f4cf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:13.675700 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1997/3988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:13.680936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae8a5a-407b-4e32-bfcb-9211135ad430 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:13.691062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae8a5a-407b-4e32-bfcb-9211135ad430 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:13.696732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:13.697403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.697679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.697945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.698595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:13.698899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:13.700514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:13.713525 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1992/3989] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:13.717902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25667d49-f756-45a3-af11-a4e71f4cf168 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:13.727606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25667d49-f756-45a3-af11-a4e71f4cf168 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:13.732452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:13.733118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.733403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.733674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.734311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:13.736260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:13.769350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1998/3990] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:13 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:13.770718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:13.783291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadfed3-ef6b-47aa-ac55-3fff953c5e3b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:13.849669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:13.850291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.850571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.850841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.852312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:13.854455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:13.887952 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1993/3991] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:13 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:13.892680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:13.928900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836c253-52d7-4be5-8ee5-f09d22e803e3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:13.935149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:13.935894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.936131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.936406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.937055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:13.939089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:13.953378 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 1999/3992] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:13.954380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:13.966369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65298ba7-8c35-4558-9032-775007a50008 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:13.971229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7990-91f6-433d-aed0-5bdc6677f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:13.971832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7990-91f6-433d-aed0-5bdc6677f215 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:13.972112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7990-91f6-433d-aed0-5bdc6677f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:13.972383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7990-91f6-433d-aed0-5bdc6677f215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:13.973053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa7990-91f6-433d-aed0-5bdc6677f215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:13.974687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa7990-91f6-433d-aed0-5bdc6677f215 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:13.987048 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1994/3993] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:13.991188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:13.998558 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:14.003672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6d945-094d-46e2-be5f-2a6851a335fe admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.010581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.011535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.011981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.012421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] PATH_INFO: `/v3/projects/c51b19dced264560b8842bc60dbf363c/users/da92e1793ec748b4ae5b7ae820def17e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.030413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51b19dced264560b8842bc60dbf363c, user_id=da92e1793ec748b4ae5b7ae820def17e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.033126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.048077 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2000/3994] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:13 2022] PUT /identity/v3/projects/c51b19dced264560b8842bc60dbf363c/users/da92e1793ec748b4ae5b7ae820def17e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:14.060075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a341b-c877-4342-8002-7ba73ef3e203 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.060361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a341b-c877-4342-8002-7ba73ef3e203 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.060634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a341b-c877-4342-8002-7ba73ef3e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.089951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a50a341b-c877-4342-8002-7ba73ef3e203 None None] MFA Rules not processed for user `da92e1793ec748b4ae5b7ae820def17e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:14.091183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a50a341b-c877-4342-8002-7ba73ef3e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:14.122045 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:14.165968 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1995/3995] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:14.170854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.236863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92867a14-2d91-4b37-bc21-86da6db5956b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.241652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.242819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.243098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.243377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.244015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.246260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.281695 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2001/3996] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:14 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:14.286016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a341b-c877-4342-8002-7ba73ef3e203 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.297679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a341b-c877-4342-8002-7ba73ef3e203 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.361800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.362516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.363318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.363318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.363975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.366272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.391731 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1996/3997] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:14 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:14.395856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.407252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146548-d58a-4660-9f55-b391ebc809d6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.412092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.412784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.413154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.413490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.414232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.415858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.426593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2002/3998] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:14.431292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.441458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf407121-ae09-4afd-94e0-ee7d5c126bb2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.446696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.447351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.447627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.448138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] PATH_INFO: `/v3/projects/eda918ce9e8c47b1bc606e89052dd605/users/b13a9ce6413c478f85a83eb600e2e8a2/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.467665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda918ce9e8c47b1bc606e89052dd605, user_id=b13a9ce6413c478f85a83eb600e2e8a2, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.470607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.487307 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1997/3999] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:14 2022] PUT /identity/v3/projects/eda918ce9e8c47b1bc606e89052dd605/users/b13a9ce6413c478f85a83eb600e2e8a2/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:14.492842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.503837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f1bb7-b3d4-4b2f-b148-54779306347c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.584628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e998d2-c479-4a2c-b38e-9bd471c476e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.585511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e998d2-c479-4a2c-b38e-9bd471c476e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.585880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e998d2-c479-4a2c-b38e-9bd471c476e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.586390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e998d2-c479-4a2c-b38e-9bd471c476e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.587374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e998d2-c479-4a2c-b38e-9bd471c476e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.588860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e998d2-c479-4a2c-b38e-9bd471c476e1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.604845 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2003/4000] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:14.609286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.623808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764f074-3bea-49eb-b30e-3b8eea1d008b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.632249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.633898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.634308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.634654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] PATH_INFO: `/v3/projects/eda918ce9e8c47b1bc606e89052dd605/users/b13a9ce6413c478f85a83eb600e2e8a2/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.636871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda918ce9e8c47b1bc606e89052dd605, user_id=b13a9ce6413c478f85a83eb600e2e8a2, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.640245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.657092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1998/4001] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:14 2022] PUT /identity/v3/projects/eda918ce9e8c47b1bc606e89052dd605/users/b13a9ce6413c478f85a83eb600e2e8a2/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:14.668041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7bdaa-d07e-4443-90da-a15e2e0b003e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.668403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7bdaa-d07e-4443-90da-a15e2e0b003e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.668743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7bdaa-d07e-4443-90da-a15e2e0b003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.700475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8ae7bdaa-d07e-4443-90da-a15e2e0b003e None None] MFA Rules not processed for user `b13a9ce6413c478f85a83eb600e2e8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:14.701924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ae7bdaa-d07e-4443-90da-a15e2e0b003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:14.749692 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:14.781918 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2004/4002] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:14.786674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.799048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5f98-118d-4175-9fe1-4e59c2e40b8a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.805335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.806028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.806386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.806727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.807437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.809389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:14.845168 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 1999/4003] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:14 2022] POST /identity/v3/projects => generated 359 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:14.849398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7bdaa-d07e-4443-90da-a15e2e0b003e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:14.859480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7bdaa-d07e-4443-90da-a15e2e0b003e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:14.957608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:14.958671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:14.958671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:14.958921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:14.959454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:14.961486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.015158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.033379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2005/4004] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:14 2022] POST /identity/v3/users => generated 416 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:15.047663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29ecff-a81d-47ee-b118-3038c46a616c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.053795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.055219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.055894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.056776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/users/436713c7bc954ec3b5568f82d7f43ae7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.072975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_user(user_id=436713c7bc954ec3b5568f82d7f43ae7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.075228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.077109 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2000/4005] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:19:15 2022] GET /identity/v3/users/436713c7bc954ec3b5568f82d7f43ae7 => generated 416 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:15.081434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.092575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a9ece-a165-4322-8ac9-9f37e90a616b tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.099385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.100023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.100326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.100603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/users/436713c7bc954ec3b5568f82d7f43ae7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.102384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_user(user_id=436713c7bc954ec3b5568f82d7f43ae7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.104530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.155363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436713c7bc954ec3b5568f82d7f43ae7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.156127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436713c7bc954ec3b5568f82d7f43ae7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.156935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436713c7bc954ec3b5568f82d7f43ae7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.167083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436713c7bc954ec3b5568f82d7f43ae7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.186362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436713c7bc954ec3b5568f82d7f43ae7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.201229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2006/4006] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:15 2022] DELETE /identity/v3/users/436713c7bc954ec3b5568f82d7f43ae7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:15.205339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.207403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:15.221040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537213b-46eb-46bc-b793-a2638494d2b9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.267660 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:15.286115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.286790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.287076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.287354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/0a7979d302154a4e9491168118e9e55a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.288517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a7979d302154a4e9491168118e9e55a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.291178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.353991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7979d302154a4e9491168118e9e55a', 'request_id': 'req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.360466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7979d302154a4e9491168118e9e55a', 'request_id': 'req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.368130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7979d302154a4e9491168118e9e55a', 'request_id': 'req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.390933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 0a7979d302154a4e9491168118e9e55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:15.391600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.392623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.394550 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2001/4007] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:15 2022] DELETE /identity/v3/projects/0a7979d302154a4e9491168118e9e55a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:15.402741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.413412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8589da-ece5-4328-9788-17048a3689ba tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.454091 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:15.481533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.482301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.482493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.482771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.483424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.485142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.503827 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2007/4008] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:15 2022] POST /identity/v3/projects => generated 348 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:15.518399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.525075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:15.541491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5c4d-22e3-436d-a900-40a9c8cfcbad tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.596130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.596731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.597009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.597307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.597959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:15.598261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.599255 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:15.599255 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:15.599255 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:15.600383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.617562 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2002/4009] 10.222.0.16 () {58 vars in 1160 bytes} [Sun Sep 11 01:19:15 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:15.621760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.632076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2a2d4-a4f6-445d-b369-a4e7c90377c7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.637134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.637729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.638007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.638280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.638921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.640484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.658997 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2008/4010] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 11 01:19:15 2022] GET /identity/v3/domains => generated 829 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:15.663160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.673700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385c6c6-93e5-4639-920f-a0bae1d60b29 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.678250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.678864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.679141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.679717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/902af93047c147a6b7a27a61d35dff8d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.680930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:update_project(project_id=902af93047c147a6b7a27a61d35dff8d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.681957 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:15.681957 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:15.681957 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:15.682938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.696460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '902af93047c147a6b7a27a61d35dff8d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.697186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '902af93047c147a6b7a27a61d35dff8d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.721458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '902af93047c147a6b7a27a61d35dff8d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.722092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '902af93047c147a6b7a27a61d35dff8d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.725102 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2003/4011] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 11 01:19:15 2022] PATCH /identity/v3/projects/902af93047c147a6b7a27a61d35dff8d => generated 362 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:15.729016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.730906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:15.744620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508744d9-d0d2-4da6-9004-ddc69d672f83 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.801135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:15.801756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:15.802035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:15.802308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/902af93047c147a6b7a27a61d35dff8d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:15.813093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=902af93047c147a6b7a27a61d35dff8d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:15.814792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:15.837593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '902af93047c147a6b7a27a61d35dff8d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.843170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '902af93047c147a6b7a27a61d35dff8d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.889405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902af93047c147a6b7a27a61d35dff8d', 'request_id': 'req-8888e189-1669-4a40-bacb-2b239f1e9caf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.895661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902af93047c147a6b7a27a61d35dff8d', 'request_id': 'req-8888e189-1669-4a40-bacb-2b239f1e9caf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.904700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902af93047c147a6b7a27a61d35dff8d', 'request_id': 'req-8888e189-1669-4a40-bacb-2b239f1e9caf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.915601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 902af93047c147a6b7a27a61d35dff8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:15.915883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.916511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.926698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '902af93047c147a6b7a27a61d35dff8d', 'request_id': 'req-8888e189-1669-4a40-bacb-2b239f1e9caf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.927375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '902af93047c147a6b7a27a61d35dff8d', 'request_id': 'req-8888e189-1669-4a40-bacb-2b239f1e9caf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.931078 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:15.932689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '902af93047c147a6b7a27a61d35dff8d', 'request_id': 'req-8888e189-1669-4a40-bacb-2b239f1e9caf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:15.940298 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2009/4012] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:15 2022] DELETE /identity/v3/projects/902af93047c147a6b7a27a61d35dff8d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:15.945409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:15.956194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5dc85-80fb-47e9-8ed1-a252aa8238cf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:15.992572 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:16.023834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.024417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.024725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.024992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.025667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.027838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.062544 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2004/4013] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:15 2022] POST /identity/v3/projects => generated 360 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:16.066991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.069042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:16.082962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888e189-1669-4a40-bacb-2b239f1e9caf tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.154801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.155592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.155978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.156353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/9305f3da55864463983e2460b36578f5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.157949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=9305f3da55864463983e2460b36578f5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.160261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.162290 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2010/4014] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:16 2022] GET /identity/v3/projects/9305f3da55864463983e2460b36578f5 => generated 360 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:16.169407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.182304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88de01-de2c-4f93-9086-97fc188f63be tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.192847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.193529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.193816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.194257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/9305f3da55864463983e2460b36578f5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.196135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9305f3da55864463983e2460b36578f5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.198275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.249237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9305f3da55864463983e2460b36578f5', 'request_id': 'req-7daa3208-7f20-4c2d-9378-1edb3a840c45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.254762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9305f3da55864463983e2460b36578f5', 'request_id': 'req-7daa3208-7f20-4c2d-9378-1edb3a840c45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.262256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9305f3da55864463983e2460b36578f5', 'request_id': 'req-7daa3208-7f20-4c2d-9378-1edb3a840c45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.275391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 9305f3da55864463983e2460b36578f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:16.275796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.276534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.278406 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2005/4015] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:16 2022] DELETE /identity/v3/projects/9305f3da55864463983e2460b36578f5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:16.283341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.285033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:16.297603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b6958-76f5-4d28-a027-c6e77a71fb7f tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.357293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.357909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.358194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.358467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.359116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.361000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.397643 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2011/4016] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:16 2022] POST /identity/v3/projects => generated 360 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:16.402052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.415258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa3208-7f20-4c2d-9378-1edb3a840c45 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.488925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.489745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.490530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.490530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/545266df1b754e5eaca5a63cd31993a5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.491541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=545266df1b754e5eaca5a63cd31993a5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.494273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.496441 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2006/4017] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:16 2022] GET /identity/v3/projects/545266df1b754e5eaca5a63cd31993a5 => generated 360 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:16.501576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.514417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae394e-bf38-432f-ab58-14183edd7d42 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.521857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.522577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.523805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.524149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/545266df1b754e5eaca5a63cd31993a5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.525367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=545266df1b754e5eaca5a63cd31993a5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.541321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.631307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545266df1b754e5eaca5a63cd31993a5', 'request_id': 'req-3700c9c3-d354-4024-b0d2-a113bdfca4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.641774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545266df1b754e5eaca5a63cd31993a5', 'request_id': 'req-3700c9c3-d354-4024-b0d2-a113bdfca4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.654938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545266df1b754e5eaca5a63cd31993a5', 'request_id': 'req-3700c9c3-d354-4024-b0d2-a113bdfca4b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.679205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 545266df1b754e5eaca5a63cd31993a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:16.680009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.680897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:16.683046 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2012/4018] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:16 2022] DELETE /identity/v3/projects/545266df1b754e5eaca5a63cd31993a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:16.687997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.689997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:16.708630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab8996-0a41-4776-9bf2-8d99f39dee62 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.766865 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:16.789208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.790245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.790539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.790811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.791461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.793992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.832309 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2007/4019] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:19:16 2022] POST /identity/v3/projects => generated 348 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:16.833820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.844205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700c9c3-d354-4024-b0d2-a113bdfca4b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.847795 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:16.905713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.906357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.906639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.906911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/202095d35a424196b3bca3980183fcd6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.908097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=202095d35a424196b3bca3980183fcd6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.910228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.911922 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2013/4020] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:16 2022] GET /identity/v3/projects/202095d35a424196b3bca3980183fcd6 => generated 348 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:16.916689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:16.928252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7f69-93bd-4539-8a29-7b27e8ab0be1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:16.934353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:16.934538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:16.934788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:16.935052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/202095d35a424196b3bca3980183fcd6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:16.936171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=202095d35a424196b3bca3980183fcd6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:16.938289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:16.995334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202095d35a424196b3bca3980183fcd6', 'request_id': 'req-ef4d6c90-7567-4f46-b752-648f927634f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.002286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202095d35a424196b3bca3980183fcd6', 'request_id': 'req-ef4d6c90-7567-4f46-b752-648f927634f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.011012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202095d35a424196b3bca3980183fcd6', 'request_id': 'req-ef4d6c90-7567-4f46-b752-648f927634f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.026970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 202095d35a424196b3bca3980183fcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:17.027652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.028412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.030183 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2008/4021] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:16 2022] DELETE /identity/v3/projects/202095d35a424196b3bca3980183fcd6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:17.035427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:17.037649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:17.051468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fd62f-3433-4db0-ad25-1d61e8ff25fb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:17.108721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:17.109497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:17.109783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:17.110069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:17.110745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:17.112321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:17.129435 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2014/4022] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:19:17 2022] POST /identity/v3/domains => generated 276 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:17.133638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:17.143604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6c90-7567-4f46-b752-648f927634f7 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:17.201841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:17.202481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:17.202740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:17.203008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:17.203638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:17.205540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:17.252553 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2009/4023] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:17 2022] POST /identity/v3/projects => generated 404 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:17.256332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:17.267776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825a119-4cf1-4c55-a48a-60ecb2866801 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:17.328197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:17.328837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:17.329157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:17.329435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/7551bed4c1894d29abcff593cb30fec1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:17.330580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=7551bed4c1894d29abcff593cb30fec1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:17.332613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:17.334301 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2015/4024] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:17 2022] GET /identity/v3/projects/7551bed4c1894d29abcff593cb30fec1 => generated 404 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:17.338640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:17.349312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be2101-dc2b-40bc-b74c-dd4863f2cc39 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:17.354913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:17.355529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:17.355811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:17.356086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/7551bed4c1894d29abcff593cb30fec1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:17.357350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7551bed4c1894d29abcff593cb30fec1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:17.359268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:17.392608 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:17.411673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7551bed4c1894d29abcff593cb30fec1', 'request_id': 'req-601a057e-9df9-437f-b9e2-6fa880772401'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.419574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7551bed4c1894d29abcff593cb30fec1', 'request_id': 'req-601a057e-9df9-437f-b9e2-6fa880772401'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.426755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7551bed4c1894d29abcff593cb30fec1', 'request_id': 'req-601a057e-9df9-437f-b9e2-6fa880772401'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.447613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 7551bed4c1894d29abcff593cb30fec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:17.447901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.448555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.450519 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2010/4025] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:17 2022] DELETE /identity/v3/projects/7551bed4c1894d29abcff593cb30fec1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:17.455804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:17.457706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:17.470569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625a912-e06d-4183-9fd8-529090612379 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:17.514567 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:17.529264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:17.529909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:17.530192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:17.530470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains/0fd5a008d8854d1eb4e37b75e0c92962` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:17.531799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0fd5a008d8854d1eb4e37b75e0c92962)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:17.532845 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:17.532845 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:17.532845 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:17.533784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:17.557130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.557878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.582835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.583446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.585982 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2016/4026] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:19:17 2022] PATCH /identity/v3/domains/0fd5a008d8854d1eb4e37b75e0c92962 => generated 277 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:17.590020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:17.599990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a057e-9df9-437f-b9e2-6fa880772401 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:17.667377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:17.668163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:17.668524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:17.668920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains/0fd5a008d8854d1eb4e37b75e0c92962` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:17.682015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0fd5a008d8854d1eb4e37b75e0c92962)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:17.685155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:17.731727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.879055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.923375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962', 'request_id': 'req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.929641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962', 'request_id': 'req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.936615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962', 'request_id': 'req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.956428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 0fd5a008d8854d1eb4e37b75e0c92962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:17.956781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.957476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.967307 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:17.970458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962', 'request_id': 'req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.970613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962', 'request_id': 'req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.971288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0fd5a008d8854d1eb4e37b75e0c92962', 'request_id': 'req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:17.987881 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2011/4027] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:17 2022] DELETE /identity/v3/domains/0fd5a008d8854d1eb4e37b75e0c92962 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:18.002639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:18.004158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:18.020725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ad674-ad61-48a3-832c-fa9d5c4a17b6 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:18.096854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:18.097503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:18.097785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:18.098060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:18.098716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:18.100428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:18.128625 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2017/4028] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:19:18 2022] POST /identity/v3/domains => generated 276 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:18.130769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:18.133324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:18.147612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb464-44c8-4a1e-8eb2-093dacb20c01 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:18.208102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:18.208838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:18.209258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:18.209600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:18.210285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:18.212794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:18.253404 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2012/4029] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:18 2022] POST /identity/v3/projects => generated 410 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:18.254977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:18.277387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bba3a-4555-4bd4-81fe-a3da0c19bbab tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:18.348819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:18.349543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:18.349829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:18.350105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:18.350775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:18.353093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:18.393372 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2018/4030] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:18 2022] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:18.394819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:18.407210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea446b-cbbf-4038-8907-32212d1ceac1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:18.498168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:18.498851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:18.499183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:18.499999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/fff5b22f6285400e840db75f4636d597` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:18.501314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fff5b22f6285400e840db75f4636d597)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:18.504063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:18.571948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff5b22f6285400e840db75f4636d597', 'request_id': 'req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.579047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff5b22f6285400e840db75f4636d597', 'request_id': 'req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.590387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff5b22f6285400e840db75f4636d597', 'request_id': 'req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.604464 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:18.610724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project fff5b22f6285400e840db75f4636d597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:18.610890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.612359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.618044 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2013/4031] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:18 2022] DELETE /identity/v3/projects/fff5b22f6285400e840db75f4636d597 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:18.619479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:18.622818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:18.636623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d010a-79bc-400c-a27b-13dbb3d57af9 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:18.658463 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:18.703641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:18.704280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:18.704562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:18.704864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/c90c45a78e054778b46e388560017187` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:18.706042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c90c45a78e054778b46e388560017187)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:18.707967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:18.777594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90c45a78e054778b46e388560017187', 'request_id': 'req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.779467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90c45a78e054778b46e388560017187', 'request_id': 'req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.791001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90c45a78e054778b46e388560017187', 'request_id': 'req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.802828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project c90c45a78e054778b46e388560017187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:18.803818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.803818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.805786 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2019/4032] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:18 2022] DELETE /identity/v3/projects/c90c45a78e054778b46e388560017187 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:18.809760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:18.822391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8a3fb-f00a-440c-9fb4-bc68547ddf07 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:18.901086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:18.901913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:18.902506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:18.902840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains/122734862fbd447dab1f976b51dce142` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:18.904204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=122734862fbd447dab1f976b51dce142)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:18.905977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:18.928909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '122734862fbd447dab1f976b51dce142'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.929938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '122734862fbd447dab1f976b51dce142'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.961421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '122734862fbd447dab1f976b51dce142'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.962132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '122734862fbd447dab1f976b51dce142'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:18.968129 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2014/4033] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:19:18 2022] PATCH /identity/v3/domains/122734862fbd447dab1f976b51dce142 => generated 277 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:18.970111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:18.974478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:18.995124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20f0e8-5cc0-4791-b8b4-60ed9a867015 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:19.085385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:19.085385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:19.085385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:19.085746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains/122734862fbd447dab1f976b51dce142` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:19.109876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=122734862fbd447dab1f976b51dce142)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:19.111122 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:19.111122 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:19.111122 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:19.113590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:19.141575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '122734862fbd447dab1f976b51dce142'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.145024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '122734862fbd447dab1f976b51dce142'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.171897 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:19.197388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122734862fbd447dab1f976b51dce142', 'request_id': 'req-3a44b92f-d992-408a-b17f-f1c8c037656d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.205869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122734862fbd447dab1f976b51dce142', 'request_id': 'req-3a44b92f-d992-408a-b17f-f1c8c037656d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.214644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122734862fbd447dab1f976b51dce142', 'request_id': 'req-3a44b92f-d992-408a-b17f-f1c8c037656d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.227421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 122734862fbd447dab1f976b51dce142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:19.227797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.228492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.236773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '122734862fbd447dab1f976b51dce142', 'request_id': 'req-3a44b92f-d992-408a-b17f-f1c8c037656d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.237521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '122734862fbd447dab1f976b51dce142', 'request_id': 'req-3a44b92f-d992-408a-b17f-f1c8c037656d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.242591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '122734862fbd447dab1f976b51dce142', 'request_id': 'req-3a44b92f-d992-408a-b17f-f1c8c037656d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.250386 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2020/4034] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:18 2022] DELETE /identity/v3/domains/122734862fbd447dab1f976b51dce142 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:19.255392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:19.256999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:19.281470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72909-d0e0-4644-9830-39b5a9e640e3 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:19.343862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:19.344595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:19.344944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:19.345323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:19.346031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:19.347947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:19.386798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2015/4035] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:19 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:19.390916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:19.392561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:19.406448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44b92f-d992-408a-b17f-f1c8c037656d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:19.470098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:19.471072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:19.471348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:19.471618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/f5ecdc4112374580b326ae21b85389a3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:19.472779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=f5ecdc4112374580b326ae21b85389a3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:19.474843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:19.477405 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2021/4036] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:19 2022] GET /identity/v3/projects/f5ecdc4112374580b326ae21b85389a3 => generated 377 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:19.481829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:19.524233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac307-3a71-4309-815c-bd7fc3b53763 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:19.529834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:19.530609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:19.530893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:19.531847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:19.532525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:19.541221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:19.572848 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2016/4037] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:19:19 2022] GET /identity/v3/projects => generated 6175 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:19.577452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:19.588747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d3042-dafd-4198-b4e2-f48540d1ecbb tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:19.593660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:19.594449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:19.594797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:19.595137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/f5ecdc4112374580b326ae21b85389a3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:19.596637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5ecdc4112374580b326ae21b85389a3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:19.598898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:19.671864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ecdc4112374580b326ae21b85389a3', 'request_id': 'req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.686877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ecdc4112374580b326ae21b85389a3', 'request_id': 'req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.709451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ecdc4112374580b326ae21b85389a3', 'request_id': 'req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.724493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project f5ecdc4112374580b326ae21b85389a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:19.724907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.725669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:19.727800 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2022/4038] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:19 2022] DELETE /identity/v3/projects/f5ecdc4112374580b326ae21b85389a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:19.732854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:19.734819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:19.748270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891548c5-040f-4c30-9631-4439fc39dd15 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:19.786477 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:19.837887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:19.838580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:19.839302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:19.839605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:19.840338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:19.842210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:19.877664 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2017/4039] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:19:19 2022] POST /identity/v3/projects => generated 346 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:19.881950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:19.894217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d1ccd-fc2d-445b-b608-efc64fefa3d4 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:19.909950 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:19.967281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:19.968049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:19.968327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:19.968603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/80749d0601404ae9836fb926e005bd11` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:19.969866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:update_project(project_id=80749d0601404ae9836fb926e005bd11)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:19.970863 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:19.970863 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:19:19.970863 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:19:19.973130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.009567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2023/4040] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 11 01:19:19 2022] PATCH /identity/v3/projects/80749d0601404ae9836fb926e005bd11 => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:20.013892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.025054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af430c-9e43-440a-8ccd-883ca29100e1 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.030030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.030662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.030942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.031215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/80749d0601404ae9836fb926e005bd11` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.044240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=80749d0601404ae9836fb926e005bd11)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.046565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.048360 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2018/4041] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:20 2022] GET /identity/v3/projects/80749d0601404ae9836fb926e005bd11 => generated 348 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:20.052540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.063686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8f72f-808f-4bda-95d2-b525ed6e4b5e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.068514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.069349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.070362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.070753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/80749d0601404ae9836fb926e005bd11` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.072019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80749d0601404ae9836fb926e005bd11)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.074386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.183976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80749d0601404ae9836fb926e005bd11', 'request_id': 'req-4d7946ac-5a1d-48a1-b315-73a5517e6288'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.191023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80749d0601404ae9836fb926e005bd11', 'request_id': 'req-4d7946ac-5a1d-48a1-b315-73a5517e6288'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.201533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80749d0601404ae9836fb926e005bd11', 'request_id': 'req-4d7946ac-5a1d-48a1-b315-73a5517e6288'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.213807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 80749d0601404ae9836fb926e005bd11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:20.214171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.214869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.216638 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2024/4042] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:20 2022] DELETE /identity/v3/projects/80749d0601404ae9836fb926e005bd11 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:20.221540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.223543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:20.238098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d29b7-a171-46ac-9699-27ba6617026c tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.298764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.299445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.299735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.300015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.300641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.302625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.336111 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2019/4043] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:20 2022] POST /identity/v3/projects => generated 360 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:20.340064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.351165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7946ac-5a1d-48a1-b315-73a5517e6288 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.409523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.410160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.410439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.410711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/911b2f9d3a91473b8214b30c69148c2c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.411956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:update_project(project_id=911b2f9d3a91473b8214b30c69148c2c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.414522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.440886 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:20.481311 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2025/4044] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 11 01:19:20 2022] PATCH /identity/v3/projects/911b2f9d3a91473b8214b30c69148c2c => generated 372 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:20.482712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.501349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16333-8bb5-4f94-b22b-65c42afedd55 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.506012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.506661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.506942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.507724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/911b2f9d3a91473b8214b30c69148c2c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.523570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=911b2f9d3a91473b8214b30c69148c2c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.526101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.528595 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2020/4045] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:20 2022] GET /identity/v3/projects/911b2f9d3a91473b8214b30c69148c2c => generated 359 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:20.534774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.545851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68643fd2-ef30-403c-83d9-61e9d2b25690 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.550751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.551415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.551698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.552388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/911b2f9d3a91473b8214b30c69148c2c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.553607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=911b2f9d3a91473b8214b30c69148c2c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.555716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.640681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911b2f9d3a91473b8214b30c69148c2c', 'request_id': 'req-b13c1949-c522-4edf-af3d-7a5ff6d7013d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.650591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911b2f9d3a91473b8214b30c69148c2c', 'request_id': 'req-b13c1949-c522-4edf-af3d-7a5ff6d7013d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.666064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911b2f9d3a91473b8214b30c69148c2c', 'request_id': 'req-b13c1949-c522-4edf-af3d-7a5ff6d7013d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.682273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project 911b2f9d3a91473b8214b30c69148c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:20.683027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.684219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b13c1949-c522-4edf-af3d-7a5ff6d7013d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:20.690476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2026/4046] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:20 2022] DELETE /identity/v3/projects/911b2f9d3a91473b8214b30c69148c2c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:20.691948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.697098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:20.713394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98881519-6186-4e93-aae9-478417e6e96e tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.808504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.809704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.809704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.809938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.810635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.814993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.849785 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2021/4047] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:20 2022] POST /identity/v3/projects => generated 353 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:20.850997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.852228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.852981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.853775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:20.858699 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:20.883158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:20.884516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:20.951288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970faf4-6b0b-442b-b29b-3c13a9f5dcda tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:20.957825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:20.958676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:20.959005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:20.959386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/b4d87471b4814373bb2181c40bea449f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:20.961270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:update_project(project_id=b4d87471b4814373bb2181c40bea449f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:20.964031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:20.985587 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2027/4048] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:21.019831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:21.022184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:21.035671 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2022/4049] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 11 01:19:20 2022] PATCH /identity/v3/projects/b4d87471b4814373bb2181c40bea449f => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:21.042184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:21.059101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c99ab-8c83-425b-a0dd-d2c54d1a1c3d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:21.070925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:21.082308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:21.082308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:21.082308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/b4d87471b4814373bb2181c40bea449f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:21.104611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4d87471b4814373bb2181c40bea449f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:21.106836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:21.109297 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2023/4050] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:19:21 2022] GET /identity/v3/projects/b4d87471b4814373bb2181c40bea449f => generated 355 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:21.117577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:21.129199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805045ea-5743-43a5-859a-ba3f47a88f7a tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:21.136772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:21.136772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:21.137369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:21.137802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/projects/b4d87471b4814373bb2181c40bea449f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:21.139089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4d87471b4814373bb2181c40bea449f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:21.141374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:21.216318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf6755-d636-4a35-9bd7-d726eb63a460 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:21.221599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d87471b4814373bb2181c40bea449f', 'request_id': 'req-7205d540-9853-4084-bba3-250c7583315d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.228646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d87471b4814373bb2181c40bea449f', 'request_id': 'req-7205d540-9853-4084-bba3-250c7583315d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.235819 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:21.238017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d87471b4814373bb2181c40bea449f', 'request_id': 'req-7205d540-9853-4084-bba3-250c7583315d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.262154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] The token cache is being invalidate because project b4d87471b4814373bb2181c40bea449f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:21.262449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.263451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.266124 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2024/4051] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:21 2022] DELETE /identity/v3/projects/b4d87471b4814373bb2181c40bea449f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:21.270855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:21.273857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:21.317169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:21.317823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:21.319138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:21.319339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:21.321908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:21.342768 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:21.360559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205d540-9853-4084-bba3-250c7583315d tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:21.368590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:21.369952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:21.370480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:21.370991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains/122734862fbd447dab1f976b51dce142` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:21.380536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Could not find domain: 122734862fbd447dab1f976b51dce142.: keystone.exception.DomainNotFound: Could not find domain: 122734862fbd447dab1f976b51dce142. Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 122734862fbd447dab1f976b51dce142. Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:19:21.387266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:19:21.388781 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 122734862fbd447dab1f976b51dce142. Sep 11 01:19:21.390181 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:21.391695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2025/4052] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:19:21 2022] PATCH /identity/v3/domains/122734862fbd447dab1f976b51dce142 => generated 112 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:19:21.393483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:21.397592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:21.400831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:21.406921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c0abf-2eb3-4043-a242-cf6408daf095 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:21.411714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982cee8-5e9c-480e-963f-79e441f2c979 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b13a9ce6413c478f85a83eb600e2e8a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eda918ce9e8c47b1bc606e89052dd605', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:21.412343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982cee8-5e9c-480e-963f-79e441f2c979 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:21.412760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982cee8-5e9c-480e-963f-79e441f2c979 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:21.413151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982cee8-5e9c-480e-963f-79e441f2c979 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] PATH_INFO: `/v3/domains/0fd5a008d8854d1eb4e37b75e0c92962` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:21.422869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982cee8-5e9c-480e-963f-79e441f2c979 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:19:21.424137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2028/4053] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b982cee8-5e9c-480e-963f-79e441f2c979 tempest-ProjectsTestJSON-392928359 tempest-ProjectsTestJSON-392928359-project-admin] Could not find domain: 0fd5a008d8854d1eb4e37b75e0c92962.: keystone.exception.DomainNotFound: Could not find domain: 0fd5a008d8854d1eb4e37b75e0c92962. Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0fd5a008d8854d1eb4e37b75e0c92962. Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:19:21.429415 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:19:21.431099 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0fd5a008d8854d1eb4e37b75e0c92962. Sep 11 01:19:21.432445 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:21.435345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2026/4054] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:19:21 2022] PATCH /identity/v3/domains/0fd5a008d8854d1eb4e37b75e0c92962 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:19:21.438545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:21.440037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:21.532872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cfc55-6f36-4d0d-aaa5-98e49f48764b service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:21.542052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:21.542894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:21.543179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:21.543567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] PATH_INFO: `/v3/users/da92e1793ec748b4ae5b7ae820def17e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:21.544635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da92e1793ec748b4ae5b7ae820def17e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:21.547315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:21.695600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da92e1793ec748b4ae5b7ae820def17e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.699547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da92e1793ec748b4ae5b7ae820def17e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.700326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da92e1793ec748b4ae5b7ae820def17e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.711900 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:21.721255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da92e1793ec748b4ae5b7ae820def17e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.754592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da92e1793ec748b4ae5b7ae820def17e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:21.794041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:21.794329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:21.794611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:21.797287 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2029/4055] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:21 2022] DELETE /identity/v3/users/da92e1793ec748b4ae5b7ae820def17e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:21.847925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:21.849271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:22.020663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:22.022253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:22.033733 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2027/4056] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:22.230276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529b6d1-f261-423b-b3bd-79e8f66d5825 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:22.239465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:22.240110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:22.240398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:22.240667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:22.265630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:22.267235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:22.283405 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2030/4057] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:22.634899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:22.636443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:22.655878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1003dde-3ec1-4a6b-bb83-1180a81cc00c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:22.666338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:22.666995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:22.667297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:22.667570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] PATH_INFO: `/v3/projects/c51b19dced264560b8842bc60dbf363c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:22.669582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51b19dced264560b8842bc60dbf363c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:22.679742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:22.780328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51b19dced264560b8842bc60dbf363c', 'request_id': 'req-adde5ae6-84b6-4f20-bdab-9151f0040c24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:22.799031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51b19dced264560b8842bc60dbf363c', 'request_id': 'req-adde5ae6-84b6-4f20-bdab-9151f0040c24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:22.826695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51b19dced264560b8842bc60dbf363c', 'request_id': 'req-adde5ae6-84b6-4f20-bdab-9151f0040c24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:22.862787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] The token cache is being invalidate because project c51b19dced264560b8842bc60dbf363c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:22.864391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:22.868876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:22.874896 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2028/4058] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:22 2022] DELETE /identity/v3/projects/c51b19dced264560b8842bc60dbf363c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:22.876405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:22.889139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695a16c-9dac-4c08-9b47-b34d1f1aa9d7 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:23.006131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:23.006769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:23.007046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:23.007481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] PATH_INFO: `/v3/users/b13a9ce6413c478f85a83eb600e2e8a2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:23.009569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13a9ce6413c478f85a83eb600e2e8a2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:23.012316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:23.093362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13a9ce6413c478f85a83eb600e2e8a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.094687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13a9ce6413c478f85a83eb600e2e8a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.095319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13a9ce6413c478f85a83eb600e2e8a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.106199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13a9ce6413c478f85a83eb600e2e8a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.123973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-94b74fa7-7ec4-4873-87ad-d9544c671c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13a9ce6413c478f85a83eb600e2e8a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.127211 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:23.149396 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2031/4059] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:22 2022] DELETE /identity/v3/users/b13a9ce6413c478f85a83eb600e2e8a2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:23.659097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:23.660557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:23.689357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde5ae6-84b6-4f20-bdab-9151f0040c24 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:23.821086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:23.821086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:23.821086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:23.821086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] PATH_INFO: `/v3/projects/eda918ce9e8c47b1bc606e89052dd605` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:23.821579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda918ce9e8c47b1bc606e89052dd605)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:23.821579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:23.829877 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:23.925403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda918ce9e8c47b1bc606e89052dd605', 'request_id': 'req-20c05c84-d303-45ce-acb4-71ab171e3b53'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.933599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda918ce9e8c47b1bc606e89052dd605', 'request_id': 'req-20c05c84-d303-45ce-acb4-71ab171e3b53'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.943325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda918ce9e8c47b1bc606e89052dd605', 'request_id': 'req-20c05c84-d303-45ce-acb4-71ab171e3b53'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.964651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] The token cache is being invalidate because project eda918ce9e8c47b1bc606e89052dd605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:23.965143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.966057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20c05c84-d303-45ce-acb4-71ab171e3b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:23.968665 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2029/4060] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:23 2022] DELETE /identity/v3/projects/eda918ce9e8c47b1bc606e89052dd605 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:23.977610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f722e-a8fa-47af-ae15-2a33a04060d0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:23.978666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f722e-a8fa-47af-ae15-2a33a04060d0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:23.979170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f722e-a8fa-47af-ae15-2a33a04060d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.008255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-902f722e-a8fa-47af-ae15-2a33a04060d0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:24.010187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-902f722e-a8fa-47af-ae15-2a33a04060d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:24.099148 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2032/4061] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:24.108013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265334b7-3a43-4fa8-906f-8da66265500a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.108293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265334b7-3a43-4fa8-906f-8da66265500a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.108918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265334b7-3a43-4fa8-906f-8da66265500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.145142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-265334b7-3a43-4fa8-906f-8da66265500a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:24.145142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-265334b7-3a43-4fa8-906f-8da66265500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:24.158510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f722e-a8fa-47af-ae15-2a33a04060d0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:24.159157 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2030/4062] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:24.170066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f722e-a8fa-47af-ae15-2a33a04060d0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:24.178785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:24.180200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.180545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.180877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.181765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:24.182222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:24.185841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:24.203469 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2033/4063] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:24.208381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265334b7-3a43-4fa8-906f-8da66265500a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:24.227152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265334b7-3a43-4fa8-906f-8da66265500a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:24.233005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:24.240366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.240748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.241198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.243654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:24.245986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:24.303863 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2031/4064] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:24 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:24.305181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:24.318677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eb2ee-cf6c-4246-92ec-b4d71ad08937 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:24.426465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:24.427117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.427467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.427810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.428549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:24.431636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:24.480488 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2034/4065] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:24 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:24.482529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:24.502630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3149b-0ef9-47f5-9e8e-fe084ab5b77b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:24.519626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:24.523407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.524070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.525818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.527786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:24.530227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:24.551768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:24.552884 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2032/4066] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:24.564981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122bfbb-0b6f-4d51-be3b-b57561595694 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:24.579889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2389c4-0cb7-4c0c-97de-884a7261d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:24.583298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2389c4-0cb7-4c0c-97de-884a7261d34a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.583298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2389c4-0cb7-4c0c-97de-884a7261d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.583298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2389c4-0cb7-4c0c-97de-884a7261d34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.583298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2389c4-0cb7-4c0c-97de-884a7261d34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:24.583298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2389c4-0cb7-4c0c-97de-884a7261d34a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:24.616094 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2035/4067] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:24.626445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:24.660722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275abb4-d71d-4ea0-a19c-aae9ba42122e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:24.672273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:24.673767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.674238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.674679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] PATH_INFO: `/v3/projects/49596b709233418289fdfaa05dd2b7e3/users/f7871d27b57c404cbe78f4ab7f29bd1d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.727706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49596b709233418289fdfaa05dd2b7e3, user_id=f7871d27b57c404cbe78f4ab7f29bd1d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:24.730754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:24.773563 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2033/4068] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:24 2022] PUT /identity/v3/projects/49596b709233418289fdfaa05dd2b7e3/users/f7871d27b57c404cbe78f4ab7f29bd1d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:24.840242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d192fb-a8f6-4d8f-a531-7adeb142947f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:24.840667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d192fb-a8f6-4d8f-a531-7adeb142947f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:24.841036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d192fb-a8f6-4d8f-a531-7adeb142947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:24.890670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-74d192fb-a8f6-4d8f-a531-7adeb142947f None None] MFA Rules not processed for user `f7871d27b57c404cbe78f4ab7f29bd1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:24.892493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-74d192fb-a8f6-4d8f-a531-7adeb142947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:25.013745 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:25.075805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:25.094392 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2036/4069] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:25.223046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654a9f7-42ac-4f92-800d-bfa885b68800 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:25.228435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:25.229150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.229436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.229711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.232480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:25.232480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:25.278077 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2034/4070] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:25 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:25.282692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d192fb-a8f6-4d8f-a531-7adeb142947f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:25.297711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d192fb-a8f6-4d8f-a531-7adeb142947f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:25.401759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:25.403653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.405391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.405695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.408385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:25.410434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:25.460046 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2037/4071] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:25 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:25.463791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:25.484578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa582-6c89-4606-ba04-fa7b26803724 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:25.489706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:25.490420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.490816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.491219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.491977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:25.493948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:25.519067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:25.539057 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2035/4072] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:25.543389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe793f7-47d7-40ac-90cc-9648d98700ba admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:25.550069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21134f-e10f-4b14-b907-b8d63f9217b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:25.550865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21134f-e10f-4b14-b907-b8d63f9217b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.551253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21134f-e10f-4b14-b907-b8d63f9217b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.551632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21134f-e10f-4b14-b907-b8d63f9217b5 admin admin] PATH_INFO: `/v3/projects/1c00e7e2172b419695c43a979c3e9d44/users/ad759a148f9b40a0bc098d969d97b335/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.595429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21134f-e10f-4b14-b907-b8d63f9217b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c00e7e2172b419695c43a979c3e9d44, user_id=ad759a148f9b40a0bc098d969d97b335, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:25.599273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21134f-e10f-4b14-b907-b8d63f9217b5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:25.618384 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2038/4073] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:25 2022] PUT /identity/v3/projects/1c00e7e2172b419695c43a979c3e9d44/users/ad759a148f9b40a0bc098d969d97b335/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:25.622638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:25.632547 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:25.639577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58017ea-51cf-4653-865a-89d198e43fc5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:25.796536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.796855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.797148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.809575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:25.810305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.810676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.811044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.812054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:25.814014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:25.840459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:25.842051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:25.844241 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2036/4074] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:25.849160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:25.887596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d677c-cd57-47d6-b032-700432e64870 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:25.902548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41152e1b-2c6c-4204-95a0-624c1c510381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:25.907638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41152e1b-2c6c-4204-95a0-624c1c510381 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.907927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41152e1b-2c6c-4204-95a0-624c1c510381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.908205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41152e1b-2c6c-4204-95a0-624c1c510381 admin admin] PATH_INFO: `/v3/projects/1c00e7e2172b419695c43a979c3e9d44/users/ad759a148f9b40a0bc098d969d97b335/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.914605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41152e1b-2c6c-4204-95a0-624c1c510381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c00e7e2172b419695c43a979c3e9d44, user_id=ad759a148f9b40a0bc098d969d97b335, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:25.923281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41152e1b-2c6c-4204-95a0-624c1c510381 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:25.984802 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2037/4075] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:25 2022] PUT /identity/v3/projects/1c00e7e2172b419695c43a979c3e9d44/users/ad759a148f9b40a0bc098d969d97b335/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:25.996483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d25f96-c2cf-46b7-acc2-63513ad9e394 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:25.996873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d25f96-c2cf-46b7-acc2-63513ad9e394 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:25.997309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d25f96-c2cf-46b7-acc2-63513ad9e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:25.999143 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2039/4076] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:26.112462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-18d25f96-c2cf-46b7-acc2-63513ad9e394 None None] MFA Rules not processed for user `ad759a148f9b40a0bc098d969d97b335`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:26.114365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-18d25f96-c2cf-46b7-acc2-63513ad9e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:26.167229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:26.170446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:26.265120 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2038/4077] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:26.267050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d25f96-c2cf-46b7-acc2-63513ad9e394 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:26.296200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d25f96-c2cf-46b7-acc2-63513ad9e394 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:26.313714 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:26.317094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad759a148f9b40a0bc098d969d97b335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c00e7e2172b419695c43a979c3e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:26.318152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:26.318438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:26.319200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:26.322894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:26.326423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:26.342835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabffdf-5ca2-47d6-9af7-78f9191e1b02 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:26.414402 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2039/4078] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:26 2022] POST /identity/v3/projects => generated 358 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:26.415513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:26.503889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:26.504858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:26.505441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:26.506134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:26.512009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:26.550215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:26.552122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:26.556431 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:26.579189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862c1a9-212f-4344-ba63-5a0e6b89db4d tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:26.582513 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2040/4079] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:26.587858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad759a148f9b40a0bc098d969d97b335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c00e7e2172b419695c43a979c3e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:26.589924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:26.590390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:26.590841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:26.591664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:26.594817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:26.666257 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2040/4080] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:26 2022] POST /identity/v3/users => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:26.672406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:26.731287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1fbe1-16c6-40cf-a6a3-afbbacb3acc1 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:26.747637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620643-85ae-4a9c-a2e6-8c273720566a tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad759a148f9b40a0bc098d969d97b335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c00e7e2172b419695c43a979c3e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:26.748163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620643-85ae-4a9c-a2e6-8c273720566a tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:26.748472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620643-85ae-4a9c-a2e6-8c273720566a tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:26.748770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620643-85ae-4a9c-a2e6-8c273720566a tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:26.749564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620643-85ae-4a9c-a2e6-8c273720566a tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:26.749877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620643-85ae-4a9c-a2e6-8c273720566a tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:26.752218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620643-85ae-4a9c-a2e6-8c273720566a tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:26.872941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2041/4081] 10.222.0.16 () {58 vars in 1157 bytes} [Sun Sep 11 01:19:26 2022] GET /identity/v3/users?domain_id=default => generated 7711 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:26.877117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:26.910646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d62d9-2b83-4b31-a127-c0f8a68025fb tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:26.933788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad759a148f9b40a0bc098d969d97b335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c00e7e2172b419695c43a979c3e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:26.934793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:26.935272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:26.935725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] PATH_INFO: `/v3/users/2d28bdd75e8644dd9d650cf2eb887f45` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:27.007878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorizing `identity:update_user(user_id=2d28bdd75e8644dd9d650cf2eb887f45)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:27.016468 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:19:27.016468 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:19:27.016468 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:19:27.022007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:27.109772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2d28bdd75e8644dd9d650cf2eb887f45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.155525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invalidating the token cache because user 2d28bdd75e8644dd9d650cf2eb887f45 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:27.155833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.160263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.197400 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2041/4082] 10.222.0.16 () {60 vars in 1244 bytes} [Sun Sep 11 01:19:26 2022] PATCH /identity/v3/users/2d28bdd75e8644dd9d650cf2eb887f45 => generated 488 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:27.203353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:27.203929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:27.204046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:27.222732 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.auth.plugins.core [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] User is disabled: 2d28bdd75e8644dd9d650cf2eb887f45: AssertionError: User is disabled: 2d28bdd75e8644dd9d650cf2eb887f45 Sep 11 01:19:27.234181 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.server.flask.application [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 11 01:19:27.236466 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2042/4083] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:27 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 35 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 11 01:19:27.241111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:27.244281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:27.296690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e7f9-227c-49e0-a0cd-3a6beb610926 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:27.319640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad759a148f9b40a0bc098d969d97b335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c00e7e2172b419695c43a979c3e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:27.320372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:27.322936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:27.323336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] PATH_INFO: `/v3/users/2d28bdd75e8644dd9d650cf2eb887f45` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:27.371960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2d28bdd75e8644dd9d650cf2eb887f45)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:27.374492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:27.465700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d28bdd75e8644dd9d650cf2eb887f45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.466512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d28bdd75e8644dd9d650cf2eb887f45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.467137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d28bdd75e8644dd9d650cf2eb887f45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.496616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d28bdd75e8644dd9d650cf2eb887f45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.514962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d28bdd75e8644dd9d650cf2eb887f45'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.537104 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2042/4084] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:27 2022] DELETE /identity/v3/users/2d28bdd75e8644dd9d650cf2eb887f45 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:27.541707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:27.544628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:27.811881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543160f-48ef-489a-8d4e-bc1789b81860 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:27.823668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad759a148f9b40a0bc098d969d97b335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c00e7e2172b419695c43a979c3e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:27.825113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:27.825580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:27.826062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] PATH_INFO: `/v3/projects/52aad05cc1934d4297090afa4ad386dc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:27.827430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52aad05cc1934d4297090afa4ad386dc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:27.845305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:27.965465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52aad05cc1934d4297090afa4ad386dc', 'request_id': 'req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:27.990239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52aad05cc1934d4297090afa4ad386dc', 'request_id': 'req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.009240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52aad05cc1934d4297090afa4ad386dc', 'request_id': 'req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.018696 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:28.031418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] The token cache is being invalidate because project 52aad05cc1934d4297090afa4ad386dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:28.031776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.032510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.037139 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2043/4085] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:27 2022] DELETE /identity/v3/projects/52aad05cc1934d4297090afa4ad386dc => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:28.042537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:28.056705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5b8d6-9418-42e4-8954-ab1493047b3b tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:28.126122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cf443-0e7b-49fe-be70-3582c9a112b8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad759a148f9b40a0bc098d969d97b335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c00e7e2172b419695c43a979c3e9d44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:28.127081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf443-0e7b-49fe-be70-3582c9a112b8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:28.127081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf443-0e7b-49fe-be70-3582c9a112b8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:28.127503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf443-0e7b-49fe-be70-3582c9a112b8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:28.128216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cf443-0e7b-49fe-be70-3582c9a112b8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:28.130295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cf443-0e7b-49fe-be70-3582c9a112b8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:28.139096 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8d7cf443-0e7b-49fe-be70-3582c9a112b8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Could not find domain: 2d4b0866dd19432aa0fe10618d4e4980.: keystone.exception.DomainNotFound: Could not find domain: 2d4b0866dd19432aa0fe10618d4e4980. Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2d4b0866dd19432aa0fe10618d4e4980. Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:19:28.172045 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:19:28.173652 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:19:28.175140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:19:28.176710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:19:28.176710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:19:28.176710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2d4b0866dd19432aa0fe10618d4e4980. Sep 11 01:19:28.176710 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:19:28.186192 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2043/4086] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:28 2022] POST /identity/v3/users => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:19:28.192854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:28.195503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:28.339733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef5960-e9ca-494d-8a64-ae733336d5ed None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:28.341330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef5960-e9ca-494d-8a64-ae733336d5ed None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:28.341636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef5960-e9ca-494d-8a64-ae733336d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:28.382784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcd718-0f6b-4b94-b8da-ba9f07bfb8d8 tempest-UsersNegativeTest-1955384812 tempest-UsersNegativeTest-1955384812-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:28.401960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:28.402993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ebef5960-e9ca-494d-8a64-ae733336d5ed None None] MFA Rules not processed for user `f1dcb9c93dae470a9f7285f34edf096d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:28.403433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:28.403728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:28.404072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] PATH_INFO: `/v3/users/f7871d27b57c404cbe78f4ab7f29bd1d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:28.406664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7871d27b57c404cbe78f4ab7f29bd1d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:28.408869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ebef5960-e9ca-494d-8a64-ae733336d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:28.412363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:28.547920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7871d27b57c404cbe78f4ab7f29bd1d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.548645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7871d27b57c404cbe78f4ab7f29bd1d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.549713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7871d27b57c404cbe78f4ab7f29bd1d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.568117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7871d27b57c404cbe78f4ab7f29bd1d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.578475 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2044/4087] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:28.595542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7871d27b57c404cbe78f4ab7f29bd1d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:28.644065 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2044/4088] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:28 2022] DELETE /identity/v3/users/f7871d27b57c404cbe78f4ab7f29bd1d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:28.649759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:28.650194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:28.650587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:28.702269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:28.708276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:28.845768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2045/4089] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:28.853355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:28.855321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:28.963318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a1ae-9a97-44a7-912b-c81221a1521b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:28.985025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:28.985910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:28.989757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:28.990383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:29.013248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:29.016548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:29.048949 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2045/4090] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:29.638371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:29.640326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:29.668338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d9a00-26bc-4fa7-a656-b474145c011a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:29.672778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:29.674323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:29.690307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332a2d1-6ab2-4a50-9b54-5d4909a1ca43 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:29.695737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:29.697127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:29.697525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:29.697906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] PATH_INFO: `/v3/projects/49596b709233418289fdfaa05dd2b7e3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:29.698666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:29.699282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:29.699564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:29.699734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49596b709233418289fdfaa05dd2b7e3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:29.699857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:29.703091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:29.703400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:29.740242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:29.742803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:29.804999 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2046/4091] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:29.825148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49596b709233418289fdfaa05dd2b7e3', 'request_id': 'req-f05dc526-a78e-467b-abf6-c0438b79f4c1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:29.854096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49596b709233418289fdfaa05dd2b7e3', 'request_id': 'req-f05dc526-a78e-467b-abf6-c0438b79f4c1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:29.872882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49596b709233418289fdfaa05dd2b7e3', 'request_id': 'req-f05dc526-a78e-467b-abf6-c0438b79f4c1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:29.982923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] The token cache is being invalidate because project 49596b709233418289fdfaa05dd2b7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:29.984363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:29.989092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:30.008609 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2046/4092] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:29 2022] DELETE /identity/v3/projects/49596b709233418289fdfaa05dd2b7e3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:30.012797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:30.029727 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:30.034392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31002869-9bcb-4c2a-9152-be966f5f2576 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:30.158373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:30.159031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:30.159339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:30.159628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] PATH_INFO: `/v3/users/ad759a148f9b40a0bc098d969d97b335` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:30.160939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad759a148f9b40a0bc098d969d97b335)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:30.163010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:30.297758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad759a148f9b40a0bc098d969d97b335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:30.298824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad759a148f9b40a0bc098d969d97b335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:30.299753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad759a148f9b40a0bc098d969d97b335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:30.308635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad759a148f9b40a0bc098d969d97b335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:30.332641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-df800273-47fc-4a17-8998-75676c5147b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad759a148f9b40a0bc098d969d97b335'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:30.354633 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2047/4093] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:30 2022] DELETE /identity/v3/users/ad759a148f9b40a0bc098d969d97b335 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:31.476992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:31.479975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:31.536848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dc526-a78e-467b-abf6-c0438b79f4c1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:31.625603 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:31.714262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:31.715194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:31.715660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:31.716091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] PATH_INFO: `/v3/projects/1c00e7e2172b419695c43a979c3e9d44` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:31.720496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c00e7e2172b419695c43a979c3e9d44)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:31.722799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:31.905669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c00e7e2172b419695c43a979c3e9d44', 'request_id': 'req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:31.933092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c00e7e2172b419695c43a979c3e9d44', 'request_id': 'req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:31.945760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c00e7e2172b419695c43a979c3e9d44', 'request_id': 'req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:32.001297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] The token cache is being invalidate because project 1c00e7e2172b419695c43a979c3e9d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:32.002082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:32.002965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1c2bb5fc-399e-42d5-b7c4-fbff44c189db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:32.005230 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2047/4094] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:31 2022] DELETE /identity/v3/projects/1c00e7e2172b419695c43a979c3e9d44 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:32.012859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478943-1061-4e42-8db9-1412c62aaaec None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:32.013461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478943-1061-4e42-8db9-1412c62aaaec None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:32.013760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478943-1061-4e42-8db9-1412c62aaaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:32.044199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-36478943-1061-4e42-8db9-1412c62aaaec None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:32.045884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-36478943-1061-4e42-8db9-1412c62aaaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:32.252551 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2048/4095] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:32.254467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f85f-d023-4397-b46c-d617b79b2dd0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:32.254868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f85f-d023-4397-b46c-d617b79b2dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:32.255282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f85f-d023-4397-b46c-d617b79b2dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:32.290972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8dd0f85f-d023-4397-b46c-d617b79b2dd0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:32.292353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8dd0f85f-d023-4397-b46c-d617b79b2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:32.314156 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2048/4096] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:32.318787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36478943-1061-4e42-8db9-1412c62aaaec None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:32.329340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36478943-1061-4e42-8db9-1412c62aaaec None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:32.347040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:32.350448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:32.350938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:32.351315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:32.351999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:32.352305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:32.354114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:32.369873 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2049/4097] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:32.374453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0f85f-d023-4397-b46c-d617b79b2dd0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:32.392613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0f85f-d023-4397-b46c-d617b79b2dd0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:32.404260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:32.404892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:32.407793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:32.407793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:32.408832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:32.414804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:32.465734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2049/4098] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:32 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:32.467470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:32.481108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b73154-349d-4a56-83f6-3df34c1d9c0b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:32.508636 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:32.709018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:32.711044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:32.711380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:32.711865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:32.712554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:32.733174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:32.816152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2050/4099] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:32 2022] POST /identity/v3/users => generated 303 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:32.818315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:32.839508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375cb4-aa53-48a2-8fbc-8c74a4473062 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:32.852868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:32.854821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:32.855215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:32.855593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:32.857904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:32.860144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:32.923494 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2050/4100] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:32.923807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:32.950017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd58c5c-08ef-442a-a210-c85544277af0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:32.962946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4b377-ee86-46da-a72a-b3c904c842a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:32.963798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b377-ee86-46da-a72a-b3c904c842a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:32.964096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b377-ee86-46da-a72a-b3c904c842a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:32.964367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b377-ee86-46da-a72a-b3c904c842a4 admin admin] PATH_INFO: `/v3/projects/9a3111f236c04893ad459cbc8c313a23/users/c2825e782ae4430e908ef7a22608d55e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.008913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4b377-ee86-46da-a72a-b3c904c842a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3111f236c04893ad459cbc8c313a23, user_id=c2825e782ae4430e908ef7a22608d55e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:33.012515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4b377-ee86-46da-a72a-b3c904c842a4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:33.047656 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2051/4101] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:32 2022] PUT /identity/v3/projects/9a3111f236c04893ad459cbc8c313a23/users/c2825e782ae4430e908ef7a22608d55e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:33.055158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:33.072173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48da13-7c5a-4fbc-a9ea-504e34ef2e88 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:33.106506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a47e6-c6c8-4bf6-be0e-fd0d1844f3ec None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:33.107336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a47e6-c6c8-4bf6-be0e-fd0d1844f3ec None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:33.108084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a47e6-c6c8-4bf6-be0e-fd0d1844f3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.153839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fd5a47e6-c6c8-4bf6-be0e-fd0d1844f3ec None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:33.155507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd5a47e6-c6c8-4bf6-be0e-fd0d1844f3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:33.207499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:33.207947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:33.208232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:33.208503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.209166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:33.211466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:33.225968 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2051/4102] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:33.231098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:33.243082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730835b1-0ee4-42bc-8177-b41a40ea73ed admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:33.250458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:33.252106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:33.252478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:33.252835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] PATH_INFO: `/v3/projects/9a3111f236c04893ad459cbc8c313a23/users/c2825e782ae4430e908ef7a22608d55e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.259055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3111f236c04893ad459cbc8c313a23, user_id=c2825e782ae4430e908ef7a22608d55e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:33.264077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:33.264828 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2052/4103] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:33.282952 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2052/4104] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:33 2022] PUT /identity/v3/projects/9a3111f236c04893ad459cbc8c313a23/users/c2825e782ae4430e908ef7a22608d55e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:33.295104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463034a-dafc-4bf5-964a-d9d73d9eeeef None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:33.295104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463034a-dafc-4bf5-964a-d9d73d9eeeef None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:33.295104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463034a-dafc-4bf5-964a-d9d73d9eeeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.335516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:33.337978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:33.344161 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:33.368458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6463034a-dafc-4bf5-964a-d9d73d9eeeef None None] MFA Rules not processed for user `c2825e782ae4430e908ef7a22608d55e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:33.369764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6463034a-dafc-4bf5-964a-d9d73d9eeeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:33.507577 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2053/4105] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:33.509860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463034a-dafc-4bf5-964a-d9d73d9eeeef None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:33.548324 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:33.584243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af2fe-b583-4095-acb4-61289867b850 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:33.607809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:33.609735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:33.609903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:33.611575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.636624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463034a-dafc-4bf5-964a-d9d73d9eeeef None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:33.646425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:33.648532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:33.649251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:33.650213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.651284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:33.665237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:33.730507 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2054/4106] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:33 2022] POST /identity/v3/projects => generated 391 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:33.736728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:33.779306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:33.781003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:33.802547 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2053/4107] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:33.915933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ada48-7087-4662-8a8d-d80979f3ba15 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:33.967296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:33.967960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:33.968245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:33.968539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:33.969719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:33.971759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:34.025052 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2055/4108] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:33 2022] POST /identity/v3/users => generated 296 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:34.029245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:34.056542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ec1b1-55bb-4e75-a283-d4a973497791 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:34.071024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:34.073007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:34.073969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:34.076721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:34.080346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:34.087447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:34.125235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2054/4109] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:34.129442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:34.146532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e9b6-22cd-4429-91a6-ff18387d98c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:34.165910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca357bd-0ac1-43f5-ac3a-d53c78551b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:34.167391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca357bd-0ac1-43f5-ac3a-d53c78551b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:34.167771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca357bd-0ac1-43f5-ac3a-d53c78551b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:34.168147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca357bd-0ac1-43f5-ac3a-d53c78551b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:34.168904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca357bd-0ac1-43f5-ac3a-d53c78551b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:34.170621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca357bd-0ac1-43f5-ac3a-d53c78551b9a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:34.217662 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2056/4110] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:34.219304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:34.237561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcdf8-4d16-4359-b599-6e0fd3b918ba admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:34.251703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:34.252149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:34.252528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:34.252895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] PATH_INFO: `/v3/projects/f6783c25860b4fe69945795e6decbd77/users/a1d7a4e7caf54564b74b5a40fff4e72c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:34.289917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6783c25860b4fe69945795e6decbd77, user_id=a1d7a4e7caf54564b74b5a40fff4e72c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:34.298020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:34.330876 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2055/4111] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:34 2022] PUT /identity/v3/projects/f6783c25860b4fe69945795e6decbd77/users/a1d7a4e7caf54564b74b5a40fff4e72c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:34.345008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320a72-513a-455c-a805-ec65877cfb66 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:34.345008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320a72-513a-455c-a805-ec65877cfb66 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:34.345008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320a72-513a-455c-a805-ec65877cfb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:34.385977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-81320a72-513a-455c-a805-ec65877cfb66 None None] MFA Rules not processed for user `a1d7a4e7caf54564b74b5a40fff4e72c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:34.387711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-81320a72-513a-455c-a805-ec65877cfb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:34.568769 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:34.588295 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2057/4112] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:39.807755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:39.810736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:39.968607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06a95b-e735-4290-a4d7-a87bc54b0015 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:39.972978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:39.974233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:39.974764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:39.975265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:40.023207 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:40.121535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:40.124069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:40.137960 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2056/4113] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:41.259454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e65f07-45ce-4f01-9b0c-78e5d223d7be None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:41.259998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e65f07-45ce-4f01-9b0c-78e5d223d7be None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:41.260144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e65f07-45ce-4f01-9b0c-78e5d223d7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:41.291539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e3e65f07-45ce-4f01-9b0c-78e5d223d7be None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:41.292839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e3e65f07-45ce-4f01-9b0c-78e5d223d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:41.425755 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2058/4114] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:41.440768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:41.536031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbaa4d-e4af-46cd-96fe-f0d8bafcc973 service glance] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:41.543910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:41.544445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:41.544811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:41.545395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:41.556702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:41.558633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:41.570093 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2057/4115] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:42.288503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706c575-391e-4bb9-8916-62097435fa76 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:42.289055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706c575-391e-4bb9-8916-62097435fa76 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:42.289305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706c575-391e-4bb9-8916-62097435fa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:42.322691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7706c575-391e-4bb9-8916-62097435fa76 None None] MFA Rules not processed for user `9fdb77980af84574812088ed93c00f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:42.325161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7706c575-391e-4bb9-8916-62097435fa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:42.339998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:42.430041 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2059/4116] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:42.491345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff67c08-248f-45bd-8d65-669669fb7ed7 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:42.497429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:42.498531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:42.499004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:42.499446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] PATH_INFO: `/v3/users/c2825e782ae4430e908ef7a22608d55e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:42.501601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2825e782ae4430e908ef7a22608d55e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:42.503714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:42.582184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2825e782ae4430e908ef7a22608d55e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:42.583028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2825e782ae4430e908ef7a22608d55e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:42.583728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2825e782ae4430e908ef7a22608d55e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:42.586629 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:42.608793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2825e782ae4430e908ef7a22608d55e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:42.618343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2825e782ae4430e908ef7a22608d55e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:42.650550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:42.650853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:42.651920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:42.655594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2058/4117] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:42 2022] DELETE /identity/v3/users/c2825e782ae4430e908ef7a22608d55e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:42.686741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:42.688248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:42.771968 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2060/4118] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:42.779496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:42.783478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:42.903017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f8061-ee70-4e98-b5f5-c96bc620b75a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:42.909085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:42.909885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:42.910169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:42.910494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:42.927888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:42.930238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:42.960857 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2059/4119] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:43.161223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:43.163353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:43.186371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34cf44-df2e-40ca-8a66-13af08992f03 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:43.193591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:43.194554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:43.195034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:43.196086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:43.198612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:43.215838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:43.218271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:43.239278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2061/4120] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:43.637841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:43.639849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:43.664634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a05aa-fce0-416f-ad2d-7fe5ac6cd0b5 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:43.675222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:43.677122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:43.677694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:43.679381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] PATH_INFO: `/v3/projects/9a3111f236c04893ad459cbc8c313a23` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:43.681613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3111f236c04893ad459cbc8c313a23)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:43.684722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:43.765430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3111f236c04893ad459cbc8c313a23', 'request_id': 'req-43922986-25e6-4310-bfab-159d103e1acd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:43.774324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3111f236c04893ad459cbc8c313a23', 'request_id': 'req-43922986-25e6-4310-bfab-159d103e1acd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:43.781737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3111f236c04893ad459cbc8c313a23', 'request_id': 'req-43922986-25e6-4310-bfab-159d103e1acd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:43.813560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] The token cache is being invalidate because project 9a3111f236c04893ad459cbc8c313a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:43.813560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:43.813560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:43.813560 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2060/4121] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:43 2022] DELETE /identity/v3/projects/9a3111f236c04893ad459cbc8c313a23 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:43.818831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:43.836333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660b30-ef94-4176-85f8-d3a4aededb1c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:43.896722 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:43.951493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:43.952464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:43.952915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:43.953398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] PATH_INFO: `/v3/users/a1d7a4e7caf54564b74b5a40fff4e72c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:43.955085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d7a4e7caf54564b74b5a40fff4e72c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:43.958620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:44.062448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d7a4e7caf54564b74b5a40fff4e72c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.064750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d7a4e7caf54564b74b5a40fff4e72c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.065802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d7a4e7caf54564b74b5a40fff4e72c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.077392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d7a4e7caf54564b74b5a40fff4e72c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.098288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4981d77-74cf-4c18-a082-ffd434c05ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d7a4e7caf54564b74b5a40fff4e72c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.117256 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2062/4122] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:43 2022] DELETE /identity/v3/users/a1d7a4e7caf54564b74b5a40fff4e72c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:44.571233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:44.572681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:44.603887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43922986-25e6-4310-bfab-159d103e1acd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:44.728107 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:44.757917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:44.758590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:44.758874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:44.759150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] PATH_INFO: `/v3/projects/f6783c25860b4fe69945795e6decbd77` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:44.761695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6783c25860b4fe69945795e6decbd77)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:44.767053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:44.871108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6783c25860b4fe69945795e6decbd77', 'request_id': 'req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.878928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6783c25860b4fe69945795e6decbd77', 'request_id': 'req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.887850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6783c25860b4fe69945795e6decbd77', 'request_id': 'req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.916326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] The token cache is being invalidate because project f6783c25860b4fe69945795e6decbd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:44.916597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.917320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4a101e4-79ba-44e1-9775-c4eb3802e2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:44.919374 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2061/4123] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:44 2022] DELETE /identity/v3/projects/f6783c25860b4fe69945795e6decbd77 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:44.924935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3b1ad-28dc-4cf9-9c0b-807fa2d8e8a5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:44.928011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3b1ad-28dc-4cf9-9c0b-807fa2d8e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:44.928565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3b1ad-28dc-4cf9-9c0b-807fa2d8e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:44.969366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-49f3b1ad-28dc-4cf9-9c0b-807fa2d8e8a5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:44.971059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-49f3b1ad-28dc-4cf9-9c0b-807fa2d8e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:45.101604 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2063/4124] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:45.108693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d7fd-bd3b-4aa1-b802-32230ea7b572 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.108985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d7fd-bd3b-4aa1-b802-32230ea7b572 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.109292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d7fd-bd3b-4aa1-b802-32230ea7b572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.143327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7806d7fd-bd3b-4aa1-b802-32230ea7b572 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:45.145217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7806d7fd-bd3b-4aa1-b802-32230ea7b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:45.156161 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2062/4125] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:45.160584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3b1ad-28dc-4cf9-9c0b-807fa2d8e8a5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.174050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3b1ad-28dc-4cf9-9c0b-807fa2d8e8a5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.187522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.188314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.188698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.189246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.190069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:45.190493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.192190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.206569 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2064/4126] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:45.211285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806d7fd-bd3b-4aa1-b802-32230ea7b572 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.224079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806d7fd-bd3b-4aa1-b802-32230ea7b572 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.230844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.231664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.232145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.232581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.233428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.235483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.269097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2063/4127] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:45 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:45.271040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.284806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d839d-bda9-4c3a-9eb3-7a4c63e156ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.354606 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:45.382608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.383248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.383775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.384060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.384756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.386740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.417459 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2065/4128] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:45 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:45.421825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.437682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cba794-9be4-4217-96e3-fb964e86e791 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.445842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.446480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.446762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.447040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.447776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.450404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.472913 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2064/4129] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:45.476554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.488616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b359bc8-4855-44b8-ae23-486735b5759a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.515374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fbb3f-6a92-4875-a6b1-1ba7dbb6eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.516092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fbb3f-6a92-4875-a6b1-1ba7dbb6eb26 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.516323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fbb3f-6a92-4875-a6b1-1ba7dbb6eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.516538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fbb3f-6a92-4875-a6b1-1ba7dbb6eb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.517254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fbb3f-6a92-4875-a6b1-1ba7dbb6eb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.518865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fbb3f-6a92-4875-a6b1-1ba7dbb6eb26 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.533700 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2066/4130] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:45.537173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.551597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c9e91-c9ad-4350-9449-a7fa1b0f8fc7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.561879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.563776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.564182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.564539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] PATH_INFO: `/v3/projects/55da826f587e4dd79aed81718d2b0751/users/f532fc5f7a2f4854b980a174abda9756/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.597978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=55da826f587e4dd79aed81718d2b0751, user_id=f532fc5f7a2f4854b980a174abda9756, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.602316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:45.648023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2065/4131] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:45 2022] PUT /identity/v3/projects/55da826f587e4dd79aed81718d2b0751/users/f532fc5f7a2f4854b980a174abda9756/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:45.648748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3823-f56d-4341-a119-d6ca6c07412a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.649100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3823-f56d-4341-a119-d6ca6c07412a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.649420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3823-f56d-4341-a119-d6ca6c07412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.690976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f5ec3823-f56d-4341-a119-d6ca6c07412a None None] MFA Rules not processed for user `f532fc5f7a2f4854b980a174abda9756`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:45.692496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f5ec3823-f56d-4341-a119-d6ca6c07412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:45.821227 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2067/4132] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:45.843453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:45.846169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:45.932025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3411-75ba-46c5-ba73-d0c5f3c635cb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:45.945705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:45.948241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:45.949039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:45.949809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:45.970505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:45.972665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:46.002957 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2066/4133] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:46.208018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9070747-8b7d-4c78-8870-f8c2699d31f8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:46.208951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9070747-8b7d-4c78-8870-f8c2699d31f8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:46.209728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9070747-8b7d-4c78-8870-f8c2699d31f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:46.294208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d9070747-8b7d-4c78-8870-f8c2699d31f8 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:46.298577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d9070747-8b7d-4c78-8870-f8c2699d31f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:46.470124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2068/4134] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:46.494119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:46.496243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:46.568437 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:46.676403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8f815-a688-4353-a50c-77ef2bcccfe8 service glance] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:46.683413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:46.684263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:46.684738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:46.685215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:46.696075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:46.698179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:46.708452 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2067/4135] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:47.320562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96a8dd-ae3b-4370-b7bd-0de943ce15fc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:47.321188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96a8dd-ae3b-4370-b7bd-0de943ce15fc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:47.321506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96a8dd-ae3b-4370-b7bd-0de943ce15fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:47.369224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4d96a8dd-ae3b-4370-b7bd-0de943ce15fc None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:47.370821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4d96a8dd-ae3b-4370-b7bd-0de943ce15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:47.432464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2069/4136] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:47.433987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:47.454318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62037f-7552-4868-b5e6-2e7f7a26e84f service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:47.464405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:47.465823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:47.466932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:47.467220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:47.480197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:47.484193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:47.496871 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2068/4137] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:48.097613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8051-cc65-4ddc-975f-d59e00eb204e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:48.097913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8051-cc65-4ddc-975f-d59e00eb204e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:48.098182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc8051-cc65-4ddc-975f-d59e00eb204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:48.177387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3dbc8051-cc65-4ddc-975f-d59e00eb204e None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:48.182616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3dbc8051-cc65-4ddc-975f-d59e00eb204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:48.200506 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2070/4138] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:48.226367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:48.246215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4741b0-6630-4b1b-b251-986f945ca344 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:48.252569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:48.253292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:48.253668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:48.253946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:48.265827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:48.267502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:48.281053 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2069/4139] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:48.865164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932aac8-ad82-4f9a-be6c-a7451f5067eb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:48.865730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932aac8-ad82-4f9a-be6c-a7451f5067eb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:48.866256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932aac8-ad82-4f9a-be6c-a7451f5067eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:48.891878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b932aac8-ad82-4f9a-be6c-a7451f5067eb None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:48.893496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b932aac8-ad82-4f9a-be6c-a7451f5067eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:48.914744 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2071/4140] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:48.931652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:48.944296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5cbf4-efab-4df8-b91c-b771a56b016e service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:48.950487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:48.951088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:48.951415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:48.951795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:48.961975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:48.963627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:48.973101 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2070/4141] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:49.511312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ed85-a890-46d8-882a-6a4aeb26fe16 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:49.512198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ed85-a890-46d8-882a-6a4aeb26fe16 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:49.512589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ed85-a890-46d8-882a-6a4aeb26fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:49.548932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-da68ed85-a890-46d8-882a-6a4aeb26fe16 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:49.550383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-da68ed85-a890-46d8-882a-6a4aeb26fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:49.560868 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2072/4142] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:49.583682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:49.596016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30d151-ad64-4cbc-9557-f05a0546f09e service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:49.602525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:49.603193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:49.603479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:49.603752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:49.614714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:49.617677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:49.627421 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2071/4143] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:49.934696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2dba5-87bb-48af-9f69-47acc66bbc07 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:49.935269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2dba5-87bb-48af-9f69-47acc66bbc07 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:49.935389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2dba5-87bb-48af-9f69-47acc66bbc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:49.957766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b3d2dba5-87bb-48af-9f69-47acc66bbc07 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:49.958998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b3d2dba5-87bb-48af-9f69-47acc66bbc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:49.971769 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2073/4144] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:49.986517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:50.002699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc8492-1831-41a6-87ff-3e692ea93dd4 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:50.010563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:50.011477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:50.011860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:50.012353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:50.025007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:50.026629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:50.036334 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2072/4145] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:19:51.267377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130f579-802c-4b75-8ebe-f0c3e2cb56f5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:51.268275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130f579-802c-4b75-8ebe-f0c3e2cb56f5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:51.268563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130f579-802c-4b75-8ebe-f0c3e2cb56f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:51.312278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5130f579-802c-4b75-8ebe-f0c3e2cb56f5 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:51.314602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5130f579-802c-4b75-8ebe-f0c3e2cb56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:51.331611 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2074/4146] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:51.339028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:51.355941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610f2ad-ddf0-4909-abdb-b59bbe57f281 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:51.363373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:51.364339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:51.365328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:51.366398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:51.380231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:51.386145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:51.396771 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2073/4147] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:51.640119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348654fe-575c-4914-9336-39b2e07fa2e4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:51.640415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348654fe-575c-4914-9336-39b2e07fa2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:51.640692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348654fe-575c-4914-9336-39b2e07fa2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:51.672922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-348654fe-575c-4914-9336-39b2e07fa2e4 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:51.674371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-348654fe-575c-4914-9336-39b2e07fa2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:51.700156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2075/4148] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:51.706846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:51.733824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac5fae-848e-4eb4-bf16-74a70553e500 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:51.744955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:51.746220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:51.754764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:51.755322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:51.774042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:51.776298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:51.791900 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2074/4149] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:52.141285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211a30-0eed-4337-b52b-6aa5b59d8803 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:52.141944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211a30-0eed-4337-b52b-6aa5b59d8803 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:52.142470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211a30-0eed-4337-b52b-6aa5b59d8803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:52.169247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c6211a30-0eed-4337-b52b-6aa5b59d8803 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:52.170589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c6211a30-0eed-4337-b52b-6aa5b59d8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:52.180647 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2076/4150] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:52.198951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:52.212111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4fc4a-4a8f-4fdd-adef-49458e956d61 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:52.223647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:52.225752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:52.226233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:52.226845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:52.236846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:52.238927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:52.250509 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2075/4151] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:52.461293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894efa6-2287-46ef-b8d5-e161bdbb35ef None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:52.461847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894efa6-2287-46ef-b8d5-e161bdbb35ef None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:52.461847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894efa6-2287-46ef-b8d5-e161bdbb35ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:52.473487 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:52.489272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6894efa6-2287-46ef-b8d5-e161bdbb35ef None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:52.490855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6894efa6-2287-46ef-b8d5-e161bdbb35ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:52.499456 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2077/4152] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:52.514209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:52.529507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e793-5cc4-4e8f-934a-918d962d4c7b service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:52.535761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:52.536606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:52.536882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:52.537250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:52.546873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:52.549094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:52.558768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2076/4153] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:52.722959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6e2f-6928-40d8-a411-35d14d5261bb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:52.723248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6e2f-6928-40d8-a411-35d14d5261bb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:52.723634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6e2f-6928-40d8-a411-35d14d5261bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:52.743571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-736f6e2f-6928-40d8-a411-35d14d5261bb None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:52.744786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-736f6e2f-6928-40d8-a411-35d14d5261bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:52.754347 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2078/4154] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:52.766363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:52.780326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd56cee-3637-4903-a68a-8d2b1af7e685 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:52.785450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:52.786048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:52.786324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:52.786597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:52.795392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:52.796943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:52.805920 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2077/4155] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:52.947068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2bca-b854-4638-aefb-681f1b836ada None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:52.947356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2bca-b854-4638-aefb-681f1b836ada None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:52.947628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c2bca-b854-4638-aefb-681f1b836ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:52.967052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-696c2bca-b854-4638-aefb-681f1b836ada None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:52.968358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-696c2bca-b854-4638-aefb-681f1b836ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:52.976416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2079/4156] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:52.988502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:52.999987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ff754-555f-42fa-a13e-bdc5ff802685 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:53.004922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64236-6e4b-4e34-8784-cbb4ecabeef3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:53.005538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64236-6e4b-4e34-8784-cbb4ecabeef3 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:53.005812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64236-6e4b-4e34-8784-cbb4ecabeef3 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:53.006076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64236-6e4b-4e34-8784-cbb4ecabeef3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:53.013879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64236-6e4b-4e34-8784-cbb4ecabeef3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:53.015458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e64236-6e4b-4e34-8784-cbb4ecabeef3 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:53.024006 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2078/4157] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:19:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:19:53.134518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c2bca-b854-4638-aefb-681f1b836ada None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:53.205975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c2bca-b854-4638-aefb-681f1b836ada None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:53.211896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:53.212534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:53.212810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:53.213103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] PATH_INFO: `/v3/users/f532fc5f7a2f4854b980a174abda9756` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:53.214251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f532fc5f7a2f4854b980a174abda9756)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:53.216159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:53.264421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f532fc5f7a2f4854b980a174abda9756'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:53.265086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f532fc5f7a2f4854b980a174abda9756'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:53.265847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f532fc5f7a2f4854b980a174abda9756'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:53.274512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f532fc5f7a2f4854b980a174abda9756'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:53.290418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f532fc5f7a2f4854b980a174abda9756'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:53.318061 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2080/4158] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:53 2022] DELETE /identity/v3/users/f532fc5f7a2f4854b980a174abda9756 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:53.323142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:53.323725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:53.324119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:53.347110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:53.348817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:53.377377 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:53.422796 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2079/4159] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:53.432894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:53.434351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:53.514258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f96c8-a112-4ba3-8ba2-e7fdb96d7c8d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:53.518285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3d16b-b970-45b9-b191-e0416718ef08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:53.518900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3d16b-b970-45b9-b191-e0416718ef08 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:53.519406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3d16b-b970-45b9-b191-e0416718ef08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:53.519739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3d16b-b970-45b9-b191-e0416718ef08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:53.531008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3d16b-b970-45b9-b191-e0416718ef08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:53.532453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3d16b-b970-45b9-b191-e0416718ef08 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:53.543080 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2081/4160] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:53.963354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:53.965421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:53.987906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658c7f9-4dfa-4bd3-b1c8-c830ca654bd0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:53.997157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:53.997812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:53.998089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:53.998361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] PATH_INFO: `/v3/projects/55da826f587e4dd79aed81718d2b0751` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:53.999516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55da826f587e4dd79aed81718d2b0751)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.001480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.050096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55da826f587e4dd79aed81718d2b0751', 'request_id': 'req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.057204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55da826f587e4dd79aed81718d2b0751', 'request_id': 'req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.063955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55da826f587e4dd79aed81718d2b0751', 'request_id': 'req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.083573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] The token cache is being invalidate because project 55da826f587e4dd79aed81718d2b0751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:54.083856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.084708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66e7bdc7-62ac-4399-bc6e-6787f2ca3788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.086763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2080/4161] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:53 2022] DELETE /identity/v3/projects/55da826f587e4dd79aed81718d2b0751 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:54.091617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72b98f-f9e4-4f94-a361-ec06791599d6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.091900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72b98f-f9e4-4f94-a361-ec06791599d6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.092172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72b98f-f9e4-4f94-a361-ec06791599d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.107149 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:54.116279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ab72b98f-f9e4-4f94-a361-ec06791599d6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:54.118902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ab72b98f-f9e4-4f94-a361-ec06791599d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:54.199728 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2082/4162] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:54.207264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c5fc-2ac0-4721-8312-f45ec89fc75b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.207577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c5fc-2ac0-4721-8312-f45ec89fc75b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.207850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c5fc-2ac0-4721-8312-f45ec89fc75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.228512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1c84c5fc-2ac0-4721-8312-f45ec89fc75b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:54.229748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1c84c5fc-2ac0-4721-8312-f45ec89fc75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:54.237561 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2081/4163] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:54.242296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72b98f-f9e4-4f94-a361-ec06791599d6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.252371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72b98f-f9e4-4f94-a361-ec06791599d6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.257309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.257916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.258229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.258504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.259140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:54.259443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.261020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.272635 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2083/4164] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:19:54.276834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c5fc-2ac0-4721-8312-f45ec89fc75b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.286476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c5fc-2ac0-4721-8312-f45ec89fc75b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.291983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.292584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.292919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.293244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.293903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.295833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.325764 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2082/4165] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:54.329646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.341721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73842-4c5d-4774-8168-e1bf385d2b58 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.402914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.403394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.403677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.403953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.404614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.406566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.430860 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2084/4166] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:54.434737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.445206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ecc4e-8d2f-4d2f-82ca-de9db3e8afbf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.451971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.452580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.452859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.453164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.453800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.455661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.469428 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2083/4167] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:54.474007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.486506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c87aca-723b-44d8-bc26-4a7bf9bd00ce admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.491727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50673187-8796-4810-8bce-f3dec473a41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.492522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50673187-8796-4810-8bce-f3dec473a41c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.492933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50673187-8796-4810-8bce-f3dec473a41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.493454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50673187-8796-4810-8bce-f3dec473a41c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.494296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50673187-8796-4810-8bce-f3dec473a41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.496064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50673187-8796-4810-8bce-f3dec473a41c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.513880 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2085/4168] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:54.525113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.535178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328e6c0-0f0c-4a82-9f02-e8275642dd79 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.542707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.543972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.544326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.544834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] PATH_INFO: `/v3/projects/5ec44737a4ab4c899d985734256713b1/users/cc9196d22c6b4d0d805502c1b9263619/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.566361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec44737a4ab4c899d985734256713b1, user_id=cc9196d22c6b4d0d805502c1b9263619, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.569815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.590096 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2084/4169] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:54 2022] PUT /identity/v3/projects/5ec44737a4ab4c899d985734256713b1/users/cc9196d22c6b4d0d805502c1b9263619/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:54.605797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb966b-0a10-444a-aa6b-1fa67dd441c7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.605797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb966b-0a10-444a-aa6b-1fa67dd441c7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.605797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb966b-0a10-444a-aa6b-1fa67dd441c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.645127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-56cb966b-0a10-444a-aa6b-1fa67dd441c7 None None] MFA Rules not processed for user `cc9196d22c6b4d0d805502c1b9263619`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:54.647247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56cb966b-0a10-444a-aa6b-1fa67dd441c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:54.661538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.663804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:54.726404 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:54.732220 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2086/4170] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:54.736590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb966b-0a10-444a-aa6b-1fa67dd441c7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.742792 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:54.748495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80faa1-3347-4c7d-95db-a9d16829cdbe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.749086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb966b-0a10-444a-aa6b-1fa67dd441c7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.753619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.754255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.754540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.754843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] PATH_INFO: `/v3/users/10d97cc298004c52a1b959c3f6e096b0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.755377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.755991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d97cc298004c52a1b959c3f6e096b0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.756226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.757011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.757369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.757999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.758716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.759880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.791385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2087/4171] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:54.795527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.807095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d97cc298004c52a1b959c3f6e096b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.807758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d97cc298004c52a1b959c3f6e096b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.808381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d97cc298004c52a1b959c3f6e096b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.821940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d97cc298004c52a1b959c3f6e096b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.829893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc541f10-c93f-4855-b831-557735c14d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d97cc298004c52a1b959c3f6e096b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:54.844332 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2085/4172] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:54 2022] DELETE /identity/v3/users/10d97cc298004c52a1b959c3f6e096b0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:54.848754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5630-025b-4307-a623-83aafffba219 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.848909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5630-025b-4307-a623-83aafffba219 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.849233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5630-025b-4307-a623-83aafffba219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.862407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f375a-7d42-4139-bbfe-49a40a670d80 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.869105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-817a5630-025b-4307-a623-83aafffba219 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:54.870316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-817a5630-025b-4307-a623-83aafffba219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:54.920454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.921089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.921404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.921678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.922344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.924292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:54.930107 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2086/4173] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:19:54.940151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5630-025b-4307-a623-83aafffba219 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.941640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-817a5630-025b-4307-a623-83aafffba219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:54.948284 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2088/4174] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:54 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:19:54.952119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:54.953902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:54.966490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b113c-7dd2-4657-b17f-9564e01e20cb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:54.971604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:54.973100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:54.973100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:54.973100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:54.973570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:54.975218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:55.005938 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2089/4175] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:19:55.007495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:55.029463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c605a-0e0b-4ea7-b4cb-07b322fa7e69 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:55.044265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:55.044970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.045282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.045653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:55.046261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:55.049659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5630-025b-4307-a623-83aafffba219 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:55.051590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:55.055999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746177c-2c85-41b5-9f29-c31cfb85f438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:55.056795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746177c-2c85-41b5-9f29-c31cfb85f438 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.057563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746177c-2c85-41b5-9f29-c31cfb85f438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.057842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746177c-2c85-41b5-9f29-c31cfb85f438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:55.070169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746177c-2c85-41b5-9f29-c31cfb85f438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:55.070922 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2090/4176] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:55.071600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746177c-2c85-41b5-9f29-c31cfb85f438 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:55.074125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:55.088388 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2087/4177] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:55.096304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf377-9ea7-4ee6-b194-1f13ad0346d3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:55.101242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:55.102000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.102347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.102690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] PATH_INFO: `/v3/projects/621c6187ce114b8680d5ee0345f08856/users/dad814a15b3b445981ce69f177d6e58b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:55.122988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621c6187ce114b8680d5ee0345f08856, user_id=dad814a15b3b445981ce69f177d6e58b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:55.126984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:55.149988 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2091/4178] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:55 2022] PUT /identity/v3/projects/621c6187ce114b8680d5ee0345f08856/users/dad814a15b3b445981ce69f177d6e58b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:55.161306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.161592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.161871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:55.194553 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:55.209886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] MFA Rules not processed for user `dad814a15b3b445981ce69f177d6e58b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:55.211501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:55.360637 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2088/4179] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:55.374784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:55.376658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:55.423822 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:55.455981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345dc35-e153-455e-991d-c882809b0245 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:55.460627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:55.461193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.461486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.461744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:55.463485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:55.539107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:55.540866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:55.555156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2092/4180] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:55.693050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:55.695836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:55.798182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:55.810955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67ba7-94ca-45a3-9b81-00bd2e0923ae service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:55.820742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721ac78-e200-4d4c-9376-bed8ba0b97d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:55.821393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ac78-e200-4d4c-9376-bed8ba0b97d7 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.821678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ac78-e200-4d4c-9376-bed8ba0b97d7 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.821941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ac78-e200-4d4c-9376-bed8ba0b97d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:55.835104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721ac78-e200-4d4c-9376-bed8ba0b97d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:55.837073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721ac78-e200-4d4c-9376-bed8ba0b97d7 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:55.843396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fdc3c-7298-443f-a7d7-c82298a796b1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:55.848308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:55.849050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.849353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.849893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] PATH_INFO: `/v3/projects/dfb80684ae754fd28265862cb51302e6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:55.851193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb80684ae754fd28265862cb51302e6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:55.852873 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2093/4181] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:55.862097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:55.921220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb80684ae754fd28265862cb51302e6', 'request_id': 'req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:55.928911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb80684ae754fd28265862cb51302e6', 'request_id': 'req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:55.936408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb80684ae754fd28265862cb51302e6', 'request_id': 'req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:55.963931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] The token cache is being invalidate because project dfb80684ae754fd28265862cb51302e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:55.964410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:55.965299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5926bd35-5e5a-40cd-8ff7-1c9b59dfed56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:55.967264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2089/4182] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:55 2022] DELETE /identity/v3/projects/dfb80684ae754fd28265862cb51302e6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:55.972726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd807-d3ff-42e3-a04f-7bd38afa9004 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:55.973136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd807-d3ff-42e3-a04f-7bd38afa9004 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:55.974359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd807-d3ff-42e3-a04f-7bd38afa9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.002330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a7abd807-d3ff-42e3-a04f-7bd38afa9004 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:56.003685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7abd807-d3ff-42e3-a04f-7bd38afa9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:56.075782 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2094/4183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:56.085354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b3a9b-cb47-424e-b656-a7aa7ffd414a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.085965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b3a9b-cb47-424e-b656-a7aa7ffd414a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.085965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b3a9b-cb47-424e-b656-a7aa7ffd414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.107540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-373b3a9b-cb47-424e-b656-a7aa7ffd414a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:56.108780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-373b3a9b-cb47-424e-b656-a7aa7ffd414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:56.118869 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2090/4184] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:56.123507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abd807-d3ff-42e3-a04f-7bd38afa9004 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:56.136680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abd807-d3ff-42e3-a04f-7bd38afa9004 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:56.141386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:56.141989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.142265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.142553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.144591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:19:56.144931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:56.146800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:56.168123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2095/4185] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:19:56.172632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b3a9b-cb47-424e-b656-a7aa7ffd414a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:56.183705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b3a9b-cb47-424e-b656-a7aa7ffd414a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:56.188544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:56.189199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.189482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.189757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.190410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:56.192335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:56.217460 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:56.225153 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2091/4186] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:19:56 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:56.229774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:56.242004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e859e0-14ca-4843-b522-8a4a57383e17 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:56.305867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:56.306671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.306910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.307252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.307953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:56.309990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:56.319271 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:56.338653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2096/4187] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:19:56 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:19:56.339944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:56.354694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ce9f5-f6b0-4f0f-a4b2-1527c2e6f8ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:56.361397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:56.362048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.362282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.362798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.363358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:56.365589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:56.383971 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2092/4188] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:56.387704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:56.398239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15c955-d70d-4944-80c6-c4582eefb32a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:56.409035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2e612-edf0-4d94-ae0a-026d99a8b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:56.409679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2e612-edf0-4d94-ae0a-026d99a8b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.409960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2e612-edf0-4d94-ae0a-026d99a8b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.410234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2e612-edf0-4d94-ae0a-026d99a8b6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.410881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2e612-edf0-4d94-ae0a-026d99a8b6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:56.413022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2e612-edf0-4d94-ae0a-026d99a8b6bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:56.434604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:56.435491 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2097/4189] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:19:56.449918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f65335-af92-40ee-bfc9-fd34b0b48686 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:56.456951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:56.462206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.473395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.475615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] PATH_INFO: `/v3/projects/c32a8fa7abe44d50b2921b81b538ac18/users/074a5c9ee2084bb48894b34332cef788/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.513607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32a8fa7abe44d50b2921b81b538ac18, user_id=074a5c9ee2084bb48894b34332cef788, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:56.517497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:56.548988 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2093/4190] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:19:56 2022] PUT /identity/v3/projects/c32a8fa7abe44d50b2921b81b538ac18/users/074a5c9ee2084bb48894b34332cef788/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:19:56.555660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.556004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.556216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.577771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:56.579067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:56.662421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2098/4191] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:56.677461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:56.680903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:56.766273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb2d-0699-4339-9a61-b3c3c8cf043b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:56.770083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:56.770688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:56.770965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:56.771229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:56.782598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:56.784016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:56.795816 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2094/4192] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:57.232750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:57.237117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:57.352812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b1987-6faf-4eaf-8f65-5f65ac34ae9f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:57.357962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a073dc1-3f1c-4ea5-920b-f341e2c710c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:57.358716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a073dc1-3f1c-4ea5-920b-f341e2c710c0 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:57.359458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a073dc1-3f1c-4ea5-920b-f341e2c710c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:57.359458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a073dc1-3f1c-4ea5-920b-f341e2c710c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:57.363363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a073dc1-3f1c-4ea5-920b-f341e2c710c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:57.438536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:57.440056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:57.455141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601348-9011-45d5-900f-b3ec3cb08202 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:57.462227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a073dc1-3f1c-4ea5-920b-f341e2c710c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:57.463109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:57.464412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:57.464880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:57.465449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a073dc1-3f1c-4ea5-920b-f341e2c710c0 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:57.465650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] PATH_INFO: `/v3/users/cc9196d22c6b4d0d805502c1b9263619` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:57.478446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9196d22c6b4d0d805502c1b9263619)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:57.480399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:57.497839 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2099/4193] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:57.578467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9196d22c6b4d0d805502c1b9263619'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:57.579116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9196d22c6b4d0d805502c1b9263619'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:57.579717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9196d22c6b4d0d805502c1b9263619'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:57.592643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9196d22c6b4d0d805502c1b9263619'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:57.600490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9196d22c6b4d0d805502c1b9263619'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:57.614689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2095/4194] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:57 2022] DELETE /identity/v3/users/cc9196d22c6b4d0d805502c1b9263619 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:57.619717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:57.620009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:57.620311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:57.640941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:19:57.642325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:57.642509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:57.644022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:57.659251 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:57.699662 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:57.718645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d42b1-640a-4940-ae25-e8aa3bcc9e73 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:57.720276 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2100/4195] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:19:57.723300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:57.724147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:57.724147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:57.724421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:57.727404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:57.730647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:57.732297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:57.748426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:57.748914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205b44f-1c04-4470-9564-20f1c9759f46 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:57.750722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:57.758342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:57.760586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:57.761117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:57.761720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:57.765767 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2096/4196] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:57.772333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:57.773918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:57.784180 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2101/4197] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:19:58.110088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:58.123448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088049fe-b2a9-4285-abcb-3269eb9e4e57 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:58.129219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:58.129841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:58.130119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:58.130516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:58.132308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:58.288161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:58.289680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:58.304835 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2097/4198] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:19:58.380828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:58.389499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:58.422313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22c14-136e-4ac4-a124-cb6f5d055f1b service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:58.431701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:58.432835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:58.434455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:58.435370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] PATH_INFO: `/v3/projects/5ec44737a4ab4c899d985734256713b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:58.437601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec44737a4ab4c899d985734256713b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:58.441695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:58.528491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec44737a4ab4c899d985734256713b1', 'request_id': 'req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.536385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec44737a4ab4c899d985734256713b1', 'request_id': 'req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.562285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec44737a4ab4c899d985734256713b1', 'request_id': 'req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.576501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] The token cache is being invalidate because project 5ec44737a4ab4c899d985734256713b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:19:58.576777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.577493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.582015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2102/4199] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:58 2022] DELETE /identity/v3/projects/5ec44737a4ab4c899d985734256713b1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:58.583097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:58.605100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40c060-1599-4265-b04c-a684abdd8e1a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:58.714663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:58.715473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:58.715981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:58.716309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] PATH_INFO: `/v3/users/dad814a15b3b445981ce69f177d6e58b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:58.717864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad814a15b3b445981ce69f177d6e58b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:58.721800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:58.796397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad814a15b3b445981ce69f177d6e58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.797390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad814a15b3b445981ce69f177d6e58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.798339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad814a15b3b445981ce69f177d6e58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.844261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad814a15b3b445981ce69f177d6e58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.867817 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:58.875227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28a5ab80-9193-4c6a-bb2e-a70eb32c21b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad814a15b3b445981ce69f177d6e58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:58.904852 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2098/4200] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:19:58 2022] DELETE /identity/v3/users/dad814a15b3b445981ce69f177d6e58b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:19:59.567382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:19:59.569769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:19:59.618837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0065e-0ad9-42e0-9dc4-e6c8f0321524 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:19:59.798105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:19:59.799578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:19:59.801329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:19:59.802286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] PATH_INFO: `/v3/projects/621c6187ce114b8680d5ee0345f08856` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:19:59.807041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621c6187ce114b8680d5ee0345f08856)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:19:59.811401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:19:59.911618 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:19:59.957123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621c6187ce114b8680d5ee0345f08856', 'request_id': 'req-22e6de77-8b91-4145-b67c-a558de870598'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:59.970522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621c6187ce114b8680d5ee0345f08856', 'request_id': 'req-22e6de77-8b91-4145-b67c-a558de870598'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:19:59.985742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621c6187ce114b8680d5ee0345f08856', 'request_id': 'req-22e6de77-8b91-4145-b67c-a558de870598'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:00.007646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] The token cache is being invalidate because project 621c6187ce114b8680d5ee0345f08856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:20:00.008219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:00.009985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-22e6de77-8b91-4145-b67c-a558de870598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:00.016833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2103/4201] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:19:59 2022] DELETE /identity/v3/projects/621c6187ce114b8680d5ee0345f08856 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:00.024925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c6e6-1472-4790-8d49-143acf239ad3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.029513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c6e6-1472-4790-8d49-143acf239ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.029887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c6e6-1472-4790-8d49-143acf239ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.085182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c912c6e6-1472-4790-8d49-143acf239ad3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:00.086574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c912c6e6-1472-4790-8d49-143acf239ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:00.215960 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2099/4202] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:00.230029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a063-4c2c-47a4-a4bb-f980d8561fa3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.230607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a063-4c2c-47a4-a4bb-f980d8561fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.231147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a063-4c2c-47a4-a4bb-f980d8561fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.294368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5f77a063-4c2c-47a4-a4bb-f980d8561fa3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:00.295670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5f77a063-4c2c-47a4-a4bb-f980d8561fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:00.338783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2104/4203] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:00.340017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912c6e6-1472-4790-8d49-143acf239ad3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:00.346589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319352f-d9ad-4ca9-a3fb-14c33b7646ae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.346589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319352f-d9ad-4ca9-a3fb-14c33b7646ae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.346837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319352f-d9ad-4ca9-a3fb-14c33b7646ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.375059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912c6e6-1472-4790-8d49-143acf239ad3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:00.388505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:00.389512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.389983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.390428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.391254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:20:00.391731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:00.394352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2319352f-d9ad-4ca9-a3fb-14c33b7646ae None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:00.396403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2319352f-d9ad-4ca9-a3fb-14c33b7646ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:00.399143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:00.425601 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2100/4204] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:20:00.431666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:00.452792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58357924-bd4d-4736-af5d-f5c9cce4a8f9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:00.466666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:00.467599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.468088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.469524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.470427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:00.472770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:00.555535 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2105/4205] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:20:00.578866 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2101/4206] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:20:00 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:00.584636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319352f-d9ad-4ca9-a3fb-14c33b7646ae None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:00.617515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319352f-d9ad-4ca9-a3fb-14c33b7646ae None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:00.774028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:00.774986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.775515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.776018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.777497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:00.779695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:00.812017 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2106/4207] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:20:00 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:00.815839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:00.837871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecf7a7-9e6e-44db-8ff9-a4220e8801ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:00.852074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:00.852938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.853335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.853640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.854296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:00.856122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:00.886734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2102/4208] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:00.891808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:00.911179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee4ab-54ea-4162-bbc1-043a7a048d1b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:00.929105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f6636-75db-4ff2-bf29-04cafd32d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:00.930514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f6636-75db-4ff2-bf29-04cafd32d244 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.930795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f6636-75db-4ff2-bf29-04cafd32d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.931063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f6636-75db-4ff2-bf29-04cafd32d244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:00.931728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f6636-75db-4ff2-bf29-04cafd32d244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:00.940749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f6636-75db-4ff2-bf29-04cafd32d244 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:00.955504 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2107/4209] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:00.960941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:00.983128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afccfa-2ce8-42cb-b5d3-42ef43240da9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:00.992573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:00.993376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:00.993654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:00.993928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] PATH_INFO: `/v3/projects/130450a2f2e44b9cb2f715e7c9f2f6da/users/cb2665b2649e4c3b80851d9c82c3a3fc/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.024380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130450a2f2e44b9cb2f715e7c9f2f6da, user_id=cb2665b2649e4c3b80851d9c82c3a3fc, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:01.028226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:01.065973 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2103/4210] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:00 2022] PUT /identity/v3/projects/130450a2f2e44b9cb2f715e7c9f2f6da/users/cb2665b2649e4c3b80851d9c82c3a3fc/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:01.079531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225b05-029b-4919-b724-822a2ec27678 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:01.079918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225b05-029b-4919-b724-822a2ec27678 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:01.080273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225b05-029b-4919-b724-822a2ec27678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.129981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-78225b05-029b-4919-b724-822a2ec27678 None None] MFA Rules not processed for user `cb2665b2649e4c3b80851d9c82c3a3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:01.131636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-78225b05-029b-4919-b724-822a2ec27678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:01.171875 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:01.223771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2108/4211] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:01.229134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:01.303349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d370-e4d7-4cd6-b41f-ce9b44fd2cc3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:01.311625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:01.312596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:01.312879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:01.313190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.314612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:01.316940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:01.375660 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2104/4212] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:20:01 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:01.379700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78225b05-029b-4919-b724-822a2ec27678 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:01.396455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78225b05-029b-4919-b724-822a2ec27678 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:01.559189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:01.559902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:01.560320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:01.560718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.561461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:01.563513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:01.630084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:01.632421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2109/4213] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:20:01 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:01.638505 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:01.655485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5ec5-12d2-4418-a687-ecb2ed523f66 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:01.679433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:01.680158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:01.680507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:01.680843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.681584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:01.683245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:01.703997 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2105/4214] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:20:01.708182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:01.721902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f1f8-f299-4992-bdb5-0e1b78e75b1c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:01.728773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c523f-f428-4bdb-b086-bb51ad3450d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:01.729177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c523f-f428-4bdb-b086-bb51ad3450d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:01.729468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c523f-f428-4bdb-b086-bb51ad3450d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:01.729750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c523f-f428-4bdb-b086-bb51ad3450d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.730544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c523f-f428-4bdb-b086-bb51ad3450d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:01.732264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c523f-f428-4bdb-b086-bb51ad3450d0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:01.752942 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2110/4215] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:01.756833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:01.775340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae144c3-3be1-4e58-a149-e8bd17507836 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:01.787805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:01.788627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:01.789143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:01.789660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] PATH_INFO: `/v3/projects/02af77ef74ea478982786c75479acbaf/users/870dae1c1fac4bbda2ad67298e30def9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.834124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02af77ef74ea478982786c75479acbaf, user_id=870dae1c1fac4bbda2ad67298e30def9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:01.837531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:01.869724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2106/4216] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:01 2022] PUT /identity/v3/projects/02af77ef74ea478982786c75479acbaf/users/870dae1c1fac4bbda2ad67298e30def9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:20:01.881378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6d6c-37bf-4759-98b5-055f89800329 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:01.882667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6d6c-37bf-4759-98b5-055f89800329 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:01.883019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6d6c-37bf-4759-98b5-055f89800329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:01.930932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ea8b6d6c-37bf-4759-98b5-055f89800329 None None] MFA Rules not processed for user `870dae1c1fac4bbda2ad67298e30def9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:01.932873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ea8b6d6c-37bf-4759-98b5-055f89800329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:02.036295 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2111/4217] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:02.040525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:02.156094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffbdba-81d2-4ddd-bbc5-f96653e0e768 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:02.161577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:02.163964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:02.163964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:02.164358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:02.165283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:02.167871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:02.219008 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2107/4218] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:20:02 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:02.219343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6d6c-37bf-4759-98b5-055f89800329 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:02.247256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6d6c-37bf-4759-98b5-055f89800329 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:02.347195 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:02.425606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:02.426280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:02.426523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:02.426778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:02.430691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:02.433905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:02.508505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2112/4219] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:20:02 2022] POST /identity/v3/users => generated 298 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:20:02.510898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:02.544201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08ee83-f7da-4f1e-a12b-5cac886b1faa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:02.559770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:02.561559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:02.561859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:02.562700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:02.565014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:02.568059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:02.599725 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2108/4220] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:02.610181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:02.617370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ddc24-cfb3-4672-9a25-d3253c1c6ae5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:02.641268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:02.641956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:02.642507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:02.642955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] PATH_INFO: `/v3/projects/26eeac4b82de4b7db451a1bb8e6003bc/users/ebb103da14564502a72c1b1883b29d0a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:02.697714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26eeac4b82de4b7db451a1bb8e6003bc, user_id=ebb103da14564502a72c1b1883b29d0a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:02.700862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:02.745397 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2113/4221] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:02 2022] PUT /identity/v3/projects/26eeac4b82de4b7db451a1bb8e6003bc/users/ebb103da14564502a72c1b1883b29d0a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:02.749219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:02.766153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeeeeb-e23c-43a2-a71b-c3bdf0878e1c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:02.927124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3ac7-56c3-4e83-8965-c7b6067319ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:02.928125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3ac7-56c3-4e83-8965-c7b6067319ac admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:02.928659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3ac7-56c3-4e83-8965-c7b6067319ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:02.929146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3ac7-56c3-4e83-8965-c7b6067319ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:02.929984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3ac7-56c3-4e83-8965-c7b6067319ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:02.938153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3ac7-56c3-4e83-8965-c7b6067319ac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:02.955124 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2109/4222] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:02.960399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:02.974371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373617b5-527d-424a-ac9a-f9b639a6e666 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:02.981685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:02.982531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:02.982912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:02.983319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] PATH_INFO: `/v3/projects/26eeac4b82de4b7db451a1bb8e6003bc/users/ebb103da14564502a72c1b1883b29d0a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:02.985468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26eeac4b82de4b7db451a1bb8e6003bc, user_id=ebb103da14564502a72c1b1883b29d0a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:02.988344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:03.001321 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2114/4223] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:02 2022] PUT /identity/v3/projects/26eeac4b82de4b7db451a1bb8e6003bc/users/ebb103da14564502a72c1b1883b29d0a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:03.012971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:03.014071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:03.014454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:03.051463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] MFA Rules not processed for user `ebb103da14564502a72c1b1883b29d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:03.053703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:03.088091 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:03.175443 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2110/4224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:20:03.250708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:03.253852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:03.465118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6647b-fe0b-4dbd-b136-d2493e0f0f57 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:03.470235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:03.471568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:03.472548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:03.473088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:03.654064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:03.658845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:03.681174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2115/4225] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:04.951184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:04.961978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:05.155099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a10a5-ec16-41df-a70e-daec2214584c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:05.166879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:05.167670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:05.167954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:05.168222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] PATH_INFO: `/v3/users/727349587bce493c9325266e31895db9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:05.170412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=727349587bce493c9325266e31895db9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:05.173275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:05.266607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727349587bce493c9325266e31895db9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:05.268124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727349587bce493c9325266e31895db9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:05.272547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727349587bce493c9325266e31895db9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:05.299521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727349587bce493c9325266e31895db9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:05.309193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f7ec447-c25c-46a2-adf8-de32436829ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727349587bce493c9325266e31895db9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:05.349158 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2111/4226] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:20:04 2022] DELETE /identity/v3/users/727349587bce493c9325266e31895db9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:05.963071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:05.982714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d013ac-d7b7-4661-bb05-cc070b55a361 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:06.093102 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:06.134710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:06.136137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:06.136420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:06.136752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] PATH_INFO: `/v3/projects/6978a4495b634054befbe0ae0b06634e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:06.139755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6978a4495b634054befbe0ae0b06634e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:06.147968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:06.244550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6978a4495b634054befbe0ae0b06634e', 'request_id': 'req-4c0b8017-8a3a-4187-b08e-21a597d385c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:06.257890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6978a4495b634054befbe0ae0b06634e', 'request_id': 'req-4c0b8017-8a3a-4187-b08e-21a597d385c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:06.279253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6978a4495b634054befbe0ae0b06634e', 'request_id': 'req-4c0b8017-8a3a-4187-b08e-21a597d385c0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:06.305259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] The token cache is being invalidate because project 6978a4495b634054befbe0ae0b06634e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:20:06.308828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:06.312303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c0b8017-8a3a-4187-b08e-21a597d385c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:06.316145 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2116/4227] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:20:05 2022] DELETE /identity/v3/projects/6978a4495b634054befbe0ae0b06634e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:06.321216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d014806-6e61-4a27-a9da-127af872c54a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:06.321648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d014806-6e61-4a27-a9da-127af872c54a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:06.321778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d014806-6e61-4a27-a9da-127af872c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:06.372643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4d014806-6e61-4a27-a9da-127af872c54a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:06.376394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d014806-6e61-4a27-a9da-127af872c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:06.434228 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:06.494896 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2112/4228] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:06.497148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b469cd3-0857-4cee-9218-c0b73315d000 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:06.497613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b469cd3-0857-4cee-9218-c0b73315d000 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:06.498056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b469cd3-0857-4cee-9218-c0b73315d000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:06.556058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b469cd3-0857-4cee-9218-c0b73315d000 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:06.559779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b469cd3-0857-4cee-9218-c0b73315d000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:06.573624 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2117/4229] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:06.576970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d014806-6e61-4a27-a9da-127af872c54a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:06.596559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d014806-6e61-4a27-a9da-127af872c54a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:06.609855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:06.610498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:06.610777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:06.611048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:06.611729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:20:06.612017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:06.613662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:06.661270 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2113/4230] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:20:06.663962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b469cd3-0857-4cee-9218-c0b73315d000 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:06.676510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b469cd3-0857-4cee-9218-c0b73315d000 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:06.700228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:06.702265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:06.702775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:06.706218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:06.710387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:06.712579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:06.789112 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2118/4231] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:20:06 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:06.790638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:06.806016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006cfb-5791-4db5-b3e1-f011f786bdc1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:06.987948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:06.988847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:06.989424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:06.989858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:06.991032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:06.993917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:07.028019 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2114/4232] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:20:06 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:07.031087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:07.047133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872a216-4fdc-473b-a0c6-090530d5201d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:07.056690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:07.058437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:07.058914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:07.059442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:07.060940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:07.063401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:07.082389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2119/4233] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:07.086658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:07.099265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189e356-c900-47d2-b20f-8d57aeb72207 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:07.118596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44354b06-4600-4e12-9490-5c6070ce0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:07.119244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354b06-4600-4e12-9490-5c6070ce0a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:07.119819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354b06-4600-4e12-9490-5c6070ce0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:07.119819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354b06-4600-4e12-9490-5c6070ce0a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:07.120677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44354b06-4600-4e12-9490-5c6070ce0a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:07.122697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44354b06-4600-4e12-9490-5c6070ce0a7d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:07.148597 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2115/4234] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:07.153118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:07.165937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69418c82-eaae-4b9d-a5ea-938f03efa509 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:07.175079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:07.175781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:07.176096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:07.176322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] PATH_INFO: `/v3/projects/1d868837f7f94d24adee2dc81d6d56a2/users/978efdbaa0a146edaf2347450f3b997a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:07.213713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d868837f7f94d24adee2dc81d6d56a2, user_id=978efdbaa0a146edaf2347450f3b997a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:07.216635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:07.243948 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2120/4235] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:07 2022] PUT /identity/v3/projects/1d868837f7f94d24adee2dc81d6d56a2/users/978efdbaa0a146edaf2347450f3b997a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:07.248988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9512e-5699-4029-b7fd-97fdb51c8915 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:07.249304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9512e-5699-4029-b7fd-97fdb51c8915 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:07.249585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9512e-5699-4029-b7fd-97fdb51c8915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:07.290665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d9c9512e-5699-4029-b7fd-97fdb51c8915 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:07.292674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d9c9512e-5699-4029-b7fd-97fdb51c8915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:07.460257 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2116/4236] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:07.507249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:07.509793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:07.634669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6268fc-9d04-44fb-bf25-bc7fd5885030 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:07.639247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdae8e-6e5d-458b-9acb-8bb94428f161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:07.639883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdae8e-6e5d-458b-9acb-8bb94428f161 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:07.640223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdae8e-6e5d-458b-9acb-8bb94428f161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:07.640504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdae8e-6e5d-458b-9acb-8bb94428f161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:07.665727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdae8e-6e5d-458b-9acb-8bb94428f161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:07.667499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdae8e-6e5d-458b-9acb-8bb94428f161 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:07.680056 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2121/4237] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:12.548342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9512e-5699-4029-b7fd-97fdb51c8915 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:12.568831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9512e-5699-4029-b7fd-97fdb51c8915 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:12.572909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:12.573888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:12.574470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:12.575240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:12.580760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:12.619896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:12.621506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:12.647076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2117/4238] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:14.313359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d93fc-edea-42b2-9643-5a7217f13d76 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:14.313359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d93fc-edea-42b2-9643-5a7217f13d76 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:14.313359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d93fc-edea-42b2-9643-5a7217f13d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:14.360644 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:14.380253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4a7d93fc-edea-42b2-9643-5a7217f13d76 None None] MFA Rules not processed for user `074a5c9ee2084bb48894b34332cef788`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:14.384731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4a7d93fc-edea-42b2-9643-5a7217f13d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:14.588357 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2122/4239] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:20.898575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:20.898575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:20.913874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41050ec-923e-4273-aaef-ccea1c934f08 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:20.922306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:20.922982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:20.923520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:20.924470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] PATH_INFO: `/v3/users/074a5c9ee2084bb48894b34332cef788` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:20.926133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074a5c9ee2084bb48894b34332cef788)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:20.929609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:20.979242 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:20.999119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074a5c9ee2084bb48894b34332cef788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:20.999847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074a5c9ee2084bb48894b34332cef788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.000462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074a5c9ee2084bb48894b34332cef788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.017560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074a5c9ee2084bb48894b34332cef788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.026495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4d17da8-babc-45ff-9cf6-b614c063df08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074a5c9ee2084bb48894b34332cef788'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.052558 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2118/4240] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:20:20 2022] DELETE /identity/v3/users/074a5c9ee2084bb48894b34332cef788 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:21.271837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d93fc-edea-42b2-9643-5a7217f13d76 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:21.292237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d93fc-edea-42b2-9643-5a7217f13d76 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:21.389397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:21.390499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.390972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.391396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] PATH_INFO: `/v3/projects/c32a8fa7abe44d50b2921b81b538ac18` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.394522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32a8fa7abe44d50b2921b81b538ac18)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:21.404989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:21.490847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32a8fa7abe44d50b2921b81b538ac18', 'request_id': 'req-a5e79445-6a05-4179-9aa7-7e6600cc8573'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.499385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32a8fa7abe44d50b2921b81b538ac18', 'request_id': 'req-a5e79445-6a05-4179-9aa7-7e6600cc8573'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.510794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32a8fa7abe44d50b2921b81b538ac18', 'request_id': 'req-a5e79445-6a05-4179-9aa7-7e6600cc8573'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.525731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] The token cache is being invalidate because project c32a8fa7abe44d50b2921b81b538ac18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:20:21.526042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.526810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5e79445-6a05-4179-9aa7-7e6600cc8573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:21.536318 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2123/4241] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:20:21 2022] DELETE /identity/v3/projects/c32a8fa7abe44d50b2921b81b538ac18 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:20:21.537981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3a9b-82d3-41bf-a573-cff0eb15adee None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.538137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3a9b-82d3-41bf-a573-cff0eb15adee None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.538397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3a9b-82d3-41bf-a573-cff0eb15adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.564225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-df5e3a9b-82d3-41bf-a573-cff0eb15adee None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:21.567139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-df5e3a9b-82d3-41bf-a573-cff0eb15adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:21.641567 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2119/4242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:21.650209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88ae7c-ea2a-4b1d-bb45-288a4f4e14cc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.650945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88ae7c-ea2a-4b1d-bb45-288a4f4e14cc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.651458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88ae7c-ea2a-4b1d-bb45-288a4f4e14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.677891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1b88ae7c-ea2a-4b1d-bb45-288a4f4e14cc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:21.679923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1b88ae7c-ea2a-4b1d-bb45-288a4f4e14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:21.689407 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2124/4243] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:21.693936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3a9b-82d3-41bf-a573-cff0eb15adee None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:21.704672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3a9b-82d3-41bf-a573-cff0eb15adee None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:21.710581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:21.711294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.711633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.712013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.712732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:20:21.713156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:21.714867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:21.729112 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2120/4244] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:20:21.732917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88ae7c-ea2a-4b1d-bb45-288a4f4e14cc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:21.743335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88ae7c-ea2a-4b1d-bb45-288a4f4e14cc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:21.748220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:21.748840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.749215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.749493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.750135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:21.752086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:21.789963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2125/4245] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:20:21 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:21.794242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:21.809627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940f1a1-2b3b-40a7-990d-dcf121a9a2a4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:21.886151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:21.887039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.887325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.887618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.888973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:21.890948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:21.929497 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2121/4246] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:20:21 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:21.931316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:21.937510 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:21.945215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176f91-d2e9-439d-88f3-ab2152cb1684 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:21.951549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:21.952349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.952786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.953219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.953998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:21.955763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:21.968390 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2126/4247] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:21.970717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:21.982005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0140f-00e6-4a35-8025-e7bf715a35f2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:21.987429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46873a6-ead5-42a8-b25f-676a3ef58f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:21.988038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46873a6-ead5-42a8-b25f-676a3ef58f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:21.988514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46873a6-ead5-42a8-b25f-676a3ef58f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:21.988806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46873a6-ead5-42a8-b25f-676a3ef58f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:21.989481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46873a6-ead5-42a8-b25f-676a3ef58f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:21.991868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46873a6-ead5-42a8-b25f-676a3ef58f9e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:22.007309 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2122/4248] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:22.017909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:22.030658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad60c8a-f203-4520-8172-48dc1ba50e84 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:22.038132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff582a8-de60-4cbf-808a-100619ee7f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:22.038898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff582a8-de60-4cbf-808a-100619ee7f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:22.039245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff582a8-de60-4cbf-808a-100619ee7f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:22.039654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff582a8-de60-4cbf-808a-100619ee7f40 admin admin] PATH_INFO: `/v3/projects/65ff144533fb4a11b46dbe883625116b/users/f01b6459a5c54bafba0ddf73cfd1e399/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:22.072640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff582a8-de60-4cbf-808a-100619ee7f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ff144533fb4a11b46dbe883625116b, user_id=f01b6459a5c54bafba0ddf73cfd1e399, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:22.078008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff582a8-de60-4cbf-808a-100619ee7f40 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:22.135646 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2127/4249] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:22 2022] PUT /identity/v3/projects/65ff144533fb4a11b46dbe883625116b/users/f01b6459a5c54bafba0ddf73cfd1e399/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:22.140628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:22.141050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:22.141546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:22.183992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:22.186439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:22.202871 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:22.239561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:22.239561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:22.240672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:22.283388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:22.284628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:22.357018 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2123/4250] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:22.373569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:22.375303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:22.409643 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2128/4251] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:22.449772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:22.452233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:22.510694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f055c8a-6248-44db-9779-515bc6de2828 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:22.530271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:22.535125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:22.535593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:22.535814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:22.563836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:22.566662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:22.580889 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2124/4252] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:20:22.597800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89402-bf00-4f90-a46e-ae6ef58bec1c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:22.607715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6a21d-6c37-48f0-a222-22c044dac8e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:22.608397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6a21d-6c37-48f0-a222-22c044dac8e8 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:22.608666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6a21d-6c37-48f0-a222-22c044dac8e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:22.608939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6a21d-6c37-48f0-a222-22c044dac8e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:22.621004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6a21d-6c37-48f0-a222-22c044dac8e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:22.623186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6a21d-6c37-48f0-a222-22c044dac8e8 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:22.646275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2129/4253] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:20:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:20:26.575737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:26.577263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:26.601522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f09c1-c6a1-440e-b3a7-7f52b122a1f8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:26.620647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:26.621419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:26.621693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:26.621958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] PATH_INFO: `/v3/users/f1dcb9c93dae470a9f7285f34edf096d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:26.624302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1dcb9c93dae470a9f7285f34edf096d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:26.630924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:26.748805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1dcb9c93dae470a9f7285f34edf096d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:26.752405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1dcb9c93dae470a9f7285f34edf096d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:26.752735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1dcb9c93dae470a9f7285f34edf096d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:26.779808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1dcb9c93dae470a9f7285f34edf096d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:26.799255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dfe6bfe2-fdb8-49d3-8b78-d8c15b00f7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1dcb9c93dae470a9f7285f34edf096d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:26.825025 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2125/4254] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:20:26 2022] DELETE /identity/v3/users/f1dcb9c93dae470a9f7285f34edf096d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:27.497519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:27.498035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:27.498035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:27.610598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] MFA Rules not processed for user `978efdbaa0a146edaf2347450f3b997a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:27.611954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:27.780315 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:27.819913 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2130/4255] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:27.830470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:27.831518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:27.832115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:27.879503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] MFA Rules not processed for user `978efdbaa0a146edaf2347450f3b997a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:27.882465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:27.901908 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2126/4256] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:28.396221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:28.398799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:28.616718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e34cb-7368-4a2c-b07e-0c41306f3a01 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:28.626967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd98256-cd29-4756-86a3-f38c618976ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:28.642192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98256-cd29-4756-86a3-f38c618976ab service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:28.643802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98256-cd29-4756-86a3-f38c618976ab service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:28.644606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98256-cd29-4756-86a3-f38c618976ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:28.670745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd98256-cd29-4756-86a3-f38c618976ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:28.672907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd98256-cd29-4756-86a3-f38c618976ab service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:28.719173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:28.721737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:28.723443 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2131/4257] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:20:28.850911 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:28.974597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d1cf6-b910-49b8-b765-5e267afd46b6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:28.983370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:28.984386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:28.984866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:28.985357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] PATH_INFO: `/v3/projects/b4c17859ce2c436ea85485cc60e6959d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:28.988102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c17859ce2c436ea85485cc60e6959d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:28.991214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:29.101046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c17859ce2c436ea85485cc60e6959d', 'request_id': 'req-10abcace-1f64-4933-bf8a-bf27fc6365c5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:29.117222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c17859ce2c436ea85485cc60e6959d', 'request_id': 'req-10abcace-1f64-4933-bf8a-bf27fc6365c5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:29.134238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c17859ce2c436ea85485cc60e6959d', 'request_id': 'req-10abcace-1f64-4933-bf8a-bf27fc6365c5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:29.163860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] The token cache is being invalidate because project b4c17859ce2c436ea85485cc60e6959d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:20:29.165350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:29.166512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-10abcace-1f64-4933-bf8a-bf27fc6365c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:20:29.170905 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2127/4258] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:20:28 2022] DELETE /identity/v3/projects/b4c17859ce2c436ea85485cc60e6959d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:29.176132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b656ab-47af-471d-9d45-f52afab26d99 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:29.176545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b656ab-47af-471d-9d45-f52afab26d99 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:29.176975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b656ab-47af-471d-9d45-f52afab26d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:29.218413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d1b656ab-47af-471d-9d45-f52afab26d99 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:29.219852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d1b656ab-47af-471d-9d45-f52afab26d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:29.348155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2132/4259] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:29.356688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c983d-909a-4466-881d-c8c45dbdb403 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:29.356964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c983d-909a-4466-881d-c8c45dbdb403 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:29.357257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c983d-909a-4466-881d-c8c45dbdb403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:29.434377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b09c983d-909a-4466-881d-c8c45dbdb403 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:29.435631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b09c983d-909a-4466-881d-c8c45dbdb403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:29.479715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b656ab-47af-471d-9d45-f52afab26d99 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:29.481681 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2128/4260] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:29.497673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b656ab-47af-471d-9d45-f52afab26d99 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:29.529371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:29.529371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:29.529371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:29.529371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:29.533285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:20:29.533285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:29.533285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:29.590320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512674bd-6ae8-4fb1-9fca-89f6c536faa4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:29.590620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512674bd-6ae8-4fb1-9fca-89f6c536faa4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:29.591024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512674bd-6ae8-4fb1-9fca-89f6c536faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:29.641553 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2133/4261] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:20:29.642847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:29.648055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-512674bd-6ae8-4fb1-9fca-89f6c536faa4 None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:29.649885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-512674bd-6ae8-4fb1-9fca-89f6c536faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:29.695877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dde75-45ca-4c54-8453-443b5b347b78 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:29.732045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:29.732851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:29.734809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:29.735268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:29.736376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:29.744230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:29.766370 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2129/4262] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:20:29.854520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512674bd-6ae8-4fb1-9fca-89f6c536faa4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:29.855696 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2134/4263] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:20:29 2022] POST /identity/v3/projects => generated 389 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:20:29.872232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512674bd-6ae8-4fb1-9fca-89f6c536faa4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:30.006387 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:30.026063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:30.027320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:30.027955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:30.029536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:30.031520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:30.036064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:30.075453 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2130/4264] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:20:29 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:20:30.078558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:30.114635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991a91-e0a0-479f-88df-92d90507757d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:30.122041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:30.123159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:30.123690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:30.124214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:30.125249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:30.148448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:30.166617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:30.168041 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2135/4265] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:20:30.183406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6736c-8e75-4004-8f37-418bacc2794f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:30.231818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c9064-4c4c-49df-bed3-26f9b4365e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:30.232673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9064-4c4c-49df-bed3-26f9b4365e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:30.232976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9064-4c4c-49df-bed3-26f9b4365e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:30.233280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9064-4c4c-49df-bed3-26f9b4365e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:30.233932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c9064-4c4c-49df-bed3-26f9b4365e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:30.237471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c9064-4c4c-49df-bed3-26f9b4365e6f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:30.281518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:30.294125 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2131/4266] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:30.307381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1cc4a-5c22-4eb3-bb3c-66692ab41fc6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:30.318026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:30.319292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:30.319994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:30.320517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] PATH_INFO: `/v3/projects/f5f98622100d44fca07f033864a3e351/users/f2e7bdbfc4994010a5f889b486e4f15b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:30.345042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f98622100d44fca07f033864a3e351, user_id=f2e7bdbfc4994010a5f889b486e4f15b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:30.350363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:30.385008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:30.386331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:30.386847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:30.391181 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2136/4267] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:30 2022] PUT /identity/v3/projects/f5f98622100d44fca07f033864a3e351/users/f2e7bdbfc4994010a5f889b486e4f15b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:30.429408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:30.432496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:30.659235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2132/4268] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:30.747081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:30.749351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:30.768558 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:30.883664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa421-e25a-4c32-86a2-6d6fc1c19b7d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:30.889623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db923-c316-4126-908f-e9fafd920dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:30.890276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db923-c316-4126-908f-e9fafd920dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:30.890557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db923-c316-4126-908f-e9fafd920dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:30.890829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db923-c316-4126-908f-e9fafd920dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:30.913934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db923-c316-4126-908f-e9fafd920dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:30.915608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db923-c316-4126-908f-e9fafd920dbb service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:30.930342 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2137/4269] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:31.754508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:31.757552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:31.815440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce662-9ee3-493e-9a24-7aa473ba3977 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:31.843086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:31.845394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:31.846641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:31.848269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:31.857996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:32.156631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:32.160809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:32.204686 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2133/4270] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:33.587304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f2e48-8fa9-4834-872f-fe8a84cce3d6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:33.589139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f2e48-8fa9-4834-872f-fe8a84cce3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:33.589683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f2e48-8fa9-4834-872f-fe8a84cce3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:33.702139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cc6f2e48-8fa9-4834-872f-fe8a84cce3d6 None None] MFA Rules not processed for user `f01b6459a5c54bafba0ddf73cfd1e399`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:33.703409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cc6f2e48-8fa9-4834-872f-fe8a84cce3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:33.999231 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2138/4271] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:35.007041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:35.008672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:35.263629 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:35.301348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1de58-39b8-44a5-8a67-df57553d65a1 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:35.327940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aa54c-43fd-4f8e-99a6-9589cf486b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:35.328598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aa54c-43fd-4f8e-99a6-9589cf486b64 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:35.328916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aa54c-43fd-4f8e-99a6-9589cf486b64 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:35.329252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aa54c-43fd-4f8e-99a6-9589cf486b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:35.367225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aa54c-43fd-4f8e-99a6-9589cf486b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:35.376784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aa54c-43fd-4f8e-99a6-9589cf486b64 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:35.410804 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2134/4272] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:41.414792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4ac20-4565-49a4-a8b0-318b3092ad74 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:41.415247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4ac20-4565-49a4-a8b0-318b3092ad74 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:41.415397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4ac20-4565-49a4-a8b0-318b3092ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:41.483084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-32f4ac20-4565-49a4-a8b0-318b3092ad74 None None] MFA Rules not processed for user `f01b6459a5c54bafba0ddf73cfd1e399`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:41.484597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-32f4ac20-4565-49a4-a8b0-318b3092ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:41.524316 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2139/4273] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:42.234673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c436eca-ff23-4ffb-8078-eb7c6bceb836 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:42.235501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c436eca-ff23-4ffb-8078-eb7c6bceb836 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:42.235951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c436eca-ff23-4ffb-8078-eb7c6bceb836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:42.266940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6c436eca-ff23-4ffb-8078-eb7c6bceb836 None None] MFA Rules not processed for user `f2e7bdbfc4994010a5f889b486e4f15b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:42.268305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c436eca-ff23-4ffb-8078-eb7c6bceb836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:42.345327 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2135/4274] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:42.350364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4ac20-4565-49a4-a8b0-318b3092ad74 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:42.370585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4ac20-4565-49a4-a8b0-318b3092ad74 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:42.375367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:42.375975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:42.376253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:42.376523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:42.377206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:42.379085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:42.416734 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2140/4275] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:20:42 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:20:42.420788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c436eca-ff23-4ffb-8078-eb7c6bceb836 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:42.433369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c436eca-ff23-4ffb-8078-eb7c6bceb836 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:42.508619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:42.509269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:42.509552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:42.509926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:42.510759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:42.518928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:42.558204 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2136/4276] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:20:42 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:20:42.578200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:42.592613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef764809-f9bd-4960-aab2-190eb0d54ad2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:42.604709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:42.605787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:42.606298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:42.606861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:42.608626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:42.610602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:42.629317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2141/4277] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:42.634273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:42.646368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd40a9-7dcd-491d-98db-6fd822b2f58f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:42.652755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:42.653294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:42.653689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:42.654076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] PATH_INFO: `/v3/projects/ad77a6e9822547f5bbc873f4684012d0/users/9403d05d164f4b00afdf891a113ed12f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:42.675847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad77a6e9822547f5bbc873f4684012d0, user_id=9403d05d164f4b00afdf891a113ed12f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:42.678649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:42.696324 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2137/4278] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:42 2022] PUT /identity/v3/projects/ad77a6e9822547f5bbc873f4684012d0/users/9403d05d164f4b00afdf891a113ed12f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:42.699951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:42.711326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd314c-4603-4019-a4ef-c2b866d0232a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:42.738695 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:42.787246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5286c8-630c-41f4-badd-4a6ba40b2fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:42.788223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5286c8-630c-41f4-badd-4a6ba40b2fba admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:42.788724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5286c8-630c-41f4-badd-4a6ba40b2fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:42.789235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5286c8-630c-41f4-badd-4a6ba40b2fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:42.790121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5286c8-630c-41f4-badd-4a6ba40b2fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:42.792214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5286c8-630c-41f4-badd-4a6ba40b2fba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:42.815544 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2142/4279] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:20:42.823565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:42.844990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e5e84-bf14-445c-a2d9-e4cbfb15cae2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:42.850439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:42.851126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:42.851398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:42.851667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] PATH_INFO: `/v3/projects/ad77a6e9822547f5bbc873f4684012d0/users/9403d05d164f4b00afdf891a113ed12f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:42.853776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad77a6e9822547f5bbc873f4684012d0, user_id=9403d05d164f4b00afdf891a113ed12f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:42.856407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:42.876216 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2138/4280] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:20:42 2022] PUT /identity/v3/projects/ad77a6e9822547f5bbc873f4684012d0/users/9403d05d164f4b00afdf891a113ed12f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:20:45.190968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:45.191520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:45.191520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:45.235742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:45.237214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:45.373580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2143/4281] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 11 01:20:45.388702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:45.390619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:45.440616 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:45.522952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cc7e-cc97-4c55-a44d-3e4d9e4c537d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:45.548293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:45.549093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:45.549621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:45.549975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:45.561355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:45.563618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:45.599490 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2139/4282] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:20:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:20:49.244767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:49.247014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:49.502071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9af16-e8ce-4f99-8f58-d9504c8c856d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:49.511986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e8be6-ddcb-40ff-ab63-7bbe901d4615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:49.513032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8be6-ddcb-40ff-ab63-7bbe901d4615 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:49.513032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8be6-ddcb-40ff-ab63-7bbe901d4615 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:49.513608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8be6-ddcb-40ff-ab63-7bbe901d4615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:49.522119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e29e8be6-ddcb-40ff-ab63-7bbe901d4615 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:49.564981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e8be6-ddcb-40ff-ab63-7bbe901d4615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:49.567455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e8be6-ddcb-40ff-ab63-7bbe901d4615 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:49.587004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2144/4283] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:52.426073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:52.583760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc428e-bb45-4a37-8cef-77c9766dcc9d service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:52.621895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:52.622541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:52.622822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:52.623099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:52.637565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:52.801286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:52.805757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:52.830184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2140/4284] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:20:53.091536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:53.092003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:53.092133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:53.155152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] MFA Rules not processed for user `9403d05d164f4b00afdf891a113ed12f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:20:53.156514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:53.179337 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:53.328741 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2145/4285] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:20:53.340525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:20:53.342904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:20:53.553903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e33159-f50d-4672-83c1-6c3f32a4d183 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:20:53.562370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:20:53.564764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:20:53.565046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:20:53.565346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:20:53.588944 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:20:53.910737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:20:53.928314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:20:53.944072 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2141/4286] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:03.321524 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=24 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:03.935865 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=23 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:04.315374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:04.318330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:04.393284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0305d21-d69e-48a0-ac50-26e9d431702c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:04.459095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:04.460026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:04.460427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:04.461761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:04.476344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:04.522954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:04.525334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:04.558708 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2146/4287] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:08.949895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:08.987185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db714e-ebcd-4a88-ab18-d5597dbdf72d service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:08.997512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1aa85-05aa-460b-890d-1c14a0f77521 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:08.998132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1aa85-05aa-460b-890d-1c14a0f77521 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:08.998409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1aa85-05aa-460b-890d-1c14a0f77521 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:08.998676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1aa85-05aa-460b-890d-1c14a0f77521 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:09.000407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9dc1aa85-05aa-460b-890d-1c14a0f77521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:09.016653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1aa85-05aa-460b-890d-1c14a0f77521 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:09.018280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1aa85-05aa-460b-890d-1c14a0f77521 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:09.043722 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2142/4288] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:10.292376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:10.294819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:10.461382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51f30-8b9f-4964-8822-eb3c236ff65d service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:10.468911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:10.469713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:10.469995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:10.470444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] PATH_INFO: `/v3/users/cb2665b2649e4c3b80851d9c82c3a3fc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:10.471706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2665b2649e4c3b80851d9c82c3a3fc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:10.474489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:10.606037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2665b2649e4c3b80851d9c82c3a3fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:10.606741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2665b2649e4c3b80851d9c82c3a3fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:10.607609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2665b2649e4c3b80851d9c82c3a3fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:10.621270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2665b2649e4c3b80851d9c82c3a3fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:10.659640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2665b2649e4c3b80851d9c82c3a3fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:10.688182 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2147/4289] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:10 2022] DELETE /identity/v3/users/cb2665b2649e4c3b80851d9c82c3a3fc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:10.690263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:10.690757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:10.690927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:10.745075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:10.746822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:10.880053 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2143/4290] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:21:10.896994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:10.898512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:10.958496 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:10.998398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245b20-6a58-4240-9e97-0bbb19d81232 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:11.007216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:11.008186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:11.008674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:11.009446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:11.029334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:11.031412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:11.061700 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2148/4291] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:11.775615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:11.777875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:11.836405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698fc33-148e-43bb-8bf9-8e9f1d0ebae1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:11.844803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:11.846833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:11.851018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:11.852247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] PATH_INFO: `/v3/projects/130450a2f2e44b9cb2f715e7c9f2f6da` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:11.854057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130450a2f2e44b9cb2f715e7c9f2f6da)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:11.856440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:12.094876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130450a2f2e44b9cb2f715e7c9f2f6da', 'request_id': 'req-08321511-70aa-4975-b144-f152ffc37f86'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.122710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130450a2f2e44b9cb2f715e7c9f2f6da', 'request_id': 'req-08321511-70aa-4975-b144-f152ffc37f86'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.157442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130450a2f2e44b9cb2f715e7c9f2f6da', 'request_id': 'req-08321511-70aa-4975-b144-f152ffc37f86'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.210913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] The token cache is being invalidate because project 130450a2f2e44b9cb2f715e7c9f2f6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:12.210913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.216556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-08321511-70aa-4975-b144-f152ffc37f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.226358 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2144/4292] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:11 2022] DELETE /identity/v3/projects/130450a2f2e44b9cb2f715e7c9f2f6da => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:12.227950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:12.244493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68dcac-78da-4857-aca4-703ff45fbaf3 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:12.425491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:12.429307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:12.429598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:12.429877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] PATH_INFO: `/v3/users/870dae1c1fac4bbda2ad67298e30def9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:12.431958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] RBAC: Authorizing `identity:delete_user(user_id=870dae1c1fac4bbda2ad67298e30def9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:12.442131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:12.566078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870dae1c1fac4bbda2ad67298e30def9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.571117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870dae1c1fac4bbda2ad67298e30def9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.571820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870dae1c1fac4bbda2ad67298e30def9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.588590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870dae1c1fac4bbda2ad67298e30def9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.618972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870dae1c1fac4bbda2ad67298e30def9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:12.637654 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2149/4293] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:12 2022] DELETE /identity/v3/users/870dae1c1fac4bbda2ad67298e30def9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:13.357883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:13.359103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:13.359481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:13.399940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:13.402463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:13.550215 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2145/4294] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:13.567705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:13.570223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:13.620122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:13.621844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:13.630449 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:13.740712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e353d7-8925-4437-ac62-91fafb72564f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:13.745287 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:13.747106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:13.748031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:13.748468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:13.748817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] PATH_INFO: `/v3/projects/02af77ef74ea478982786c75479acbaf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:13.750267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02af77ef74ea478982786c75479acbaf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:13.753327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:13.767995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45024752-353b-4ffe-af22-d5338fe6155a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:13.782493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:13.789471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:13.789790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:13.790306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:13.815646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:13.825636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:13.848965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02af77ef74ea478982786c75479acbaf', 'request_id': 'req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:13.851333 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2150/4295] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:21:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:21:13.878338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02af77ef74ea478982786c75479acbaf', 'request_id': 'req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:13.893770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02af77ef74ea478982786c75479acbaf', 'request_id': 'req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:13.962483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] The token cache is being invalidate because project 02af77ef74ea478982786c75479acbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:13.965106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:13.980818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-461aaba6-5e74-4cdc-a0dc-4eb17a39d6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:14.005830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2146/4296] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:13 2022] DELETE /identity/v3/projects/02af77ef74ea478982786c75479acbaf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:21:14.009254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:14.033559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea7f4-9130-484c-be9a-01eefac70f32 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:14.231254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:14.232118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:14.232215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:14.232489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] PATH_INFO: `/v3/users/ebb103da14564502a72c1b1883b29d0a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:14.235621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb103da14564502a72c1b1883b29d0a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:14.240108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:14.404178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb103da14564502a72c1b1883b29d0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:14.406735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb103da14564502a72c1b1883b29d0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:14.409465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb103da14564502a72c1b1883b29d0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:14.430395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb103da14564502a72c1b1883b29d0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:14.475802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb103da14564502a72c1b1883b29d0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:14.512675 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2151/4297] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:14 2022] DELETE /identity/v3/users/ebb103da14564502a72c1b1883b29d0a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:15.060043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:15.062196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:15.062644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:15.098530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:15.100048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:15.214096 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2147/4298] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:15.228472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:15.229974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:15.423073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4aa36-c3c0-4e4a-8a32-6d1e120aeb48 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:15.430505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f8cfa-75f4-48b2-9d29-db653e978088 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:15.431233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8cfa-75f4-48b2-9d29-db653e978088 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:15.431619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8cfa-75f4-48b2-9d29-db653e978088 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:15.431980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8cfa-75f4-48b2-9d29-db653e978088 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:15.444563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f8cfa-75f4-48b2-9d29-db653e978088 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:15.446396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f8cfa-75f4-48b2-9d29-db653e978088 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:15.451333 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:15.464546 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2152/4299] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:21:15.601339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:15.603024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:15.702235 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:15.741175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7df94-28a9-4ce1-8862-d9afff0fee36 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:15.747466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:15.748212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:15.748678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:15.749167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] PATH_INFO: `/v3/projects/26eeac4b82de4b7db451a1bb8e6003bc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:15.752956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26eeac4b82de4b7db451a1bb8e6003bc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:15.760299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:15.878314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26eeac4b82de4b7db451a1bb8e6003bc', 'request_id': 'req-1105ed9a-f719-4280-907d-37694f054b8d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:15.884926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26eeac4b82de4b7db451a1bb8e6003bc', 'request_id': 'req-1105ed9a-f719-4280-907d-37694f054b8d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:15.896480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26eeac4b82de4b7db451a1bb8e6003bc', 'request_id': 'req-1105ed9a-f719-4280-907d-37694f054b8d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:15.923940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] The token cache is being invalidate because project 26eeac4b82de4b7db451a1bb8e6003bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:15.924572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:15.927512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1105ed9a-f719-4280-907d-37694f054b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:15.929584 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2148/4300] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:15 2022] DELETE /identity/v3/projects/26eeac4b82de4b7db451a1bb8e6003bc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:15.934732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76662-4e1c-4a4a-b7f3-b6be0a3d9af8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:15.935411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76662-4e1c-4a4a-b7f3-b6be0a3d9af8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:15.935814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76662-4e1c-4a4a-b7f3-b6be0a3d9af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.037431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-efe76662-4e1c-4a4a-b7f3-b6be0a3d9af8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:16.039244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-efe76662-4e1c-4a4a-b7f3-b6be0a3d9af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:16.212792 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2153/4301] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:16.213198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983a61c-b9c4-4f89-a054-048983494da4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.213643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983a61c-b9c4-4f89-a054-048983494da4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.213758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983a61c-b9c4-4f89-a054-048983494da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.274370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0983a61c-b9c4-4f89-a054-048983494da4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:16.277840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aff6f-f2a1-4f4d-b443-4c88f4b85b35 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.278340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aff6f-f2a1-4f4d-b443-4c88f4b85b35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.278438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aff6f-f2a1-4f4d-b443-4c88f4b85b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.279099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0983a61c-b9c4-4f89-a054-048983494da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:16.307679 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2149/4302] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:16.310234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983a61c-b9c4-4f89-a054-048983494da4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:16.316327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a89aff6f-f2a1-4f4d-b443-4c88f4b85b35 None None] MFA Rules not processed for user `9fdb77980af84574812088ed93c00f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:16.318172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a89aff6f-f2a1-4f4d-b443-4c88f4b85b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:16.332536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983a61c-b9c4-4f89-a054-048983494da4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:16.345750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:16.346636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.347876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.349348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.350447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:21:16.351726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:16.354456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:16.386065 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2150/4303] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:21:16.387893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:16.414319 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2154/4304] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:16.418343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f264e74-58af-4efc-8d34-3405ee8ce459 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:16.431986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:16.432713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.433100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.433947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.434593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:16.436498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:16.503194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89aff6f-f2a1-4f4d-b443-4c88f4b85b35 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:16.513978 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2151/4305] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:21:16 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:16.537798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89aff6f-f2a1-4f4d-b443-4c88f4b85b35 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:16.675839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:16.676460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.676758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.677006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.677709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:16.679648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:16.723114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2155/4306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:21:16 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:16.728256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:16.742455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d753aaf-70a0-4f2b-bc8e-3257cb584d07 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:16.750140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:16.751359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.752310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.752964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.754624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:16.757143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:16.773466 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2152/4307] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:16.774482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:16.787114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a944-ab7b-40e3-bfd9-5a4ea72f32ea admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:16.795290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48da5d3-b426-49a7-8a8e-676f72138f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:16.796120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48da5d3-b426-49a7-8a8e-676f72138f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.796504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48da5d3-b426-49a7-8a8e-676f72138f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.796848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48da5d3-b426-49a7-8a8e-676f72138f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.797595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48da5d3-b426-49a7-8a8e-676f72138f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:16.801233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48da5d3-b426-49a7-8a8e-676f72138f3b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:16.804952 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:16.828155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2156/4308] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:16.828417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:16.855947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4db6b-13a5-49ba-8576-ecb20d88f30c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:16.869524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:16.870466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.872440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.872872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] PATH_INFO: `/v3/projects/4cda00fafdf64533bd907cd341701b1c/users/436838a8e1fe4d028af66eea45269871/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:16.922583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cda00fafdf64533bd907cd341701b1c, user_id=436838a8e1fe4d028af66eea45269871, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:16.926193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:16.974869 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2153/4309] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:16 2022] PUT /identity/v3/projects/4cda00fafdf64533bd907cd341701b1c/users/436838a8e1fe4d028af66eea45269871/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:21:16.979048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee799ce-460b-4348-baf9-eb44d9d77b35 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:16.979359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee799ce-460b-4348-baf9-eb44d9d77b35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:16.979637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee799ce-460b-4348-baf9-eb44d9d77b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.027350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5ee799ce-460b-4348-baf9-eb44d9d77b35 None None] MFA Rules not processed for user `436838a8e1fe4d028af66eea45269871`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:17.029793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ee799ce-460b-4348-baf9-eb44d9d77b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:17.150826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2157/4310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:17.153473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:17.283731 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:17.303411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89111bf-43b1-415d-9495-51f8401349b0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:17.312071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:17.313570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:17.314830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:17.315766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.316972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:17.320662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:17.389317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee799ce-460b-4348-baf9-eb44d9d77b35 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:17.394165 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2154/4311] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:21:17 2022] POST /identity/v3/projects => generated 407 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:17.404396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee799ce-460b-4348-baf9-eb44d9d77b35 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:17.525706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:17.527305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:17.527922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:17.528386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.529424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:17.531619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:17.569453 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2158/4312] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:21:17 2022] POST /identity/v3/users => generated 310 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:21:17.572861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:17.597323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f5cd9-2fa8-4e6e-a2e0-7941d38556a9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:17.607355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:17.607993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:17.608273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:17.608542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.609345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:17.610851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:17.627994 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2155/4313] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:17.632573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:17.649234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189e96-da4e-416a-92b0-c88f5bbc699b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:17.657926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:17.658905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:17.659621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:17.660203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] PATH_INFO: `/v3/projects/0912e16b417f4d20acfcb914686e3786/users/2409b8858b6c48729b10a039d16e152c/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.702359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0912e16b417f4d20acfcb914686e3786, user_id=2409b8858b6c48729b10a039d16e152c, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:17.707138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:17.740941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2159/4314] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:17 2022] PUT /identity/v3/projects/0912e16b417f4d20acfcb914686e3786/users/2409b8858b6c48729b10a039d16e152c/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:21:17.744751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:17.760633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133d49-2a8e-4db2-a534-70decb625cd4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:17.840203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fa15a-7070-472f-9c56-46e01952fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:17.841384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fa15a-7070-472f-9c56-46e01952fcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:17.841384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fa15a-7070-472f-9c56-46e01952fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:17.841576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fa15a-7070-472f-9c56-46e01952fcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.842205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fa15a-7070-472f-9c56-46e01952fcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:17.844124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fa15a-7070-472f-9c56-46e01952fcb1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:17.856005 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2156/4315] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:17.860012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:17.874078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad1cb-863e-4360-b82e-308a0c02e32f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:17.882488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:17.884160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:17.884574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:17.884925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] PATH_INFO: `/v3/projects/0912e16b417f4d20acfcb914686e3786/users/2409b8858b6c48729b10a039d16e152c/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.887291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0912e16b417f4d20acfcb914686e3786, user_id=2409b8858b6c48729b10a039d16e152c, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:17.891071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:17.910914 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2160/4316] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:17 2022] PUT /identity/v3/projects/0912e16b417f4d20acfcb914686e3786/users/2409b8858b6c48729b10a039d16e152c/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:17.922616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:17.922911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:17.923293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:17.980513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] MFA Rules not processed for user `2409b8858b6c48729b10a039d16e152c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:17.985090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:18.120791 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2157/4317] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:18.141586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:18.143482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:18.272033 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:18.346543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f46ff-9667-495a-9957-6580bbf452f9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:18.364158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014231-35bb-4855-9469-588c1e0aa876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:18.364804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014231-35bb-4855-9469-588c1e0aa876 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:18.365108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014231-35bb-4855-9469-588c1e0aa876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:18.365388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014231-35bb-4855-9469-588c1e0aa876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:18.506802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014231-35bb-4855-9469-588c1e0aa876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:18.508310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014231-35bb-4855-9469-588c1e0aa876 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:18.531058 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2161/4318] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:19.587755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:19.590925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:19.690276 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:19.782833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722eba1-339c-46a8-8910-7ed4a1b72693 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:19.805671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:19.806457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:19.806830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:19.807217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:19.855519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:19.858036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:19.884890 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2158/4319] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:21.357723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dc4db-2ac8-45be-840a-00d9a4831f09 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:21.359034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dc4db-2ac8-45be-840a-00d9a4831f09 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:21.359461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dc4db-2ac8-45be-840a-00d9a4831f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:21.398283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-204dc4db-2ac8-45be-840a-00d9a4831f09 None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:21.401935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-204dc4db-2ac8-45be-840a-00d9a4831f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:21.547353 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2162/4320] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:21.827586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:21.829630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:21.911673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5b8cf-456d-44b3-963d-6c737c0f8af7 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:21.917239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:21.918173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:21.918726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:21.919456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] PATH_INFO: `/v3/users/978efdbaa0a146edaf2347450f3b997a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:21.920798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978efdbaa0a146edaf2347450f3b997a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:21.922985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:21.986310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978efdbaa0a146edaf2347450f3b997a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:21.987370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978efdbaa0a146edaf2347450f3b997a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:21.988250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978efdbaa0a146edaf2347450f3b997a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.002559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978efdbaa0a146edaf2347450f3b997a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.011420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1053a435-085e-4e15-892d-a24f13de73d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978efdbaa0a146edaf2347450f3b997a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.031502 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2159/4321] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:21 2022] DELETE /identity/v3/users/978efdbaa0a146edaf2347450f3b997a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:22.233492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dc4db-2ac8-45be-840a-00d9a4831f09 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:22.247145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dc4db-2ac8-45be-840a-00d9a4831f09 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:22.348489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:22.349186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:22.349740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:22.350077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] PATH_INFO: `/v3/projects/1d868837f7f94d24adee2dc81d6d56a2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:22.351263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d868837f7f94d24adee2dc81d6d56a2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:22.353442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:22.390134 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:22.419851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d868837f7f94d24adee2dc81d6d56a2', 'request_id': 'req-4e0dd35e-aa47-4d98-8cc0-755549e90478'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.427888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d868837f7f94d24adee2dc81d6d56a2', 'request_id': 'req-4e0dd35e-aa47-4d98-8cc0-755549e90478'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.441258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d868837f7f94d24adee2dc81d6d56a2', 'request_id': 'req-4e0dd35e-aa47-4d98-8cc0-755549e90478'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.466523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] The token cache is being invalidate because project 1d868837f7f94d24adee2dc81d6d56a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:22.466817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.467661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4e0dd35e-aa47-4d98-8cc0-755549e90478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:22.469777 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2163/4322] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:22 2022] DELETE /identity/v3/projects/1d868837f7f94d24adee2dc81d6d56a2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:22.479626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035c47-0d5c-40c3-bcc0-29e135d59d3f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:22.480441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035c47-0d5c-40c3-bcc0-29e135d59d3f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:22.480441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035c47-0d5c-40c3-bcc0-29e135d59d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:22.504574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8c035c47-0d5c-40c3-bcc0-29e135d59d3f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:22.506239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c035c47-0d5c-40c3-bcc0-29e135d59d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:22.544995 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:22.584409 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2160/4323] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:22.677198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b69a33-2eb7-4a63-a56b-1ad20d6c1181 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:22.677834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b69a33-2eb7-4a63-a56b-1ad20d6c1181 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:22.678309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b69a33-2eb7-4a63-a56b-1ad20d6c1181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:22.701577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79b69a33-2eb7-4a63-a56b-1ad20d6c1181 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:22.702991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79b69a33-2eb7-4a63-a56b-1ad20d6c1181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:22.711414 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2164/4324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:22.715857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c035c47-0d5c-40c3-bcc0-29e135d59d3f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:22.728259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c035c47-0d5c-40c3-bcc0-29e135d59d3f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:22.733391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:22.734105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:22.734455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:22.734795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:22.735509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:21:22.735875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:22.737693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:22.755241 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2161/4325] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:21:22.767207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b69a33-2eb7-4a63-a56b-1ad20d6c1181 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:22.776690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b69a33-2eb7-4a63-a56b-1ad20d6c1181 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:22.782243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:22.782858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:22.783140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:22.783407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:22.784102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:22.786778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:22.826872 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2165/4326] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:21:22 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:22.827717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:22.877126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013524-ba78-4f82-910c-5ab47ae3ee96 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:23.023513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:23.028580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:23.028864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:23.030229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:23.031268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:23.036459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:23.092519 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2162/4327] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:21:22 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:23.096877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:23.131608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795cfaa-1480-4191-b35a-6dda83877388 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:23.142290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:23.142920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:23.146433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:23.147443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:23.148277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:23.152681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:23.195797 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2166/4328] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:23.196577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:23.212272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523f31-7db8-4f1c-99dc-c5d2d9adbe88 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:23.230127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d737987-ec44-436c-b360-97edeef5e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:23.245176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737987-ec44-436c-b360-97edeef5e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:23.247310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737987-ec44-436c-b360-97edeef5e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:23.247715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737987-ec44-436c-b360-97edeef5e5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:23.248529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d737987-ec44-436c-b360-97edeef5e5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:23.252689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d737987-ec44-436c-b360-97edeef5e5f7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:23.270895 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2163/4329] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:23.273961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:23.284889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6021e2-7df0-4f8c-b592-12f9be1ce005 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:23.291071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:23.291754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:23.292091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:23.292508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] PATH_INFO: `/v3/projects/6dba2e1d0a1c40adad2d85e383c5d6da/users/5b10ebef20984a6b850398267e79e50b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:23.317237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dba2e1d0a1c40adad2d85e383c5d6da, user_id=5b10ebef20984a6b850398267e79e50b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:23.320233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:23.362099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2167/4330] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:23 2022] PUT /identity/v3/projects/6dba2e1d0a1c40adad2d85e383c5d6da/users/5b10ebef20984a6b850398267e79e50b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:21:23.367611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:23.368423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:23.368580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:23.409347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:23.411711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:23.575623 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2164/4331] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:23.610711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:23.612479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:23.684412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a60a7-16dc-450d-a1a5-dce2b52b2df2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:23.689545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3681f-aab2-415f-8e87-8ad067c32eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:23.690197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3681f-aab2-415f-8e87-8ad067c32eda service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:23.690450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3681f-aab2-415f-8e87-8ad067c32eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:23.690942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3681f-aab2-415f-8e87-8ad067c32eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:23.704007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3681f-aab2-415f-8e87-8ad067c32eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:23.707435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3681f-aab2-415f-8e87-8ad067c32eda service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:23.723945 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2168/4332] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:32.212193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:32.213986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:32.247501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517a2c-f489-4696-8d43-9ef56b50221c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:32.257481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:32.258266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:32.258912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:32.259385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] PATH_INFO: `/v3/users/436838a8e1fe4d028af66eea45269871` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:32.260755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436838a8e1fe4d028af66eea45269871)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:32.264650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:32.383123 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:32.410962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436838a8e1fe4d028af66eea45269871'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:32.413654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436838a8e1fe4d028af66eea45269871'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:32.414306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436838a8e1fe4d028af66eea45269871'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:32.450420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436838a8e1fe4d028af66eea45269871'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:32.479841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436838a8e1fe4d028af66eea45269871'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:32.523647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990ac3-aa56-4dce-97d3-4e49f82262f4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:32.524880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990ac3-aa56-4dce-97d3-4e49f82262f4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:32.525236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990ac3-aa56-4dce-97d3-4e49f82262f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:32.525729 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2165/4333] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:32 2022] DELETE /identity/v3/users/436838a8e1fe4d028af66eea45269871 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:32.552591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-12990ac3-aa56-4dce-97d3-4e49f82262f4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:32.554584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-12990ac3-aa56-4dce-97d3-4e49f82262f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:32.617193 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:32.640054 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2169/4334] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:21:32.675615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:32.680648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:32.725249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:32.726325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:32.726750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:32.799501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] MFA Rules not processed for user `5b10ebef20984a6b850398267e79e50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:32.803249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:32.851085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2932c8-d510-43c9-b1d2-8233e7e06557 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:32.860552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c857e9-605a-4ac8-83da-40bdf1332894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:32.861870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c857e9-605a-4ac8-83da-40bdf1332894 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:32.862346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c857e9-605a-4ac8-83da-40bdf1332894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:32.862874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c857e9-605a-4ac8-83da-40bdf1332894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:32.890442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c857e9-605a-4ac8-83da-40bdf1332894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:32.893421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c857e9-605a-4ac8-83da-40bdf1332894 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:32.907774 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2166/4335] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:33.002531 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2170/4336] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:33.010219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:33.010219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:33.012764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:33.056540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] MFA Rules not processed for user `5b10ebef20984a6b850398267e79e50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:33.058062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:33.072929 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2167/4337] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:33.080419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:33.082501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:33.193761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a80715-e915-4546-8b3b-93b82bcce54f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:33.200218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:33.200835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:33.201333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:33.201825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:33.214165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:33.215773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:33.227399 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2171/4338] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:33.831125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:33.834268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:33.860789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e573a66-e035-491b-93f6-af64a4623ca0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:33.869431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:33.870517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:33.870951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:33.871375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] PATH_INFO: `/v3/projects/4cda00fafdf64533bd907cd341701b1c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:33.872685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cda00fafdf64533bd907cd341701b1c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:33.875561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:34.020644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cda00fafdf64533bd907cd341701b1c', 'request_id': 'req-e6448f53-901e-479c-a41e-9fd6a11ee7f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.030213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cda00fafdf64533bd907cd341701b1c', 'request_id': 'req-e6448f53-901e-479c-a41e-9fd6a11ee7f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.054392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cda00fafdf64533bd907cd341701b1c', 'request_id': 'req-e6448f53-901e-479c-a41e-9fd6a11ee7f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.083318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] The token cache is being invalidate because project 4cda00fafdf64533bd907cd341701b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:34.085087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.086092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.088166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2168/4339] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:33 2022] DELETE /identity/v3/projects/4cda00fafdf64533bd907cd341701b1c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:34.092012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:34.110356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854bd56-ba8b-4752-95d9-77acac2bbde5 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:34.240060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:34.240711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:34.240990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:34.241288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] PATH_INFO: `/v3/users/2409b8858b6c48729b10a039d16e152c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:34.244911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2409b8858b6c48729b10a039d16e152c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:34.249021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:34.258314 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:34.351949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2409b8858b6c48729b10a039d16e152c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.352854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2409b8858b6c48729b10a039d16e152c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.353734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2409b8858b6c48729b10a039d16e152c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.371867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2409b8858b6c48729b10a039d16e152c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.407938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c30630c-9b0f-43c1-a6ef-f5482e91d72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2409b8858b6c48729b10a039d16e152c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:34.439656 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2172/4340] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:34 2022] DELETE /identity/v3/users/2409b8858b6c48729b10a039d16e152c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:35.166624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:35.168115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:35.196578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6448f53-901e-479c-a41e-9fd6a11ee7f9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:35.278566 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:35.357662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:35.359137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:35.359658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:35.359993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] PATH_INFO: `/v3/projects/0912e16b417f4d20acfcb914686e3786` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:35.363046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0912e16b417f4d20acfcb914686e3786)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:35.365109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:35.487547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0912e16b417f4d20acfcb914686e3786', 'request_id': 'req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:35.581225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0912e16b417f4d20acfcb914686e3786', 'request_id': 'req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:35.608093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0912e16b417f4d20acfcb914686e3786', 'request_id': 'req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:35.656363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] The token cache is being invalidate because project 0912e16b417f4d20acfcb914686e3786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:35.656880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:35.658258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7e7f5d56-c59a-46c6-99d2-2e4d6b0a5401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:35.666908 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2169/4341] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:35 2022] DELETE /identity/v3/projects/0912e16b417f4d20acfcb914686e3786 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:35.671638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74673a74-43a1-4564-b187-6dd7999d1db9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:35.672492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74673a74-43a1-4564-b187-6dd7999d1db9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:35.672998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74673a74-43a1-4564-b187-6dd7999d1db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:35.713486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-74673a74-43a1-4564-b187-6dd7999d1db9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:35.714967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-74673a74-43a1-4564-b187-6dd7999d1db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:35.871078 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2173/4342] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:35.879437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5cec-6320-41c5-9e3f-11778b450c2f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:35.880054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5cec-6320-41c5-9e3f-11778b450c2f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:35.880561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5cec-6320-41c5-9e3f-11778b450c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:35.930667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8bad5cec-6320-41c5-9e3f-11778b450c2f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:35.933743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8bad5cec-6320-41c5-9e3f-11778b450c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:35.944662 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2170/4343] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:35.948930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74673a74-43a1-4564-b187-6dd7999d1db9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:35.964582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74673a74-43a1-4564-b187-6dd7999d1db9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:35.982844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:35.984070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:35.984655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:35.986062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:35.986953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:21:35.988970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:35.992846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:36.029795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2174/4344] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:21:36.034386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5cec-6320-41c5-9e3f-11778b450c2f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:36.049640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5cec-6320-41c5-9e3f-11778b450c2f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:36.059226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:36.060271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.060737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.061314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.062185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:36.068154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:36.149423 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2171/4345] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:21:36 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:36.153914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:36.169102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb4c0-ddbd-4a86-9863-ddcd0b3cef16 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:36.306667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:36.306960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.307248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.307511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.308270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:36.310355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:36.346576 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:36.360148 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2175/4346] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:21:36 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:36.361139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:36.383362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f38f3-b4d7-411b-a78b-8e44515a68e1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:36.395490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:36.396113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.396387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.396695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.397326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:36.400196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:36.415127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2172/4347] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:36.418984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:36.432303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e6f09-61ae-473f-bf41-9b8ab20a1709 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:36.439974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdab396-16cb-4ebf-af1c-80ce386d615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:36.441428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab396-16cb-4ebf-af1c-80ce386d615a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.441857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab396-16cb-4ebf-af1c-80ce386d615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.442274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdab396-16cb-4ebf-af1c-80ce386d615a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.450297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab396-16cb-4ebf-af1c-80ce386d615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:36.452306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdab396-16cb-4ebf-af1c-80ce386d615a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:36.470240 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2176/4348] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:36.478854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:36.510984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e14c-8c1b-4379-86ec-1390432843e2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:36.516939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:36.517662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.518709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.518999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] PATH_INFO: `/v3/projects/912e8e829b584d85880d6542d5792e5a/users/4dee6241a08f47d688a10f5d7498eff4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.557090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] RBAC: Authorizing `identity:create_grant(project_id=912e8e829b584d85880d6542d5792e5a, user_id=4dee6241a08f47d688a10f5d7498eff4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:36.560336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:36.578055 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2173/4349] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:36 2022] PUT /identity/v3/projects/912e8e829b584d85880d6542d5792e5a/users/4dee6241a08f47d688a10f5d7498eff4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:36.588996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e7ff5-0a1f-438b-9690-6799f927efd5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.589345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e7ff5-0a1f-438b-9690-6799f927efd5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.589578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e7ff5-0a1f-438b-9690-6799f927efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.621793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d36e7ff5-0a1f-438b-9690-6799f927efd5 None None] MFA Rules not processed for user `4dee6241a08f47d688a10f5d7498eff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:36.623094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d36e7ff5-0a1f-438b-9690-6799f927efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:36.773471 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2177/4350] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:36.777740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:36.911258 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:36.924395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac704f-a460-41f6-af27-a18ae69f911e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:36.933905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:36.936574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:36.936574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:36.937324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:36.938725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:36.945438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:37.010049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e7ff5-0a1f-438b-9690-6799f927efd5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:37.019664 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2174/4351] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:21:36 2022] POST /identity/v3/projects => generated 399 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:37.025696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e7ff5-0a1f-438b-9690-6799f927efd5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:37.230137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:37.230835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:37.231114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:37.231421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:37.232145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:37.234287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:37.285923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:37.295748 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2178/4352] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:21:37 2022] POST /identity/v3/users => generated 306 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:21:37.306040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e309bf-ff58-4c36-920e-82788d393d88 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:37.320368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:37.321019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:37.321327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:37.321631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:37.323209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:37.323888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:37.356696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:37.363486 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2175/4353] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:21:37.396020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17dabc-af1f-4b49-8854-6b3f6596cbe7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:37.413831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:37.414306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:37.414592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:37.414867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] PATH_INFO: `/v3/projects/43b0aefe1ce1402893303f3a3f834c87/users/538ea1013de24b449fbfef4e2dbd1a6d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:37.464228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b0aefe1ce1402893303f3a3f834c87, user_id=538ea1013de24b449fbfef4e2dbd1a6d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:37.467216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:37.495020 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2179/4354] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:37 2022] PUT /identity/v3/projects/43b0aefe1ce1402893303f3a3f834c87/users/538ea1013de24b449fbfef4e2dbd1a6d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:37.499373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:37.515359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324e73-f6ce-41f6-b6ca-605f15b9707d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:37.686139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc6013-923c-43e4-8d47-e3740a69da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:37.687972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6013-923c-43e4-8d47-e3740a69da4f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:37.688358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6013-923c-43e4-8d47-e3740a69da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:37.689659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6013-923c-43e4-8d47-e3740a69da4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:37.691953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc6013-923c-43e4-8d47-e3740a69da4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:37.694533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc6013-923c-43e4-8d47-e3740a69da4f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:37.718389 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2176/4355] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:37.721860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:37.735282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb26e-adcf-4448-982a-76d4bf1700b2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:37.748993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:37.749712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:37.749991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:37.750263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] PATH_INFO: `/v3/projects/43b0aefe1ce1402893303f3a3f834c87/users/538ea1013de24b449fbfef4e2dbd1a6d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:37.755432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b0aefe1ce1402893303f3a3f834c87, user_id=538ea1013de24b449fbfef4e2dbd1a6d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:37.765906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:37.808392 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2180/4356] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:37 2022] PUT /identity/v3/projects/43b0aefe1ce1402893303f3a3f834c87/users/538ea1013de24b449fbfef4e2dbd1a6d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:37.808972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:37.809204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:37.809412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:37.848287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] MFA Rules not processed for user `538ea1013de24b449fbfef4e2dbd1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:37.849376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:37.978290 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2177/4357] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:37.989270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:37.991049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:38.041858 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:38.087432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6019fe3-6e3e-4a88-9f8a-28a5232bab4a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:38.097258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b13b1-2f8f-4f81-b90c-636dc54d9750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:38.098320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b13b1-2f8f-4f81-b90c-636dc54d9750 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:38.098841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b13b1-2f8f-4f81-b90c-636dc54d9750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:38.099312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b13b1-2f8f-4f81-b90c-636dc54d9750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:38.303651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b13b1-2f8f-4f81-b90c-636dc54d9750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:38.305968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b13b1-2f8f-4f81-b90c-636dc54d9750 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:38.329125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2181/4358] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:39.124159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:39.126159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:39.242873 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:39.283713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836f4ae-8fde-46c4-bc05-ed7424a2929e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:39.299099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6256f8-eb10-4d5e-a845-bac5c14f5242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:39.300422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6256f8-eb10-4d5e-a845-bac5c14f5242 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:39.300865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6256f8-eb10-4d5e-a845-bac5c14f5242 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:39.301362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6256f8-eb10-4d5e-a845-bac5c14f5242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:39.315155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6256f8-eb10-4d5e-a845-bac5c14f5242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:39.317650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6256f8-eb10-4d5e-a845-bac5c14f5242 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:39.330675 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2178/4359] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:42.431962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1474-177b-447b-89d3-87b56cf90098 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:42.432494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1474-177b-447b-89d3-87b56cf90098 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:42.432620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1474-177b-447b-89d3-87b56cf90098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:42.463355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e17e1474-177b-447b-89d3-87b56cf90098 None None] MFA Rules not processed for user `f2e7bdbfc4994010a5f889b486e4f15b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:42.473638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e17e1474-177b-447b-89d3-87b56cf90098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:42.578488 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2182/4360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:42.590318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9349dc-a057-4296-838b-1a5edc2991f6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:42.590852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9349dc-a057-4296-838b-1a5edc2991f6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:42.590852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9349dc-a057-4296-838b-1a5edc2991f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:42.623753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bc9349dc-a057-4296-838b-1a5edc2991f6 None None] MFA Rules not processed for user `f2e7bdbfc4994010a5f889b486e4f15b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:42.625392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bc9349dc-a057-4296-838b-1a5edc2991f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:42.634652 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2179/4361] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:46.669835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:46.671018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:46.672168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:46.701327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] MFA Rules not processed for user `eefc130baa41461584a6e497329381ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:46.702573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:46.733504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bde1b-d3c9-49c5-b878-91e283abaa65 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:46.734053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bde1b-d3c9-49c5-b878-91e283abaa65 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:46.734318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bde1b-d3c9-49c5-b878-91e283abaa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:46.762316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-807bde1b-d3c9-49c5-b878-91e283abaa65 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:46.763657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-807bde1b-d3c9-49c5-b878-91e283abaa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:46.809160 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2183/4362] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:46.856906 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2180/4363] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:46.886095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:46.887545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:46.953184 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:46.996058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32537190-141f-4592-9e64-dcc2dbdb2343 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:47.002076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5fe35-b45e-452e-85d5-cd3e33d331a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:47.003500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5fe35-b45e-452e-85d5-cd3e33d331a1 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:47.003890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5fe35-b45e-452e-85d5-cd3e33d331a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:47.004271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5fe35-b45e-452e-85d5-cd3e33d331a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:47.029799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5fe35-b45e-452e-85d5-cd3e33d331a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:47.037332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5fe35-b45e-452e-85d5-cd3e33d331a1 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:47.049287 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2184/4364] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:21:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:21:47.569909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bde1b-d3c9-49c5-b878-91e283abaa65 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:47.724981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bde1b-d3c9-49c5-b878-91e283abaa65 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:47.730248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:47.731116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:47.731677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:47.732129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] PATH_INFO: `/v3/users/4dee6241a08f47d688a10f5d7498eff4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:47.733546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dee6241a08f47d688a10f5d7498eff4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:47.744922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:47.871738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dee6241a08f47d688a10f5d7498eff4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:47.872950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dee6241a08f47d688a10f5d7498eff4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:47.873994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dee6241a08f47d688a10f5d7498eff4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:47.892730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dee6241a08f47d688a10f5d7498eff4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:47.901597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dee6241a08f47d688a10f5d7498eff4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:47.906167 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:47.947090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2181/4365] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:47 2022] DELETE /identity/v3/users/4dee6241a08f47d688a10f5d7498eff4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:47.947832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:47.948271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:47.948362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:48.002035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:48.010115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:48.176782 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2185/4366] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:48.186650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:48.189054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:48.347339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846dfbe-9cf3-41e1-ad8b-1c0ebf61ab2e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:48.357908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:48.359956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:48.360804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:48.362011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:48.394315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:48.397609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:48.426830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2182/4367] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:21:48.756229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:48.757905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:48.782298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da4af-3687-4542-ac4c-275c7323fe43 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:48.795100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:48.795754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:48.796030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:48.796302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] PATH_INFO: `/v3/projects/912e8e829b584d85880d6542d5792e5a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:48.801953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912e8e829b584d85880d6542d5792e5a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:48.803880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:48.972321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912e8e829b584d85880d6542d5792e5a', 'request_id': 'req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:48.987885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912e8e829b584d85880d6542d5792e5a', 'request_id': 'req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.003797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912e8e829b584d85880d6542d5792e5a', 'request_id': 'req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.040911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] The token cache is being invalidate because project 912e8e829b584d85880d6542d5792e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:49.041474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.042305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.044641 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2186/4368] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:48 2022] DELETE /identity/v3/projects/912e8e829b584d85880d6542d5792e5a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:49.048658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:49.060820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844aae-49f8-458f-9759-2da1b897d1e7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:49.139554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:49.140191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:49.140466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:49.140781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] PATH_INFO: `/v3/users/538ea1013de24b449fbfef4e2dbd1a6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:49.145862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538ea1013de24b449fbfef4e2dbd1a6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:49.148076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:49.228684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538ea1013de24b449fbfef4e2dbd1a6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.229811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538ea1013de24b449fbfef4e2dbd1a6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.232787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538ea1013de24b449fbfef4e2dbd1a6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.267001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538ea1013de24b449fbfef4e2dbd1a6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.276652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-678a11b0-5fc2-42d4-a9ca-10cdf9c38a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538ea1013de24b449fbfef4e2dbd1a6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.315788 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2183/4369] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:49 2022] DELETE /identity/v3/users/538ea1013de24b449fbfef4e2dbd1a6d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:49.571993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:49.573755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:49.610612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb038-bbba-4a5b-8fd6-e9a4b5c5afc6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:49.716409 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:49.749524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:49.755036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:49.755536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:49.756117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] PATH_INFO: `/v3/projects/43b0aefe1ce1402893303f3a3f834c87` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:49.759159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b0aefe1ce1402893303f3a3f834c87)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:49.766083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:49.900390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b0aefe1ce1402893303f3a3f834c87', 'request_id': 'req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.917638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b0aefe1ce1402893303f3a3f834c87', 'request_id': 'req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.937619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b0aefe1ce1402893303f3a3f834c87', 'request_id': 'req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.956873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] The token cache is being invalidate because project 43b0aefe1ce1402893303f3a3f834c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:21:49.958035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.958717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d32c3b6-9d19-44d0-8cb6-5a3346543ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:49.960852 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2187/4370] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:21:49 2022] DELETE /identity/v3/projects/43b0aefe1ce1402893303f3a3f834c87 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:49.965875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0e73-8a44-42cd-bc9a-89c302526872 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:49.966168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0e73-8a44-42cd-bc9a-89c302526872 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:49.966448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0e73-8a44-42cd-bc9a-89c302526872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:49.999589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9d5b0e73-8a44-42cd-bc9a-89c302526872 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:50.001041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d5b0e73-8a44-42cd-bc9a-89c302526872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:50.030237 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:50.103270 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2184/4371] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:50.111456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed1d19-7919-467b-b4fe-19e1b4008253 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.113831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed1d19-7919-467b-b4fe-19e1b4008253 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.114296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed1d19-7919-467b-b4fe-19e1b4008253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.137792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-44ed1d19-7919-467b-b4fe-19e1b4008253 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:50.139083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-44ed1d19-7919-467b-b4fe-19e1b4008253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:50.148780 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2188/4372] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:50.153525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0e73-8a44-42cd-bc9a-89c302526872 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:50.176844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0e73-8a44-42cd-bc9a-89c302526872 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:50.183984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:50.184902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.185444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.185927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.187370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:21:50.187904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:50.189857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:50.207653 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2185/4373] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:21:50.214280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed1d19-7919-467b-b4fe-19e1b4008253 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:50.234896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed1d19-7919-467b-b4fe-19e1b4008253 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:50.253254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:50.254478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.256080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.256370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.257024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:50.258945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:50.339863 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2189/4374] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:21:50 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:50.343002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:50.356375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4a93-a8aa-48c5-80e3-545e0bab43c7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:50.539272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:50.542025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.542313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.545457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.550308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:50.562634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:50.640310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:50.652660 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2186/4375] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:21:50 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:50.660099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd2706-bbe7-4eeb-95cd-621407df8f7b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:50.671228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:50.671862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.672138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.672406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.673071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:50.679723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:50.710892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:50.711740 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2190/4376] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:50.728692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431b399-0c70-494b-86d3-be79c8ec4a8f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:50.749961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54da07f-565c-44ed-b847-5889ec878195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:50.750594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da07f-565c-44ed-b847-5889ec878195 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.750876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da07f-565c-44ed-b847-5889ec878195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.751153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da07f-565c-44ed-b847-5889ec878195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.755329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54da07f-565c-44ed-b847-5889ec878195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:50.761331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54da07f-565c-44ed-b847-5889ec878195 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:50.819928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2187/4377] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:50.822190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:50.838141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2698c4b-6019-4949-a533-ac613fd91404 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:50.860836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:50.868412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.869666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.870681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] PATH_INFO: `/v3/projects/627dc47477314bf0bef25356e8890e43/users/27548049bd294f999495de16ef2fd59b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.917597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] RBAC: Authorizing `identity:create_grant(project_id=627dc47477314bf0bef25356e8890e43, user_id=27548049bd294f999495de16ef2fd59b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:50.920686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:50.953337 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2191/4378] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:50 2022] PUT /identity/v3/projects/627dc47477314bf0bef25356e8890e43/users/27548049bd294f999495de16ef2fd59b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:50.964207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dda1cb-3127-47e0-b89a-0f15b875e6d9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:50.964505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dda1cb-3127-47e0-b89a-0f15b875e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:50.964782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dda1cb-3127-47e0-b89a-0f15b875e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:50.997696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-28dda1cb-3127-47e0-b89a-0f15b875e6d9 None None] MFA Rules not processed for user `27548049bd294f999495de16ef2fd59b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:50.999105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-28dda1cb-3127-47e0-b89a-0f15b875e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:51.147079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2188/4379] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:51.151284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:51.317861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256506c8-27ee-44a3-a728-9e27c69a711a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:51.336365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:51.337510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:51.337895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:51.338274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:51.339050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:51.341263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:51.390960 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:51.417780 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2192/4380] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:21:51 2022] POST /identity/v3/projects => generated 393 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:51.418173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dda1cb-3127-47e0-b89a-0f15b875e6d9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:51.439034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dda1cb-3127-47e0-b89a-0f15b875e6d9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:51.458572 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:51.591051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:51.591484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:51.591761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:51.592035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:51.603276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:51.605258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:51.675645 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2189/4381] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:21:51 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:21:51.681432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:51.702786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bf6f4-6e88-4eb6-8e62-4f065297cc5b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:51.728459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:51.729322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:51.732235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:51.733930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:51.753317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:51.757660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:51.808698 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2193/4382] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:51.810455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:51.829550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265019-a8f8-4c82-aca2-142f8394bc4a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:51.845402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:51.846090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:51.847670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:51.848102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] PATH_INFO: `/v3/projects/36043d777ba1428dad198cf354bc94f6/users/6784580578c74c5eb347a60d0c252294/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:51.886260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36043d777ba1428dad198cf354bc94f6, user_id=6784580578c74c5eb347a60d0c252294, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:51.888994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:51.931555 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2190/4383] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:51 2022] PUT /identity/v3/projects/36043d777ba1428dad198cf354bc94f6/users/6784580578c74c5eb347a60d0c252294/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:51.934061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:51.952637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9524a1-34a2-42fb-8d51-22a4a5780c19 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:52.119065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e03ec-03b8-4158-a89f-bbdc2a35495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:52.119713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e03ec-03b8-4158-a89f-bbdc2a35495f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:52.119972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e03ec-03b8-4158-a89f-bbdc2a35495f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:52.120247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e03ec-03b8-4158-a89f-bbdc2a35495f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:52.120933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e03ec-03b8-4158-a89f-bbdc2a35495f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:52.123088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e03ec-03b8-4158-a89f-bbdc2a35495f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:52.153552 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2194/4384] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:21:52.154528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:52.177735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9593f-6a1e-4999-b152-d80868f27a57 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:52.192031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:52.192805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:52.193103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:52.193386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] PATH_INFO: `/v3/projects/36043d777ba1428dad198cf354bc94f6/users/6784580578c74c5eb347a60d0c252294/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:52.199435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36043d777ba1428dad198cf354bc94f6, user_id=6784580578c74c5eb347a60d0c252294, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:52.203736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:52.220694 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2191/4385] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:21:52 2022] PUT /identity/v3/projects/36043d777ba1428dad198cf354bc94f6/users/6784580578c74c5eb347a60d0c252294/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:52.231634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730109e8-075e-4af6-9b97-ebf8ecb9e4d4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:52.231962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730109e8-075e-4af6-9b97-ebf8ecb9e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:52.232425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730109e8-075e-4af6-9b97-ebf8ecb9e4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:52.344738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-730109e8-075e-4af6-9b97-ebf8ecb9e4d4 None None] MFA Rules not processed for user `6784580578c74c5eb347a60d0c252294`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:52.356062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-730109e8-075e-4af6-9b97-ebf8ecb9e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:52.672064 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2195/4386] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:21:52.723721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:52.726018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:52.899429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b075bd-74b3-4742-bcdc-d757f3fc3c04 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:52.905369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcead8-d3be-4294-ba19-056d9323f993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:52.906088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcead8-d3be-4294-ba19-056d9323f993 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:52.909526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcead8-d3be-4294-ba19-056d9323f993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:52.910024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcead8-d3be-4294-ba19-056d9323f993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:52.926131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcead8-d3be-4294-ba19-056d9323f993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:52.928315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcead8-d3be-4294-ba19-056d9323f993 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:53.004466 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2192/4387] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:21:58.601870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730109e8-075e-4af6-9b97-ebf8ecb9e4d4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:58.704964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730109e8-075e-4af6-9b97-ebf8ecb9e4d4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:58.710239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:58.710953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:58.711298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:58.711633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] PATH_INFO: `/v3/users/27548049bd294f999495de16ef2fd59b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:58.712761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27548049bd294f999495de16ef2fd59b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:58.714719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:58.731972 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:21:58.778532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27548049bd294f999495de16ef2fd59b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:58.779214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27548049bd294f999495de16ef2fd59b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:58.779824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27548049bd294f999495de16ef2fd59b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:58.788557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27548049bd294f999495de16ef2fd59b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:58.810831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27548049bd294f999495de16ef2fd59b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:21:58.829109 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2196/4388] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:21:58 2022] DELETE /identity/v3/users/27548049bd294f999495de16ef2fd59b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:21:58.831362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:58.831856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:58.831947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:58.852847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:21:58.854350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:58.923390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2193/4389] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:21:58.935015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:21:58.936972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:21:59.032585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91825f4-3fc9-4c34-a1d2-ee2f5e9b8665 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:21:59.040401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:21:59.048853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:21:59.049147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:21:59.049456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:21:59.070775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:21:59.072230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:21:59.101229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2197/4390] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:00.107877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:00.109393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:00.131403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830139d-d2dc-4b74-aef5-cc98d43d5446 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:00.142746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:00.143799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:00.144233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:00.144692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] PATH_INFO: `/v3/projects/627dc47477314bf0bef25356e8890e43` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:00.149997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627dc47477314bf0bef25356e8890e43)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:00.152527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:00.157126 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:00.271349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627dc47477314bf0bef25356e8890e43', 'request_id': 'req-4ba2738b-1da7-44e3-8696-59f5a4953773'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.288364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627dc47477314bf0bef25356e8890e43', 'request_id': 'req-4ba2738b-1da7-44e3-8696-59f5a4953773'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.301890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627dc47477314bf0bef25356e8890e43', 'request_id': 'req-4ba2738b-1da7-44e3-8696-59f5a4953773'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.325293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] The token cache is being invalidate because project 627dc47477314bf0bef25356e8890e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:22:00.325753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.327244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.330008 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2194/4391] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:22:00 2022] DELETE /identity/v3/projects/627dc47477314bf0bef25356e8890e43 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:00.334633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:00.355911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14668395-9bb8-4b8c-9917-1db62a8bc7ec service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:00.470140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:00.470550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:00.471140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:00.471885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] PATH_INFO: `/v3/users/6784580578c74c5eb347a60d0c252294` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:00.475264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] RBAC: Authorizing `identity:delete_user(user_id=6784580578c74c5eb347a60d0c252294)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:00.477704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:00.578258 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:00.595896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6784580578c74c5eb347a60d0c252294'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.598818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6784580578c74c5eb347a60d0c252294'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.599596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6784580578c74c5eb347a60d0c252294'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.610392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6784580578c74c5eb347a60d0c252294'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.639399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0479fa1e-c817-41d9-bfd4-629c6eda30da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6784580578c74c5eb347a60d0c252294'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:00.668003 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2198/4392] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:22:00 2022] DELETE /identity/v3/users/6784580578c74c5eb347a60d0c252294 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:01.050873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:01.052463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:01.076306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2738b-1da7-44e3-8696-59f5a4953773 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:01.170818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:01.171885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:01.172283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:01.172656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] PATH_INFO: `/v3/projects/36043d777ba1428dad198cf354bc94f6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:01.181937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36043d777ba1428dad198cf354bc94f6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:01.184407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:01.278368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36043d777ba1428dad198cf354bc94f6', 'request_id': 'req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:01.288233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36043d777ba1428dad198cf354bc94f6', 'request_id': 'req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:01.295834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36043d777ba1428dad198cf354bc94f6', 'request_id': 'req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:01.316428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] The token cache is being invalidate because project 36043d777ba1428dad198cf354bc94f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:22:01.326276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:01.327495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-baa6f5a4-042e-4ab5-8729-1bfc28db1b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:01.334177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2195/4393] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:22:01 2022] DELETE /identity/v3/projects/36043d777ba1428dad198cf354bc94f6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:01.335950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976255a-fa9f-471d-97d7-196f923e9fbf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:01.336415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976255a-fa9f-471d-97d7-196f923e9fbf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:01.336496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976255a-fa9f-471d-97d7-196f923e9fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:01.372771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2976255a-fa9f-471d-97d7-196f923e9fbf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:01.374513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2976255a-fa9f-471d-97d7-196f923e9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:01.532569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100effe-5f54-4b9e-a9ee-24988781fd8e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:01.532569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100effe-5f54-4b9e-a9ee-24988781fd8e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:01.532569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100effe-5f54-4b9e-a9ee-24988781fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:01.537796 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2199/4394] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:01.561332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c100effe-5f54-4b9e-a9ee-24988781fd8e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:01.563261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c100effe-5f54-4b9e-a9ee-24988781fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:01.588401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976255a-fa9f-471d-97d7-196f923e9fbf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:01.595490 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2196/4395] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:01.601335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976255a-fa9f-471d-97d7-196f923e9fbf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:01.606236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:01.606874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:01.607656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:01.607932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:01.608604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:22:01.608910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:01.610559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:01.643716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100effe-5f54-4b9e-a9ee-24988781fd8e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:01.651860 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2200/4396] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:22:01.657350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100effe-5f54-4b9e-a9ee-24988781fd8e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:01.663365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:01.663989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:01.664267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:01.664539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:01.665196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:01.667105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:01.700098 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:01.750434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:01.760971 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2197/4397] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:22:01 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:01.778054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e923a-0090-43af-9bb4-d89fdf1abd2b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:01.888878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:01.890548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:01.890868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:01.891147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:01.891880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:01.895399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:01.959229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2201/4398] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:22:01 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:01.963948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:01.978471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f2697-7403-4e60-bf2c-81a096283102 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:01.984010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:01.985953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:01.985953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:01.985953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:01.985953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:01.987635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:02.007147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:02.014552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2198/4399] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:22:02.020763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ed7e-50ef-46fb-bbed-8254b8f2a28b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:02.028974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd20d3-037c-4e30-ba70-05fe05333b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:02.030024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd20d3-037c-4e30-ba70-05fe05333b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:02.030167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd20d3-037c-4e30-ba70-05fe05333b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:02.030528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd20d3-037c-4e30-ba70-05fe05333b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:02.031223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd20d3-037c-4e30-ba70-05fe05333b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:02.032928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd20d3-037c-4e30-ba70-05fe05333b64 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:02.086465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:02.095757 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2202/4400] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:22:02.100827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c139a-4a61-49c0-8b10-42b4f17159ab admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:02.106581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:02.107841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:02.108129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:02.108506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] PATH_INFO: `/v3/projects/d8fd90a2d6ee4ef5af5f0381569611b1/users/162d0b239f46412f8664ab047815daf5/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:02.145384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fd90a2d6ee4ef5af5f0381569611b1, user_id=162d0b239f46412f8664ab047815daf5, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:02.150395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:02.223715 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2199/4401] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:22:02 2022] PUT /identity/v3/projects/d8fd90a2d6ee4ef5af5f0381569611b1/users/162d0b239f46412f8664ab047815daf5/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:02.226243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6b657-0fee-4066-bbaa-d87249db6bb5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:02.226607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6b657-0fee-4066-bbaa-d87249db6bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:02.226882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6b657-0fee-4066-bbaa-d87249db6bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:02.270887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d9a6b657-0fee-4066-bbaa-d87249db6bb5 None None] MFA Rules not processed for user `162d0b239f46412f8664ab047815daf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:02.272069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d9a6b657-0fee-4066-bbaa-d87249db6bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:02.286474 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:02.504333 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2203/4402] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:22:02.542286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:02.544640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:02.735439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3de66-b7d5-44db-8ae3-781d2630afd9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:02.754974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9602d28-2614-407b-a12a-76b57947bf9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:02.755614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602d28-2614-407b-a12a-76b57947bf9c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:02.755897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602d28-2614-407b-a12a-76b57947bf9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:02.756167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9602d28-2614-407b-a12a-76b57947bf9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:02.775578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9602d28-2614-407b-a12a-76b57947bf9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:02.777412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9602d28-2614-407b-a12a-76b57947bf9c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:02.798771 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2200/4403] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:02.841475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6b657-0fee-4066-bbaa-d87249db6bb5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:03.007896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6b657-0fee-4066-bbaa-d87249db6bb5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:03.012729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:03.013414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:03.013699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:03.013972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] PATH_INFO: `/v3/users/162d0b239f46412f8664ab047815daf5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:03.015180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162d0b239f46412f8664ab047815daf5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:03.018676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:03.109293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162d0b239f46412f8664ab047815daf5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:03.110633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162d0b239f46412f8664ab047815daf5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:03.111264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162d0b239f46412f8664ab047815daf5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:03.153253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162d0b239f46412f8664ab047815daf5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:03.192681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162d0b239f46412f8664ab047815daf5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:03.238569 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2204/4404] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:22:02 2022] DELETE /identity/v3/users/162d0b239f46412f8664ab047815daf5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:03.242607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:03.243092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:03.243378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:03.317147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:03.328634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:03.547870 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2201/4405] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:03.558691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:03.561414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:03.625499 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:03.663820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19693a36-fb36-4325-8fa4-8e98fd797624 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:03.672248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada9a4-3f5d-4b0c-969e-4f0d1c3877cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:03.673031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada9a4-3f5d-4b0c-969e-4f0d1c3877cb service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:03.673433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada9a4-3f5d-4b0c-969e-4f0d1c3877cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:03.673947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada9a4-3f5d-4b0c-969e-4f0d1c3877cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:03.686224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada9a4-3f5d-4b0c-969e-4f0d1c3877cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:03.687987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada9a4-3f5d-4b0c-969e-4f0d1c3877cb service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:03.700174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2205/4406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:04.181553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:04.186987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:04.235587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3c3a2-7092-4db2-8c9b-d1352b05ec80 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:04.261445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:04.262605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:04.263821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:04.264366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] PATH_INFO: `/v3/projects/d8fd90a2d6ee4ef5af5f0381569611b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:04.269717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fd90a2d6ee4ef5af5f0381569611b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:04.275321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:04.382016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fd90a2d6ee4ef5af5f0381569611b1', 'request_id': 'req-c94ee70d-a8b5-4d86-a15e-9b04b022794a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:04.401632 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:04.405237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fd90a2d6ee4ef5af5f0381569611b1', 'request_id': 'req-c94ee70d-a8b5-4d86-a15e-9b04b022794a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:04.415950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fd90a2d6ee4ef5af5f0381569611b1', 'request_id': 'req-c94ee70d-a8b5-4d86-a15e-9b04b022794a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:04.441491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] The token cache is being invalidate because project d8fd90a2d6ee4ef5af5f0381569611b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:22:04.442542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:04.444099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c94ee70d-a8b5-4d86-a15e-9b04b022794a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:04.448817 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2202/4407] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:22:04 2022] DELETE /identity/v3/projects/d8fd90a2d6ee4ef5af5f0381569611b1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:04.454422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e0f4e-f399-40de-a939-6dc5cd4ea3d0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:04.454422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e0f4e-f399-40de-a939-6dc5cd4ea3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:04.454726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e0f4e-f399-40de-a939-6dc5cd4ea3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:04.500598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-677e0f4e-f399-40de-a939-6dc5cd4ea3d0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:04.505033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-677e0f4e-f399-40de-a939-6dc5cd4ea3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:04.758663 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2206/4408] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:04.766515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8d3a-1cdb-4292-beae-6c2f03a3f5ad None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:04.767017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8d3a-1cdb-4292-beae-6c2f03a3f5ad None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:04.767606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8d3a-1cdb-4292-beae-6c2f03a3f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:04.806093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-195e8d3a-1cdb-4292-beae-6c2f03a3f5ad None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:04.809441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-195e8d3a-1cdb-4292-beae-6c2f03a3f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:04.819918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2203/4409] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:04.824484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e0f4e-f399-40de-a939-6dc5cd4ea3d0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:04.841392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e0f4e-f399-40de-a939-6dc5cd4ea3d0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:04.851452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:04.852092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:04.852373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:04.852646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:04.853328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:22:04.853634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:04.855229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:04.884968 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2207/4410] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:22:04.891008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e8d3a-1cdb-4292-beae-6c2f03a3f5ad None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:04.929745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e8d3a-1cdb-4292-beae-6c2f03a3f5ad None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:04.949374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:04.952341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:04.954575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:04.957731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:04.958902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:04.965837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:05.037809 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2204/4411] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:22:04 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:05.041963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:05.060935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf99e4-966d-4430-bb09-0a61285773d1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:05.184722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:05.185589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:05.185896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:05.186227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:05.186928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:05.189574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:05.235577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:05.238241 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2208/4412] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:22:05 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:05.256942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21390c-8a51-4499-bf86-f124566bdbdd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:05.277759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:05.279085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:05.280963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:05.281429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:05.285720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:05.287976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:05.338636 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2205/4413] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:22:05.343187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:05.356212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd481e-25db-475f-9b74-f443ba69c078 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:05.362762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398518e-8d0a-487e-8a4e-0235b00d8004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:05.363491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398518e-8d0a-487e-8a4e-0235b00d8004 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:05.363814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398518e-8d0a-487e-8a4e-0235b00d8004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:05.364275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398518e-8d0a-487e-8a4e-0235b00d8004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:05.365268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398518e-8d0a-487e-8a4e-0235b00d8004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:05.367276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398518e-8d0a-487e-8a4e-0235b00d8004 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:05.388951 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2209/4414] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:22:05.390129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:05.407832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5138e-4dec-4f6f-8eb2-3735cd508abf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:05.416512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:05.417231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:05.417514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:05.417786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] PATH_INFO: `/v3/projects/373afd566aa7402cb34e4f2e0e4f00d4/users/e322f876172246e88d326191d40a8e87/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:05.492145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373afd566aa7402cb34e4f2e0e4f00d4, user_id=e322f876172246e88d326191d40a8e87, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:05.505829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:05.561416 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2206/4415] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:22:05 2022] PUT /identity/v3/projects/373afd566aa7402cb34e4f2e0e4f00d4/users/e322f876172246e88d326191d40a8e87/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:05.565235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0a2f-6362-419a-a594-5e8284ce4aeb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:05.565604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0a2f-6362-419a-a594-5e8284ce4aeb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:05.565936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0a2f-6362-419a-a594-5e8284ce4aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:05.638405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8b4a0a2f-6362-419a-a594-5e8284ce4aeb None None] MFA Rules not processed for user `e322f876172246e88d326191d40a8e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:05.639687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b4a0a2f-6362-419a-a594-5e8284ce4aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:05.697044 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:05.824187 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2210/4416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:05.832954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:05.837215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:05.940405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9d7ef-cad2-4d0d-90c5-a9c7b089c190 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:05.944670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:05.945707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:05.946099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:05.946492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:05.956302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:05.957921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:05.968788 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2207/4417] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:08.233023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc16e0-304c-4e1e-b1e7-8247da6c6895 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:08.233558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc16e0-304c-4e1e-b1e7-8247da6c6895 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:08.233652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc16e0-304c-4e1e-b1e7-8247da6c6895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:08.276399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d5dc16e0-304c-4e1e-b1e7-8247da6c6895 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:08.278526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5dc16e0-304c-4e1e-b1e7-8247da6c6895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:08.394629 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2211/4418] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:08.415428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:08.417238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:08.557048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889b27d-dc50-47f7-bd92-b7d53a9c00e7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:08.563745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d79b62-9028-4f9e-ae14-096cb72152ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:08.564364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d79b62-9028-4f9e-ae14-096cb72152ad service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:08.565615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d79b62-9028-4f9e-ae14-096cb72152ad service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:08.566051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d79b62-9028-4f9e-ae14-096cb72152ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:08.579407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d79b62-9028-4f9e-ae14-096cb72152ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:08.586230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d79b62-9028-4f9e-ae14-096cb72152ad service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:08.602145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2208/4419] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:22:09.524017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd110-9700-4d12-aeda-55e09c931b28 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:09.524470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd110-9700-4d12-aeda-55e09c931b28 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:09.524742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd110-9700-4d12-aeda-55e09c931b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:09.573340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bf5cd110-9700-4d12-aeda-55e09c931b28 None None] MFA Rules not processed for user `9fdb77980af84574812088ed93c00f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:09.578140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bf5cd110-9700-4d12-aeda-55e09c931b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:09.714778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2212/4420] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:18.594770 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=2,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:19.702075 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=66 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:23.980465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:23.980986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:23.981288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:24.008249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] MFA Rules not processed for user `5b10ebef20984a6b850398267e79e50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:24.009505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:24.081236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2209/4421] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:28.031767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99f78-8d0e-41a9-a64e-e0cc9d9e6998 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:28.032234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99f78-8d0e-41a9-a64e-e0cc9d9e6998 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:28.032331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99f78-8d0e-41a9-a64e-e0cc9d9e6998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:28.085096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-03a99f78-8d0e-41a9-a64e-e0cc9d9e6998 None None] MFA Rules not processed for user `b061026cc5d644d1a3fe41b2fe05c7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:28.087084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03a99f78-8d0e-41a9-a64e-e0cc9d9e6998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:28.225417 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2213/4422] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:30.456002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:30.457573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:30.566977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b6a5-83d0-40a6-b743-1f921a1b8d08 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:30.575493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:30.576635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:30.577096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:30.577541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:30.581873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:30.597834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:30.599358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:30.612468 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2210/4423] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:38.214020 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=25 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:40.605775 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=59 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:44.468459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a99f78-8d0e-41a9-a64e-e0cc9d9e6998 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:44.483328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a99f78-8d0e-41a9-a64e-e0cc9d9e6998 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:44.487751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:44.488453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:44.488921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:44.489434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:44.491696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:44.510417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:44.512199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:44.532030 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2214/4424] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:49.703081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:49.715949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18890b-e2b2-4eee-90e1-985ffd3d6175 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:49.724001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:49.726289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:49.726807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:49.729362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:49.734258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:49.773400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:49.774856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:49.796731 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2211/4425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:52.311212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:52.312747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:52.400748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed34837-e0da-413b-be29-04af206a743d service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:52.406636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:52.407663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:52.407992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:52.408269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] PATH_INFO: `/v3/users/9fdb77980af84574812088ed93c00f25` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:52.409612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdb77980af84574812088ed93c00f25)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:52.411542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:52.538098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdb77980af84574812088ed93c00f25'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:52.538802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdb77980af84574812088ed93c00f25'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:52.539419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdb77980af84574812088ed93c00f25'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:52.547900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdb77980af84574812088ed93c00f25'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:52.567438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbce1fb3-b3c4-4abb-8099-2cf0176b76d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdb77980af84574812088ed93c00f25'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:52.614147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2215/4426] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:22:52 2022] DELETE /identity/v3/users/9fdb77980af84574812088ed93c00f25 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:53.254397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:53.270375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a05b6-3833-45df-b359-3ecef11afd1f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:53.411192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:53.412055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:53.412432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:53.412800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] PATH_INFO: `/v3/projects/af6dc4665bf44c09881985fcd63117e5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:53.414320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6dc4665bf44c09881985fcd63117e5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:53.416880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:53.555036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6dc4665bf44c09881985fcd63117e5', 'request_id': 'req-51d2ed25-6e3d-4bba-ba03-df7303b0f247'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:53.575631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6dc4665bf44c09881985fcd63117e5', 'request_id': 'req-51d2ed25-6e3d-4bba-ba03-df7303b0f247'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:53.595852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6dc4665bf44c09881985fcd63117e5', 'request_id': 'req-51d2ed25-6e3d-4bba-ba03-df7303b0f247'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:53.630624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] The token cache is being invalidate because project af6dc4665bf44c09881985fcd63117e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:22:53.631031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:53.631904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d2ed25-6e3d-4bba-ba03-df7303b0f247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:53.634777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2212/4427] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:22:53 2022] DELETE /identity/v3/projects/af6dc4665bf44c09881985fcd63117e5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:53.639937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a60c0-70b5-4394-95a0-4db6f918433e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:53.640396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a60c0-70b5-4394-95a0-4db6f918433e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:53.640494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a60c0-70b5-4394-95a0-4db6f918433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:53.694079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-214a60c0-70b5-4394-95a0-4db6f918433e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:53.696420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-214a60c0-70b5-4394-95a0-4db6f918433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:53.858124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2216/4428] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:53.861160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e6837-6216-4e0a-8d5a-27fe45e77256 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:53.861556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e6837-6216-4e0a-8d5a-27fe45e77256 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:53.861770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e6837-6216-4e0a-8d5a-27fe45e77256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:53.914348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5f3e6837-6216-4e0a-8d5a-27fe45e77256 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:53.916502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f3e6837-6216-4e0a-8d5a-27fe45e77256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:53.938465 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2213/4429] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:53.940004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a60c0-70b5-4394-95a0-4db6f918433e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:53.960460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a60c0-70b5-4394-95a0-4db6f918433e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:53.983484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:53.984125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:53.985673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:53.985987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:53.987063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:22:53.988053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:53.991247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:53.994380 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:54.023172 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2217/4430] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:22:54.025255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e6837-6216-4e0a-8d5a-27fe45e77256 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:54.052801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e6837-6216-4e0a-8d5a-27fe45e77256 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:54.068910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:54.069640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:54.069929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:54.070669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:54.074025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:54.076332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:54.201679 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2214/4431] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:22:54 2022] POST /identity/v3/projects => generated 395 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:54.207274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:54.222592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f6111-1b02-4c0b-b5ed-2fa17f56aa82 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:54.337178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:54.337974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:54.338350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:54.338628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:54.342808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:54.346189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:54.382800 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2218/4432] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:22:54 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:22:54.384535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:54.398336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468d7d7-6a99-4de8-871e-b4aa30d9015f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:54.405769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:54.407786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:54.408288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:54.408791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:54.409681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:54.412063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:54.428625 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2215/4433] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:22:54.430907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:54.445510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877b36-0135-4be4-b1c1-e270aab009c6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:54.451052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50c6da-1876-440a-bd10-f60388b0262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:54.466309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c6da-1876-440a-bd10-f60388b0262e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:54.466668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c6da-1876-440a-bd10-f60388b0262e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:54.466898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c6da-1876-440a-bd10-f60388b0262e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:54.467621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c6da-1876-440a-bd10-f60388b0262e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:54.473797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c6da-1876-440a-bd10-f60388b0262e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:54.540197 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2219/4434] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:22:54.541670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:54.558100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff0ed-6f64-484c-ba35-2fdd71d6262a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:54.570768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b25a81-318f-4b28-8895-0c6e62f60c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:54.571669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25a81-318f-4b28-8895-0c6e62f60c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:54.572053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25a81-318f-4b28-8895-0c6e62f60c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:54.572417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b25a81-318f-4b28-8895-0c6e62f60c11 admin admin] PATH_INFO: `/v3/projects/f45a21eb77b0478888a234593731251c/users/dace725d65804aa3a4f5f0270ad9ba8a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:54.600551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b25a81-318f-4b28-8895-0c6e62f60c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45a21eb77b0478888a234593731251c, user_id=dace725d65804aa3a4f5f0270ad9ba8a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:54.603923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b25a81-318f-4b28-8895-0c6e62f60c11 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:54.627018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:54.627194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:54.627327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:54.657028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] MFA Rules not processed for user `f01b6459a5c54bafba0ddf73cfd1e399`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:54.659204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:54.667108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2216/4435] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:22:54 2022] PUT /identity/v3/projects/f45a21eb77b0478888a234593731251c/users/dace725d65804aa3a4f5f0270ad9ba8a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:54.677694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca4b8-6ec1-4f8a-94b3-edead3fc5e5b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:54.678320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca4b8-6ec1-4f8a-94b3-edead3fc5e5b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:54.680159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca4b8-6ec1-4f8a-94b3-edead3fc5e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:54.698691 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:54.747130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2220/4436] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:54.752520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-732ca4b8-6ec1-4f8a-94b3-edead3fc5e5b None None] MFA Rules not processed for user `dace725d65804aa3a4f5f0270ad9ba8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:54.754041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-732ca4b8-6ec1-4f8a-94b3-edead3fc5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:54.841306 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2217/4437] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:54.856345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:54.859242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:54.995958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30769e3c-2777-455d-bee2-4c8030f28230 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:55.012154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:55.013290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:55.013784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:55.014290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:55.028654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:55.030954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:55.057784 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2221/4438] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:54 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:55.131266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71867f9c-e03a-4cdc-a9ca-974d4075263d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:55.132308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71867f9c-e03a-4cdc-a9ca-974d4075263d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:55.132799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71867f9c-e03a-4cdc-a9ca-974d4075263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:55.179055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-71867f9c-e03a-4cdc-a9ca-974d4075263d None None] MFA Rules not processed for user `dace725d65804aa3a4f5f0270ad9ba8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:55.184159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-71867f9c-e03a-4cdc-a9ca-974d4075263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:55.211574 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2218/4439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:22:56.536356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:56.543032 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:56.659766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef94186-90a6-45ee-b43f-a7f832c1d00b service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:56.675383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:56.676267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:56.676763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:56.677229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] PATH_INFO: `/v3/users/dace725d65804aa3a4f5f0270ad9ba8a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:56.679319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dace725d65804aa3a4f5f0270ad9ba8a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:56.681946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:56.811131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dace725d65804aa3a4f5f0270ad9ba8a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:56.811367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dace725d65804aa3a4f5f0270ad9ba8a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:56.811830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dace725d65804aa3a4f5f0270ad9ba8a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:56.839409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dace725d65804aa3a4f5f0270ad9ba8a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:56.884285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dace725d65804aa3a4f5f0270ad9ba8a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:56.931553 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2222/4440] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:22:56 2022] DELETE /identity/v3/users/dace725d65804aa3a4f5f0270ad9ba8a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:56.935843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:56.936622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:56.937084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:56.967788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:56.972495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:57.101042 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2219/4441] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:57.176117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:57.177922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:57.314768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60b77-2335-496a-b388-c0c3195a74ba admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:57.324068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd718ac-5170-4649-aa78-a5dfa013e0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:57.324825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd718ac-5170-4649-aa78-a5dfa013e0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:57.325171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd718ac-5170-4649-aa78-a5dfa013e0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:57.325445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd718ac-5170-4649-aa78-a5dfa013e0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:57.383925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd718ac-5170-4649-aa78-a5dfa013e0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:57.385408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd718ac-5170-4649-aa78-a5dfa013e0e1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:57.418258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2223/4442] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:22:58.195284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:58.197271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:58.237117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c105b-2530-4c7c-bc0e-6f3cdeed2b01 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:58.244700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:58.245625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.245913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.246188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] PATH_INFO: `/v3/projects/f45a21eb77b0478888a234593731251c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.249259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45a21eb77b0478888a234593731251c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:58.253411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:58.324989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45a21eb77b0478888a234593731251c', 'request_id': 'req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:58.332642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45a21eb77b0478888a234593731251c', 'request_id': 'req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:58.340118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45a21eb77b0478888a234593731251c', 'request_id': 'req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:58.355979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] The token cache is being invalidate because project f45a21eb77b0478888a234593731251c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:22:58.356359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:58.357356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d15b0c7f-2f5a-42f6-ac76-7e970a01e954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:58.365502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c672ec9-e82c-488f-b290-1f6e49d05882 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.365996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c672ec9-e82c-488f-b290-1f6e49d05882 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.366280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c672ec9-e82c-488f-b290-1f6e49d05882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.369697 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2220/4443] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:22:58 2022] DELETE /identity/v3/projects/f45a21eb77b0478888a234593731251c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:58.389172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5c672ec9-e82c-488f-b290-1f6e49d05882 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:58.390872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5c672ec9-e82c-488f-b290-1f6e49d05882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:58.414573 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:58.496692 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2224/4444] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:58.506832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3c618-6b5f-433a-998d-ae0620624a7f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.507207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3c618-6b5f-433a-998d-ae0620624a7f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.507627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3c618-6b5f-433a-998d-ae0620624a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.549835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bcc3c618-6b5f-433a-998d-ae0620624a7f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:58.552276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bcc3c618-6b5f-433a-998d-ae0620624a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:58.571432 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2221/4445] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:58.575757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c672ec9-e82c-488f-b290-1f6e49d05882 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:58.586764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c672ec9-e82c-488f-b290-1f6e49d05882 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:58.593237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:58.593910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.594701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.595337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.596008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:22:58.596318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:58.597970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:58.612859 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2225/4446] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:22:58.617980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3c618-6b5f-433a-998d-ae0620624a7f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:58.631726 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:58.647473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3c618-6b5f-433a-998d-ae0620624a7f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:58.658052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:58.659439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.660413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.660853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.662166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:58.665678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:58.711353 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2222/4447] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:22:58 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:58.715098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:58.726475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f896c-1718-4a0f-90db-962f4734bd59 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:58.832476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:58.833133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.833473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.833748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.834470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:58.836576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:58.904287 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2226/4448] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:22:58 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:58.910190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:58.922511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620ed0-5358-492f-8e60-1c102dffdd8f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:58.932142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:58.932142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.932142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.932142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.933486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:58.933625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:58.935108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:58.935675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:58.949819 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2223/4449] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:22:58.950160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365fd9f-c357-4fa6-a6a1-d3b17db17531 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:58.951177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:58.956179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:58.956905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.957315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.957657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] PATH_INFO: `/v3/users/eefc130baa41461584a6e497329381ba` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.958906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eefc130baa41461584a6e497329381ba)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:58.960837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:58.964126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8961a9-7e63-4d0b-bc84-f69c0a56d63d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:58.973416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:58.974791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:58.975105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:58.975373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:58.976026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:58.978309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:59.001142 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2224/4450] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:22:59.003277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:59.018685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b971b-f25b-44e6-931f-40549d23be20 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:59.023520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639300e-a363-4242-8e0e-3ddd885c253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:59.024188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639300e-a363-4242-8e0e-3ddd885c253c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.024467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639300e-a363-4242-8e0e-3ddd885c253c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.026680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639300e-a363-4242-8e0e-3ddd885c253c admin admin] PATH_INFO: `/v3/projects/1de5d9b10e0b40679e1e7e85ce0b43f5/users/ad5157708e874f8ebe74bd4553b982b1/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.039898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eefc130baa41461584a6e497329381ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.041617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eefc130baa41461584a6e497329381ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.043690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eefc130baa41461584a6e497329381ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.050163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639300e-a363-4242-8e0e-3ddd885c253c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de5d9b10e0b40679e1e7e85ce0b43f5, user_id=ad5157708e874f8ebe74bd4553b982b1, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:59.053046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639300e-a363-4242-8e0e-3ddd885c253c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:59.058598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eefc130baa41461584a6e497329381ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.079865 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2225/4451] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:22:59 2022] PUT /identity/v3/projects/1de5d9b10e0b40679e1e7e85ce0b43f5/users/ad5157708e874f8ebe74bd4553b982b1/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:59.085028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.085568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.086043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.095381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eefc130baa41461584a6e497329381ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.115155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:59.117045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:59.119582 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2227/4452] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:22:58 2022] DELETE /identity/v3/users/eefc130baa41461584a6e497329381ba => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:59.207390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2226/4453] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:22:59.226800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:59.228694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:59.262455 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:59.347920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec74e0-b7b8-4ee3-9560-d2377f8e510f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:59.358680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3e6a-f495-455f-802c-79e2b16c6677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:59.359369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3e6a-f495-455f-802c-79e2b16c6677 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.359700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3e6a-f495-455f-802c-79e2b16c6677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.360043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3e6a-f495-455f-802c-79e2b16c6677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.373382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3e6a-f495-455f-802c-79e2b16c6677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:59.376098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3e6a-f495-455f-802c-79e2b16c6677 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:59.392971 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2228/4454] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:22:59.516344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:59.518154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:59.540596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7ded-7ea3-4760-a567-96b51dc1093a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:59.549044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:59.555216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.555400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.555804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] PATH_INFO: `/v3/projects/bec277c86f7749cebd0635dcfde3518d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.557266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec277c86f7749cebd0635dcfde3518d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:59.559320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:59.624570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec277c86f7749cebd0635dcfde3518d', 'request_id': 'req-cf263d7a-ddf1-431b-800c-abcf157b89cc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.633012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec277c86f7749cebd0635dcfde3518d', 'request_id': 'req-cf263d7a-ddf1-431b-800c-abcf157b89cc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.642051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec277c86f7749cebd0635dcfde3518d', 'request_id': 'req-cf263d7a-ddf1-431b-800c-abcf157b89cc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.661435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] The token cache is being invalidate because project bec277c86f7749cebd0635dcfde3518d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:22:59.662061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.663334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf263d7a-ddf1-431b-800c-abcf157b89cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:22:59.668261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2227/4455] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:22:59 2022] DELETE /identity/v3/projects/bec277c86f7749cebd0635dcfde3518d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:22:59.669988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b5e5-948d-49af-ad9b-f0319bf4d55a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.670273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b5e5-948d-49af-ad9b-f0319bf4d55a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.670573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b5e5-948d-49af-ad9b-f0319bf4d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.693206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c543b5e5-948d-49af-ad9b-f0319bf4d55a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:59.694439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c543b5e5-948d-49af-ad9b-f0319bf4d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:59.769164 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2229/4456] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:59.776631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780609-d2ed-4fda-ac5f-f09f9a2e0659 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.776972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780609-d2ed-4fda-ac5f-f09f9a2e0659 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.777494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780609-d2ed-4fda-ac5f-f09f9a2e0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.798191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0d780609-d2ed-4fda-ac5f-f09f9a2e0659 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:22:59.799476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d780609-d2ed-4fda-ac5f-f09f9a2e0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:22:59.807876 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2228/4457] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:22:59.812020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b5e5-948d-49af-ad9b-f0319bf4d55a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:59.833541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b5e5-948d-49af-ad9b-f0319bf4d55a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:59.841888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:59.842868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.843748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.844239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.846491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:22:59.847153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:59.849363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:59.873624 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2230/4458] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:22:59.877292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d780609-d2ed-4fda-ac5f-f09f9a2e0659 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:59.892448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d780609-d2ed-4fda-ac5f-f09f9a2e0659 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:22:59.913592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:22:59.914467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:22:59.914758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:22:59.915038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:22:59.915724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:22:59.919344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:22:59.936499 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:22:59.974305 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2229/4459] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:22:59 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:22:59.978217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:22:59.989785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fd725-22ba-43cf-af9a-623cf119c29c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:00.058326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:00.059156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:00.059502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:00.059835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:00.060644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:00.062694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:00.093238 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2231/4460] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:22:59 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:00.094657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:00.105978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d0315-d6f9-4db5-ae0d-cc218007a808 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:00.112144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:00.112859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:00.113229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:00.113572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:00.114292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:00.116343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:00.132888 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2230/4461] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:23:00.134218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:00.147319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edd79a-9003-4ea3-be08-7a0411d66d81 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:00.155759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b168-1bdd-4b7a-b2b3-3c44a6b53ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:00.156224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b168-1bdd-4b7a-b2b3-3c44a6b53ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:00.156480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b168-1bdd-4b7a-b2b3-3c44a6b53ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:00.156780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b168-1bdd-4b7a-b2b3-3c44a6b53ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:00.157702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b168-1bdd-4b7a-b2b3-3c44a6b53ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:00.159451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b168-1bdd-4b7a-b2b3-3c44a6b53ec8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:00.179249 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2232/4462] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:23:00.186316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:00.201693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d0334-05aa-48da-80bd-213c1589c273 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:00.208526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473a1b4-172f-4e27-a264-9a1888ca1d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:00.209496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a1b4-172f-4e27-a264-9a1888ca1d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:00.209697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a1b4-172f-4e27-a264-9a1888ca1d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:00.210270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473a1b4-172f-4e27-a264-9a1888ca1d1c admin admin] PATH_INFO: `/v3/projects/fcb527fa3464455e9b300601c24eda53/users/4c6bb33c292d4437ad9865f1bdd9834a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:00.229677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473a1b4-172f-4e27-a264-9a1888ca1d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb527fa3464455e9b300601c24eda53, user_id=4c6bb33c292d4437ad9865f1bdd9834a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:00.233125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473a1b4-172f-4e27-a264-9a1888ca1d1c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:00.265550 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2231/4463] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:00 2022] PUT /identity/v3/projects/fcb527fa3464455e9b300601c24eda53/users/4c6bb33c292d4437ad9865f1bdd9834a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:00.277958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:00.278309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:00.278639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:00.327488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] MFA Rules not processed for user `4c6bb33c292d4437ad9865f1bdd9834a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:00.330553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:00.342340 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:00.459215 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2233/4464] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:00.473053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf2fe-3696-4892-a23d-e00bb02ef7ae None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:00.474023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf2fe-3696-4892-a23d-e00bb02ef7ae None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:00.474356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf2fe-3696-4892-a23d-e00bb02ef7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:00.522173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-68caf2fe-3696-4892-a23d-e00bb02ef7ae None None] MFA Rules not processed for user `4c6bb33c292d4437ad9865f1bdd9834a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:00.523678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-68caf2fe-3696-4892-a23d-e00bb02ef7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:00.546221 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2232/4465] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:00.687256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:00.689706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:00.794494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0884-2023-4214-b813-47808d7d8424 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:00.803187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:00.803820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:00.804102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:00.804545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:00.817609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:00.820023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:00.833015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2234/4466] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:07.982064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:07.982064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:07.982790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:08.046593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] MFA Rules not processed for user `ad5157708e874f8ebe74bd4553b982b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:08.048986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:08.261311 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2233/4467] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:08.370228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:08.371913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:08.393625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7a7cf-89b8-42ed-b05e-a5af2d7b206a service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:08.400943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658fde-0a1c-4e40-9c18-f7e86dd30643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:08.401985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658fde-0a1c-4e40-9c18-f7e86dd30643 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:08.402519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658fde-0a1c-4e40-9c18-f7e86dd30643 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:08.402791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658fde-0a1c-4e40-9c18-f7e86dd30643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:08.414145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658fde-0a1c-4e40-9c18-f7e86dd30643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:08.415652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658fde-0a1c-4e40-9c18-f7e86dd30643 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:08.428983 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2235/4468] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:18.254533 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:18.421529 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=62 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:19.659029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:19.661209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:19.771248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92e5cd-25e6-4ed8-9639-2c1a6ae5d858 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:19.777479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:19.778314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:19.778820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:19.779650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] PATH_INFO: `/v3/users/e322f876172246e88d326191d40a8e87` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:19.782109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e322f876172246e88d326191d40a8e87)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:19.785115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:19.865080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e322f876172246e88d326191d40a8e87'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:19.866268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e322f876172246e88d326191d40a8e87'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:19.868121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e322f876172246e88d326191d40a8e87'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:19.914111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e322f876172246e88d326191d40a8e87'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:19.926716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e322f876172246e88d326191d40a8e87'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:19.944888 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2234/4469] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:19 2022] DELETE /identity/v3/users/e322f876172246e88d326191d40a8e87 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:19.949681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:19.950241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:19.950241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:19.973990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:19.976105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:20.074480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2236/4470] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:20.100156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:20.101700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:20.191852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed390905-c1e7-456a-be33-add8adeb77e5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:20.196204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad42e0-09fb-4573-94f0-94ea7ab827af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:20.196911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad42e0-09fb-4573-94f0-94ea7ab827af service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:20.197211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad42e0-09fb-4573-94f0-94ea7ab827af service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:20.197480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad42e0-09fb-4573-94f0-94ea7ab827af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:20.213259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad42e0-09fb-4573-94f0-94ea7ab827af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:20.215171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad42e0-09fb-4573-94f0-94ea7ab827af service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:20.228695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2235/4471] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:20.700970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:20.703331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:20.729936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9676d6-436c-481d-9a8e-5730820c9f70 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:20.738155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:20.739747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:20.740382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:20.741212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] PATH_INFO: `/v3/projects/373afd566aa7402cb34e4f2e0e4f00d4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:20.743288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=373afd566aa7402cb34e4f2e0e4f00d4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:20.747750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:20.824816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373afd566aa7402cb34e4f2e0e4f00d4', 'request_id': 'req-00019d00-8b42-4219-834d-f75bae3bb8fb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:20.833692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373afd566aa7402cb34e4f2e0e4f00d4', 'request_id': 'req-00019d00-8b42-4219-834d-f75bae3bb8fb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:20.846008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373afd566aa7402cb34e4f2e0e4f00d4', 'request_id': 'req-00019d00-8b42-4219-834d-f75bae3bb8fb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:20.867346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] The token cache is being invalidate because project 373afd566aa7402cb34e4f2e0e4f00d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:20.867346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:20.868913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00019d00-8b42-4219-834d-f75bae3bb8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:20.874197 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2237/4472] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:20 2022] DELETE /identity/v3/projects/373afd566aa7402cb34e4f2e0e4f00d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:20.877152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840fc6-ebad-4291-9e69-cd310130b16d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:20.877682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840fc6-ebad-4291-9e69-cd310130b16d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:20.877682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840fc6-ebad-4291-9e69-cd310130b16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:20.903341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-23840fc6-ebad-4291-9e69-cd310130b16d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:20.905262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-23840fc6-ebad-4291-9e69-cd310130b16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:20.929629 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:20.998834 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2236/4473] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:21.010683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce8b3-cccf-4a80-bf41-a11eed60f334 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.012211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce8b3-cccf-4a80-bf41-a11eed60f334 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.015101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ce8b3-cccf-4a80-bf41-a11eed60f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.059368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-de2ce8b3-cccf-4a80-bf41-a11eed60f334 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:21.060670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-de2ce8b3-cccf-4a80-bf41-a11eed60f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.072317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2238/4474] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:21.076236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840fc6-ebad-4291-9e69-cd310130b16d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.088303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840fc6-ebad-4291-9e69-cd310130b16d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.096857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.097913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.098196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.098461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.099237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:21.099804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.101473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.124271 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2237/4475] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:21.128973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ce8b3-cccf-4a80-bf41-a11eed60f334 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.142593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ce8b3-cccf-4a80-bf41-a11eed60f334 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.149202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.149909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.150281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.150555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.151260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.153504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.188838 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2239/4476] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:21.193558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.205740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e4a0b-9346-475d-a077-dca6a2e2b7e4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.267983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.268636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.268957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.269201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.269802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.271832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.297502 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2238/4477] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:21.301517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.313143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5939-a414-4987-bc4e-b2d8c6c98210 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.318173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.318794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.319193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.319466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.320765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.321731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.333457 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2240/4478] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:23:21.337426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.348280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f66dcd-1ca4-4c3f-a930-66fd438acf39 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.353438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aa5d6-139a-438b-951e-beb2ea4c6831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.353943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aa5d6-139a-438b-951e-beb2ea4c6831 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.354291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aa5d6-139a-438b-951e-beb2ea4c6831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.354628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aa5d6-139a-438b-951e-beb2ea4c6831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.355813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aa5d6-139a-438b-951e-beb2ea4c6831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.357045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aa5d6-139a-438b-951e-beb2ea4c6831 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.368904 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2239/4479] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:23:21.373366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.387556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecc7cc-418f-4b89-9deb-b8583d1366bb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.394803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.395820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.396504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.396677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] PATH_INFO: `/v3/projects/f6b7c580bc7c43199c5d3800b541a4d7/users/2cea2d37893b42029f85c9a5ebbc539e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.422392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b7c580bc7c43199c5d3800b541a4d7, user_id=2cea2d37893b42029f85c9a5ebbc539e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.425286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.447470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2241/4480] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:21 2022] PUT /identity/v3/projects/f6b7c580bc7c43199c5d3800b541a4d7/users/2cea2d37893b42029f85c9a5ebbc539e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:23:21.458610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.458918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.459190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.491034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] MFA Rules not processed for user `2cea2d37893b42029f85c9a5ebbc539e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:21.492385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.563697 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2240/4481] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:21.572161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:21.574122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:21.596140 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:21.639981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62231e38-c4c0-46cf-a534-3af11fd874eb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:21.645018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:21.645962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:21.646434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:21.646780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:21.658829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:21.660598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:21.672278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2242/4482] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:23.403345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:23.404926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:23.443361 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:23.508929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383f3f4-3f60-4428-9ed7-d1836fac8e5e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:23.516733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:23.517437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:23.517789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:23.517979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] PATH_INFO: `/v3/users/ad5157708e874f8ebe74bd4553b982b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:23.519174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5157708e874f8ebe74bd4553b982b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:23.521278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:23.622287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5157708e874f8ebe74bd4553b982b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:23.622287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5157708e874f8ebe74bd4553b982b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:23.622813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5157708e874f8ebe74bd4553b982b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:23.638410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5157708e874f8ebe74bd4553b982b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:23.647986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-962c20f4-de50-471b-b204-19a632e10704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5157708e874f8ebe74bd4553b982b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:23.665155 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2241/4483] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:23 2022] DELETE /identity/v3/users/ad5157708e874f8ebe74bd4553b982b1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:23.887549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:23.914514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e01a1b-384d-455e-8e4c-5de5b1c0da87 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:24.039808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:24.040105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.040393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.040771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] PATH_INFO: `/v3/projects/1de5d9b10e0b40679e1e7e85ce0b43f5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.042311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de5d9b10e0b40679e1e7e85ce0b43f5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:24.048347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:24.149491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de5d9b10e0b40679e1e7e85ce0b43f5', 'request_id': 'req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:24.157722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de5d9b10e0b40679e1e7e85ce0b43f5', 'request_id': 'req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:24.170423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de5d9b10e0b40679e1e7e85ce0b43f5', 'request_id': 'req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:24.186327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] The token cache is being invalidate because project 1de5d9b10e0b40679e1e7e85ce0b43f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:24.186775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:24.188182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5db39bf6-e85e-42b7-bfd1-1efbf4af3c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:24.190071 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2243/4484] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:23 2022] DELETE /identity/v3/projects/1de5d9b10e0b40679e1e7e85ce0b43f5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:24.198411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013510b-b660-49c4-9c07-d3a279772627 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.200702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013510b-b660-49c4-9c07-d3a279772627 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.201190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013510b-b660-49c4-9c07-d3a279772627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.233954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a013510b-b660-49c4-9c07-d3a279772627 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:24.236339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a013510b-b660-49c4-9c07-d3a279772627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:24.314615 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2242/4485] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:24.323406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f1c4-26c8-4fb9-90bb-3bb3d98b48d2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.323749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f1c4-26c8-4fb9-90bb-3bb3d98b48d2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.324120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f1c4-26c8-4fb9-90bb-3bb3d98b48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.346142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-91d1f1c4-26c8-4fb9-90bb-3bb3d98b48d2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:24.347526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-91d1f1c4-26c8-4fb9-90bb-3bb3d98b48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:24.356770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2244/4486] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:24.361820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013510b-b660-49c4-9c07-d3a279772627 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:24.375919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013510b-b660-49c4-9c07-d3a279772627 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:24.382307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:24.382929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.383657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.383657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.384256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:24.384721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:24.386669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:24.399860 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2243/4487] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:24.404639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f1c4-26c8-4fb9-90bb-3bb3d98b48d2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:24.419879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f1c4-26c8-4fb9-90bb-3bb3d98b48d2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:24.425904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:24.426638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.427042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.427405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.428146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:24.430178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:24.473828 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2245/4488] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:24 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:24.475600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:24.490477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb855052-ee6b-483a-b387-bf650c982b32 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:24.553697 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:24.605517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:24.606100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.606502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.606610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.607249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:24.611934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:24.667339 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2244/4489] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:24 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:24.668601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:24.689516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa501ca-d54a-4ede-bb21-77c593cb8020 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:24.701950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:24.702593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.702925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.703239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.703898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:24.708087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:24.721842 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2246/4490] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:24.726219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:24.740886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946741a4-def1-4191-89a1-7e44ee620c7d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:24.746015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5edf84-1504-49a4-85de-80737f63f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:24.746536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5edf84-1504-49a4-85de-80737f63f512 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.746714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5edf84-1504-49a4-85de-80737f63f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.746991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5edf84-1504-49a4-85de-80737f63f512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.747641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5edf84-1504-49a4-85de-80737f63f512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:24.749390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5edf84-1504-49a4-85de-80737f63f512 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:24.770768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2245/4491] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:24.775015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:24.789132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fb438-c01a-49d4-9529-7ccf9aea2500 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:24.794916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:24.795719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.796094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.797813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] PATH_INFO: `/v3/projects/aba851db20da455e8fc776ca6aa9eb6f/users/6b3529a3d50546ef9ec5bd41aa871757/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.813709 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:24.820277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba851db20da455e8fc776ca6aa9eb6f, user_id=6b3529a3d50546ef9ec5bd41aa871757, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:24.834555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:24.870969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2247/4492] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:24 2022] PUT /identity/v3/projects/aba851db20da455e8fc776ca6aa9eb6f/users/6b3529a3d50546ef9ec5bd41aa871757/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:23:24.876729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559667-a44c-4698-9dce-0860e6c4d739 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:24.877096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559667-a44c-4698-9dce-0860e6c4d739 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:24.877459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559667-a44c-4698-9dce-0860e6c4d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:24.915704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-76559667-a44c-4698-9dce-0860e6c4d739 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:24.917094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-76559667-a44c-4698-9dce-0860e6c4d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:25.060296 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2246/4493] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:25.073347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:25.075836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:25.169713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f375db-824f-42f1-b406-cf8df77b63b3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:25.175447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:25.176148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:25.176520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:25.176861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:25.186992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:25.189720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:25.201748 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2248/4494] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:31.695789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b9ce-107a-4e6e-80a1-56e0de34c6a4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:31.696369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b9ce-107a-4e6e-80a1-56e0de34c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:31.696369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b9ce-107a-4e6e-80a1-56e0de34c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:31.730920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f6b6b9ce-107a-4e6e-80a1-56e0de34c6a4 None None] MFA Rules not processed for user `6b3529a3d50546ef9ec5bd41aa871757`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:31.732426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f6b6b9ce-107a-4e6e-80a1-56e0de34c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:31.837255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2247/4495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:31.847196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:31.849491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:31.943979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f8c4d-a7b0-4bee-b657-eeaa4faec738 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:31.950170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:31.950806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:31.951094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:31.951376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:31.963397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:31.964996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:31.975527 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2249/4496] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:23:33.503460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:33.503981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:33.504519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:33.528552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] MFA Rules not processed for user `6b3529a3d50546ef9ec5bd41aa871757`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:33.530148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:33.538421 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2248/4497] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:35.184720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:35.188634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:35.321048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258adfc-763b-43fa-bb21-ee132b3f6c43 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:35.326749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:35.330149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:35.330438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:35.330712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:35.333681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:35.361357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:35.363584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:35.381675 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2250/4498] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:35.486726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:35.488424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:35.510476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b8551-0e3a-4c0a-ade2-a58e10d4890d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:35.541413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2663c7c-64f4-4cf8-8bcf-0a422e7556be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:35.542659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663c7c-64f4-4cf8-8bcf-0a422e7556be service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:35.543506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663c7c-64f4-4cf8-8bcf-0a422e7556be service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:35.543958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2663c7c-64f4-4cf8-8bcf-0a422e7556be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:35.547749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e2663c7c-64f4-4cf8-8bcf-0a422e7556be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:35.566013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663c7c-64f4-4cf8-8bcf-0a422e7556be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:35.567722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2663c7c-64f4-4cf8-8bcf-0a422e7556be service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:35.593614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:35.595307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:35.634024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2249/4499] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:35.653138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719100-d554-418e-aafd-ef4377c9f93b service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:35.659563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:35.660749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:35.661328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:35.661726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] PATH_INFO: `/v3/users/2cea2d37893b42029f85c9a5ebbc539e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:35.663099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cea2d37893b42029f85c9a5ebbc539e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:35.665462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:35.668250 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:35.784539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cea2d37893b42029f85c9a5ebbc539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:35.786059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cea2d37893b42029f85c9a5ebbc539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:35.787912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cea2d37893b42029f85c9a5ebbc539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:35.805978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cea2d37893b42029f85c9a5ebbc539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:35.831907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cea2d37893b42029f85c9a5ebbc539e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:35.857497 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2251/4500] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:35 2022] DELETE /identity/v3/users/2cea2d37893b42029f85c9a5ebbc539e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:23:35.859871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:35.860209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:35.860481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:35.904769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:35.906075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:35.920595 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:35.990148 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2250/4501] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:36.000764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:36.002215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:36.082955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec71eb-37c5-4af8-b9ca-3fbcc92b133f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:36.088329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2060a89-e1b3-4a29-8c75-f6aa9f1eb927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:36.089238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060a89-e1b3-4a29-8c75-f6aa9f1eb927 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.091295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060a89-e1b3-4a29-8c75-f6aa9f1eb927 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.091604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060a89-e1b3-4a29-8c75-f6aa9f1eb927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.104000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2060a89-e1b3-4a29-8c75-f6aa9f1eb927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:36.105633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2060a89-e1b3-4a29-8c75-f6aa9f1eb927 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:36.117688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2252/4502] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:36.346131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:36.347731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:36.371858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18347-5308-4d32-bddd-03156c5f5ae4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:36.386776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:36.387591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.387971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.388309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] PATH_INFO: `/v3/projects/f6b7c580bc7c43199c5d3800b541a4d7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.389990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b7c580bc7c43199c5d3800b541a4d7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:36.395884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:36.470353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b7c580bc7c43199c5d3800b541a4d7', 'request_id': 'req-7d176668-4785-4c44-9f69-0d36b1a484e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:36.479685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b7c580bc7c43199c5d3800b541a4d7', 'request_id': 'req-7d176668-4785-4c44-9f69-0d36b1a484e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:36.488905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b7c580bc7c43199c5d3800b541a4d7', 'request_id': 'req-7d176668-4785-4c44-9f69-0d36b1a484e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:36.507457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] The token cache is being invalidate because project f6b7c580bc7c43199c5d3800b541a4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:36.507754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:36.508432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7d176668-4785-4c44-9f69-0d36b1a484e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:36.510213 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2251/4503] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:36 2022] DELETE /identity/v3/projects/f6b7c580bc7c43199c5d3800b541a4d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:36.520724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd2af3-f074-49b7-9c3e-37cfce278de6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.521269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd2af3-f074-49b7-9c3e-37cfce278de6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.521352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd2af3-f074-49b7-9c3e-37cfce278de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.555787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-46fd2af3-f074-49b7-9c3e-37cfce278de6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:36.557177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-46fd2af3-f074-49b7-9c3e-37cfce278de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:36.636334 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2253/4504] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:36.644955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babf29a-138b-4bf8-a392-17451f0bed62 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.645420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babf29a-138b-4bf8-a392-17451f0bed62 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.645807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babf29a-138b-4bf8-a392-17451f0bed62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.669725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2babf29a-138b-4bf8-a392-17451f0bed62 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:36.671007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2babf29a-138b-4bf8-a392-17451f0bed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:36.679522 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2252/4505] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:36.684153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd2af3-f074-49b7-9c3e-37cfce278de6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:36.695711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd2af3-f074-49b7-9c3e-37cfce278de6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:36.701398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:36.702059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.703083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.703558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.704388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:36.704702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:36.706333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:36.724347 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2254/4506] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:36.725730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babf29a-138b-4bf8-a392-17451f0bed62 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:36.735841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babf29a-138b-4bf8-a392-17451f0bed62 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:36.740692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:36.741349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.741685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.741964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.742616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:36.744549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:36.775086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2253/4507] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:36 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:36.779786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:36.791898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430132a-597c-4d70-97e2-e690a444d1e2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:36.796550 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:36.854944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:36.856182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.856182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.856182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.856801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:36.858833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:36.887402 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2255/4508] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:36 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:23:36.888790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:36.901893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7000078-25f2-414c-a227-99461a5dffba admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:36.911395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:36.912751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.913355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.913939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.915134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:36.917275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:36.931224 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2254/4509] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:23:36.935272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:36.967492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2324a6a-4b48-4114-a7db-a14ed1c439fa admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:36.974090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cab54-5a19-46c4-ad66-fd24d7dcae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:36.974849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cab54-5a19-46c4-ad66-fd24d7dcae69 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:36.975234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cab54-5a19-46c4-ad66-fd24d7dcae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:36.975612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cab54-5a19-46c4-ad66-fd24d7dcae69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:36.976395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cab54-5a19-46c4-ad66-fd24d7dcae69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:36.978339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cab54-5a19-46c4-ad66-fd24d7dcae69 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:36.991838 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2256/4510] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:36.995850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:37.009372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08fc5-4525-456b-a795-71ef27abc8de admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:37.017252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:37.018120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:37.018522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:37.018839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] PATH_INFO: `/v3/projects/cf389eb808294ba99ba7e7faac508b55/users/043cc76dfaa241cab7d4d0bf8f5aea4e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:37.045842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf389eb808294ba99ba7e7faac508b55, user_id=043cc76dfaa241cab7d4d0bf8f5aea4e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:37.049282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:37.068453 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2255/4511] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:36 2022] PUT /identity/v3/projects/cf389eb808294ba99ba7e7faac508b55/users/043cc76dfaa241cab7d4d0bf8f5aea4e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:37.181631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:37.181843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:37.182114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:37.238571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] MFA Rules not processed for user `043cc76dfaa241cab7d4d0bf8f5aea4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:37.240097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:37.323462 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2257/4512] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:37.346972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:37.348916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:37.394000 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:37.424200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641224fe-0bf6-43de-a427-342b2285d698 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:37.428094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:37.428912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:37.429241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:37.429544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:37.441144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:37.442792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:37.456075 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2256/4513] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:38.048290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:38.050137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:38.071160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326c3f0-493d-47aa-af65-fb67275c4349 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:38.076233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a9a67-3c06-47f6-ab8a-4f622486e4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:38.077900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9a67-3c06-47f6-ab8a-4f622486e4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:38.078683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9a67-3c06-47f6-ab8a-4f622486e4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:38.079274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9a67-3c06-47f6-ab8a-4f622486e4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:38.081889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad5a9a67-3c06-47f6-ab8a-4f622486e4e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:38.097169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a9a67-3c06-47f6-ab8a-4f622486e4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:38.100046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a9a67-3c06-47f6-ab8a-4f622486e4e2 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:38.113777 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2258/4514] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:23:38.638189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:38.781799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810b7f4-9cb8-45b7-b06a-48911f235835 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:38.789462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:38.793405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:38.793998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:38.794551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] PATH_INFO: `/v3/users/043cc76dfaa241cab7d4d0bf8f5aea4e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:38.796814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043cc76dfaa241cab7d4d0bf8f5aea4e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:38.799860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:38.894532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043cc76dfaa241cab7d4d0bf8f5aea4e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:38.895587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043cc76dfaa241cab7d4d0bf8f5aea4e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:38.896268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043cc76dfaa241cab7d4d0bf8f5aea4e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:38.916552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043cc76dfaa241cab7d4d0bf8f5aea4e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:38.926105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043cc76dfaa241cab7d4d0bf8f5aea4e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:38.965151 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2257/4515] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:38 2022] DELETE /identity/v3/users/043cc76dfaa241cab7d4d0bf8f5aea4e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:38.969867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:38.970208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:38.970483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:38.991585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:38.992813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:39.078140 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2259/4516] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:39.091954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:39.093910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:39.169613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669d037-e737-4288-af7d-a4ede9326db1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:39.174221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0a1c7-9e3f-4c77-b951-b9c43238ffc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:39.174547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a1c7-9e3f-4c77-b951-b9c43238ffc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:39.174956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a1c7-9e3f-4c77-b951-b9c43238ffc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:39.175245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a1c7-9e3f-4c77-b951-b9c43238ffc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:39.187448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0a1c7-9e3f-4c77-b951-b9c43238ffc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:39.190333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0a1c7-9e3f-4c77-b951-b9c43238ffc9 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:39.196348 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:39.215986 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2258/4517] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:39.873979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:39.875958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:39.886562 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:39.894268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829eadf-214d-4204-9e3d-5e20caef03a4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:39.900004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:39.900674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:39.900954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:39.901269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] PATH_INFO: `/v3/projects/cf389eb808294ba99ba7e7faac508b55` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:39.902783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf389eb808294ba99ba7e7faac508b55)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:39.905133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.014169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf389eb808294ba99ba7e7faac508b55', 'request_id': 'req-f176635e-9daf-4d56-83a9-b77dd03d3f28'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:40.023578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf389eb808294ba99ba7e7faac508b55', 'request_id': 'req-f176635e-9daf-4d56-83a9-b77dd03d3f28'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:40.048144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf389eb808294ba99ba7e7faac508b55', 'request_id': 'req-f176635e-9daf-4d56-83a9-b77dd03d3f28'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:40.080850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] The token cache is being invalidate because project cf389eb808294ba99ba7e7faac508b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:40.081488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:40.082087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f176635e-9daf-4d56-83a9-b77dd03d3f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:40.084103 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2260/4518] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:39 2022] DELETE /identity/v3/projects/cf389eb808294ba99ba7e7faac508b55 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:40.089406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f89f1-3a89-4140-b97c-b126023130a9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.089897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f89f1-3a89-4140-b97c-b126023130a9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.090339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f89f1-3a89-4140-b97c-b126023130a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.128341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff4f89f1-3a89-4140-b97c-b126023130a9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:40.130564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff4f89f1-3a89-4140-b97c-b126023130a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:40.210344 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2259/4519] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:40.218393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049473f0-2317-4cbf-a75f-dc32073d29af None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.218742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049473f0-2317-4cbf-a75f-dc32073d29af None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.219120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049473f0-2317-4cbf-a75f-dc32073d29af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.241604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-049473f0-2317-4cbf-a75f-dc32073d29af None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:40.242839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-049473f0-2317-4cbf-a75f-dc32073d29af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:40.254187 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2261/4520] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:40.259443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f89f1-3a89-4140-b97c-b126023130a9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:40.271852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f89f1-3a89-4140-b97c-b126023130a9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:40.276553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:40.277448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.277724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.277992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.278640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:40.278940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:40.281196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.297310 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2260/4521] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:40.301922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049473f0-2317-4cbf-a75f-dc32073d29af None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:40.314953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049473f0-2317-4cbf-a75f-dc32073d29af None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:40.321484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:40.322207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.322575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.322927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.323652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:40.325877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.364071 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2262/4522] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:40 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:23:40.365544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:40.378255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4dcbe-dd6f-4680-a018-5eece1efd91b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:40.450209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:40.451019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.451410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.451742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.452691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:40.455104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.497640 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2261/4523] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:40 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:40.502598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:40.514779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c1fe-9692-4fc8-8626-a4f69a199965 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:40.521181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:40.522926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.523124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.523555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.524615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:40.527661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.542823 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2263/4524] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:40.548174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:40.576756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b715-7405-4eec-95cf-698b4376b541 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:40.583329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47002e-41d0-4816-a364-b78a19830819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:40.584127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47002e-41d0-4816-a364-b78a19830819 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.584384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47002e-41d0-4816-a364-b78a19830819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.584651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47002e-41d0-4816-a364-b78a19830819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.585535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47002e-41d0-4816-a364-b78a19830819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:40.587409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47002e-41d0-4816-a364-b78a19830819 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.602701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2262/4525] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:23:40.609580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:40.638088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5835b-e263-4b0c-8d38-83779bb0c74b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:40.647977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:40.648925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.649244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.649521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] PATH_INFO: `/v3/projects/69b607cfa67f43108a4e79cf4e96b6b1/users/9998871b511b4475ba58cefde0ac19c9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.668871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b607cfa67f43108a4e79cf4e96b6b1, user_id=9998871b511b4475ba58cefde0ac19c9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:40.671642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.689343 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2264/4526] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:40 2022] PUT /identity/v3/projects/69b607cfa67f43108a4e79cf4e96b6b1/users/9998871b511b4475ba58cefde0ac19c9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:40.705848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.706151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.706474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.739418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] MFA Rules not processed for user `9998871b511b4475ba58cefde0ac19c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:40.740873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:40.809867 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:40.830598 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2263/4527] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:40.837954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:40.840779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:40.910941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5758f4-d3ae-429a-ab4e-7638fe550fe8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:40.915030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:40.915654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:40.916087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:40.916366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:40.926438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:40.927850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:40.939243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2265/4528] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:41.689855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:41.691625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:41.798303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e403-15ac-40fa-b1c1-78a7de61fb17 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:41.803043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:41.803621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:41.803899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:41.804179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] PATH_INFO: `/v3/users/5b10ebef20984a6b850398267e79e50b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:41.805347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b10ebef20984a6b850398267e79e50b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:41.807418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:41.856525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b10ebef20984a6b850398267e79e50b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:41.857203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b10ebef20984a6b850398267e79e50b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:41.857814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b10ebef20984a6b850398267e79e50b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:41.871351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b10ebef20984a6b850398267e79e50b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:41.879310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f8aa95c-64a0-4b52-9747-e7529c6e24c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b10ebef20984a6b850398267e79e50b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:41.898547 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2264/4529] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:41 2022] DELETE /identity/v3/users/5b10ebef20984a6b850398267e79e50b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:42.091258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.108490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a107c84-9d4b-4084-8903-eb998d14b71e service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.142432 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:42.206158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.207127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.207736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.208163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] PATH_INFO: `/v3/projects/6dba2e1d0a1c40adad2d85e383c5d6da` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.210395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dba2e1d0a1c40adad2d85e383c5d6da)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.212656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.285919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dba2e1d0a1c40adad2d85e383c5d6da', 'request_id': 'req-8070c1d1-6441-4391-836b-dc8ab2e0174c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:42.286812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dba2e1d0a1c40adad2d85e383c5d6da', 'request_id': 'req-8070c1d1-6441-4391-836b-dc8ab2e0174c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:42.300668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dba2e1d0a1c40adad2d85e383c5d6da', 'request_id': 'req-8070c1d1-6441-4391-836b-dc8ab2e0174c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:42.316094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] The token cache is being invalidate because project 6dba2e1d0a1c40adad2d85e383c5d6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:42.316337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:42.317360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8070c1d1-6441-4391-836b-dc8ab2e0174c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:42.319506 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2266/4530] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:42 2022] DELETE /identity/v3/projects/6dba2e1d0a1c40adad2d85e383c5d6da => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:42.327792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c416c81-7518-4172-950c-d89b6898dd09 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.328778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c416c81-7518-4172-950c-d89b6898dd09 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.328778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c416c81-7518-4172-950c-d89b6898dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.352653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6c416c81-7518-4172-950c-d89b6898dd09 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:42.353983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c416c81-7518-4172-950c-d89b6898dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:42.424447 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2265/4531] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:42.432877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ee969-492a-4783-a778-1356a953025b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.433212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ee969-492a-4783-a778-1356a953025b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.433493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ee969-492a-4783-a778-1356a953025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.455958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1b4ee969-492a-4783-a778-1356a953025b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:42.456673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1b4ee969-492a-4783-a778-1356a953025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:42.467341 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2267/4532] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:42.472206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c416c81-7518-4172-950c-d89b6898dd09 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.487256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c416c81-7518-4172-950c-d89b6898dd09 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.495331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.496139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.496435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.496811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.497515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:23:42.497818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.499483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.519727 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:42.525596 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2266/4533] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:23:42.538292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ee969-492a-4783-a778-1356a953025b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.552149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ee969-492a-4783-a778-1356a953025b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.560439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.561274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.561749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.562355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.563123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.565184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.600268 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2268/4534] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:23:42 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:42.603883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.620084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1309178-01b5-469c-aa5a-e484d55abf50 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.701776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.702520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.702755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.703087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.704078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.706590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.732709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2267/4535] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:23:42 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:23:42.738151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.752546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464caa-763f-4f39-906b-f2c1016cf81a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.758957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.759844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.760295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.760694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.761522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.764344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.776965 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2269/4536] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:42.781462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.793211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303a0f4-c8ea-438a-bcc8-c0fb4640c904 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.799464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c050a-8115-4c09-8230-3da0fd815f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.800163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c050a-8115-4c09-8230-3da0fd815f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.800539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c050a-8115-4c09-8230-3da0fd815f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.800817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c050a-8115-4c09-8230-3da0fd815f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.801496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c050a-8115-4c09-8230-3da0fd815f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.803156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c050a-8115-4c09-8230-3da0fd815f43 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.815644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2268/4537] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:23:42.819445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:42.830128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb22c0c-773d-4bfe-8811-678f3e901496 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:42.836575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acb55e-132b-4f39-a737-2fc2f02b98ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:42.836575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb55e-132b-4f39-a737-2fc2f02b98ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.836575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb55e-132b-4f39-a737-2fc2f02b98ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.836575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acb55e-132b-4f39-a737-2fc2f02b98ed admin admin] PATH_INFO: `/v3/projects/b22a9de82e42430184ca586d3bf68050/users/3a2307e88ac541b5a0caed598d3b4050/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.852850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acb55e-132b-4f39-a737-2fc2f02b98ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22a9de82e42430184ca586d3bf68050, user_id=3a2307e88ac541b5a0caed598d3b4050, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:42.855615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acb55e-132b-4f39-a737-2fc2f02b98ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:42.881779 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2270/4538] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:23:42 2022] PUT /identity/v3/projects/b22a9de82e42430184ca586d3bf68050/users/3a2307e88ac541b5a0caed598d3b4050/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:23:42.893588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:42.894335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:42.894701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:42.957031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] MFA Rules not processed for user `3a2307e88ac541b5a0caed598d3b4050`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:42.958864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:43.077922 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2269/4539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:43.081348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d8b1c-a1d8-4283-b295-a32dba1339af None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:43.081882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d8b1c-a1d8-4283-b295-a32dba1339af None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:43.082400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d8b1c-a1d8-4283-b295-a32dba1339af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:43.106079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6f3d8b1c-a1d8-4283-b295-a32dba1339af None None] MFA Rules not processed for user `3a2307e88ac541b5a0caed598d3b4050`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:43.112026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6f3d8b1c-a1d8-4283-b295-a32dba1339af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:43.134424 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2271/4540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:43.142157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:43.143610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:43.252688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdea72b-0ad1-4008-9b6d-8c131d3a2779 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:43.262653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:43.264012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:43.264287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:43.264561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:43.270717 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:43.278046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:43.280252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:43.309668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2270/4541] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:43.925568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cddf7-7ba3-443f-aad7-d094caa8d487 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:43.926093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cddf7-7ba3-443f-aad7-d094caa8d487 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:43.926564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cddf7-7ba3-443f-aad7-d094caa8d487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:43.969538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b4cddf7-7ba3-443f-aad7-d094caa8d487 None None] MFA Rules not processed for user `3a2307e88ac541b5a0caed598d3b4050`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:43.976274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b4cddf7-7ba3-443f-aad7-d094caa8d487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:43.987729 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2272/4542] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:23:47.218403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:47.219875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:47.238339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e16a1-0c62-4572-ac8c-3ef716c108b0 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:47.245158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666f5b7-5bc2-4c5b-81c7-1977b6aaefdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:47.246107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666f5b7-5bc2-4c5b-81c7-1977b6aaefdf service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:47.246595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666f5b7-5bc2-4c5b-81c7-1977b6aaefdf service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:47.247021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666f5b7-5bc2-4c5b-81c7-1977b6aaefdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:47.250229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5666f5b7-5bc2-4c5b-81c7-1977b6aaefdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:47.267904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666f5b7-5bc2-4c5b-81c7-1977b6aaefdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:47.269890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666f5b7-5bc2-4c5b-81c7-1977b6aaefdf service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:47.285419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2271/4543] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:53.954540 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:57.279381 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:57.868679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522503-6c36-4b7d-8f67-860a0d69ab9e None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:57.869835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522503-6c36-4b7d-8f67-860a0d69ab9e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:57.870104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522503-6c36-4b7d-8f67-860a0d69ab9e None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:57.872296 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2273/4544] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:23:57.879183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:57.879543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:57.879831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:57.939545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:57.940856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:57.994777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2272/4545] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:23:58.007656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d522503-6c36-4b7d-8f67-860a0d69ab9e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:58.010345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d522503-6c36-4b7d-8f67-860a0d69ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:58.025026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d522503-6c36-4b7d-8f67-860a0d69ab9e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:58.028977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d343192-9b38-4f9c-b9f5-b5d066c13d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:58.030704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d343192-9b38-4f9c-b9f5-b5d066c13d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:58.030704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d343192-9b38-4f9c-b9f5-b5d066c13d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:58.030926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d343192-9b38-4f9c-b9f5-b5d066c13d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:58.038448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d343192-9b38-4f9c-b9f5-b5d066c13d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:58.039915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d343192-9b38-4f9c-b9f5-b5d066c13d3b service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:58.048538 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2274/4546] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:58.535721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:58.537336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:58.627851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c8081-367b-4a5e-9d39-e4dfcda52c06 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:58.634146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:58.634971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:58.635247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:58.635594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] PATH_INFO: `/v3/users/4c6bb33c292d4437ad9865f1bdd9834a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:58.636971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6bb33c292d4437ad9865f1bdd9834a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:58.639064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:58.712926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6bb33c292d4437ad9865f1bdd9834a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:58.714067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6bb33c292d4437ad9865f1bdd9834a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:58.714763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6bb33c292d4437ad9865f1bdd9834a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:58.728451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6bb33c292d4437ad9865f1bdd9834a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:58.736340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6bb33c292d4437ad9865f1bdd9834a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:58.753957 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2273/4547] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:23:58 2022] DELETE /identity/v3/users/4c6bb33c292d4437ad9865f1bdd9834a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:58.758243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:58.758633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:58.758977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:58.780358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:58.781644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:58.847342 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2275/4548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:23:58.857289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:58.858938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:58.874722 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:23:58.951359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a0196-ac0e-4649-9a6c-9fab9b771a5a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:58.956783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab1e6-1a2d-4423-85cf-fa809da022a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:58.957608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab1e6-1a2d-4423-85cf-fa809da022a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:58.957938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab1e6-1a2d-4423-85cf-fa809da022a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:58.958653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab1e6-1a2d-4423-85cf-fa809da022a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:58.970849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab1e6-1a2d-4423-85cf-fa809da022a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:58.972630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab1e6-1a2d-4423-85cf-fa809da022a7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:58.983809 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2274/4549] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:23:59.650388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:23:59.651910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:59.665541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204d1b9-bbc3-4bfa-95ac-5a7923755295 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:23:59.671579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:23:59.672387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:59.672675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:59.672951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] PATH_INFO: `/v3/projects/fcb527fa3464455e9b300601c24eda53` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:59.674260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb527fa3464455e9b300601c24eda53)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:23:59.676190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:23:59.764993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb527fa3464455e9b300601c24eda53', 'request_id': 'req-d3afdc7b-759c-4568-ae9b-2a81389fc008'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:59.776134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb527fa3464455e9b300601c24eda53', 'request_id': 'req-d3afdc7b-759c-4568-ae9b-2a81389fc008'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:59.791392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb527fa3464455e9b300601c24eda53', 'request_id': 'req-d3afdc7b-759c-4568-ae9b-2a81389fc008'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:59.818085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] The token cache is being invalidate because project fcb527fa3464455e9b300601c24eda53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:23:59.818620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:59.819598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3afdc7b-759c-4568-ae9b-2a81389fc008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:23:59.823619 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2276/4550] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:23:59 2022] DELETE /identity/v3/projects/fcb527fa3464455e9b300601c24eda53 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:23:59.828221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643557-bf9d-46f0-8d58-f6756d6a3c61 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:23:59.828840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643557-bf9d-46f0-8d58-f6756d6a3c61 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:23:59.829198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643557-bf9d-46f0-8d58-f6756d6a3c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:23:59.855245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d3643557-bf9d-46f0-8d58-f6756d6a3c61 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:23:59.857353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d3643557-bf9d-46f0-8d58-f6756d6a3c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:23:59.990949 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2275/4551] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:00.002583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc1947-f600-45dc-b6fe-f4a1dfbb4c67 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.002878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc1947-f600-45dc-b6fe-f4a1dfbb4c67 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.003156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc1947-f600-45dc-b6fe-f4a1dfbb4c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.099525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-51dc1947-f600-45dc-b6fe-f4a1dfbb4c67 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:00.100768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-51dc1947-f600-45dc-b6fe-f4a1dfbb4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:00.141223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2277/4552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:00.142517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3643557-bf9d-46f0-8d58-f6756d6a3c61 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:00.157219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3643557-bf9d-46f0-8d58-f6756d6a3c61 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:00.178933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:00.179749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.183096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.183559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.184536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:00.184971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:00.187478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:00.214627 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2276/4553] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:00.218410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc1947-f600-45dc-b6fe-f4a1dfbb4c67 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:00.245200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc1947-f600-45dc-b6fe-f4a1dfbb4c67 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:00.268829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:00.269686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.270105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.270520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.271321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:00.273649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:00.344219 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2278/4554] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:00 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:00.347701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:00.365535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f7ba-cbc3-4258-bad1-8c63c55d6bac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:00.509313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:00.509980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.510265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.510566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.511214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:00.513740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:00.571483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:00.571774 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2277/4555] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:00 2022] POST /identity/v3/users => generated 282 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:00.587363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331037ba-6aa7-49ff-abd1-64bf58130325 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:00.593437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:00.594145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.594501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.595756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.595756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:00.598630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:00.621475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:00.629203 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2279/4556] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:24:00.647686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695947b3-b01c-48fc-aa85-3fddfe2e7871 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:00.665214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75fa5-6358-4135-af2c-7bc71fbdb7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:00.666403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75fa5-6358-4135-af2c-7bc71fbdb7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.669233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75fa5-6358-4135-af2c-7bc71fbdb7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.669699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75fa5-6358-4135-af2c-7bc71fbdb7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.684993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b75fa5-6358-4135-af2c-7bc71fbdb7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:00.693878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b75fa5-6358-4135-af2c-7bc71fbdb7ee admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:00.738720 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2278/4557] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:00.739883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:00.755448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c039b8-314a-4206-91bc-6b6a403e5deb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:00.769505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:00.776402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.776888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.778247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] PATH_INFO: `/v3/projects/7bbde25ffbd54eb1945eb5d56140135e/users/53f4ca74fca3476eb85ab9ea1b8e0001/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.856456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbde25ffbd54eb1945eb5d56140135e, user_id=53f4ca74fca3476eb85ab9ea1b8e0001, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:00.862790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:00.893822 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2280/4558] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:00 2022] PUT /identity/v3/projects/7bbde25ffbd54eb1945eb5d56140135e/users/53f4ca74fca3476eb85ab9ea1b8e0001/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:00.907737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80742890-320b-4bc6-8e83-8ad54ebaa715 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:00.908243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80742890-320b-4bc6-8e83-8ad54ebaa715 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:00.908335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80742890-320b-4bc6-8e83-8ad54ebaa715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:00.964281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-80742890-320b-4bc6-8e83-8ad54ebaa715 None None] MFA Rules not processed for user `53f4ca74fca3476eb85ab9ea1b8e0001`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:00.965827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80742890-320b-4bc6-8e83-8ad54ebaa715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:00.976836 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:01.109115 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2279/4559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:01.132684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:01.139713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:01.187617 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:01.387893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec5558-c27e-4723-bce6-333973d6c782 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:01.400876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:01.401659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.402259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.402590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.414072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:01.415918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:01.441489 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2281/4560] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:01.447870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be578b5-ac73-4a80-8f0e-9a05ba7df233 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.448147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be578b5-ac73-4a80-8f0e-9a05ba7df233 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.448595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be578b5-ac73-4a80-8f0e-9a05ba7df233 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.450150 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2280/4561] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:24:01.457343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:24:01.474031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:01.485953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04b61a-f3e8-4842-b145-b99e5eb0be31 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:01.495921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f4ca74fca3476eb85ab9ea1b8e0001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bbde25ffbd54eb1945eb5d56140135e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:01.499403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.504080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.505656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] PATH_INFO: `/v3/projects/7bbde25ffbd54eb1945eb5d56140135e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.507542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorizing `identity:get_project(project_id=7bbde25ffbd54eb1945eb5d56140135e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:01.510040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:01.529097 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2282/4562] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:24:01 2022] GET /identity/v3/projects/7bbde25ffbd54eb1945eb5d56140135e => generated 363 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:01.596195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756ec9-84fc-4493-8203-eb487b365eb0 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.596915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756ec9-84fc-4493-8203-eb487b365eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.597242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756ec9-84fc-4493-8203-eb487b365eb0 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.598928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2281/4563] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:24:01.605714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:24:01.630020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:01.640586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2f46-5e9a-4c26-8846-7c2d16e68a9d tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:01.645147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f4ca74fca3476eb85ab9ea1b8e0001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bbde25ffbd54eb1945eb5d56140135e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:01.645934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.646287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.646635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] PATH_INFO: `/v3/projects/7bbde25ffbd54eb1945eb5d56140135e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.650339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorizing `identity:get_project(project_id=7bbde25ffbd54eb1945eb5d56140135e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:01.652353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:01.659323 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2283/4564] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:24:01 2022] GET /identity/v3/projects/7bbde25ffbd54eb1945eb5d56140135e => generated 363 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:24:01.697357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1100f-043d-4e52-92a1-bffae92d629e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.697726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1100f-043d-4e52-92a1-bffae92d629e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.698064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1100f-043d-4e52-92a1-bffae92d629e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.699448 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2282/4565] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:24:01.704227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:24:01.706004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:01.724054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:01.732493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758ed2e-1dcf-4d4f-ab8b-e7d2c8911a51 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:01.737509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f4ca74fca3476eb85ab9ea1b8e0001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bbde25ffbd54eb1945eb5d56140135e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:01.738141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.738423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.738699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] PATH_INFO: `/v3/projects/7bbde25ffbd54eb1945eb5d56140135e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.739834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorizing `identity:get_project(project_id=7bbde25ffbd54eb1945eb5d56140135e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:01.741660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:01.743445 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2284/4566] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:24:01 2022] GET /identity/v3/projects/7bbde25ffbd54eb1945eb5d56140135e => generated 363 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:01.776105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129d04-a968-47f5-9145-978f3d46425e None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.776457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129d04-a968-47f5-9145-978f3d46425e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.776798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129d04-a968-47f5-9145-978f3d46425e None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.778454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2283/4567] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 01:24:01.783684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:24:01.798787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:01.807246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960af134-d5c5-4b8c-8053-11e2446b56ec tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:01.812080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f4ca74fca3476eb85ab9ea1b8e0001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bbde25ffbd54eb1945eb5d56140135e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:01.812709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.812990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.813298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] PATH_INFO: `/v3/projects/7bbde25ffbd54eb1945eb5d56140135e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.814496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorizing `identity:get_project(project_id=7bbde25ffbd54eb1945eb5d56140135e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:01.816279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:01.817961 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2285/4568] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:24:01 2022] GET /identity/v3/projects/7bbde25ffbd54eb1945eb5d56140135e => generated 363 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:01.855930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dae8d-34b8-43f5-bbbf-57a3169727a6 None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.856239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dae8d-34b8-43f5-bbbf-57a3169727a6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.856517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dae8d-34b8-43f5-bbbf-57a3169727a6 None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.857942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2284/4569] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 01:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:24:01.863909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating service token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 01:24:01.879511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:01.888439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4f0e-7489-4f62-98e3-c64124f024ed tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:01.892757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7c21e-2c33-4d75-9a66-4bd82a847fc2 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f4ca74fca3476eb85ab9ea1b8e0001', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bbde25ffbd54eb1945eb5d56140135e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:01.893408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c21e-2c33-4d75-9a66-4bd82a847fc2 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:01.893738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c21e-2c33-4d75-9a66-4bd82a847fc2 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:01.894308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7c21e-2c33-4d75-9a66-4bd82a847fc2 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] PATH_INFO: `/v3/projects/7bbde25ffbd54eb1945eb5d56140135e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:01.895474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7c21e-2c33-4d75-9a66-4bd82a847fc2 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorizing `identity:get_project(project_id=7bbde25ffbd54eb1945eb5d56140135e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:01.897291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7c21e-2c33-4d75-9a66-4bd82a847fc2 tempest-QuotasTestJSON-727158091 tempest-QuotasTestJSON-727158091-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:01.898930 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2286/4570] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 01:24:01 2022] GET /identity/v3/projects/7bbde25ffbd54eb1945eb5d56140135e => generated 363 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:01.933549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dae8d-34b8-43f5-bbbf-57a3169727a6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:02.001687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dae8d-34b8-43f5-bbbf-57a3169727a6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:02.006199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:02.006840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:02.007120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:02.007393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] PATH_INFO: `/v3/users/53f4ca74fca3476eb85ab9ea1b8e0001` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:02.008550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f4ca74fca3476eb85ab9ea1b8e0001)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:02.010626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:02.062997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f4ca74fca3476eb85ab9ea1b8e0001'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:02.063773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f4ca74fca3476eb85ab9ea1b8e0001'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:02.064455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f4ca74fca3476eb85ab9ea1b8e0001'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:02.078226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f4ca74fca3476eb85ab9ea1b8e0001'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:02.085353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f4ca74fca3476eb85ab9ea1b8e0001'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:02.101694 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2285/4571] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:01 2022] DELETE /identity/v3/users/53f4ca74fca3476eb85ab9ea1b8e0001 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:02.107434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866146-df22-4c06-80a0-670727410fe1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:02.107842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866146-df22-4c06-80a0-670727410fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:02.108674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866146-df22-4c06-80a0-670727410fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:02.129922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-96866146-df22-4c06-80a0-670727410fe1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:02.131156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96866146-df22-4c06-80a0-670727410fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:02.213231 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2287/4572] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:02.225978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:02.227753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:02.267521 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:02.315935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f786-7bc3-469d-b01a-ef25a197861e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:02.319863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92fdbd-6f2f-4e83-944c-ad01a612fe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:02.320549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92fdbd-6f2f-4e83-944c-ad01a612fe05 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:02.320828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92fdbd-6f2f-4e83-944c-ad01a612fe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:02.321124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92fdbd-6f2f-4e83-944c-ad01a612fe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:02.333292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92fdbd-6f2f-4e83-944c-ad01a612fe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:02.334936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92fdbd-6f2f-4e83-944c-ad01a612fe05 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:02.348578 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2286/4573] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:02.896307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866146-df22-4c06-80a0-670727410fe1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:02.897888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96866146-df22-4c06-80a0-670727410fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:02.910322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866146-df22-4c06-80a0-670727410fe1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:02.915667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:02.916305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:02.916591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:02.917012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] PATH_INFO: `/v3/projects/7bbde25ffbd54eb1945eb5d56140135e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:02.918665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbde25ffbd54eb1945eb5d56140135e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:02.921639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:02.990430 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:02.994622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbde25ffbd54eb1945eb5d56140135e', 'request_id': 'req-4b49f34e-807d-446a-ad10-74bd9c5bec05'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:03.002627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbde25ffbd54eb1945eb5d56140135e', 'request_id': 'req-4b49f34e-807d-446a-ad10-74bd9c5bec05'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:03.013399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbde25ffbd54eb1945eb5d56140135e', 'request_id': 'req-4b49f34e-807d-446a-ad10-74bd9c5bec05'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:03.026438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] The token cache is being invalidate because project 7bbde25ffbd54eb1945eb5d56140135e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:03.027703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:03.028435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b49f34e-807d-446a-ad10-74bd9c5bec05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:03.030898 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2288/4574] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:02 2022] DELETE /identity/v3/projects/7bbde25ffbd54eb1945eb5d56140135e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:03.036979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a911ed-7bf0-4d0b-965f-22126357b5d4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.037469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a911ed-7bf0-4d0b-965f-22126357b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.037550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a911ed-7bf0-4d0b-965f-22126357b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.060229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-96a911ed-7bf0-4d0b-965f-22126357b5d4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:03.062074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-96a911ed-7bf0-4d0b-965f-22126357b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:03.147182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2287/4575] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:03.149138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13c21-0bff-4c77-9a9f-bb1d21d19d36 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.149490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13c21-0bff-4c77-9a9f-bb1d21d19d36 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.149828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13c21-0bff-4c77-9a9f-bb1d21d19d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.174679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5ca13c21-0bff-4c77-9a9f-bb1d21d19d36 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:03.175894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ca13c21-0bff-4c77-9a9f-bb1d21d19d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:03.184350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2289/4576] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:03.189867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a911ed-7bf0-4d0b-965f-22126357b5d4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:03.200959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a911ed-7bf0-4d0b-965f-22126357b5d4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:03.207683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:03.208402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.208778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.209506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.210078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:03.210488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:03.212234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:03.233276 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2288/4577] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:03.234428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca13c21-0bff-4c77-9a9f-bb1d21d19d36 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:03.244110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca13c21-0bff-4c77-9a9f-bb1d21d19d36 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:03.250439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:03.251046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.251492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.251921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.252770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:03.254863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:03.316388 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2290/4578] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:03 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:03.319126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:03.355981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200beb8-3036-4d4b-bbaa-d486abe5a6f8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:03.456779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:03.460019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.460698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.463511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.464409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:03.466599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:03.497232 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2289/4579] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:03 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:03.501615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:03.536052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb86c40-a19b-471d-bc8a-1f248a0011c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:03.542943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:03.543864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.544393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.544949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.546002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:03.548128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:03.565336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:03.566212 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2291/4580] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:03.577367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defbb32-4bed-4901-ac82-b148f44d9db6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:03.585048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1066a8-b4fe-481a-a71c-f62038710bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:03.585928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1066a8-b4fe-481a-a71c-f62038710bba admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.587492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1066a8-b4fe-481a-a71c-f62038710bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.587933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1066a8-b4fe-481a-a71c-f62038710bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.588830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1066a8-b4fe-481a-a71c-f62038710bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:03.591419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1066a8-b4fe-481a-a71c-f62038710bba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:03.611108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2290/4581] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:24:03.614909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:03.626158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf97862-e601-46ce-b4f3-bc395c9a7c11 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:03.631989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:03.632892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.633437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.633960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] PATH_INFO: `/v3/projects/a4ab8c12eb714eda84701859286240cc/users/e8b63c217bce426baecddadb9159379c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.657752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ab8c12eb714eda84701859286240cc, user_id=e8b63c217bce426baecddadb9159379c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:03.662297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:03.681035 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2292/4582] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:03 2022] PUT /identity/v3/projects/a4ab8c12eb714eda84701859286240cc/users/e8b63c217bce426baecddadb9159379c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:03.692970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4e86-4cab-4aba-964e-6049c5fdf72c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.693357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4e86-4cab-4aba-964e-6049c5fdf72c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.693706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4e86-4cab-4aba-964e-6049c5fdf72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.728221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1eee4e86-4cab-4aba-964e-6049c5fdf72c None None] MFA Rules not processed for user `e8b63c217bce426baecddadb9159379c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:03.729973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1eee4e86-4cab-4aba-964e-6049c5fdf72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:03.757443 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:03.836465 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2291/4583] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:03.851564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:03.855071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:03.956499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de74cd-a71b-4382-b936-d4059127fa05 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:03.961227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:03.962009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:03.962357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:03.962699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:03.973805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:03.975269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:03.986238 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2293/4584] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:05.282360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:05.282893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:05.282976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:05.319044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] MFA Rules not processed for user `5570c8ed79ec4196aa73b96a03ee17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:05.323367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:05.401015 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2292/4585] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:05.470151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:05.476203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:05.644919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bcc9a-bf87-4299-96b2-211e0ba79480 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:05.649916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:05.650769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:05.651053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:05.651331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:05.654226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:05.669291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:05.671244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:05.685216 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2294/4586] 10.222.0.16 () {60 vars in 1396 bytes} [Sun Sep 11 01:24:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:10.810386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:10.812999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:10.925465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51d8f3-06b2-406f-b76e-e1ec0c9f469a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:10.930697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d2255-f0e7-4f15-b2c9-5dee00bbd8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:10.932231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2255-f0e7-4f15-b2c9-5dee00bbd8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:10.932681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2255-f0e7-4f15-b2c9-5dee00bbd8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:10.933162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2255-f0e7-4f15-b2c9-5dee00bbd8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:10.935313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f64d2255-f0e7-4f15-b2c9-5dee00bbd8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:10.952956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d2255-f0e7-4f15-b2c9-5dee00bbd8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:10.954829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d2255-f0e7-4f15-b2c9-5dee00bbd8e7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:10.967006 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2293/4587] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:15.678053 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:20.960658 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=68 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:22.425624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:22.548161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3a60d-4c41-48bb-92f2-b4d5bfa33143 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:22.553542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:22.554490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:22.555273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:22.555754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] PATH_INFO: `/v3/users/e8b63c217bce426baecddadb9159379c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:22.557537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b63c217bce426baecddadb9159379c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:22.559813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:22.637636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b63c217bce426baecddadb9159379c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:22.639017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b63c217bce426baecddadb9159379c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:22.640210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b63c217bce426baecddadb9159379c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:22.648947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b63c217bce426baecddadb9159379c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:22.667597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b63c217bce426baecddadb9159379c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:22.687242 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2295/4588] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:22 2022] DELETE /identity/v3/users/e8b63c217bce426baecddadb9159379c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:22.692021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:22.692910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:22.693456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:22.714331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:22.715975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:22.795646 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2294/4589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:22.807002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:22.809034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:22.888130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb65c3-e3c0-4b23-8482-73842f28e076 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:22.893953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c815a-fe45-48a1-bc6d-ab3cf0432ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:22.895929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c815a-fe45-48a1-bc6d-ab3cf0432ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:22.896427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c815a-fe45-48a1-bc6d-ab3cf0432ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:22.897390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c815a-fe45-48a1-bc6d-ab3cf0432ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:22.909404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c815a-fe45-48a1-bc6d-ab3cf0432ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:22.911768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c815a-fe45-48a1-bc6d-ab3cf0432ce0 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:22.926947 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2296/4590] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:23.337259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:23.339013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:23.387131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f1e0a-c0c7-4e3a-9386-bd889fdcc017 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:23.399080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:23.399956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:23.400705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:23.401092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] PATH_INFO: `/v3/projects/a4ab8c12eb714eda84701859286240cc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:23.402573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ab8c12eb714eda84701859286240cc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:23.407428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:23.472386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ab8c12eb714eda84701859286240cc', 'request_id': 'req-101a51f9-7d23-4b53-b6e2-2f9e33faa895'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:23.478746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ab8c12eb714eda84701859286240cc', 'request_id': 'req-101a51f9-7d23-4b53-b6e2-2f9e33faa895'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:23.497828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ab8c12eb714eda84701859286240cc', 'request_id': 'req-101a51f9-7d23-4b53-b6e2-2f9e33faa895'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:23.521534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] The token cache is being invalidate because project a4ab8c12eb714eda84701859286240cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:23.522068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:23.523566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-101a51f9-7d23-4b53-b6e2-2f9e33faa895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:23.532342 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2295/4591] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:23 2022] DELETE /identity/v3/projects/a4ab8c12eb714eda84701859286240cc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:23.534811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbefff9-e343-45b9-ac04-d4fce8574335 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:23.539566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbefff9-e343-45b9-ac04-d4fce8574335 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:23.540022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbefff9-e343-45b9-ac04-d4fce8574335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:23.586049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2fbefff9-e343-45b9-ac04-d4fce8574335 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:23.588830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2fbefff9-e343-45b9-ac04-d4fce8574335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:23.620173 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:23.732034 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2297/4592] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:23.740433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a0dfa-1822-48a8-b67c-7e4ed66abc9a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:23.740905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a0dfa-1822-48a8-b67c-7e4ed66abc9a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:23.740990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a0dfa-1822-48a8-b67c-7e4ed66abc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:23.774885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3a6a0dfa-1822-48a8-b67c-7e4ed66abc9a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:23.776172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3a6a0dfa-1822-48a8-b67c-7e4ed66abc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:23.803805 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2296/4593] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:23.807711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbefff9-e343-45b9-ac04-d4fce8574335 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:23.831675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbefff9-e343-45b9-ac04-d4fce8574335 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:23.837217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:23.837883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:23.838162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:23.838725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:23.839411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:23.839963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:23.841585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:23.855250 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2298/4594] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:23.860449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a0dfa-1822-48a8-b67c-7e4ed66abc9a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:23.870083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a0dfa-1822-48a8-b67c-7e4ed66abc9a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:23.876759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:23.877595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:23.877973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:23.878340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:23.879075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:23.882199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:23.920745 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2297/4595] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:23 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:23.922133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:23.944347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114293eb-94eb-4211-b8d9-a6f3ad91ab61 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.027518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.028470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.028926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.029988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.030848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.032937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.076493 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2299/4596] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:23 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:24.078834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.095752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72b4cf-6f11-497e-9dab-8d87a0fb4c9f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.101148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.102089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.102550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.103001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.103904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.105734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.116944 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2298/4597] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:24:24.121211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.132553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7035b-f059-4884-a0f7-e942a036e390 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.137608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cae18-64d2-4ecf-b593-d9544462be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.138222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cae18-64d2-4ecf-b593-d9544462be28 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.138552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cae18-64d2-4ecf-b593-d9544462be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.138895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cae18-64d2-4ecf-b593-d9544462be28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.139552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cae18-64d2-4ecf-b593-d9544462be28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.141178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cae18-64d2-4ecf-b593-d9544462be28 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.157129 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2300/4598] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:24.158401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.168679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc026b5-acab-4247-bd6a-c7ff67b27634 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.174705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.175381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.175653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.175932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] PATH_INFO: `/v3/projects/8a288ab075f742919def4196bbd26a6b/users/d986d97b6bc24964a229533392c01cac/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.192274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a288ab075f742919def4196bbd26a6b, user_id=d986d97b6bc24964a229533392c01cac, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.195006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.213800 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2299/4599] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:24 2022] PUT /identity/v3/projects/8a288ab075f742919def4196bbd26a6b/users/d986d97b6bc24964a229533392c01cac/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:24.221304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0097f-22d5-47c1-9116-8169dc14b33d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.221587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0097f-22d5-47c1-9116-8169dc14b33d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.221859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0097f-22d5-47c1-9116-8169dc14b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.261775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-27c0097f-22d5-47c1-9116-8169dc14b33d None None] MFA Rules not processed for user `d986d97b6bc24964a229533392c01cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:24.263044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-27c0097f-22d5-47c1-9116-8169dc14b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:24.379942 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2301/4600] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:24.384002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.417479 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:24.479140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150894-577e-40b2-abe7-acf132f4b15f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.487598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.489363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.489967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.490414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.491404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.493597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.542926 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2300/4601] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:24 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:24.547334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0097f-22d5-47c1-9116-8169dc14b33d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.566510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0097f-22d5-47c1-9116-8169dc14b33d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.589041 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:24.699926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.700668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.701229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.701561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.702320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.704695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.742500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2302/4602] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:24 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:24.745843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.783248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf2e3-c57d-4511-bcd5-d93668c325e2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.798955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.799855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.800337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.800960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.802481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.808014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.836221 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2301/4603] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:24.839493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.855914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe9c-8262-4c15-934e-b8866a3416c6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:24.862434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:24.863536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:24.864023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:24.864448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] PATH_INFO: `/v3/projects/454904ed30064baf940bf52d06c4d150/users/520dc318857647a099f2ebd038bb3e06/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:24.890019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=454904ed30064baf940bf52d06c4d150, user_id=520dc318857647a099f2ebd038bb3e06, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:24.892953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:24.915766 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2303/4604] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:24 2022] PUT /identity/v3/projects/454904ed30064baf940bf52d06c4d150/users/520dc318857647a099f2ebd038bb3e06/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:24.917049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:24.931271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecaa90-873f-4826-a2a6-72e7a8941361 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:25.053302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea0a1-5a78-420c-a900-d33647ed648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:25.054108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea0a1-5a78-420c-a900-d33647ed648c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.054515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea0a1-5a78-420c-a900-d33647ed648c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.054889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea0a1-5a78-420c-a900-d33647ed648c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.056125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ea0a1-5a78-420c-a900-d33647ed648c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:25.058853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ea0a1-5a78-420c-a900-d33647ed648c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:25.085043 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2302/4605] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:25.089358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:25.104759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbe42a-78fb-4771-b7b2-a5b6eb55f83a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:25.119278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:25.120121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.121654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.123692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] PATH_INFO: `/v3/projects/454904ed30064baf940bf52d06c4d150/users/520dc318857647a099f2ebd038bb3e06/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.128410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454904ed30064baf940bf52d06c4d150, user_id=520dc318857647a099f2ebd038bb3e06, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:25.143877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:25.175343 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2304/4606] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:25 2022] PUT /identity/v3/projects/454904ed30064baf940bf52d06c4d150/users/520dc318857647a099f2ebd038bb3e06/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:25.188334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f082-914d-4265-80f3-b6113952dba0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.189362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f082-914d-4265-80f3-b6113952dba0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.189743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f082-914d-4265-80f3-b6113952dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.239438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1b00f082-914d-4265-80f3-b6113952dba0 None None] MFA Rules not processed for user `520dc318857647a099f2ebd038bb3e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:25.241277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b00f082-914d-4265-80f3-b6113952dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:25.405814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2303/4607] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:25.407479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:25.427137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf02ae-6236-4246-b9ce-765ee6fdf208 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:25.441013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:25.441949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.442455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.442978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.443859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:25.445412 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:25.445412 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:25.445412 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:25.447835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:25.479500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2305/4608] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:25 2022] POST /identity/v3/services => generated 288 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:25.484426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f082-914d-4265-80f3-b6113952dba0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:25.501296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f082-914d-4265-80f3-b6113952dba0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:25.541410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:25.543368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.543657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.543935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.544629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:25.548587 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:25.548587 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:25.548587 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:25.550620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:25.557331 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:25.596573 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1011593586. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:24:25.596573 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:24:25.596573 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:25.679648 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2304/4609] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:24:25 2022] POST /identity/v3/endpoints => generated 360 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:25.681223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:25.704137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada715e3-049f-4e55-9c91-6cf9fd3c8529 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:25.775321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe84c96-9512-48e6-a1fd-4de38b46ec75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:25.775974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe84c96-9512-48e6-a1fd-4de38b46ec75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.776258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe84c96-9512-48e6-a1fd-4de38b46ec75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.776540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe84c96-9512-48e6-a1fd-4de38b46ec75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-1011593586` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.777426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe84c96-9512-48e6-a1fd-4de38b46ec75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1011593586)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:25.778500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe84c96-9512-48e6-a1fd-4de38b46ec75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:25.785973 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2306/4610] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 11 01:24:25 2022] GET /identity/v3/regions/tempest-region-1011593586 => generated 180 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:25.787933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:25.802634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853259-9aec-4efb-8426-e8488bd65789 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:25.817679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:25.817923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.818135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.818238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53cd42-ab29-4226-926e-32a311137086 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.818322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.818516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53cd42-ab29-4226-926e-32a311137086 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.818765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53cd42-ab29-4226-926e-32a311137086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.819346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:25.821478 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:25.821478 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:25.821478 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:25.822772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:25.854323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aa53cd42-ab29-4226-926e-32a311137086 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:25.856384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa53cd42-ab29-4226-926e-32a311137086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:25.864640 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2305/4611] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:25 2022] POST /identity/v3/services => generated 289 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:25.868589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:25.943775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77132e-585e-4406-a0ec-81bddc87222e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:25.962349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:25.967737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:25.968311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:25.968654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:25.970949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:25.975748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.030089 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1966764674. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:24:26.030089 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:24:26.030089 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:26.070323 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2307/4612] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3643 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:24:26.122582 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2306/4613] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:24:25 2022] POST /identity/v3/endpoints => generated 362 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:26.128958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53cd42-ab29-4226-926e-32a311137086 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.145785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.148387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:26.153409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53cd42-ab29-4226-926e-32a311137086 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.202402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.205233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.208230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.208660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-1966764674` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.211133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1966764674)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.216005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.226394 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2308/4614] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 11 01:24:26 2022] GET /identity/v3/regions/tempest-region-1966764674 => generated 180 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:26.230019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.261495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20cbf-8828-4166-9c76-2fcfbf066267 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.285317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.285954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.286244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.286520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.287206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.288223 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:26.288223 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:26.288223 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:26.292154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.318044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cf1be-3d07-4cc8-abea-f98bba187667 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.327104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.327960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.328387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.329011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.334900 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-661991213. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:24:26.334900 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:24:26.334900 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:26.339928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.342809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.356558 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2307/4615] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:24:26.405573 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:26.457081 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2309/4616] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:24:26 2022] POST /identity/v3/endpoints => generated 358 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:26.459023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.478936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666d0a-4af4-4066-a036-5ca04ffbb2fb service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.563462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.567330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.567597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.567999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-661991213` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.569654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-661991213)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.572329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.581943 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2308/4617] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 11 01:24:26 2022] GET /identity/v3/regions/tempest-region-661991213 => generated 178 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:26.585639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.606737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee429-9274-4094-9d5c-075407e8e28f tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.642981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.646523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.646916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.647324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.648293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.649804 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:26.649804 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:26.649804 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:26.651451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.676706 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2310/4618] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 11 01:24:26 2022] GET /identity/v3/endpoints => generated 4394 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:26.680587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.705615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d668-c645-46d9-a3a5-bccea6dc9ef7 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.726403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.727110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.727395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.727673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints/a9d4d71bbdef4ef79946beed45e25636` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.729886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.733140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:26.740296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=a9d4d71bbdef4ef79946beed45e25636)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.745369 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:26.745369 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:26.745369 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:26.747669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.754313 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2309/4619] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:26 2022] GET /identity/v3/endpoints/a9d4d71bbdef4ef79946beed45e25636 => generated 358 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:26.757287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.796963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a788d6b-eb89-479e-b9db-1476b3fb0e5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.813966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.815745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.827528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.833777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints/a9d4d71bbdef4ef79946beed45e25636` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.835513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a9d4d71bbdef4ef79946beed45e25636)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.839485 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:26.839485 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:26.839485 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:26.844744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.874503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a9d4d71bbdef4ef79946beed45e25636', 'request_id': 'req-d13bca3c-4779-4da4-aa27-422892e17ecd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:26.910132 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2310/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:24:26 2022] DELETE /identity/v3/endpoints/a9d4d71bbdef4ef79946beed45e25636 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:26.913770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:26.929673 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:26.946704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d213827-1729-48a3-a063-3a6a166acc30 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.968252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bca3c-4779-4da4-aa27-422892e17ecd tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:26.980230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.980819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.981157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.981384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:26.982018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:26.988378 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:26.988378 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:26.988378 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:26.988745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:26.991155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:26.992015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:26.992400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:26.994915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.008522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:27.010283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2311/4621] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 11 01:24:26 2022] GET /identity/v3/endpoints => generated 4049 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:27.014337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.032975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.034771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.036239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46421fec-1094-47cb-b1a9-ee4b7ecc1d87 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.050483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.051404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.052117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.052117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints/a9d4d71bbdef4ef79946beed45e25636` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.056209 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2311/4622] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:26 2022] GET /identity/v3/auth/tokens => generated 4004 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:24:27.062242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Could not find endpoint: a9d4d71bbdef4ef79946beed45e25636.: keystone.exception.EndpointNotFound: Could not find endpoint: a9d4d71bbdef4ef79946beed45e25636. Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._iter().one() Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._only_one_row( Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:24:27.098104 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: a9d4d71bbdef4ef79946beed45e25636. Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:24:27.099173 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:24:27.100195 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: a9d4d71bbdef4ef79946beed45e25636. Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:24:27.101175 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2312/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:24:27 2022] DELETE /identity/v3/endpoints/a9d4d71bbdef4ef79946beed45e25636 => generated 114 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:24:27.103690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.118364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaaa93-6907-409a-98f9-d8a61161151e service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.136695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.138026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.139892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.140401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-661991213` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.141951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-661991213)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.143225 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:27.143225 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:27.143225 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:27.144780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.177551 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2312/4624] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 11 01:24:27 2022] DELETE /identity/v3/regions/tempest-region-661991213 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:27.182839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.202563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d148-24d2-4442-98c7-12f27a9c0b33 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.235622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.237099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.237543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.237991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.239343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.241692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.254010 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2313/4625] 10.222.0.16 () {58 vars in 1134 bytes} [Sun Sep 11 01:24:27 2022] GET /identity/v3/endpoints => generated 4049 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:27.257199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.276632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa8c71-722f-484c-ac21-b420f75c6a7d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.282694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.283443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.283833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.284266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.285236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Adding query filter params (service_id=75bdf67636b94a758faab3591787f0f9) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:27.285649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.287978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.299385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2313/4626] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:24:27 2022] GET /identity/v3/endpoints?service_id=75bdf67636b94a758faab3591787f0f9 => generated 502 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:27.301215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.312273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d451-8707-4ab9-bb8c-e90124370009 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.333517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.334769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.335436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.335947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.341668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Adding query filter params (service_id=0fcd8533b49e49fb85a2a5d893299956) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:27.342605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.346260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.365165 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2314/4627] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:24:27 2022] GET /identity/v3/endpoints?service_id=0fcd8533b49e49fb85a2a5d893299956 => generated 504 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:27.369318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.383602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a5a5-1b2f-43f8-a082-4d15859e1388 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.400284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.400983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.401290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.401563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.402465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:27.402772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.404930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.428194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2314/4628] 10.222.0.16 () {58 vars in 1167 bytes} [Sun Sep 11 01:24:27 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:27.432528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.448801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149444-33a1-4c46-88ed-e0b20a26ed5e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.465971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.468355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.468878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.469394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.470279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:27.470838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.472685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.494328 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2315/4629] 10.222.0.16 () {58 vars in 1171 bytes} [Sun Sep 11 01:24:27 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:27.500187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.520107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2382d-0946-4e8f-a091-267e8a84e49b tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.533034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.533034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.533034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.533477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.533477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.533477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.569228 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2315/4630] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:27 2022] POST /identity/v3/services => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:27.570247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.588506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe997c-219b-4a01-b538-f4180369acc1 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.631672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.632449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.632840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.633365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.634398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.637243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.670834 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2103846163. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:24:27.670834 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:24:27.670834 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:27.719866 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2316/4631] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:24:27 2022] POST /identity/v3/endpoints => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:27.723515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.739126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a88ae7-c29b-4230-a58c-802c39831c41 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.796387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.798566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.798781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.801673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-2103846163` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.802633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2103846163)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.805936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.822407 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2316/4632] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 11 01:24:27 2022] GET /identity/v3/regions/tempest-region-2103846163 => generated 180 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:27.824435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:27.841657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a26f5-b9d7-480e-8b61-a3a532a5ce75 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:27.854702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:27.855598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:27.856097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:27.856475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints/ee5be073dde44968a295337cbf696c27` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:27.886602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=ee5be073dde44968a295337cbf696c27)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:27.887875 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:27.887875 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:27.887875 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:27.891863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:27.951873 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-780137966. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:24:27.951873 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:24:27.951873 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:28.071184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2317/4633] 10.222.0.16 () {60 vars in 1256 bytes} [Sun Sep 11 01:24:27 2022] PATCH /identity/v3/endpoints/ee5be073dde44968a295337cbf696c27 => generated 362 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:24:28.072496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.091099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa9d69-a422-4854-9b03-315f2a98cb9e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:28.135883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:28.136553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:28.137034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:28.137357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-780137966` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:28.137941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-780137966)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:28.139644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:28.147948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.148376 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2317/4634] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 11 01:24:28 2022] GET /identity/v3/regions/tempest-region-780137966 => generated 178 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:28.167105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e5b0d-49cf-49ed-a9a2-e7bf79dbf53a tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:28.182987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:28.185248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:28.186121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:28.186407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints/ee5be073dde44968a295337cbf696c27` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:28.196625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ee5be073dde44968a295337cbf696c27)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:28.199941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:28.214079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ee5be073dde44968a295337cbf696c27', 'request_id': 'req-3d134935-d0e6-4835-932e-9bbb974a198e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:28.235736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2318/4635] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:24:28 2022] DELETE /identity/v3/endpoints/ee5be073dde44968a295337cbf696c27 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:28.240191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.254699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f105979-72fb-4f39-a96c-89a3f4bd8343 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:28.277716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:28.279400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:28.279986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:28.280610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-780137966` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:28.282093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-780137966)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:28.284716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:28.325631 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-780137966. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:24:28.325631 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:24:28.325631 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:28.328547 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:28.343786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.344310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2318/4636] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 11 01:24:28 2022] DELETE /identity/v3/regions/tempest-region-780137966 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:28.367709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d134935-d0e6-4835-932e-9bbb974a198e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:28.408236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:28.409380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:28.409737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:28.410189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-2103846163` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:28.410861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2103846163)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:28.412000 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:28.412000 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:28.412000 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:28.413706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:28.486725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.487396 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2319/4637] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 11 01:24:28 2022] DELETE /identity/v3/regions/tempest-region-2103846163 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:28.518728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fcf82-285d-432c-b307-6c9b13cd333d tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:28.599861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:28.600744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:28.602967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:28.603586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/services/6a2822fc50824a00a991d0fe299c2ae1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:28.605210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6a2822fc50824a00a991d0fe299c2ae1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:28.608981 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:28.608981 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:28.608981 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:28.611327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:28.693782 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2319/4638] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:28 2022] DELETE /identity/v3/services/6a2822fc50824a00a991d0fe299c2ae1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:28.699073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.717841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22368078-b26c-4307-b4aa-20fef09640b2 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:28.764892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:28.765735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:28.765918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:28.766880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints/161670d57d154ef19572922484cd9b09` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:28.771596 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:28.776349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=161670d57d154ef19572922484cd9b09)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:28.780948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:28.816990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '161670d57d154ef19572922484cd9b09', 'request_id': 'req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:28.832465 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2320/4639] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:24:28 2022] DELETE /identity/v3/endpoints/161670d57d154ef19572922484cd9b09 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:28.837963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.856863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2de489-5dab-439c-a04a-543b879936f0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:28.885096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:28.886554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:28.886911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:28.887293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-1966764674` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:28.888154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1966764674)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:28.890602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:28.928016 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1966764674. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:24:28.928016 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:24:28.928016 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:28.947079 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2320/4640] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 11 01:24:28 2022] DELETE /identity/v3/regions/tempest-region-1966764674 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:28.952559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:28.974153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d04de-b0cd-42f9-ae33-3ff6fd6f8d24 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:29.017482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:29.018059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:29.018670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:29.018670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/services/0fcd8533b49e49fb85a2a5d893299956` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:29.019152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0fcd8533b49e49fb85a2a5d893299956)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:29.020159 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:29.020159 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:29.020159 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:29.021472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:29.063571 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2321/4641] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:28 2022] DELETE /identity/v3/services/0fcd8533b49e49fb85a2a5d893299956 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:29.065619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:29.080044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028511-196e-4930-bcee-e1c25735deb0 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:29.107752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:29.108478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:29.108814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:29.109185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/endpoints/8add6b7814f64db28b753cce0b28fa45` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:29.117794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8add6b7814f64db28b753cce0b28fa45)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:29.118985 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:29.118985 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:29.118985 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:29.120120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:29.135774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8add6b7814f64db28b753cce0b28fa45', 'request_id': 'req-158187d3-1f88-477f-9891-3bfbf6258e35'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:29.149209 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2321/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:24:29 2022] DELETE /identity/v3/endpoints/8add6b7814f64db28b753cce0b28fa45 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:29.153293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:29.174496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d9e6e-0692-47f9-bf24-6f1268681e0e tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:29.196177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:29.205944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:29.205944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:29.205944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/regions/tempest-region-1011593586` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:29.210814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1011593586)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:29.221860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:29.255439 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2322/4643] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 11 01:24:29 2022] DELETE /identity/v3/regions/tempest-region-1011593586 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:29.258894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:29.275660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158187d3-1f88-477f-9891-3bfbf6258e35 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:29.335617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a210c3-e61d-4a2e-ad24-ae7b3fe06790 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520dc318857647a099f2ebd038bb3e06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454904ed30064baf940bf52d06c4d150', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:29.336485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a210c3-e61d-4a2e-ad24-ae7b3fe06790 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:29.336876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a210c3-e61d-4a2e-ad24-ae7b3fe06790 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:29.337363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a210c3-e61d-4a2e-ad24-ae7b3fe06790 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] PATH_INFO: `/v3/services/75bdf67636b94a758faab3591787f0f9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:29.338019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a210c3-e61d-4a2e-ad24-ae7b3fe06790 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorizing `identity:delete_service(service_id=75bdf67636b94a758faab3591787f0f9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:29.339751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a210c3-e61d-4a2e-ad24-ae7b3fe06790 tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:29.434744 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2322/4644] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:29 2022] DELETE /identity/v3/services/75bdf67636b94a758faab3591787f0f9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:29.439235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:29.601754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7244f3-d237-4291-985c-642b7563a3ff tempest-EndPointsTestJSON-1130366513 tempest-EndPointsTestJSON-1130366513-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:29.632290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:29.632949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:29.633750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:29.634037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] PATH_INFO: `/v3/users/d986d97b6bc24964a229533392c01cac` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:29.636490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d986d97b6bc24964a229533392c01cac)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:29.640155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:29.743723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd986d97b6bc24964a229533392c01cac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:29.745461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd986d97b6bc24964a229533392c01cac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:29.746280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd986d97b6bc24964a229533392c01cac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:29.780461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd986d97b6bc24964a229533392c01cac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:29.786345 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=14 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:29.794542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd986d97b6bc24964a229533392c01cac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:29.839470 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2323/4645] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:29 2022] DELETE /identity/v3/users/d986d97b6bc24964a229533392c01cac => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:29.844676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:29.845239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:29.845344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:29.868899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:29.870280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:29.979354 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2323/4646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:29.986767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:29.988240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:30.282865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459312-321d-4d71-8a85-fd0450cfe16f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:30.302937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:30.303498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:30.303794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:30.304046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:30.329191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:30.330733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:30.381943 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2324/4647] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:31.294842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:31.332355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:31.369037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf309ef-1dfa-4cfc-9ae9-90c7fac7facc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:31.389279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:31.390961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:31.398088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:31.398704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] PATH_INFO: `/v3/projects/8a288ab075f742919def4196bbd26a6b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:31.400346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a288ab075f742919def4196bbd26a6b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:31.402756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:31.476947 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:31.516193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a288ab075f742919def4196bbd26a6b', 'request_id': 'req-01f75ac7-d127-478b-b37e-ff0f910d5dda'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:31.525980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a288ab075f742919def4196bbd26a6b', 'request_id': 'req-01f75ac7-d127-478b-b37e-ff0f910d5dda'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:31.566199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a288ab075f742919def4196bbd26a6b', 'request_id': 'req-01f75ac7-d127-478b-b37e-ff0f910d5dda'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:31.615598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] The token cache is being invalidate because project 8a288ab075f742919def4196bbd26a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:31.620062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:31.623445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:31.630792 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2324/4648] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:31 2022] DELETE /identity/v3/projects/8a288ab075f742919def4196bbd26a6b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:31.636488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:31.648898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564a6d5-5ca6-42d2-9b78-c78cc4dd8f74 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:31.893979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:31.895043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:31.895480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:31.895919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] PATH_INFO: `/v3/users/520dc318857647a099f2ebd038bb3e06` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:31.897634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520dc318857647a099f2ebd038bb3e06)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:31.900309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:32.039740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520dc318857647a099f2ebd038bb3e06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:32.041985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520dc318857647a099f2ebd038bb3e06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:32.045492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520dc318857647a099f2ebd038bb3e06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:32.120036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520dc318857647a099f2ebd038bb3e06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:32.141732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-40b2c7c3-8dcc-4c70-b89e-1209ff936fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520dc318857647a099f2ebd038bb3e06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:32.155636 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:32.177078 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2325/4649] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:31 2022] DELETE /identity/v3/users/520dc318857647a099f2ebd038bb3e06 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:33.456376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:33.458879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:33.493960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75ac7-d127-478b-b37e-ff0f910d5dda admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:33.592459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:33.593307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:33.593584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:33.593914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] PATH_INFO: `/v3/projects/454904ed30064baf940bf52d06c4d150` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:33.595170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=454904ed30064baf940bf52d06c4d150)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:33.597111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:33.671068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454904ed30064baf940bf52d06c4d150', 'request_id': 'req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:33.705185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454904ed30064baf940bf52d06c4d150', 'request_id': 'req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:33.728985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454904ed30064baf940bf52d06c4d150', 'request_id': 'req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:33.759701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] The token cache is being invalidate because project 454904ed30064baf940bf52d06c4d150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:33.759994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:33.760671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1ebb2d02-eeb6-425a-96cf-6aaca1fce96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:33.769813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37b9b-e9b9-4c3f-9854-2da2730181e9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:33.770337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37b9b-e9b9-4c3f-9854-2da2730181e9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:33.770462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c37b9b-e9b9-4c3f-9854-2da2730181e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:33.774276 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2325/4650] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:33 2022] DELETE /identity/v3/projects/454904ed30064baf940bf52d06c4d150 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:33.800445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-61c37b9b-e9b9-4c3f-9854-2da2730181e9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:33.802062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-61c37b9b-e9b9-4c3f-9854-2da2730181e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:33.938881 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2326/4651] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:33.948008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9f31-a1df-4757-91ff-6eda9c36e12d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:33.948850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9f31-a1df-4757-91ff-6eda9c36e12d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:33.949368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9f31-a1df-4757-91ff-6eda9c36e12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:33.988511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b41b9f31-a1df-4757-91ff-6eda9c36e12d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:33.989792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b41b9f31-a1df-4757-91ff-6eda9c36e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:34.007988 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2326/4652] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:34.009324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37b9b-e9b9-4c3f-9854-2da2730181e9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:34.031484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c37b9b-e9b9-4c3f-9854-2da2730181e9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:34.047098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:34.047823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:34.048110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:34.048386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:34.049052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:34.049383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:34.051316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:34.083547 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2327/4653] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:34.088862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b9f31-a1df-4757-91ff-6eda9c36e12d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:34.106779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b9f31-a1df-4757-91ff-6eda9c36e12d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:34.124595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:34.126105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:34.126453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:34.126732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:34.127599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:34.129659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:34.208977 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2327/4654] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:34 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:34.211166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:34.225655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26678bcd-a8a2-4067-9332-ad651fdb1849 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:34.397853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:34.398594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:34.398882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:34.399173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:34.399834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:34.404349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:34.455254 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2328/4655] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:34 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:34.459325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:34.476583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa7554-ca00-4cf7-bce6-b000715108da admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:34.489014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:34.489670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:34.490261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:34.490541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:34.491828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:34.494841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:34.520494 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2328/4656] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:34.524591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:34.555714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9e10b-a612-4aae-b0bd-58d01e92fb21 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:34.563468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9f326-0208-43c2-9688-a6d09e442121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:34.564619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9f326-0208-43c2-9688-a6d09e442121 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:34.565054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9f326-0208-43c2-9688-a6d09e442121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:34.565504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9f326-0208-43c2-9688-a6d09e442121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:34.566299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9f326-0208-43c2-9688-a6d09e442121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:34.568059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9f326-0208-43c2-9688-a6d09e442121 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:34.588747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:34.589093 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2329/4657] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:34.599630 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:34.605553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19db238-6c03-4740-ab13-09f7010a1df0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:34.622383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:34.625043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:34.625368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:34.625723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] PATH_INFO: `/v3/projects/4082eb7c84d84597a92bd6f1dbc0751f/users/397aad5d1fe049e8b1066bfe4fd36dce/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:34.674087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4082eb7c84d84597a92bd6f1dbc0751f, user_id=397aad5d1fe049e8b1066bfe4fd36dce, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:34.677414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:34.711750 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2329/4658] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:34 2022] PUT /identity/v3/projects/4082eb7c84d84597a92bd6f1dbc0751f/users/397aad5d1fe049e8b1066bfe4fd36dce/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:34.713589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4951-9d13-4e34-9a4a-1dc5736cbc5f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:34.713879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4951-9d13-4e34-9a4a-1dc5736cbc5f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:34.714148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4951-9d13-4e34-9a4a-1dc5736cbc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:34.794005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e04e4951-9d13-4e34-9a4a-1dc5736cbc5f None None] MFA Rules not processed for user `397aad5d1fe049e8b1066bfe4fd36dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:34.795208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e04e4951-9d13-4e34-9a4a-1dc5736cbc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:35.004041 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:35.119930 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2330/4659] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:35.124376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:35.240281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8bba-510d-433e-9dda-978200176b88 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:35.253137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:35.254140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:35.254529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:35.254914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:35.255847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:35.259886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:35.321434 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2330/4660] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:35 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:35.325714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e4951-9d13-4e34-9a4a-1dc5736cbc5f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:35.348367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e4951-9d13-4e34-9a4a-1dc5736cbc5f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:35.537051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:35.538049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:35.538811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:35.539919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:35.542548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:35.547995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:35.678592 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2331/4661] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:35 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:35.682184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:35.710074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5fde7-2ba0-4016-8e52-ee57959ff077 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:35.749867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:35.750496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:35.750773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:35.751040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:35.753039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:35.753302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:35.793503 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2331/4662] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:35.795089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:35.821384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d41d1-49a8-4d37-badb-13f1763c016c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:35.833907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:35.836483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:35.837040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:35.839815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] PATH_INFO: `/v3/projects/1c59c99acd51407cb68f351875eb4bc6/users/a0f2c66d3ab74d6abbff2d95b1e7fe79/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:35.879324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c59c99acd51407cb68f351875eb4bc6, user_id=a0f2c66d3ab74d6abbff2d95b1e7fe79, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:35.891329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:35.940395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:35.940895 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2332/4663] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:35 2022] PUT /identity/v3/projects/1c59c99acd51407cb68f351875eb4bc6/users/a0f2c66d3ab74d6abbff2d95b1e7fe79/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:35.955701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f69045-7913-47b3-b76e-6679f1ebd427 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:36.241655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77429f6-99a2-4b05-8a95-7e56a45fd8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:36.242305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77429f6-99a2-4b05-8a95-7e56a45fd8db admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:36.242582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77429f6-99a2-4b05-8a95-7e56a45fd8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:36.242858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77429f6-99a2-4b05-8a95-7e56a45fd8db admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:36.243535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77429f6-99a2-4b05-8a95-7e56a45fd8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:36.245350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77429f6-99a2-4b05-8a95-7e56a45fd8db admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:36.298033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2332/4664] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:36.304525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:36.323902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fbdd1-893b-45c5-9b79-6b9ce7e7d668 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:36.355279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:36.355899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:36.356179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:36.356453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] PATH_INFO: `/v3/projects/1c59c99acd51407cb68f351875eb4bc6/users/a0f2c66d3ab74d6abbff2d95b1e7fe79/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:36.359745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c59c99acd51407cb68f351875eb4bc6, user_id=a0f2c66d3ab74d6abbff2d95b1e7fe79, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:36.362523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:36.415009 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2333/4665] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:36 2022] PUT /identity/v3/projects/1c59c99acd51407cb68f351875eb4bc6/users/a0f2c66d3ab74d6abbff2d95b1e7fe79/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:36.427414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d92a-3121-467e-8a5f-337048fa22df None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:36.427745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d92a-3121-467e-8a5f-337048fa22df None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:36.427980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2d92a-3121-467e-8a5f-337048fa22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:36.506877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ddc2d92a-3121-467e-8a5f-337048fa22df None None] MFA Rules not processed for user `a0f2c66d3ab74d6abbff2d95b1e7fe79`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:36.508546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ddc2d92a-3121-467e-8a5f-337048fa22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:36.663193 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:36.758427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:36.760453 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2333/4666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:36.790654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ebe8-a2cc-4592-8dee-6ed94f79f117 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:36.804002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:36.804691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:36.804893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:36.805198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:36.805878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:36.806899 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:36.806899 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:36.806899 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:36.814980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:36.862640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2d92a-3121-467e-8a5f-337048fa22df None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:36.872176 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2334/4667] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:24:36 2022] POST /identity/v3/domains => generated 277 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:36.880494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2d92a-3121-467e-8a5f-337048fa22df None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:37.010639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:37.011436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:37.011839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:37.012117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:37.012764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:37.015680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:37.131745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:37.132157 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2334/4668] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:36 2022] POST /identity/v3/projects => generated 403 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:37.149194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324072f-7816-4914-a1a6-e4a9a16448f7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:37.286775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:37.287680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:37.287975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:37.288250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:37.288892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:37.289983 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:37.289983 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:37.289983 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:37.294498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:37.333728 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2335/4669] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:24:37 2022] POST /identity/v3/groups => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:37.334275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:37.354297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88768bdd-b90e-4dfd-a99c-0be485d1a786 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:37.367455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:37.368906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:37.369553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:37.370044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:37.370956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:37.378106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:37.439690 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2335/4670] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:37 2022] POST /identity/v3/users => generated 445 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:37.441737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:37.459564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadec996-0eb8-4cba-bec2-2aa942316a69 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:37.473855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:37.474474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:37.474739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:37.475022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:37.483450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:37.483450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:37.541533 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2336/4671] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:24:37 2022] POST /identity/v3/roles => generated 240 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:37.545948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:37.571808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e7483-6fa2-40a3-81fd-64c5fd5e03e1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:37.580717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:37.582107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:37.582387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:37.582665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/groups/281d5c1fd78d44fd902701295263b292/roles/ea39787aa6944e28854489f354173277/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:37.590307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, group_id=281d5c1fd78d44fd902701295263b292, role_id=ea39787aa6944e28854489f354173277)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:37.593920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:37.654572 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2336/4672] 10.222.0.16 () {60 vars in 1585 bytes} [Sun Sep 11 01:24:37 2022] PUT /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/groups/281d5c1fd78d44fd902701295263b292/roles/ea39787aa6944e28854489f354173277/inherited_to_projects => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:37.658746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:37.699624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab25141-b058-4c63-b2f4-574021c95fc8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:37.732698 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:37.928397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:37.929363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:37.929481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:37.929680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/groups/281d5c1fd78d44fd902701295263b292/roles/ea39787aa6944e28854489f354173277/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:37.933837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, group_id=281d5c1fd78d44fd902701295263b292, role_id=ea39787aa6944e28854489f354173277)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:37.938917 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:37.938917 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:37.938917 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:37.946559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:37.963268 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2337/4673] 10.222.0.16 () {58 vars in 1567 bytes} [Sun Sep 11 01:24:37 2022] HEAD /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/groups/281d5c1fd78d44fd902701295263b292/roles/ea39787aa6944e28854489f354173277/inherited_to_projects => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:37.968476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:37.983759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c78d6d-10a2-462c-9b58-6607c0c51371 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:37.999175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:38.000550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:38.004229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:38.005250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/groups/281d5c1fd78d44fd902701295263b292/roles/ea39787aa6944e28854489f354173277/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:38.015162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, group_id=281d5c1fd78d44fd902701295263b292, role_id=ea39787aa6944e28854489f354173277)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:38.016731 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:38.016731 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:38.016731 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:38.024257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:38.069349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role ea39787aa6944e28854489f354173277 was removed from group 281d5c1fd78d44fd902701295263b292 on project 6e553c3b714c45ca9be53a17ba76b9c5. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:38.073101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:38.076806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:38.131491 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2337/4674] 10.222.0.16 () {58 vars in 1569 bytes} [Sun Sep 11 01:24:37 2022] DELETE /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/groups/281d5c1fd78d44fd902701295263b292/roles/ea39787aa6944e28854489f354173277/inherited_to_projects => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:38.135972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:38.138734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:38.176097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878883b4-bd8f-485f-aa81-bb773b5b1d3f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:38.379753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:38.380417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:38.380702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:38.380978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles/ea39787aa6944e28854489f354173277` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:38.382698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ea39787aa6944e28854489f354173277)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:38.383720 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:38.383720 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:38.383720 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:38.384965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:38.473502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role ea39787aa6944e28854489f354173277 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:38.474130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:38.475555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:38.485420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:38.485916 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2338/4675] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:38 2022] DELETE /identity/v3/roles/ea39787aa6944e28854489f354173277 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:38.501895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bcff8-5951-40c4-9848-e4774c4cc09c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:38.705639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:38.707902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:38.709286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:38.709583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:38.712630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:38.716890 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:38.716890 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:38.716890 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:38.719105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:38.729496 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:38.755212 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2338/4676] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:24:38 2022] POST /identity/v3/roles => generated 239 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:38.756680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:38.760168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:38.823325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6134d1-3c02-4351-9a8d-1e02b74b2788 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:38.837799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:38.838527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:38.838799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:38.839077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/8b7eeae050bc448ea51eb42d26aabaf9/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:38.875252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, user_id=035e62e3550a401f99497663314f4dba, role_id=8b7eeae050bc448ea51eb42d26aabaf9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:38.878007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:38.906206 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2339/4677] 10.222.0.16 () {60 vars in 1582 bytes} [Sun Sep 11 01:24:38 2022] PUT /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/8b7eeae050bc448ea51eb42d26aabaf9/inherited_to_projects => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:38.910409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:38.940774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bddc56-3cfc-424c-a8b5-a3747fb41e0d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:39.183318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:39.183318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:39.188604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:39.189149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/8b7eeae050bc448ea51eb42d26aabaf9/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:39.192115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, user_id=035e62e3550a401f99497663314f4dba, role_id=8b7eeae050bc448ea51eb42d26aabaf9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:39.195935 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:39.195935 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:39.195935 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:39.199858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:39.213522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:39.228275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2339/4678] 10.222.0.16 () {58 vars in 1564 bytes} [Sun Sep 11 01:24:38 2022] HEAD /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/8b7eeae050bc448ea51eb42d26aabaf9/inherited_to_projects => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:39.234031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a9860-b002-48de-97a9-33d7991f319c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:39.245828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:39.246763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:39.247208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:39.248189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/8b7eeae050bc448ea51eb42d26aabaf9/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:39.257954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, user_id=035e62e3550a401f99497663314f4dba, role_id=8b7eeae050bc448ea51eb42d26aabaf9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:39.259298 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:39.259298 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:39.259298 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:39.261663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:39.277965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 8b7eeae050bc448ea51eb42d26aabaf9 was removed from user 035e62e3550a401f99497663314f4dba on project 6e553c3b714c45ca9be53a17ba76b9c5. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:39.278509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:39.279955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:39.308582 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2340/4679] 10.222.0.16 () {58 vars in 1566 bytes} [Sun Sep 11 01:24:39 2022] DELETE /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/8b7eeae050bc448ea51eb42d26aabaf9/inherited_to_projects => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:39.313882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:39.316665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:39.339840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35ef3e-e978-4915-ab93-fa4a8e354daa tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:39.480605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:39.488072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:39.489789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:39.491187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles/8b7eeae050bc448ea51eb42d26aabaf9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:39.498143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8b7eeae050bc448ea51eb42d26aabaf9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:39.510202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:39.605219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 8b7eeae050bc448ea51eb42d26aabaf9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:39.606010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:39.609515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:39.614831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2340/4680] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:39 2022] DELETE /identity/v3/roles/8b7eeae050bc448ea51eb42d26aabaf9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:39.619841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:39.636797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c8efe-8fce-42a1-b371-eb37cbad808a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:39.708013 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:39.774692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:39.775437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:39.777662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:39.778204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:39.779822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:39.785197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:39.820785 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2341/4681] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:24:39 2022] POST /identity/v3/roles => generated 240 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:39.822087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:39.823666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:39.849464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2f3d-b9b1-4645-8ee3-ceb42346caae tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:39.858897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:39.860153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:39.860442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:39.860775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/e6f99914718947cf83419c12b9d4447f/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:39.864252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5914754efb084a0a800e61b383c0ae09, group_id=281d5c1fd78d44fd902701295263b292, role_id=e6f99914718947cf83419c12b9d4447f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:39.867034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:39.895704 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2341/4682] 10.222.0.16 () {60 vars in 1582 bytes} [Sun Sep 11 01:24:39 2022] PUT /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/e6f99914718947cf83419c12b9d4447f/inherited_to_projects => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:39.897805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:39.917167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b89934-cf7c-4c47-96b7-2dd55071d716 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:40.104676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:40.105670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:40.106206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:40.106886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:40.112243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=5914754efb084a0a800e61b383c0ae09, group_id=281d5c1fd78d44fd902701295263b292)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:40.113515 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:40.113515 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:40.113515 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:40.116045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:40.149928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2342/4683] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 11 01:24:39 2022] GET /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/inherited_to_projects => generated 448 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:40.154575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:40.171762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f27b76-115e-4b80-b67d-bef7997fc723 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:40.185649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:40.186430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:40.186702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:40.186986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/e6f99914718947cf83419c12b9d4447f/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:40.198014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=5914754efb084a0a800e61b383c0ae09, group_id=281d5c1fd78d44fd902701295263b292, role_id=e6f99914718947cf83419c12b9d4447f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:40.201732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:40.221414 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2342/4684] 10.222.0.16 () {58 vars in 1564 bytes} [Sun Sep 11 01:24:40 2022] HEAD /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/e6f99914718947cf83419c12b9d4447f/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:40.222700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:40.239478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2ce7-2838-462b-be19-793699daa7a7 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:40.253855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:40.254562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:40.254848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:40.255124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/e6f99914718947cf83419c12b9d4447f/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:40.260026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5914754efb084a0a800e61b383c0ae09, group_id=281d5c1fd78d44fd902701295263b292, role_id=e6f99914718947cf83419c12b9d4447f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:40.268549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:40.292355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role e6f99914718947cf83419c12b9d4447f was removed from group 281d5c1fd78d44fd902701295263b292 on domain 5914754efb084a0a800e61b383c0ae09. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:40.292649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:40.296100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:40.329117 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2343/4685] 10.222.0.16 () {58 vars in 1566 bytes} [Sun Sep 11 01:24:40 2022] DELETE /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/groups/281d5c1fd78d44fd902701295263b292/roles/e6f99914718947cf83419c12b9d4447f/inherited_to_projects => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:40.334229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:40.336491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:40.354573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d0632-57c5-439d-acd5-701faf3ca71e tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:40.448532 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:40.521926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:40.522746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:40.523141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:40.523516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles/e6f99914718947cf83419c12b9d4447f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:40.526159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e6f99914718947cf83419c12b9d4447f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:40.528338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:40.626669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role e6f99914718947cf83419c12b9d4447f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:40.627127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:40.632098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:40.641664 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2343/4686] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:40 2022] DELETE /identity/v3/roles/e6f99914718947cf83419c12b9d4447f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:40.643112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:40.663357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321f54-5aea-470b-b781-8447ea8950c8 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:41.000541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:41.001502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:41.001940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:41.002391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:41.003224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:41.009698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:41.048310 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2344/4687] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:24:40 2022] POST /identity/v3/roles => generated 240 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:41.052431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:41.054410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:41.083782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726d9a-40ed-491f-bcc2-e69b6d4f3718 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:41.110754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:41.113230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:41.116043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:41.118996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/1feb0b1a2da644e69f3b7ea39b709b2b/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:41.136716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5914754efb084a0a800e61b383c0ae09, user_id=035e62e3550a401f99497663314f4dba, role_id=1feb0b1a2da644e69f3b7ea39b709b2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:41.154962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:41.201373 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2344/4688] 10.222.0.16 () {60 vars in 1579 bytes} [Sun Sep 11 01:24:41 2022] PUT /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/1feb0b1a2da644e69f3b7ea39b709b2b/inherited_to_projects => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:41.205544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:41.222067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292a367-05c3-4a14-bce2-c6f5ed8b3edb tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:41.375428 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:41.492847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:41.495088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:41.498777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:41.500368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:41.506513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=5914754efb084a0a800e61b383c0ae09, user_id=035e62e3550a401f99497663314f4dba)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:41.517804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:41.587430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:41.593108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:41.596247 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2345/4689] 10.222.0.16 () {58 vars in 1461 bytes} [Sun Sep 11 01:24:41 2022] GET /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/inherited_to_projects => generated 447 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:41.604088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:41.644203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b57426-b15a-4957-adcf-78baec09de74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:41.671691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:41.672400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:41.672883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:41.673383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/1feb0b1a2da644e69f3b7ea39b709b2b/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:41.678024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=5914754efb084a0a800e61b383c0ae09, user_id=035e62e3550a401f99497663314f4dba, role_id=1feb0b1a2da644e69f3b7ea39b709b2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:41.686535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:41.735800 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2346/4690] 10.222.0.16 () {58 vars in 1561 bytes} [Sun Sep 11 01:24:41 2022] HEAD /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/1feb0b1a2da644e69f3b7ea39b709b2b/inherited_to_projects => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:41.740110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:41.768521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a48aef-e70b-4ae3-b108-0e61f237f675 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:41.790702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:41.791411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:41.791697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:41.791982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/1feb0b1a2da644e69f3b7ea39b709b2b/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:41.802903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5914754efb084a0a800e61b383c0ae09, user_id=035e62e3550a401f99497663314f4dba, role_id=1feb0b1a2da644e69f3b7ea39b709b2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:41.805677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:41.822614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 1feb0b1a2da644e69f3b7ea39b709b2b was removed from user 035e62e3550a401f99497663314f4dba on domain 5914754efb084a0a800e61b383c0ae09. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:41.822911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:41.823654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:41.859017 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2347/4691] 10.222.0.16 () {58 vars in 1563 bytes} [Sun Sep 11 01:24:41 2022] DELETE /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/1feb0b1a2da644e69f3b7ea39b709b2b/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:41.864232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:41.866738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:41.880943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb7c5-30a3-45ee-bbab-4389def3ade1 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:42.097415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c83416-1542-48ca-b0ee-435d0af06d95 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:42.113579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:42.114270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:42.115194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:42.115377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles/1feb0b1a2da644e69f3b7ea39b709b2b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:42.117352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1feb0b1a2da644e69f3b7ea39b709b2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:42.121312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:42.142206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:42.143048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:42.143232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:42.143575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:42.151069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:42.174552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:42.176568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:42.208419 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2345/4692] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:42.271627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 1feb0b1a2da644e69f3b7ea39b709b2b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:42.272186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:42.273092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:42.275145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2348/4693] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:41 2022] DELETE /identity/v3/roles/1feb0b1a2da644e69f3b7ea39b709b2b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:42.283651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:42.288264 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:42.300808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a159389-99c6-4dac-897c-dbb035c75ba6 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:42.446650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:42.447297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:42.447590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:42.447888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:42.448774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:42.450967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:42.520463 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2346/4694] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:24:42 2022] POST /identity/v3/roles => generated 239 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:42.538670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:42.542048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:42.599189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba80338-b9cf-4976-bb07-e68653704711 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:42.641823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:42.643314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:42.643506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:42.643776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:42.644495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:42.647043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:42.722241 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2349/4695] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:42 2022] POST /identity/v3/projects => generated 409 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:42.726647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:42.747088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625c57-0832-4017-ba11-46658b6a2456 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:42.885351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:42.886137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:42.886519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:42.886858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/6c86cbf17d5148fbaf89b42f513be6ba/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:42.894015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5914754efb084a0a800e61b383c0ae09, user_id=035e62e3550a401f99497663314f4dba, role_id=6c86cbf17d5148fbaf89b42f513be6ba)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:42.899305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:42.932385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2347/4696] 10.222.0.16 () {60 vars in 1579 bytes} [Sun Sep 11 01:24:42 2022] PUT /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/6c86cbf17d5148fbaf89b42f513be6ba/inherited_to_projects => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:42.934494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:42.960036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ace0-74f8-4901-946b-bb5e79025592 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:43.014804 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:43.059593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:43.061200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:43.062599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:43.064398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:43.067744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Adding query filter params (scope.project.id=6e553c3b714c45ca9be53a17ba76b9c5, user.id=035e62e3550a401f99497663314f4dba) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:43.068344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:43.073339 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:43.073339 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:43.073339 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:43.083797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:43.245953 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2350/4697] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:24:42 2022] GET /identity/v3/role_assignments?scope.project.id=6e553c3b714c45ca9be53a17ba76b9c5&user.id=035e62e3550a401f99497663314f4dba&effective => generated 648 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:24:43.247155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:43.262562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87154a2-20f8-4840-975e-48ae4eb52597 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:43.273681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:43.274286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:43.274562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:43.274832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:43.275566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Adding query filter params (scope.project.id=bcdbf9ee54fe49159ee585adc111c81d, user.id=035e62e3550a401f99497663314f4dba) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:43.276534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:43.276869 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:43.276869 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:24:43.276869 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:24:43.278280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:43.438129 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2348/4698] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:24:43 2022] GET /identity/v3/role_assignments?scope.project.id=bcdbf9ee54fe49159ee585adc111c81d&user.id=035e62e3550a401f99497663314f4dba&effective => generated 648 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:24:43.439099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:43.454931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221da87-64b0-4463-a999-8fc1339d0d48 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:43.467724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:43.468705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:43.469207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:43.469645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/6c86cbf17d5148fbaf89b42f513be6ba/inherited_to_projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:43.474867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5914754efb084a0a800e61b383c0ae09, user_id=035e62e3550a401f99497663314f4dba, role_id=6c86cbf17d5148fbaf89b42f513be6ba)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:43.479953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:43.506307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 6c86cbf17d5148fbaf89b42f513be6ba was removed from user 035e62e3550a401f99497663314f4dba on domain 5914754efb084a0a800e61b383c0ae09. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:43.506307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:43.506307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:43.548290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:43.548745 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2351/4699] 10.222.0.16 () {58 vars in 1563 bytes} [Sun Sep 11 01:24:43 2022] DELETE /identity/v3/OS-INHERIT/domains/5914754efb084a0a800e61b383c0ae09/users/035e62e3550a401f99497663314f4dba/roles/6c86cbf17d5148fbaf89b42f513be6ba/inherited_to_projects => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:43.550337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:43.567126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e3726-1d57-4600-b442-4a974ff9a644 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:43.653124 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:43.701322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:43.701965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:43.702249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:43.702523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:43.703263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Adding query filter params (scope.project.id=6e553c3b714c45ca9be53a17ba76b9c5, user.id=035e62e3550a401f99497663314f4dba) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:43.703815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:43.705717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:43.933657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:43.934517 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2349/4700] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:24:43 2022] GET /identity/v3/role_assignments?scope.project.id=6e553c3b714c45ca9be53a17ba76b9c5&user.id=035e62e3550a401f99497663314f4dba&effective => generated 228 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:43.956697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba83f9-91d8-4e45-a7cf-cae1f3375996 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:43.969875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:43.970512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:43.970801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:43.971080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:43.971829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Adding query filter params (scope.project.id=bcdbf9ee54fe49159ee585adc111c81d, user.id=035e62e3550a401f99497663314f4dba) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:43.972140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:43.990570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:44.109641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:44.117223 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2352/4701] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:24:43 2022] GET /identity/v3/role_assignments?scope.project.id=bcdbf9ee54fe49159ee585adc111c81d&user.id=035e62e3550a401f99497663314f4dba&effective => generated 228 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:44.128488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed767188-5115-4b9e-b4dd-3c1a2623de87 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:44.142169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:44.142952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:44.143292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:44.143569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/projects/bcdbf9ee54fe49159ee585adc111c81d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:44.145197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bcdbf9ee54fe49159ee585adc111c81d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:44.147243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:44.262972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdbf9ee54fe49159ee585adc111c81d', 'request_id': 'req-7d161874-4259-4dcb-bfdb-e4d648a762a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:44.276832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdbf9ee54fe49159ee585adc111c81d', 'request_id': 'req-7d161874-4259-4dcb-bfdb-e4d648a762a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:44.326771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdbf9ee54fe49159ee585adc111c81d', 'request_id': 'req-7d161874-4259-4dcb-bfdb-e4d648a762a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:44.340792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] The token cache is being invalidate because project bcdbf9ee54fe49159ee585adc111c81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:44.341765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:44.342591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:44.345686 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2350/4702] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:44 2022] DELETE /identity/v3/projects/bcdbf9ee54fe49159ee585adc111c81d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:44.350155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:44.351568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:44.382191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf2677-3999-4488-a102-d717c2860edd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:44.595966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:44.596633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:44.596797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:44.597113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles/6c86cbf17d5148fbaf89b42f513be6ba` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:44.600082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6c86cbf17d5148fbaf89b42f513be6ba)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:44.604227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:44.664414 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:44.697213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 6c86cbf17d5148fbaf89b42f513be6ba has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:44.697534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:44.698285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:44.700408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2353/4703] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:44 2022] DELETE /identity/v3/roles/6c86cbf17d5148fbaf89b42f513be6ba => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:44.705656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:44.720551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d161874-4259-4dcb-bfdb-e4d648a762a6 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:44.891877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:44.892884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:44.893411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:44.893862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:44.895001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:44.900089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:44.935041 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2351/4704] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:24:44 2022] POST /identity/v3/roles => generated 239 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:44.938869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:44.940767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:44.970878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa84be2-4efb-45b4-8a78-9a74d8a43d8c tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:44.985431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:44.986432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:44.986918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:44.987479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:44.989081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:44.996710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:45.139573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2354/4705] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:44 2022] POST /identity/v3/projects => generated 409 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:45.143139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:45.165392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bffb94-fde7-4cd6-8623-4826a9c3262d tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:45.216995 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:45.408707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:45.411755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:45.412213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:45.412746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/2bf36a0da12a4de7b082cc93e324f0f3/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:45.417602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, user_id=035e62e3550a401f99497663314f4dba, role_id=2bf36a0da12a4de7b082cc93e324f0f3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:45.426446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:45.457368 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2352/4706] 10.222.0.16 () {60 vars in 1582 bytes} [Sun Sep 11 01:24:45 2022] PUT /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/2bf36a0da12a4de7b082cc93e324f0f3/inherited_to_projects => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:45.462382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:45.477649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e31527-d106-40dd-9e29-a586af42a5ad tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:45.762806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:45.764368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:45.764870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:45.766009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:45.766724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Adding query filter params (scope.project.id=e545d61e3b554de6930e1d994c1ffb91, user.id=035e62e3550a401f99497663314f4dba) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:45.767261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:45.770920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:45.906666 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2355/4707] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:24:45 2022] GET /identity/v3/role_assignments?scope.project.id=e545d61e3b554de6930e1d994c1ffb91&user.id=035e62e3550a401f99497663314f4dba&effective => generated 649 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:45.910806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:45.934345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841881e5-9b46-44de-ba0e-687bb3b78e2f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:45.957405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:45.958884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:45.959336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:45.960081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/2bf36a0da12a4de7b082cc93e324f0f3/inherited_to_projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:45.963806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6e553c3b714c45ca9be53a17ba76b9c5, user_id=035e62e3550a401f99497663314f4dba, role_id=2bf36a0da12a4de7b082cc93e324f0f3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:45.967880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:45.978472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 2bf36a0da12a4de7b082cc93e324f0f3 was removed from user 035e62e3550a401f99497663314f4dba on project 6e553c3b714c45ca9be53a17ba76b9c5. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:45.979941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:45.980848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:46.018482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:46.025296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:46.042310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2353/4708] 10.222.0.16 () {58 vars in 1566 bytes} [Sun Sep 11 01:24:45 2022] DELETE /identity/v3/OS-INHERIT/projects/6e553c3b714c45ca9be53a17ba76b9c5/users/035e62e3550a401f99497663314f4dba/roles/2bf36a0da12a4de7b082cc93e324f0f3/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:46.071363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386770a-6a2e-4dc4-86c5-11323aa8420f tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:46.281835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:46.282961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:46.283345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:46.283864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:46.285129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Adding query filter params (scope.project.id=e545d61e3b554de6930e1d994c1ffb91, user.id=035e62e3550a401f99497663314f4dba) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:46.286045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:46.291742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:46.343009 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:46.451446 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2356/4709] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:24:46 2022] GET /identity/v3/role_assignments?scope.project.id=e545d61e3b554de6930e1d994c1ffb91&user.id=035e62e3550a401f99497663314f4dba&effective => generated 228 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:46.455594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:46.467595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eff6a9-bf15-4799-8935-0b457aa6af90 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:46.473183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:46.473838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:46.474116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:46.474397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/projects/e545d61e3b554de6930e1d994c1ffb91` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:46.475571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e545d61e3b554de6930e1d994c1ffb91)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:46.477512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:46.602095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e545d61e3b554de6930e1d994c1ffb91', 'request_id': 'req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:46.621291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e545d61e3b554de6930e1d994c1ffb91', 'request_id': 'req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:46.644214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e545d61e3b554de6930e1d994c1ffb91', 'request_id': 'req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:46.667708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] The token cache is being invalidate because project e545d61e3b554de6930e1d994c1ffb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:46.668105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:46.673243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:46.675319 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2354/4710] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:46 2022] DELETE /identity/v3/projects/e545d61e3b554de6930e1d994c1ffb91 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:46.680935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:46.684137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:46.715427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c856a7b-dfef-4a89-8578-6d0bf0907a07 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:46.855026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:46.856507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:46.945262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:46.945990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:46.946206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:46.946484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/roles/2bf36a0da12a4de7b082cc93e324f0f3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:46.948909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2bf36a0da12a4de7b082cc93e324f0f3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:46.951429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:47.063573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149e4e-e8bd-4e38-abdb-1f8e5a291047 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:47.073444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invalidating the token cache because role 2bf36a0da12a4de7b082cc93e324f0f3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:47.073735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.074583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.077485 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2357/4711] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:46 2022] DELETE /identity/v3/roles/2bf36a0da12a4de7b082cc93e324f0f3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:47.082240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:47.082532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:47.084107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:47.085106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:47.085994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:47.086637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] PATH_INFO: `/v3/users/3a2307e88ac541b5a0caed598d3b4050` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:47.088382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2307e88ac541b5a0caed598d3b4050)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:47.097823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:47.147588 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:47.256830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2307e88ac541b5a0caed598d3b4050'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.259332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2307e88ac541b5a0caed598d3b4050'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.260989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2307e88ac541b5a0caed598d3b4050'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.286883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2307e88ac541b5a0caed598d3b4050'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.313770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ce67023c-d854-4fdb-9cb5-4f4abe09d250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2307e88ac541b5a0caed598d3b4050'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.323200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf0929-205b-4816-8009-f48932d79f74 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:47.347225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:47.347918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:47.348174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:47.348400 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2355/4712] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:46 2022] DELETE /identity/v3/users/3a2307e88ac541b5a0caed598d3b4050 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:47.348516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/users/035e62e3550a401f99497663314f4dba` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:47.349767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_user(user_id=035e62e3550a401f99497663314f4dba)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:47.352842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:47.353400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:47.355356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:47.355984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:47.428494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:47.430503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:47.471332 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:47.492571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035e62e3550a401f99497663314f4dba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.498277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035e62e3550a401f99497663314f4dba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.499126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035e62e3550a401f99497663314f4dba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.525374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035e62e3550a401f99497663314f4dba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.541594 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2356/4713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:47.542281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035e62e3550a401f99497663314f4dba'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:47.558501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:47.563018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:47.574456 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2358/4714] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:47 2022] DELETE /identity/v3/users/035e62e3550a401f99497663314f4dba => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:47.578965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:47.580434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:47.706664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120064a-bb6e-4f95-b15c-54a8f5abea5a tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:47.718856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:47.719228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:47.719954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:47.719954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/groups/281d5c1fd78d44fd902701295263b292` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:47.723317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_group(group_id=281d5c1fd78d44fd902701295263b292)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:47.733905 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:24:47.733905 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:24:47.733905 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:24:47.736138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:47.783761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e7241-099e-481a-b176-3e6a4801269a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:47.941821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:47.943220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:47.943792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:47.944275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:47.952381 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:47.963083 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2359/4715] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:24:47 2022] DELETE /identity/v3/groups/281d5c1fd78d44fd902701295263b292 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:47.964461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:48.051970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:48.057154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:48.099530 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2357/4716] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:48.204515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47675290-2225-4aaa-8f55-06c90baf7bfc tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:48.222306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:48.225315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:48.225605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:48.227507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/projects/6e553c3b714c45ca9be53a17ba76b9c5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:48.229830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e553c3b714c45ca9be53a17ba76b9c5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:48.237430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:48.312471 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:48.393220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e553c3b714c45ca9be53a17ba76b9c5', 'request_id': 'req-59af5580-1fa2-4d3e-8307-200101236931'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.407174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e553c3b714c45ca9be53a17ba76b9c5', 'request_id': 'req-59af5580-1fa2-4d3e-8307-200101236931'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.430556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e553c3b714c45ca9be53a17ba76b9c5', 'request_id': 'req-59af5580-1fa2-4d3e-8307-200101236931'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.463716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] The token cache is being invalidate because project 6e553c3b714c45ca9be53a17ba76b9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:48.464071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.464809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.471591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2360/4717] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:47 2022] DELETE /identity/v3/projects/6e553c3b714c45ca9be53a17ba76b9c5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:48.475216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:48.494035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993c8b-344b-4562-891d-8f286a6bd398 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:48.681769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:48.682420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:48.682783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:48.682974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/domains/5914754efb084a0a800e61b383c0ae09` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:48.688039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5914754efb084a0a800e61b383c0ae09)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:48.691728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:48.728947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5914754efb084a0a800e61b383c0ae09'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.729686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5914754efb084a0a800e61b383c0ae09'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.788486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5914754efb084a0a800e61b383c0ae09'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.790853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5914754efb084a0a800e61b383c0ae09'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:48.795511 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2358/4718] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:24:48 2022] PATCH /identity/v3/domains/5914754efb084a0a800e61b383c0ae09 => generated 278 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:24:48.799699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:48.802063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:48.826780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af5580-1fa2-4d3e-8307-200101236931 tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:48.970238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f2c66d3ab74d6abbff2d95b1e7fe79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c59c99acd51407cb68f351875eb4bc6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:48.970895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:48.971163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:48.971431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] PATH_INFO: `/v3/domains/5914754efb084a0a800e61b383c0ae09` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:48.990175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5914754efb084a0a800e61b383c0ae09)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:48.992269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:49.026637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5914754efb084a0a800e61b383c0ae09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.036873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:49.039317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:49.078157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5914754efb084a0a800e61b383c0ae09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.159132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5914754efb084a0a800e61b383c0ae09', 'request_id': 'req-8584c019-b010-4d0d-bb74-ad42c614f58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.189722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5914754efb084a0a800e61b383c0ae09', 'request_id': 'req-8584c019-b010-4d0d-bb74-ad42c614f58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.207338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5914754efb084a0a800e61b383c0ae09', 'request_id': 'req-8584c019-b010-4d0d-bb74-ad42c614f58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.256683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] The token cache is being invalidate because project 5914754efb084a0a800e61b383c0ae09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:49.256973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.257883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.276066 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:49.283180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964c994-338e-4c96-9791-4eb89deeecdd tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:49.286565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5914754efb084a0a800e61b383c0ae09', 'request_id': 'req-8584c019-b010-4d0d-bb74-ad42c614f58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.288353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5914754efb084a0a800e61b383c0ae09', 'request_id': 'req-8584c019-b010-4d0d-bb74-ad42c614f58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.290811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5914754efb084a0a800e61b383c0ae09', 'request_id': 'req-8584c019-b010-4d0d-bb74-ad42c614f58b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.305758 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:49.314021 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2361/4719] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:24:48 2022] DELETE /identity/v3/domains/5914754efb084a0a800e61b383c0ae09 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:49.320771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:49.325173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:49.431657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:49.432637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:49.433081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:49.433640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] PATH_INFO: `/v3/projects/b22a9de82e42430184ca586d3bf68050` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:49.437843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22a9de82e42430184ca586d3bf68050)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:49.439948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:49.484020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584c019-b010-4d0d-bb74-ad42c614f58b tempest-InheritsV3TestJSON-1015472296 tempest-InheritsV3TestJSON-1015472296-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:49.524655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:49.525258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:49.532355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:49.532804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] PATH_INFO: `/v3/users/397aad5d1fe049e8b1066bfe4fd36dce` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:49.535330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397aad5d1fe049e8b1066bfe4fd36dce)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:49.537317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:49.553379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22a9de82e42430184ca586d3bf68050', 'request_id': 'req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.567043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22a9de82e42430184ca586d3bf68050', 'request_id': 'req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.586732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22a9de82e42430184ca586d3bf68050', 'request_id': 'req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.611404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] The token cache is being invalidate because project b22a9de82e42430184ca586d3bf68050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:49.611697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.612455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4fcfe3b2-5201-4d50-9a1d-bfd240cdf2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.620698 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2359/4720] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:49 2022] DELETE /identity/v3/projects/b22a9de82e42430184ca586d3bf68050 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:49.627862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7398e1-0a1b-4b2f-9624-35accfdbae98 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:49.628314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7398e1-0a1b-4b2f-9624-35accfdbae98 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:49.628426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7398e1-0a1b-4b2f-9624-35accfdbae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:49.648941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397aad5d1fe049e8b1066bfe4fd36dce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.650035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397aad5d1fe049e8b1066bfe4fd36dce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.650759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397aad5d1fe049e8b1066bfe4fd36dce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.666261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1f7398e1-0a1b-4b2f-9624-35accfdbae98 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:49.667488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1f7398e1-0a1b-4b2f-9624-35accfdbae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:49.671481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397aad5d1fe049e8b1066bfe4fd36dce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.680796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-883f9ba5-fa52-4ab4-bb85-ecbebae5d394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397aad5d1fe049e8b1066bfe4fd36dce'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:49.717197 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2362/4721] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:49 2022] DELETE /identity/v3/users/397aad5d1fe049e8b1066bfe4fd36dce => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:49.719728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:49.720029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:49.720309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:49.759033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2360/4722] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:49.760487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2022-96cc-4472-ada1-ee65d7d1c12a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:49.760769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2022-96cc-4472-ada1-ee65d7d1c12a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:49.761041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2022-96cc-4472-ada1-ee65d7d1c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:49.786334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-869b2022-96cc-4472-ada1-ee65d7d1c12a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:49.787549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-869b2022-96cc-4472-ada1-ee65d7d1c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:49.800958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:49.802491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:49.875040 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:49.929033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2361/4723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:49.929994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b2022-96cc-4472-ada1-ee65d7d1c12a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:49.956905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b2022-96cc-4472-ada1-ee65d7d1c12a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:49.967086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:49.967844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:49.968120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:49.968384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:49.969821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:49.969821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:49.971447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:49.979919 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2363/4724] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:49.991267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:49.993540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:50.002745 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:50.012285 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2362/4725] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:50.018970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:50.049508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73be88b-919e-48c6-90ed-b6a0fffd7aea admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:50.116483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:50.116483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.116483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.116483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.116849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:50.116849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:50.153149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d079-336a-4905-9baa-73c46b4ec931 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:50.172737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2363/4726] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:50 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:50.173305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:50.174186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.174466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.174732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.177384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:50.196808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:50.201342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:50.272175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce7758-211d-4872-b9c2-b8ba9e763427 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:50.279205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:50.279837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.280113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.280387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.281025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:50.282704 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2364/4727] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:24:50.283143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:50.319958 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2364/4728] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:50 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:50.322908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:50.352169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8090-e772-4236-b718-4afb75bf21d7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:50.380949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:50.385952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.386241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.386521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.387189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:50.401898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:50.464085 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2365/4729] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:50.465737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:50.482495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2b654-008a-4651-bf94-f27cc50fb614 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:50.498025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e34bc-9876-49bf-b144-c60325155e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:50.498662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e34bc-9876-49bf-b144-c60325155e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.498938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e34bc-9876-49bf-b144-c60325155e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.499204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e34bc-9876-49bf-b144-c60325155e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.500571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e34bc-9876-49bf-b144-c60325155e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:50.505702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e34bc-9876-49bf-b144-c60325155e30 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:50.529639 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2365/4730] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:50.533975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:50.550865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72254c8a-9523-427f-8d7c-3e6579dfd235 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:50.561421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:50.562260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.562535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.562806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] PATH_INFO: `/v3/projects/d2d5a61641514a45b567202ad2bc75f7/users/8b1dfbbafa304ec6958dcbdd6e847ac9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.600490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d5a61641514a45b567202ad2bc75f7, user_id=8b1dfbbafa304ec6958dcbdd6e847ac9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:50.604061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:50.632092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2366/4731] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:50 2022] PUT /identity/v3/projects/d2d5a61641514a45b567202ad2bc75f7/users/8b1dfbbafa304ec6958dcbdd6e847ac9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:50.639438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.639438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.639438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.693631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:50.694869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:50.858110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:50.860341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:50.872921 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2366/4732] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:50.896408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c132c79-4ece-42aa-8e6e-ca502ace3185 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:50.899153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:50.900637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:50.923028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:50.923686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:50.923962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:50.924231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] PATH_INFO: `/v3/projects/4082eb7c84d84597a92bd6f1dbc0751f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:50.933924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4082eb7c84d84597a92bd6f1dbc0751f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:50.936676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:50.974655 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:51.032424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fc2e2-ea1c-493a-b37b-14836e92f0bb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:51.037799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:51.040725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:51.041274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:51.042036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:51.067975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:51.071505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:51.080155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4082eb7c84d84597a92bd6f1dbc0751f', 'request_id': 'req-5ea96890-a6b3-459d-b734-0fc5937b3fb6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.089254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2367/4733] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:24:51.090712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4082eb7c84d84597a92bd6f1dbc0751f', 'request_id': 'req-5ea96890-a6b3-459d-b734-0fc5937b3fb6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.105748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4082eb7c84d84597a92bd6f1dbc0751f', 'request_id': 'req-5ea96890-a6b3-459d-b734-0fc5937b3fb6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.131499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] The token cache is being invalidate because project 4082eb7c84d84597a92bd6f1dbc0751f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:51.131865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.132600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.137405 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2367/4734] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:50 2022] DELETE /identity/v3/projects/4082eb7c84d84597a92bd6f1dbc0751f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:51.141942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:51.169278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248857d0-5dac-44d4-bd02-164c5d3680b1 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:51.334940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:51.335825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:51.336161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:51.336444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] PATH_INFO: `/v3/users/a0f2c66d3ab74d6abbff2d95b1e7fe79` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:51.337859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f2c66d3ab74d6abbff2d95b1e7fe79)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:51.342576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:51.504936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f2c66d3ab74d6abbff2d95b1e7fe79'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.509655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f2c66d3ab74d6abbff2d95b1e7fe79'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.510519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f2c66d3ab74d6abbff2d95b1e7fe79'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.529928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f2c66d3ab74d6abbff2d95b1e7fe79'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.564657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6dd96ca7-fddb-4436-af36-a98adfb5b7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f2c66d3ab74d6abbff2d95b1e7fe79'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:51.596130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2368/4735] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:51 2022] DELETE /identity/v3/users/a0f2c66d3ab74d6abbff2d95b1e7fe79 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:52.809165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:52.810689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:52.838569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea96890-a6b3-459d-b734-0fc5937b3fb6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:52.990244 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:53.001750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:53.002804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.003405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.004040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] PATH_INFO: `/v3/projects/1c59c99acd51407cb68f351875eb4bc6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.006313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c59c99acd51407cb68f351875eb4bc6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:53.008451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:53.095551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c59c99acd51407cb68f351875eb4bc6', 'request_id': 'req-111fe653-9315-4ed0-863e-3b7876a111f4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:53.111313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c59c99acd51407cb68f351875eb4bc6', 'request_id': 'req-111fe653-9315-4ed0-863e-3b7876a111f4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:53.121519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c59c99acd51407cb68f351875eb4bc6', 'request_id': 'req-111fe653-9315-4ed0-863e-3b7876a111f4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:53.154417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] The token cache is being invalidate because project 1c59c99acd51407cb68f351875eb4bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:53.156713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:53.160469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-111fe653-9315-4ed0-863e-3b7876a111f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:53.167874 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2368/4736] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:52 2022] DELETE /identity/v3/projects/1c59c99acd51407cb68f351875eb4bc6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:53.170341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbda1d-5554-4267-b8e0-10b48211e7ca None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.170808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbda1d-5554-4267-b8e0-10b48211e7ca None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.170918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbda1d-5554-4267-b8e0-10b48211e7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.194682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b4fbda1d-5554-4267-b8e0-10b48211e7ca None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:53.195943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b4fbda1d-5554-4267-b8e0-10b48211e7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:53.297840 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:53.334525 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2369/4737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:53.337209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c161aa-2b23-4fd8-9d90-99bf515e7f83 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.337496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c161aa-2b23-4fd8-9d90-99bf515e7f83 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.338059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c161aa-2b23-4fd8-9d90-99bf515e7f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.369040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b4c161aa-2b23-4fd8-9d90-99bf515e7f83 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:53.371540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b4c161aa-2b23-4fd8-9d90-99bf515e7f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:53.383719 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2369/4738] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:53.388741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbda1d-5554-4267-b8e0-10b48211e7ca None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:53.399713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbda1d-5554-4267-b8e0-10b48211e7ca None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:53.410022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:53.410674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.411020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.411357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.412085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:24:53.412785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:53.414104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:53.447436 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2370/4739] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:24:53.448691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c161aa-2b23-4fd8-9d90-99bf515e7f83 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:53.468461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c161aa-2b23-4fd8-9d90-99bf515e7f83 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:53.483642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:53.484811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.487210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.487931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.488882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:53.493473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:53.569153 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2370/4740] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:53 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:53.573043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:53.589784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc787e0-9d0b-4e5b-a139-bccfc97b78e7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:53.678484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:53.679199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.679684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.680067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.681007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:53.683387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:53.715828 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2371/4741] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:53 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:53.719897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:53.734843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ba84-187b-410e-8639-d0c50afeddec admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:53.740188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:53.740875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.741178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.741451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.742093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:53.743687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:53.760271 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2371/4742] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:53.761850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:53.804583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7ff1c-7f74-42a9-9ca2-9890ee764ed4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:53.820884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b227-fabc-4935-a7f9-e53be15e1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:53.822211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b227-fabc-4935-a7f9-e53be15e1e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.823075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b227-fabc-4935-a7f9-e53be15e1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.824245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b227-fabc-4935-a7f9-e53be15e1e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.825054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4b227-fabc-4935-a7f9-e53be15e1e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:53.830885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4b227-fabc-4935-a7f9-e53be15e1e94 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:53.862766 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2372/4743] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:24:53.865820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:53.880803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c26a6b-6369-42a7-afb6-96b7ce9c97c8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:53.897825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:53.905397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:53.906031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:53.906475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] PATH_INFO: `/v3/projects/5295d4c716ce4d91bfe33d18e85bd896/users/ed1388a52fbf4e259d8f3279502d3eff/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:53.949181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5295d4c716ce4d91bfe33d18e85bd896, user_id=ed1388a52fbf4e259d8f3279502d3eff, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:53.953095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:54.008764 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2372/4744] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:53 2022] PUT /identity/v3/projects/5295d4c716ce4d91bfe33d18e85bd896/users/ed1388a52fbf4e259d8f3279502d3eff/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:54.022546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba2df-ad7f-43d9-804c-d9818f5d3f79 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:54.023056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba2df-ad7f-43d9-804c-d9818f5d3f79 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:54.023562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba2df-ad7f-43d9-804c-d9818f5d3f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:54.091953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-180ba2df-ad7f-43d9-804c-d9818f5d3f79 None None] MFA Rules not processed for user `ed1388a52fbf4e259d8f3279502d3eff`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:54.098452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-180ba2df-ad7f-43d9-804c-d9818f5d3f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:54.291796 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2373/4745] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:54.293036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:54.485481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38d81e-42ba-4325-9e75-4f54f859cfbe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:54.535607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:54.538642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:54.539053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:54.542859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:54.544782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:54.554217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:54.628950 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2373/4746] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:54 2022] POST /identity/v3/projects => generated 385 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:24:54.633755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba2df-ad7f-43d9-804c-d9818f5d3f79 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:54.653151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba2df-ad7f-43d9-804c-d9818f5d3f79 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:54.811067 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:54.839471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:54.840528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:54.842048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:54.842342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:54.846157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:54.848591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:54.898373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:54.899615 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2374/4747] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:24:54 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:54.948634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18e4ed-79c1-40c4-9c23-a84c6ce4a2a1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:54.968910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:54.972740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:54.974851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:54.975725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:54.987424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:54.990968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:55.002380 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:55.039319 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2374/4748] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:24:55.042258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:55.059369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d0712-c182-45d0-8868-58114103d226 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:55.074769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:55.076008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:55.076278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:55.076544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] PATH_INFO: `/v3/projects/ce4f48ac0dc64f4eb0640deec7801821/users/4d2a045ed9264c21859bf856c0c2fa29/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:55.111527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4f48ac0dc64f4eb0640deec7801821, user_id=4d2a045ed9264c21859bf856c0c2fa29, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:55.114266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:55.154526 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2375/4749] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:55 2022] PUT /identity/v3/projects/ce4f48ac0dc64f4eb0640deec7801821/users/4d2a045ed9264c21859bf856c0c2fa29/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:55.156191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:55.172381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd607b-30a8-4cf4-b5fb-3211a071e58b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:55.320215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b58a1-699b-45d0-8cec-cc445526cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:55.320989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b58a1-699b-45d0-8cec-cc445526cd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:55.321319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b58a1-699b-45d0-8cec-cc445526cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:55.321593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b58a1-699b-45d0-8cec-cc445526cd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:55.322247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b58a1-699b-45d0-8cec-cc445526cd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:55.323864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b58a1-699b-45d0-8cec-cc445526cd4d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:55.353024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2375/4750] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:24:55.355116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:55.374638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9971fa-3f3a-4c07-aa8d-4b1da581c694 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:55.380549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:55.381428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:55.381862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:55.382229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] PATH_INFO: `/v3/projects/ce4f48ac0dc64f4eb0640deec7801821/users/4d2a045ed9264c21859bf856c0c2fa29/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:55.384978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4f48ac0dc64f4eb0640deec7801821, user_id=4d2a045ed9264c21859bf856c0c2fa29, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:55.389416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:55.402829 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2376/4751] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:24:55 2022] PUT /identity/v3/projects/ce4f48ac0dc64f4eb0640deec7801821/users/4d2a045ed9264c21859bf856c0c2fa29/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:55.514999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526a47-0468-4582-a510-1726eda46e72 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:55.515331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526a47-0468-4582-a510-1726eda46e72 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:55.515559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526a47-0468-4582-a510-1726eda46e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:55.581239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bc526a47-0468-4582-a510-1726eda46e72 None None] MFA Rules not processed for user `4d2a045ed9264c21859bf856c0c2fa29`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:55.585414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bc526a47-0468-4582-a510-1726eda46e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:55.811314 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2376/4752] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:55.813035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:55.828839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ece34-3d17-41f5-8b3a-49571b697364 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:55.844434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2a045ed9264c21859bf856c0c2fa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce4f48ac0dc64f4eb0640deec7801821', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:55.845109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:55.845396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:55.845695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:55.846335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:55.848243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:55.949547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526a47-0468-4582-a510-1726eda46e72 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:55.952421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2377/4753] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:24:55 2022] POST /identity/v3/projects => generated 359 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:24:56.079955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526a47-0468-4582-a510-1726eda46e72 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:56.125987 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:56.177601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed1388a52fbf4e259d8f3279502d3eff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5295d4c716ce4d91bfe33d18e85bd896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:56.179264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:56.179516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:56.180055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] PATH_INFO: `/v3/projects/dd885013affd47e49a051cae940b35fd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:56.182343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] RBAC: Authorizing `identity:delete_project(project_id=dd885013affd47e49a051cae940b35fd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Sep 11 01:24:56.195416 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 11 01:24:56.196562 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:24:56.199086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2377/4754] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:55 2022] DELETE /identity/v3/projects/dd885013affd47e49a051cae940b35fd => generated 136 bytes in 250 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:24:56.203868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:56.290291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc8b7c-0196-4d90-b327-6ce99c39ddcd tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:56.297560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2a045ed9264c21859bf856c0c2fa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce4f48ac0dc64f4eb0640deec7801821', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:56.299268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:56.299955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:56.300642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] PATH_INFO: `/v3/projects/dd885013affd47e49a051cae940b35fd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:56.302282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd885013affd47e49a051cae940b35fd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:56.305247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:56.370474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd885013affd47e49a051cae940b35fd', 'request_id': 'req-764245f3-b8f0-4b44-ba87-36e51a435b1e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.379522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd885013affd47e49a051cae940b35fd', 'request_id': 'req-764245f3-b8f0-4b44-ba87-36e51a435b1e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.391306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd885013affd47e49a051cae940b35fd', 'request_id': 'req-764245f3-b8f0-4b44-ba87-36e51a435b1e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.407393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] The token cache is being invalidate because project dd885013affd47e49a051cae940b35fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:56.407936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.408949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-764245f3-b8f0-4b44-ba87-36e51a435b1e tempest-ProjectsNegativeTestJSON-1040844559 tempest-ProjectsNegativeTestJSON-1040844559-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.416139 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2378/4755] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:56 2022] DELETE /identity/v3/projects/dd885013affd47e49a051cae940b35fd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:56.422453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:56.424881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:56.537483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99934-d841-4cae-bb81-fdbcdf2ca393 tempest-ProjectsNegativeTestJSON-1260309069 tempest-ProjectsNegativeTestJSON-1260309069-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:56.634030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:56.634690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:56.634966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:56.635256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] PATH_INFO: `/v3/users/ed1388a52fbf4e259d8f3279502d3eff` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:56.637577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1388a52fbf4e259d8f3279502d3eff)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:56.640700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:56.754280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1388a52fbf4e259d8f3279502d3eff'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.755415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1388a52fbf4e259d8f3279502d3eff'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.756409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1388a52fbf4e259d8f3279502d3eff'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.804209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1388a52fbf4e259d8f3279502d3eff'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.817230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1388a52fbf4e259d8f3279502d3eff'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:56.846055 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2378/4756] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:56 2022] DELETE /identity/v3/users/ed1388a52fbf4e259d8f3279502d3eff => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:24:56.851148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:56.851645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:56.851645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:56.877552 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:56.887138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:24:56.890967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:57.016385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2379/4757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:24:57.079584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:57.081199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:57.106852 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:57.222898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6aa6d-28de-498e-8141-d946b5e61c9c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:57.233510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:57.234223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:57.234576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:57.235151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:57.269038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:57.272886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:57.331769 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2379/4758] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:24:58.663841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:58.665519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:58.700722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bfa8e-bc18-4c95-918e-9cd847834248 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:58.717913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:58.718888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:58.719351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:58.719794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] PATH_INFO: `/v3/projects/5295d4c716ce4d91bfe33d18e85bd896` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:58.724936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5295d4c716ce4d91bfe33d18e85bd896)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:58.727261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:58.838590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5295d4c716ce4d91bfe33d18e85bd896', 'request_id': 'req-d68aa917-68ab-4497-ab21-17d0b946ccec'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:58.847167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5295d4c716ce4d91bfe33d18e85bd896', 'request_id': 'req-d68aa917-68ab-4497-ab21-17d0b946ccec'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:58.862676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5295d4c716ce4d91bfe33d18e85bd896', 'request_id': 'req-d68aa917-68ab-4497-ab21-17d0b946ccec'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:58.878196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] The token cache is being invalidate because project 5295d4c716ce4d91bfe33d18e85bd896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:24:58.878830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:58.880008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:58.882509 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2380/4759] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:24:58 2022] DELETE /identity/v3/projects/5295d4c716ce4d91bfe33d18e85bd896 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:58.887317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:58.904684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471fd1-2c3b-4b23-b1a0-56778b6657b9 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:59.047483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:59.048582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:59.049146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:59.049685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] PATH_INFO: `/v3/users/4d2a045ed9264c21859bf856c0c2fa29` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:59.052509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2a045ed9264c21859bf856c0c2fa29)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:59.058277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:59.165910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2a045ed9264c21859bf856c0c2fa29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:59.166996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2a045ed9264c21859bf856c0c2fa29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:59.167971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2a045ed9264c21859bf856c0c2fa29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:59.210125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2a045ed9264c21859bf856c0c2fa29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:59.252851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2a045ed9264c21859bf856c0c2fa29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:24:59.279100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2380/4760] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:24:58 2022] DELETE /identity/v3/users/4d2a045ed9264c21859bf856c0c2fa29 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:24:59.439538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:24:59.441121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:59.578351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aa917-68ab-4497-ab21-17d0b946ccec admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:24:59.693841 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:24:59.707595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:24:59.708498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:24:59.708930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:24:59.709372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:24:59.712506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:24:59.734358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:24:59.736066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:24:59.766606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2381/4761] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:00.052660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:00.056053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:00.126073 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:00.272269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270d50-3aec-46f8-8565-02840d10cf4c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:00.278035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51ce7c-80e2-4034-a08b-1d74c08124c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:00.280216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ce7c-80e2-4034-a08b-1d74c08124c5 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:00.280708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ce7c-80e2-4034-a08b-1d74c08124c5 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:00.281215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ce7c-80e2-4034-a08b-1d74c08124c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:00.284800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-de51ce7c-80e2-4034-a08b-1d74c08124c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:00.581923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51ce7c-80e2-4034-a08b-1d74c08124c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:00.584981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51ce7c-80e2-4034-a08b-1d74c08124c5 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:00.639029 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2381/4762] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:00.825599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:00.827800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:00.847962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ddc22-3c6b-4671-a6cb-8b74cf5d078a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:00.861238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:00.862208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:00.862672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:00.863128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:00.870625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:00.899863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:00.906626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:00.920684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399ea8-64f2-4d01-b150-2cc6e33e1ccc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:00.920916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399ea8-64f2-4d01-b150-2cc6e33e1ccc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:00.921129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399ea8-64f2-4d01-b150-2cc6e33e1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:00.971152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2382/4763] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:00.972568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:00.978677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.049033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5b399ea8-64f2-4d01-b150-2cc6e33e1ccc None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:01.067168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5b399ea8-64f2-4d01-b150-2cc6e33e1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.227392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5013c-d50a-473b-9fc9-59eac7588010 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:01.238321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:01.238982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.239267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.239548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] PATH_INFO: `/v3/projects/ce4f48ac0dc64f4eb0640deec7801821` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.240394 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2382/4764] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:01.241317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4f48ac0dc64f4eb0640deec7801821)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:01.243571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:01.249337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.249641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.249897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.282962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:01.284520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.301742 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2383/4765] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:01.347958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4f48ac0dc64f4eb0640deec7801821', 'request_id': 'req-6bbfb362-472f-421c-8d53-4b6df9ef7594'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:01.369966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4f48ac0dc64f4eb0640deec7801821', 'request_id': 'req-6bbfb362-472f-421c-8d53-4b6df9ef7594'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:01.411212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4f48ac0dc64f4eb0640deec7801821', 'request_id': 'req-6bbfb362-472f-421c-8d53-4b6df9ef7594'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:01.447845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:01.450663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.468607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] The token cache is being invalidate because project ce4f48ac0dc64f4eb0640deec7801821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:01.472764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:01.475797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bbfb362-472f-421c-8d53-4b6df9ef7594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:01.478752 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2383/4766] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:00 2022] DELETE /identity/v3/projects/ce4f48ac0dc64f4eb0640deec7801821 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:01.487513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c986137-f337-49fd-ab90-26374edd08d2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.489331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c986137-f337-49fd-ab90-26374edd08d2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.491518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c986137-f337-49fd-ab90-26374edd08d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.521768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbc82-2afe-4784-8ddf-d80d310372cb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:01.582260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2c986137-f337-49fd-ab90-26374edd08d2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:01.584290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c986137-f337-49fd-ab90-26374edd08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.646404 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:01.738950 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2384/4767] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:01.740663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701032d-e36e-49b8-9ca5-65f915a05eb9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.741197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701032d-e36e-49b8-9ca5-65f915a05eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.741676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701032d-e36e-49b8-9ca5-65f915a05eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.756442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:01.760387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.760628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.766058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.769208 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:01.772362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.802881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8701032d-e36e-49b8-9ca5-65f915a05eb9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:01.804864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8701032d-e36e-49b8-9ca5-65f915a05eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.816877 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2385/4768] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:01.824443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a2ef6-9e97-4ff0-84a3-9f3013822e38 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.825165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a2ef6-9e97-4ff0-84a3-9f3013822e38 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.826390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a2ef6-9e97-4ff0-84a3-9f3013822e38 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.828702 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2386/4769] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 11 01:25:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:25:01.830573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a2ef6-9e97-4ff0-84a3-9f3013822e38 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:01.849184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a2ef6-9e97-4ff0-84a3-9f3013822e38 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:01.865929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bf0e5-72f2-4b1f-9dfc-b9c822b1a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:01.866556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bf0e5-72f2-4b1f-9dfc-b9c822b1a960 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.866833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bf0e5-72f2-4b1f-9dfc-b9c822b1a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.868204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bf0e5-72f2-4b1f-9dfc-b9c822b1a960 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.869098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bf0e5-72f2-4b1f-9dfc-b9c822b1a960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:01.872916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bf0e5-72f2-4b1f-9dfc-b9c822b1a960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:01.879633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bf0e5-72f2-4b1f-9dfc-b9c822b1a960 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:01.885728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:01.889986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:01.897317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2387/4770] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:01.897317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.897317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.897317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.906878 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2384/4771] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:01.908179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:01.921934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7380e1-8c9f-42d0-b8ac-61c8429892da service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:01.927505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:01.929872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:01.930372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:01.930866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:01.931704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:01.934017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:01.995412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:01.996773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:01.997738 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2385/4772] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:01 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:01.998806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:02.106261 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2388/4773] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:02.118049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f014c64-042a-4927-ab53-4805b1c1b21e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:02.124136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:02.124752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:02.125027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:02.125342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:02.125972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:02.127882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:02.152740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:02.155147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:02.174461 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2386/4774] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:01 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:02.176553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:02.207773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c2346-8185-47a9-bdb1-853e1c71b320 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:02.223118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:02.223751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:02.224026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:02.225155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:02.229420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:02.231795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:02.252586 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2387/4775] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:02.253538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:02.277480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2208f2-fde9-4746-b36b-8281c5fc43e0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:02.287673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:02.288304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:02.288665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:02.288926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:02.290099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:02.291718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22949e6-29f4-4717-87b2-c5970ca0b08c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:02.292040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:02.296319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046bd29-70de-4a1b-aa93-cc82bdf3efd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:02.297598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bd29-70de-4a1b-aa93-cc82bdf3efd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:02.297777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bd29-70de-4a1b-aa93-cc82bdf3efd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:02.298053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046bd29-70de-4a1b-aa93-cc82bdf3efd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:02.319700 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2388/4776] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:02.320739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:02.330004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046bd29-70de-4a1b-aa93-cc82bdf3efd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:02.332072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046bd29-70de-4a1b-aa93-cc82bdf3efd9 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:02.342320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676cee0-8361-4829-a59a-4fcac859a80c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:02.350058 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2389/4777] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:02.361136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:02.362113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:02.362585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:02.362988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] PATH_INFO: `/v3/projects/c0f355759afe4f4f93110c5cd47466ea/users/4cace4b890fe460f86390dce38452b17/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:02.392812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f355759afe4f4f93110c5cd47466ea, user_id=4cace4b890fe460f86390dce38452b17, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:02.395990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:02.415168 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:02.426556 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2389/4778] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:02 2022] PUT /identity/v3/projects/c0f355759afe4f4f93110c5cd47466ea/users/4cace4b890fe460f86390dce38452b17/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:02.439647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8012d-0553-4bfd-b305-5d864075e24f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:02.440009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8012d-0553-4bfd-b305-5d864075e24f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:02.440302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8012d-0553-4bfd-b305-5d864075e24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:02.514270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e1c8012d-0553-4bfd-b305-5d864075e24f None None] MFA Rules not processed for user `4cace4b890fe460f86390dce38452b17`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:02.515584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e1c8012d-0553-4bfd-b305-5d864075e24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:02.653813 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:02.663668 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2390/4779] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:02.665088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:02.845509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457217a5-c798-49cd-b400-81eb2a1046c0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:02.863109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:02.863703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:02.864003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:02.864274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:02.864905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:02.866856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:02.918026 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2390/4780] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:02 2022] POST /identity/v3/projects => generated 367 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:02.922380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8012d-0553-4bfd-b305-5d864075e24f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:02.936094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8012d-0553-4bfd-b305-5d864075e24f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:03.061207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:03.062078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:03.062481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:03.062856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:03.063796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:03.065939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:03.106981 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2391/4781] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:02 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:03.108680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:03.123982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea7693-77f7-4fb7-808e-11a72d84cd8a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:03.134790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:03.136467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:03.136806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:03.137429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:03.140992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:03.143473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:03.164510 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2391/4782] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:03.177177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:03.194473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97ba3b-f0ae-473d-bdb5-dcb929b53657 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:03.206902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:03.208050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:03.208542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:03.209023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] PATH_INFO: `/v3/projects/24dbe11e0c364f5fa481385b016394b5/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:03.230374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dbe11e0c364f5fa481385b016394b5, user_id=f845fdfe452645c98ca5ff9d34e4f7d6, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:03.234239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:03.263302 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2392/4783] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:03 2022] PUT /identity/v3/projects/24dbe11e0c364f5fa481385b016394b5/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:03.264885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:03.278690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a1a2b-4653-4296-9827-30d74b9567de admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:03.362339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:03.394098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:03.394729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:03.395014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:03.395291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:03.397749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:03.399370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:03.429247 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2392/4784] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:03.435617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:03.472914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977b10-10ea-4fe5-ada7-47223ab5ce88 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:03.503471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32c69a-e410-4142-9de6-74aa8ff28728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:03.505680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32c69a-e410-4142-9de6-74aa8ff28728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:03.505980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32c69a-e410-4142-9de6-74aa8ff28728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:03.506414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32c69a-e410-4142-9de6-74aa8ff28728 admin admin] PATH_INFO: `/v3/projects/24dbe11e0c364f5fa481385b016394b5/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:03.508716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32c69a-e410-4142-9de6-74aa8ff28728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dbe11e0c364f5fa481385b016394b5, user_id=f845fdfe452645c98ca5ff9d34e4f7d6, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:03.525177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32c69a-e410-4142-9de6-74aa8ff28728 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:03.551854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe8e0-6bea-4aab-ae79-fb7dc6842164 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:03.581883 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2393/4785] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:03 2022] PUT /identity/v3/projects/24dbe11e0c364f5fa481385b016394b5/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:03.592482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1e67f-ebe8-4f87-b972-b053513dbcf8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:03.592775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1e67f-ebe8-4f87-b972-b053513dbcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:03.593484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1e67f-ebe8-4f87-b972-b053513dbcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:03.690439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:03.691010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:03.691292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:03.691567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:03.700274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:03.709707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e3d1e67f-ebe8-4f87-b972-b053513dbcf8 None None] MFA Rules not processed for user `f845fdfe452645c98ca5ff9d34e4f7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:03.713650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e3d1e67f-ebe8-4f87-b972-b053513dbcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:03.736120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:03.737625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:03.792641 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2393/4786] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:03.861951 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:03.928217 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2394/4787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:03.932299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:03.987928 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:04.077374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874452c-474e-4750-8377-3107b4c28c45 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:04.096363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:04.097213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:04.097791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:04.098243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:04.099276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:04.107039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:04.163354 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2394/4788] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:03 2022] POST /identity/v3/projects => generated 369 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:04.168395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1e67f-ebe8-4f87-b972-b053513dbcf8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:04.218247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1e67f-ebe8-4f87-b972-b053513dbcf8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:04.347532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:04.348414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:04.349018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:04.349524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:04.350825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:04.353137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:04.407384 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2395/4789] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:04 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:04.408445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:04.424181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89d28-9939-4185-bc98-e622487167d7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:04.430150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:04.431029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:04.431805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:04.432269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:04.433151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:04.435842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:04.452020 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2395/4790] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:04.455737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:04.466815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa121-21f7-4464-a215-136a08e043a1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:04.472237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492886b-4b9d-49c8-8757-a2b1a3436ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:04.472994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492886b-4b9d-49c8-8757-a2b1a3436ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:04.473312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492886b-4b9d-49c8-8757-a2b1a3436ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:04.473580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492886b-4b9d-49c8-8757-a2b1a3436ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:04.474216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492886b-4b9d-49c8-8757-a2b1a3436ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:04.475923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492886b-4b9d-49c8-8757-a2b1a3436ce0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:04.491990 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2396/4791] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:04.492995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:04.512086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f8161-ae6a-4b5b-ab41-3a74cd7012ec admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:04.540618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:04.541345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:04.544245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:04.544412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] PATH_INFO: `/v3/projects/094e892b51ad4329a2d6dca214f4f899/users/c066bb76b20548f3a3307e5754720108/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:04.583964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=094e892b51ad4329a2d6dca214f4f899, user_id=c066bb76b20548f3a3307e5754720108, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:04.596736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:04.641932 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2396/4792] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:04 2022] PUT /identity/v3/projects/094e892b51ad4329a2d6dca214f4f899/users/c066bb76b20548f3a3307e5754720108/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:04.653987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602ad0-6ab6-4b7b-a32b-3411e6f31f82 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:04.654849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602ad0-6ab6-4b7b-a32b-3411e6f31f82 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:04.655128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602ad0-6ab6-4b7b-a32b-3411e6f31f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:04.733950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f5602ad0-6ab6-4b7b-a32b-3411e6f31f82 None None] MFA Rules not processed for user `c066bb76b20548f3a3307e5754720108`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:04.735262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f5602ad0-6ab6-4b7b-a32b-3411e6f31f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:04.919682 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2397/4793] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:04.927062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:05.105234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25140e1-2a51-426a-8426-495918d6d7bc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:05.117452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:05.118088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:05.118529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:05.118865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:05.119565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:05.121215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:05.175731 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2397/4794] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:25:04 2022] POST /identity/v3/domains => generated 277 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:05.180601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5602ad0-6ab6-4b7b-a32b-3411e6f31f82 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:05.202348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5602ad0-6ab6-4b7b-a32b-3411e6f31f82 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:05.442449 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:05.472750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:05.473794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:05.474285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:05.474823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:05.476628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:05.478582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:05.540682 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2398/4795] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:25:05 2022] POST /identity/v3/roles => generated 240 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:05.545903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:05.563167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb49929-c09b-493d-95d2-b657152af068 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:05.572520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:05.573313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:05.573744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:05.573928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9214cbb21de47159ad4d21a5089f8af/users/c066bb76b20548f3a3307e5754720108/roles/8d3ce5a7511e451e8888d3ff6d176584` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:05.589373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d9214cbb21de47159ad4d21a5089f8af, user_id=c066bb76b20548f3a3307e5754720108, role_id=8d3ce5a7511e451e8888d3ff6d176584)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:05.593576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:05.613109 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2398/4796] 10.222.0.16 () {60 vars in 1480 bytes} [Sun Sep 11 01:25:05 2022] PUT /identity/v3/domains/d9214cbb21de47159ad4d21a5089f8af/users/c066bb76b20548f3a3307e5754720108/roles/8d3ce5a7511e451e8888d3ff6d176584 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:05.616362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:05.633676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80ba11-4e1f-4c51-970c-fc29239ee0fa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:05.769803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:05.770486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:05.770776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:05.771653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:05.794002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:05.800027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:05.845846 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2399/4797] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:25:05 2022] POST /identity/v3/domains => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:05.846461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:05.860984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb137e1f-b631-436a-9482-25e686b2cf77 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:05.942966 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:05.975695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:05.976831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:05.977476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:05.978494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:05.979480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:05.982324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:06.029630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:06.041751 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2399/4798] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:25:05 2022] POST /identity/v3/roles => generated 239 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:06.073248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177dd1-403f-4b85-a806-e4e76e491079 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:06.096584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:06.099778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:06.100071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:06.101500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:06.103415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:06.111018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:06.214191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:06.224187 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2400/4799] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:25:06 2022] POST /identity/v3/groups => generated 326 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:06.235799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87001b9-892c-45b1-ab56-ab6f5adc5399 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:06.253533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:06.254492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:06.254931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:06.255575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups/2ac8c2221ea640a39c04a472d4266720/users/c066bb76b20548f3a3307e5754720108` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:06.272243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2ac8c2221ea640a39c04a472d4266720, user_id=c066bb76b20548f3a3307e5754720108)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:06.274236 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:25:06.274236 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:25:06.274236 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:25:06.275859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:06.388158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:06.388585 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2400/4800] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:25:06 2022] PUT /identity/v3/groups/2ac8c2221ea640a39c04a472d4266720/users/c066bb76b20548f3a3307e5754720108 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:06.427480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7506-7de6-4134-b450-0925f5a83402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:06.633167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:06.633167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:06.633513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:06.633744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/46ffcd6207784d429b691e46c941f5c7/groups/2ac8c2221ea640a39c04a472d4266720/roles/b848fa1bf93441318b82a57a2ea619c8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:06.638812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=46ffcd6207784d429b691e46c941f5c7, group_id=2ac8c2221ea640a39c04a472d4266720, role_id=b848fa1bf93441318b82a57a2ea619c8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:06.641647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:06.687199 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2401/4801] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:06 2022] PUT /identity/v3/domains/46ffcd6207784d429b691e46c941f5c7/groups/2ac8c2221ea640a39c04a472d4266720/roles/b848fa1bf93441318b82a57a2ea619c8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:06.691156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:06.714716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa9651-9914-416d-9e53-32d3601ae7db tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:06.838458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:06.839450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:06.839841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:06.840219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:06.842179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:06.844761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:06.877244 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2401/4802] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:25:06 2022] POST /identity/v3/domains => generated 276 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:06.878603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:06.893368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6e894-e59b-48fd-9658-4eaace2d491e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:06.984256 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:07.021410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:07.022391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:07.023860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:07.024254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:07.025050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:07.029288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:07.054427 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2402/4803] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:25:06 2022] POST /identity/v3/roles => generated 239 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:07.057713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:07.076888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f413f2-6668-405a-86ab-0ce8e84ba8e5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:07.086134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:07.086696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:07.086983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:07.088968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9d34dac34e542218e8b39109aa12ff6/users/c066bb76b20548f3a3307e5754720108/roles/7dbef9111a924256a6e030fc02653902` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:07.114877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d9d34dac34e542218e8b39109aa12ff6, user_id=c066bb76b20548f3a3307e5754720108, role_id=7dbef9111a924256a6e030fc02653902)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:07.118272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:07.147280 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2402/4804] 10.222.0.16 () {60 vars in 1480 bytes} [Sun Sep 11 01:25:07 2022] PUT /identity/v3/domains/d9d34dac34e542218e8b39109aa12ff6/users/c066bb76b20548f3a3307e5754720108/roles/7dbef9111a924256a6e030fc02653902 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:07.151233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:07.171193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6469aac-d15b-4edd-bae7-7977dd90056a tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:07.260462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:07.262050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:07.263506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:07.264261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:07.265389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:07.269862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:07.329504 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2403/4805] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:25:07 2022] POST /identity/v3/domains => generated 277 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:07.335012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:07.354025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87557c53-8471-4096-a08b-55eef8461958 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:07.511302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:07.511944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:07.512869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:07.513185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:07.513878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:07.515671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:07.540889 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2403/4806] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:25:07 2022] POST /identity/v3/roles => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:07.545300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:07.557548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590aff6-7312-42bf-abe9-9eec910a4ae2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:07.564740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:07.565419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:07.566483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:07.566483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:07.566852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:07.569583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:07.615242 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2404/4807] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:25:07 2022] POST /identity/v3/groups => generated 327 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:07.616957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:07.655744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482caa7-cb6f-41fa-a492-cb10b643b367 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:07.663550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:07.664770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:07.665213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:07.665600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups/a20d973250af4b8daeb6590629fdccd8/users/c066bb76b20548f3a3307e5754720108` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:07.674399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a20d973250af4b8daeb6590629fdccd8, user_id=c066bb76b20548f3a3307e5754720108)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:07.677040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:07.709751 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:07.746156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2404/4808] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:25:07 2022] PUT /identity/v3/groups/a20d973250af4b8daeb6590629fdccd8/users/c066bb76b20548f3a3307e5754720108 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:07.751371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:07.776903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e596e-7fb1-4606-b734-eeac9a4a2da4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:07.948647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:07.949357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:07.949642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:07.950439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d51d40205a0b4150a4ed38c60f331000/groups/a20d973250af4b8daeb6590629fdccd8/roles/7ccff022c5184baa9d9120b140c17764` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:07.960028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d51d40205a0b4150a4ed38c60f331000, group_id=a20d973250af4b8daeb6590629fdccd8, role_id=7ccff022c5184baa9d9120b140c17764)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:07.963219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:07.996290 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2405/4809] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:07 2022] PUT /identity/v3/domains/d51d40205a0b4150a4ed38c60f331000/groups/a20d973250af4b8daeb6590629fdccd8/roles/7ccff022c5184baa9d9120b140c17764 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:07.997399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:08.221520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff868e0-bcc7-47df-ac65-3fb818a85ed4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:08.334387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c066bb76b20548f3a3307e5754720108', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094e892b51ad4329a2d6dca214f4f899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:08.335033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:08.335591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:08.335591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] PATH_INFO: `/v3/auth/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:08.336151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:08.337342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:08.402264 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:08.441088 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2405/4810] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 11 01:25:07 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:08.443235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:08.561758 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:08.588050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626770-8e9a-4255-95a1-6d7e9660a402 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:08.595222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:08.596119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:08.596499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:08.596884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d51d40205a0b4150a4ed38c60f331000/groups/a20d973250af4b8daeb6590629fdccd8/roles/7ccff022c5184baa9d9120b140c17764` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:08.599742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d51d40205a0b4150a4ed38c60f331000, group_id=a20d973250af4b8daeb6590629fdccd8, role_id=7ccff022c5184baa9d9120b140c17764)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:08.606685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:08.624444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 7ccff022c5184baa9d9120b140c17764 was removed from group a20d973250af4b8daeb6590629fdccd8 on domain d51d40205a0b4150a4ed38c60f331000. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:08.624950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:08.626660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:08.664166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2406/4811] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 11 01:25:08 2022] DELETE /identity/v3/domains/d51d40205a0b4150a4ed38c60f331000/groups/a20d973250af4b8daeb6590629fdccd8/roles/7ccff022c5184baa9d9120b140c17764 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:08.665547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:08.667597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:08.687953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57c36-4524-410f-a4bf-8cd796090970 tempest-TokensV3TestJSON-1510779151 tempest-TokensV3TestJSON-1510779151-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:08.768319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:08.769291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:08.769691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:08.770166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups/a20d973250af4b8daeb6590629fdccd8/users/c066bb76b20548f3a3307e5754720108` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:08.776820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a20d973250af4b8daeb6590629fdccd8, user_id=c066bb76b20548f3a3307e5754720108)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:08.781312 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:25:08.781312 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:25:08.781312 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:25:08.783640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:08.817914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c066bb76b20548f3a3307e5754720108'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:08.850555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:08.852263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2406/4812] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:25:08 2022] DELETE /identity/v3/groups/a20d973250af4b8daeb6590629fdccd8/users/c066bb76b20548f3a3307e5754720108 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:08.865880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320a37-d0a7-4be4-b44d-8b88f6d37c28 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:08.955494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:08.956522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:08.956986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:08.957456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups/a20d973250af4b8daeb6590629fdccd8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:08.959917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a20d973250af4b8daeb6590629fdccd8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:08.962261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:09.060827 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2407/4813] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:25:08 2022] DELETE /identity/v3/groups/a20d973250af4b8daeb6590629fdccd8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:09.080552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:09.111980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e758832-cfbd-4d37-b4c4-40d270f2e59f tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:09.245154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:09.245873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:09.246157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:09.246432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles/7ccff022c5184baa9d9120b140c17764` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:09.248527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7ccff022c5184baa9d9120b140c17764)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:09.250636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:09.357684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 7ccff022c5184baa9d9120b140c17764 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:09.360534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.362904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.367770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2407/4814] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:09 2022] DELETE /identity/v3/roles/7ccff022c5184baa9d9120b140c17764 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:09.372592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:09.374500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:09.399763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d228a-43d2-44cd-a723-5929833e1b73 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:09.538516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:09.539457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:09.539786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:09.540112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d51d40205a0b4150a4ed38c60f331000` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:09.542370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d51d40205a0b4150a4ed38c60f331000)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:09.544973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:09.586800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.587682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.644615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.647404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14929be2-f2e1-4eba-93ad-b0c2ce300871 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.655806 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2408/4815] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:09 2022] PATCH /identity/v3/domains/d51d40205a0b4150a4ed38c60f331000 => generated 278 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:25:09.657916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:09.671669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b3c07-78f0-484f-9266-849ab043f015 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:09.684481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:09.685314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:09.685426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:09.698933 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:09.736523 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:09.740813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:09.744655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:09.774915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:09.775584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:09.777827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:09.779578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d51d40205a0b4150a4ed38c60f331000` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:09.806609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d51d40205a0b4150a4ed38c60f331000)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:09.808393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:09.849450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.854635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.865595 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2409/4816] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:09.884796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:09.897912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:09.955609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000', 'request_id': 'req-f12797fe-4316-4d20-b496-2351b5535865'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.964442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000', 'request_id': 'req-f12797fe-4316-4d20-b496-2351b5535865'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:09.989586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000', 'request_id': 'req-f12797fe-4316-4d20-b496-2351b5535865'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.006047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] The token cache is being invalidate because project d51d40205a0b4150a4ed38c60f331000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:10.006323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.006996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.018679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000', 'request_id': 'req-f12797fe-4316-4d20-b496-2351b5535865'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.019570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000', 'request_id': 'req-f12797fe-4316-4d20-b496-2351b5535865'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.025975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd51d40205a0b4150a4ed38c60f331000', 'request_id': 'req-f12797fe-4316-4d20-b496-2351b5535865'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.034646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eea4c-a71a-45a0-90e0-e57c7742f99b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:10.036404 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2408/4817] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:25:09 2022] DELETE /identity/v3/domains/d51d40205a0b4150a4ed38c60f331000 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:10.037454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:10.038876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:10.114882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:10.115430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:10.115745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:10.115972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:10.119012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:10.142018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12797fe-4316-4d20-b496-2351b5535865 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:10.152480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:10.154042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:10.154523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:10.154927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9d34dac34e542218e8b39109aa12ff6/users/c066bb76b20548f3a3307e5754720108/roles/7dbef9111a924256a6e030fc02653902` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:10.157282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d9d34dac34e542218e8b39109aa12ff6, user_id=c066bb76b20548f3a3307e5754720108, role_id=7dbef9111a924256a6e030fc02653902)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:10.160115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:10.167180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 7dbef9111a924256a6e030fc02653902 was removed from user c066bb76b20548f3a3307e5754720108 on domain d9d34dac34e542218e8b39109aa12ff6. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:10.167516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.168335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.178820 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:10.188578 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2409/4818] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 11 01:25:10 2022] DELETE /identity/v3/domains/d9d34dac34e542218e8b39109aa12ff6/users/c066bb76b20548f3a3307e5754720108/roles/7dbef9111a924256a6e030fc02653902 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:10.193030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:10.194601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:10.234480 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:10.289997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:10.292747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:10.339374 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2410/4819] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:25:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:25:10.394057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f2a28-c82c-483f-9fb6-da83a27cfede tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:10.420452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:10.422842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:10.423334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:10.423723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles/7dbef9111a924256a6e030fc02653902` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:10.439648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7dbef9111a924256a6e030fc02653902)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:10.454322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:10.555454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 7dbef9111a924256a6e030fc02653902 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:10.555840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.557337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.568275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2410/4820] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:10 2022] DELETE /identity/v3/roles/7dbef9111a924256a6e030fc02653902 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:10.569523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:10.584133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5312c-caf1-4f9b-a765-da49e8e906ae service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:10.725916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:10.726461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:10.726807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:10.727197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9d34dac34e542218e8b39109aa12ff6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:10.729869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d9d34dac34e542218e8b39109aa12ff6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:10.740456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:10.789924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.794882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.848328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.848889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:10.856779 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2411/4821] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:10 2022] PATCH /identity/v3/domains/d9d34dac34e542218e8b39109aa12ff6 => generated 277 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:10.858074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:10.859668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:10.879630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55737b5-12cf-47ce-81fd-90243da1be14 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:11.035666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:11.036606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:11.037195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:11.037671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9d34dac34e542218e8b39109aa12ff6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:11.067296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d9d34dac34e542218e8b39109aa12ff6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:11.071605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:11.151131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.181966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.345947 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:11.444942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6', 'request_id': 'req-59147b85-2bfa-48e5-b0ac-eb77685954d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.471786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6', 'request_id': 'req-59147b85-2bfa-48e5-b0ac-eb77685954d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.509820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6', 'request_id': 'req-59147b85-2bfa-48e5-b0ac-eb77685954d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.547923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] The token cache is being invalidate because project d9d34dac34e542218e8b39109aa12ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:11.548241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.549476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.572146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6', 'request_id': 'req-59147b85-2bfa-48e5-b0ac-eb77685954d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.573717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6', 'request_id': 'req-59147b85-2bfa-48e5-b0ac-eb77685954d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.580749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd9d34dac34e542218e8b39109aa12ff6', 'request_id': 'req-59147b85-2bfa-48e5-b0ac-eb77685954d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.601571 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2411/4822] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:25:10 2022] DELETE /identity/v3/domains/d9d34dac34e542218e8b39109aa12ff6 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:11.606023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:11.608306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:11.629612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d45416-2e73-4f4c-a2c7-e710eb700ff4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:11.787116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:11.787811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:11.788101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:11.788385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/46ffcd6207784d429b691e46c941f5c7/groups/2ac8c2221ea640a39c04a472d4266720/roles/b848fa1bf93441318b82a57a2ea619c8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:11.803731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=46ffcd6207784d429b691e46c941f5c7, group_id=2ac8c2221ea640a39c04a472d4266720, role_id=b848fa1bf93441318b82a57a2ea619c8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:11.807273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:11.823500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role b848fa1bf93441318b82a57a2ea619c8 was removed from group 2ac8c2221ea640a39c04a472d4266720 on domain 46ffcd6207784d429b691e46c941f5c7. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:11.823823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.834924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:11.874330 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2412/4823] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 11 01:25:11 2022] DELETE /identity/v3/domains/46ffcd6207784d429b691e46c941f5c7/groups/2ac8c2221ea640a39c04a472d4266720/roles/b848fa1bf93441318b82a57a2ea619c8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:11.875642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:11.877321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:11.912372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147b85-2bfa-48e5-b0ac-eb77685954d6 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:12.069247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:12.070012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:12.070368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:12.070727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups/2ac8c2221ea640a39c04a472d4266720/users/c066bb76b20548f3a3307e5754720108` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:12.072643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2ac8c2221ea640a39c04a472d4266720, user_id=c066bb76b20548f3a3307e5754720108)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:12.075242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:12.112800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c066bb76b20548f3a3307e5754720108'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:12.160702 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2412/4824] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:25:11 2022] DELETE /identity/v3/groups/2ac8c2221ea640a39c04a472d4266720/users/c066bb76b20548f3a3307e5754720108 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:12.164606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:12.166749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:12.189190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b07e53-e4c6-4f0e-a979-6f7961c105b5 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:12.264437 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:12.365760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:12.366687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:12.367134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:12.367594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/groups/2ac8c2221ea640a39c04a472d4266720` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:12.370090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2ac8c2221ea640a39c04a472d4266720)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:12.376507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:12.494712 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2413/4825] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:25:12 2022] DELETE /identity/v3/groups/2ac8c2221ea640a39c04a472d4266720 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:12.499408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:12.539464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750991df-58a5-4ff9-9455-ce73e7668be2 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:12.656490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:12.657403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:12.657775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:12.659767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles/b848fa1bf93441318b82a57a2ea619c8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:12.661815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b848fa1bf93441318b82a57a2ea619c8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:12.669467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:12.753560 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:12.761607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role b848fa1bf93441318b82a57a2ea619c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:12.762062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:12.765341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:12.770252 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2413/4826] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:12 2022] DELETE /identity/v3/roles/b848fa1bf93441318b82a57a2ea619c8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:12.775103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:12.778991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:12.821497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d627b-4fa5-4577-a579-6f0a9e85d73b tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:13.040229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:13.041159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:13.041617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:13.042044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/46ffcd6207784d429b691e46c941f5c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:13.045951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=46ffcd6207784d429b691e46c941f5c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:13.047773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:13.105246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '46ffcd6207784d429b691e46c941f5c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.106289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '46ffcd6207784d429b691e46c941f5c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.167610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '46ffcd6207784d429b691e46c941f5c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.169480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '46ffcd6207784d429b691e46c941f5c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.177479 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2414/4827] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:12 2022] PATCH /identity/v3/domains/46ffcd6207784d429b691e46c941f5c7 => generated 276 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:13.181491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:13.198346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d05068-05dc-46b3-9aa1-1d1b03b60b74 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:13.373298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:13.375870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:13.376357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:13.376792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/46ffcd6207784d429b691e46c941f5c7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:13.423700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=46ffcd6207784d429b691e46c941f5c7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:13.425691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:13.494475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '46ffcd6207784d429b691e46c941f5c7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.499054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '46ffcd6207784d429b691e46c941f5c7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.581932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ffcd6207784d429b691e46c941f5c7', 'request_id': 'req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.589988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ffcd6207784d429b691e46c941f5c7', 'request_id': 'req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.612808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ffcd6207784d429b691e46c941f5c7', 'request_id': 'req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.628997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] The token cache is being invalidate because project 46ffcd6207784d429b691e46c941f5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:13.629302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.643730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.670857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '46ffcd6207784d429b691e46c941f5c7', 'request_id': 'req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.673456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '46ffcd6207784d429b691e46c941f5c7', 'request_id': 'req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.683661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '46ffcd6207784d429b691e46c941f5c7', 'request_id': 'req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:13.695659 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2414/4828] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:25:13 2022] DELETE /identity/v3/domains/46ffcd6207784d429b691e46c941f5c7 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:13.703697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:13.708369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:13.779379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de56422-124f-49b3-af07-e9b24d251afb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:14.022776 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:14.061868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:14.062964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:14.063467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:14.063954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9214cbb21de47159ad4d21a5089f8af/users/c066bb76b20548f3a3307e5754720108/roles/8d3ce5a7511e451e8888d3ff6d176584` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:14.070534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d9214cbb21de47159ad4d21a5089f8af, user_id=c066bb76b20548f3a3307e5754720108, role_id=8d3ce5a7511e451e8888d3ff6d176584)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:14.073330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:14.101812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 8d3ce5a7511e451e8888d3ff6d176584 was removed from user c066bb76b20548f3a3307e5754720108 on domain d9214cbb21de47159ad4d21a5089f8af. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:14.102184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.103032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.130194 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2415/4829] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 11 01:25:13 2022] DELETE /identity/v3/domains/d9214cbb21de47159ad4d21a5089f8af/users/c066bb76b20548f3a3307e5754720108/roles/8d3ce5a7511e451e8888d3ff6d176584 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:14.134836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:14.137701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:14.178206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc965a7-60a3-43cd-b0d5-490598b9d1dc tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:14.284468 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:14.347530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:14.348186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:14.348463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:14.348733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles/8d3ce5a7511e451e8888d3ff6d176584` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:14.354210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8d3ce5a7511e451e8888d3ff6d176584)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:14.355884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:14.437505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 8d3ce5a7511e451e8888d3ff6d176584 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:14.437835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.439265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.445931 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2415/4830] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:14 2022] DELETE /identity/v3/roles/8d3ce5a7511e451e8888d3ff6d176584 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:14.446968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:14.448496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:14.485262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc783e1-af9c-403c-ae30-26c6dcb28854 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:14.650565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:14.651238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:14.651504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:14.651784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9214cbb21de47159ad4d21a5089f8af` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:14.655584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d9214cbb21de47159ad4d21a5089f8af)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:14.657196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:14.744673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.746061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.835678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.841537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:14.862395 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2416/4831] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:14 2022] PATCH /identity/v3/domains/d9214cbb21de47159ad4d21a5089f8af => generated 278 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:25:14.866939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:14.868379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:14.903175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabb3ea-8d73-4bd8-ba2e-5b97a353e1cf tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:15.074670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:15.076450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:15.079117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:15.079569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9214cbb21de47159ad4d21a5089f8af` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:15.114185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d9214cbb21de47159ad4d21a5089f8af)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:15.116107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:15.219892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.248771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.402475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af', 'request_id': 'req-9e6eb14a-707b-40e7-a374-5d2b0a96c341'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.430287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af', 'request_id': 'req-9e6eb14a-707b-40e7-a374-5d2b0a96c341'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.454403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af', 'request_id': 'req-9e6eb14a-707b-40e7-a374-5d2b0a96c341'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.471378 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:15.481479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] The token cache is being invalidate because project d9214cbb21de47159ad4d21a5089f8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:15.485670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.485670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.505839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af', 'request_id': 'req-9e6eb14a-707b-40e7-a374-5d2b0a96c341'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.507027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af', 'request_id': 'req-9e6eb14a-707b-40e7-a374-5d2b0a96c341'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.516216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd9214cbb21de47159ad4d21a5089f8af', 'request_id': 'req-9e6eb14a-707b-40e7-a374-5d2b0a96c341'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:15.530176 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2416/4832] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:25:14 2022] DELETE /identity/v3/domains/d9214cbb21de47159ad4d21a5089f8af => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:15.535509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:15.538784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:15.556314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96db6ac-3381-4130-9225-713be0b3b2ed tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:15.668424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:15.669460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:15.669956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:15.670425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:15.673595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:15.677541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:15.694980 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2417/4833] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:15.700199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:15.710171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:15.735077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb14a-707b-40e7-a374-5d2b0a96c341 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:15.742797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:15.743817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:15.744257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:15.744983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects/c0f355759afe4f4f93110c5cd47466ea/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:15.747807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c0f355759afe4f4f93110c5cd47466ea, user_id=f845fdfe452645c98ca5ff9d34e4f7d6, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:15.751152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:15.799584 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2417/4834] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:15 2022] PUT /identity/v3/projects/c0f355759afe4f4f93110c5cd47466ea/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:15.801740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:15.821860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310723cc-ab57-41aa-b922-99663e902e87 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:15.935500 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:15.995520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:15.997371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:15.997876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:15.998729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:16.001460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:16.002846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:16.192604 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2418/4835] 10.222.0.16 () {58 vars in 1146 bytes} [Sun Sep 11 01:25:15 2022] GET /identity/v3/auth/projects => generated 824 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:25:16.196220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:16.214787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae3cf-e89f-4613-b43b-6211b7feba50 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:16.222813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:16.223898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:16.224401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:16.224925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects/c0f355759afe4f4f93110c5cd47466ea/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:16.227476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c0f355759afe4f4f93110c5cd47466ea, user_id=f845fdfe452645c98ca5ff9d34e4f7d6, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:16.234873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:16.253908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 26647ebe21344cfbb8086d4b36b11321 was removed from user f845fdfe452645c98ca5ff9d34e4f7d6 on project c0f355759afe4f4f93110c5cd47466ea. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:16.254563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:16.262493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:16.291390 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2418/4836] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 11 01:25:16 2022] DELETE /identity/v3/projects/c0f355759afe4f4f93110c5cd47466ea/users/f845fdfe452645c98ca5ff9d34e4f7d6/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:16.292948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:16.295775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:16.322185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a83e00-e64a-49b1-8989-db49e5e1415d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:16.469236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432529b-1898-43ad-92fa-94337443c430 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:16.469832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432529b-1898-43ad-92fa-94337443c430 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:16.470163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432529b-1898-43ad-92fa-94337443c430 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:16.470445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432529b-1898-43ad-92fa-94337443c430 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:16.471191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432529b-1898-43ad-92fa-94337443c430 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:16.473490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432529b-1898-43ad-92fa-94337443c430 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:16.563259 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2419/4837] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:16 2022] POST /identity/v3/users => generated 323 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:16.564981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:16.577780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68abb-70fd-4050-aef8-397351c46398 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:16.595866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:16.597264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:16.597779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:16.598275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:16.599576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:16.602215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:16.635791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9e45-e91c-4441-a9c8-da9ab64dc0b9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:16.636082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9e45-e91c-4441-a9c8-da9ab64dc0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:16.636391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9e45-e91c-4441-a9c8-da9ab64dc0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:16.642569 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2419/4838] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:16 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:16.646354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:16.663437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4d9b9e45-e91c-4441-a9c8-da9ab64dc0b9 None None] MFA Rules not processed for user `f01b6459a5c54bafba0ddf73cfd1e399`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:16.664727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d9b9e45-e91c-4441-a9c8-da9ab64dc0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:16.732033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223518cf-a232-4102-8635-87ccb6611f58 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:16.739199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:16.740010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:16.740399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:16.740775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:16.741775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:16.744672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:16.759689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2420/4839] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:16.786445 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2420/4840] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:16 2022] POST /identity/v3/projects => generated 364 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:16.787988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9e45-e91c-4441-a9c8-da9ab64dc0b9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:16.843738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9e45-e91c-4441-a9c8-da9ab64dc0b9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:16.943782 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:17.000742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:17.000742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.000742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.001168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.001168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:17.002346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:17.028798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2421/4841] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:25:16 2022] POST /identity/v3/roles => generated 240 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:17.032191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:17.044793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d208502-065f-41ca-a685-faccd4aaa961 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:17.050270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaca17-cdca-44a4-bd85-fc2a9bc41561 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:17.051622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaca17-cdca-44a4-bd85-fc2a9bc41561 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.051906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaca17-cdca-44a4-bd85-fc2a9bc41561 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.052379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaca17-cdca-44a4-bd85-fc2a9bc41561 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects/4176a45e44cb48a39d1a8e5d94a4a9e4/users/109d116c5551460d994b141b8ece50da/roles/53ebdf938abd4c68930d1c0670dbd27b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.071152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfaca17-cdca-44a4-bd85-fc2a9bc41561 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4176a45e44cb48a39d1a8e5d94a4a9e4, user_id=109d116c5551460d994b141b8ece50da, role_id=53ebdf938abd4c68930d1c0670dbd27b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:17.076119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfaca17-cdca-44a4-bd85-fc2a9bc41561 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:17.093751 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2421/4842] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:17 2022] PUT /identity/v3/projects/4176a45e44cb48a39d1a8e5d94a4a9e4/users/109d116c5551460d994b141b8ece50da/roles/53ebdf938abd4c68930d1c0670dbd27b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:17.097829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:17.112026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba9889-6ce4-401e-b3c3-c7e3a153d3aa tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:17.190410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120290f-88c1-42cb-9239-31e1b5e60ad8 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:17.191107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120290f-88c1-42cb-9239-31e1b5e60ad8 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.191329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120290f-88c1-42cb-9239-31e1b5e60ad8 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.191610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120290f-88c1-42cb-9239-31e1b5e60ad8 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects/5e39bf8ea8404277a55f8bb9494c4ad6/users/109d116c5551460d994b141b8ece50da/roles/53ebdf938abd4c68930d1c0670dbd27b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.194934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120290f-88c1-42cb-9239-31e1b5e60ad8 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5e39bf8ea8404277a55f8bb9494c4ad6, user_id=109d116c5551460d994b141b8ece50da, role_id=53ebdf938abd4c68930d1c0670dbd27b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:17.198006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120290f-88c1-42cb-9239-31e1b5e60ad8 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:17.231239 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2422/4843] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:17 2022] PUT /identity/v3/projects/5e39bf8ea8404277a55f8bb9494c4ad6/users/109d116c5551460d994b141b8ece50da/roles/53ebdf938abd4c68930d1c0670dbd27b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:17.240347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74460f-a64f-4be1-993e-ff11d73168ac None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.240891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74460f-a64f-4be1-993e-ff11d73168ac None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.240891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74460f-a64f-4be1-993e-ff11d73168ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.293356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2c74460f-a64f-4be1-993e-ff11d73168ac None None] MFA Rules not processed for user `109d116c5551460d994b141b8ece50da`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:17.295254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c74460f-a64f-4be1-993e-ff11d73168ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:17.303094 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2422/4844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:17 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:25:17.307327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac3e28-af5e-490b-acce-fb1b9fd672b6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.312161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac3e28-af5e-490b-acce-fb1b9fd672b6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.313175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac3e28-af5e-490b-acce-fb1b9fd672b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.337497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-32ac3e28-af5e-490b-acce-fb1b9fd672b6 None None] MFA Rules not processed for user `109d116c5551460d994b141b8ece50da`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:17.339316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-32ac3e28-af5e-490b-acce-fb1b9fd672b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:17.521531 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2423/4845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 11 01:25:17.522752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74460f-a64f-4be1-993e-ff11d73168ac None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:17.596460 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:17.644735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74460f-a64f-4be1-993e-ff11d73168ac None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:17.652372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:17.653554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.654306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.654820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.663761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:17.666094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:17.705476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2423/4846] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 11 01:25:17 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:17.710259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029754-be47-46f9-a466-6b5c760542ba None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.710670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029754-be47-46f9-a466-6b5c760542ba None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.711603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029754-be47-46f9-a466-6b5c760542ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.726448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-df029754-be47-46f9-a466-6b5c760542ba None None] MFA Rules not processed for user `109d116c5551460d994b141b8ece50da`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:17.727772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-df029754-be47-46f9-a466-6b5c760542ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:17.806381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2424/4847] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 11 01:25:17.811637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:17.822292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198cec7-1745-4224-8734-b9f0587f1270 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:17.827649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:17.828394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:17.828958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:17.829589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/roles/53ebdf938abd4c68930d1c0670dbd27b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:17.831468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_role(role_id=53ebdf938abd4c68930d1c0670dbd27b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:17.833238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:17.885258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invalidating the token cache because role 53ebdf938abd4c68930d1c0670dbd27b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:17.886514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:17.888537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:17.891349 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2424/4848] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:17 2022] DELETE /identity/v3/roles/53ebdf938abd4c68930d1c0670dbd27b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:17.895362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df029754-be47-46f9-a466-6b5c760542ba None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:17.906760 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:17.913800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df029754-be47-46f9-a466-6b5c760542ba None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:18.006902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:18.007640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:18.007982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:18.008208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects/5e39bf8ea8404277a55f8bb9494c4ad6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:18.009644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e39bf8ea8404277a55f8bb9494c4ad6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:18.011924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:18.081091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e39bf8ea8404277a55f8bb9494c4ad6', 'request_id': 'req-9924733c-3178-46b8-8b68-8d53cccda708'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.087973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e39bf8ea8404277a55f8bb9494c4ad6', 'request_id': 'req-9924733c-3178-46b8-8b68-8d53cccda708'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.096824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e39bf8ea8404277a55f8bb9494c4ad6', 'request_id': 'req-9924733c-3178-46b8-8b68-8d53cccda708'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.112142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] The token cache is being invalidate because project 5e39bf8ea8404277a55f8bb9494c4ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:18.112812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.116346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.118673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2425/4849] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:17 2022] DELETE /identity/v3/projects/5e39bf8ea8404277a55f8bb9494c4ad6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:18.123652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:18.125294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:18.142281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f53b8-9c3c-4902-a270-f8d3b22f5bf4 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:18.213102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:18.213767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:18.214046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:18.214315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects/5e39bf8ea8404277a55f8bb9494c4ad6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:18.222346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e39bf8ea8404277a55f8bb9494c4ad6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:18.224278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Could not find project: 5e39bf8ea8404277a55f8bb9494c4ad6.: keystone.exception.ProjectNotFound: Could not find project: 5e39bf8ea8404277a55f8bb9494c4ad6. Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 11 01:25:18.235953 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5e39bf8ea8404277a55f8bb9494c4ad6. Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:25:18.237890 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2425/4850] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:18 2022] DELETE /identity/v3/projects/5e39bf8ea8404277a55f8bb9494c4ad6 => generated 113 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:25:18.241281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:18.242786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:18.296075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924733c-3178-46b8-8b68-8d53cccda708 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:18.315255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:18.316002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:18.316361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:18.316563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/projects/4176a45e44cb48a39d1a8e5d94a4a9e4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:18.318708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4176a45e44cb48a39d1a8e5d94a4a9e4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:18.320736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:18.442389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4176a45e44cb48a39d1a8e5d94a4a9e4', 'request_id': 'req-04b96eb7-46bd-497c-9a21-d452d1c5be3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.457699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4176a45e44cb48a39d1a8e5d94a4a9e4', 'request_id': 'req-04b96eb7-46bd-497c-9a21-d452d1c5be3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.472322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4176a45e44cb48a39d1a8e5d94a4a9e4', 'request_id': 'req-04b96eb7-46bd-497c-9a21-d452d1c5be3c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.496498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] The token cache is being invalidate because project 4176a45e44cb48a39d1a8e5d94a4a9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:18.496814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.500519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.507801 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2426/4851] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:18 2022] DELETE /identity/v3/projects/4176a45e44cb48a39d1a8e5d94a4a9e4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:18.509050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:18.514624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:18.546651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e912-cf29-47b4-86aa-77f0a67da256 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:18.660222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:18.661089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:18.661381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:18.661756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/users/109d116c5551460d994b141b8ece50da` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:18.663018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorizing `identity:delete_user(user_id=109d116c5551460d994b141b8ece50da)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:18.665708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:18.705633 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:18.773480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109d116c5551460d994b141b8ece50da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.774723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109d116c5551460d994b141b8ece50da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.776030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109d116c5551460d994b141b8ece50da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.812399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109d116c5551460d994b141b8ece50da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.852483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109d116c5551460d994b141b8ece50da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:18.872723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2426/4852] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:18 2022] DELETE /identity/v3/users/109d116c5551460d994b141b8ece50da => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:18.880821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:18.905075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96eb7-46bd-497c-9a21-d452d1c5be3c tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:18.923311 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:19.025936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:19.026761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:19.028464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:19.029086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d51d40205a0b4150a4ed38c60f331000` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:19.042589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Could not find domain: d51d40205a0b4150a4ed38c60f331000.: keystone.exception.DomainNotFound: Could not find domain: d51d40205a0b4150a4ed38c60f331000. Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d51d40205a0b4150a4ed38c60f331000. Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:25:19.064645 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:25:19.065982 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d51d40205a0b4150a4ed38c60f331000. Sep 11 01:25:19.067154 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:25:19.073702 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2427/4853] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:18 2022] PATCH /identity/v3/domains/d51d40205a0b4150a4ed38c60f331000 => generated 112 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:25:19.076310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:19.078145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:19.099081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96bbc7-a7c3-463d-ab76-7bcda57dbc6d tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:19.108107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:19.109409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:19.109939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:19.110453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9d34dac34e542218e8b39109aa12ff6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:19.126997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Could not find domain: d9d34dac34e542218e8b39109aa12ff6.: keystone.exception.DomainNotFound: Could not find domain: d9d34dac34e542218e8b39109aa12ff6. Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d9d34dac34e542218e8b39109aa12ff6. Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:25:19.163162 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:25:19.164454 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d9d34dac34e542218e8b39109aa12ff6. Sep 11 01:25:19.165603 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:25:19.186652 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2427/4854] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:19 2022] PATCH /identity/v3/domains/d9d34dac34e542218e8b39109aa12ff6 => generated 112 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:25:19.190223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:19.212706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b2e61-73af-410a-bf12-17fa06fb580e tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:19.227751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:19.233873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:19.234431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:19.235028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/46ffcd6207784d429b691e46c941f5c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:19.252691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Could not find domain: 46ffcd6207784d429b691e46c941f5c7.: keystone.exception.DomainNotFound: Could not find domain: 46ffcd6207784d429b691e46c941f5c7. Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 46ffcd6207784d429b691e46c941f5c7. Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:25:19.262509 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:25:19.263805 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 46ffcd6207784d429b691e46c941f5c7. Sep 11 01:25:19.264883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:25:19.270068 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2428/4855] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:19 2022] PATCH /identity/v3/domains/46ffcd6207784d429b691e46c941f5c7 => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:25:19.274129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:19.290155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a60217-a211-45f3-8bb9-a629bab969be tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:19.295773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee5a6d-eaa3-40bf-b664-e105db24f9bb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f845fdfe452645c98ca5ff9d34e4f7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24dbe11e0c364f5fa481385b016394b5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:19.296535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5a6d-eaa3-40bf-b664-e105db24f9bb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:19.296918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5a6d-eaa3-40bf-b664-e105db24f9bb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:19.297473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee5a6d-eaa3-40bf-b664-e105db24f9bb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] PATH_INFO: `/v3/domains/d9214cbb21de47159ad4d21a5089f8af` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:19.334623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee5a6d-eaa3-40bf-b664-e105db24f9bb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-36ee5a6d-eaa3-40bf-b664-e105db24f9bb tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Could not find domain: d9214cbb21de47159ad4d21a5089f8af.: keystone.exception.DomainNotFound: Could not find domain: d9214cbb21de47159ad4d21a5089f8af. Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d9214cbb21de47159ad4d21a5089f8af. Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:25:19.341295 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:25:19.342475 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d9214cbb21de47159ad4d21a5089f8af. Sep 11 01:25:19.343590 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:25:19.346101 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2428/4856] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:19 2022] PATCH /identity/v3/domains/d9214cbb21de47159ad4d21a5089f8af => generated 112 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:25:19.350545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:19.353382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:19.588863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8602dc-7c3d-4ae1-ba06-f51a5e36cf05 tempest-TokensV3TestJSON-215496754 tempest-TokensV3TestJSON-215496754-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:19.599713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:19.600773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:19.600773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:19.601083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] PATH_INFO: `/v3/users/4cace4b890fe460f86390dce38452b17` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:19.603232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cace4b890fe460f86390dce38452b17)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:19.608375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:19.784470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cace4b890fe460f86390dce38452b17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:19.786947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cace4b890fe460f86390dce38452b17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:19.789470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cace4b890fe460f86390dce38452b17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:19.813774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cace4b890fe460f86390dce38452b17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:19.827834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cace4b890fe460f86390dce38452b17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:19.862724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2429/4857] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:19 2022] DELETE /identity/v3/users/4cace4b890fe460f86390dce38452b17 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:19.866935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:19.867788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:19.867788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:19.922618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:19.929276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:20.152991 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2429/4858] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:20.164919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:20.167306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:20.198131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:20.200209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:20.224700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d59b-5b5c-4f49-bcb7-712e0dc29a15 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:20.246952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:20.247717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:20.251213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:20.253251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] PATH_INFO: `/v3/users/6b3529a3d50546ef9ec5bd41aa871757` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:20.258219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3529a3d50546ef9ec5bd41aa871757)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:20.273436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:20.332607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f92079-375d-4591-bbf2-728fac8e3151 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:20.338631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:20.339475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:20.340456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:20.341102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:20.362988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:20.364563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:20.376285 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:20.406643 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2430/4859] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:20.475596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3529a3d50546ef9ec5bd41aa871757'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:20.478945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3529a3d50546ef9ec5bd41aa871757'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:20.480960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3529a3d50546ef9ec5bd41aa871757'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:20.555615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3529a3d50546ef9ec5bd41aa871757'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:20.579579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3529a3d50546ef9ec5bd41aa871757'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:20.631685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2430/4860] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:20 2022] DELETE /identity/v3/users/6b3529a3d50546ef9ec5bd41aa871757 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:21.161746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:21.164190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:21.192765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468ff3-a25d-46dd-ac59-320eb4e39c28 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:21.232980 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:21.339424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:21.341967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:21.344828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:21.345304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] PATH_INFO: `/v3/projects/c0f355759afe4f4f93110c5cd47466ea` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:21.350490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f355759afe4f4f93110c5cd47466ea)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:21.356215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:21.464964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f355759afe4f4f93110c5cd47466ea', 'request_id': 'req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.467223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:21.470591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:21.481206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f355759afe4f4f93110c5cd47466ea', 'request_id': 'req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.494625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf9b07-d930-45d8-9355-ff90f40af64e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:21.515191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f355759afe4f4f93110c5cd47466ea', 'request_id': 'req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.532278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] The token cache is being invalidate because project c0f355759afe4f4f93110c5cd47466ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:21.532677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.536104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.542434 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2431/4861] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:21 2022] DELETE /identity/v3/projects/c0f355759afe4f4f93110c5cd47466ea => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:21.545602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:21.547946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:21.693642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d51ba-4287-4a0d-9baf-626a9fe08b8e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:21.696155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:21.696821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:21.697132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:21.697413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] PATH_INFO: `/v3/projects/aba851db20da455e8fc776ca6aa9eb6f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:21.701148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba851db20da455e8fc776ca6aa9eb6f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:21.701829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:21.702482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:21.702821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:21.703040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] PATH_INFO: `/v3/users/f845fdfe452645c98ca5ff9d34e4f7d6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:21.703166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:21.704217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f845fdfe452645c98ca5ff9d34e4f7d6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:21.708039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:21.811182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba851db20da455e8fc776ca6aa9eb6f', 'request_id': 'req-1751640f-3d2c-4b64-9783-16fc8f8b4da3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.829110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba851db20da455e8fc776ca6aa9eb6f', 'request_id': 'req-1751640f-3d2c-4b64-9783-16fc8f8b4da3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.829591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f845fdfe452645c98ca5ff9d34e4f7d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.830591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f845fdfe452645c98ca5ff9d34e4f7d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.831246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f845fdfe452645c98ca5ff9d34e4f7d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.837435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba851db20da455e8fc776ca6aa9eb6f', 'request_id': 'req-1751640f-3d2c-4b64-9783-16fc8f8b4da3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.841920 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:21.849030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f845fdfe452645c98ca5ff9d34e4f7d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.869745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] The token cache is being invalidate because project aba851db20da455e8fc776ca6aa9eb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:21.870145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.872391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1751640f-3d2c-4b64-9783-16fc8f8b4da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.874370 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2431/4862] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:21 2022] DELETE /identity/v3/projects/aba851db20da455e8fc776ca6aa9eb6f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:21.881285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856663-b06a-4155-b916-63e2e3e73f43 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:21.881593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856663-b06a-4155-b916-63e2e3e73f43 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:21.881840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856663-b06a-4155-b916-63e2e3e73f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:21.884896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-06446f2a-0a52-4f0e-a527-cd80a11e96ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f845fdfe452645c98ca5ff9d34e4f7d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:21.912358 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2432/4863] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:21 2022] DELETE /identity/v3/users/f845fdfe452645c98ca5ff9d34e4f7d6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:21.926084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e0856663-b06a-4155-b916-63e2e3e73f43 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:21.927375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e0856663-b06a-4155-b916-63e2e3e73f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:21.982607 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:22.076782 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2432/4864] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:22.079879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7b42-e733-41f1-a28d-0f2240a5e107 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.080453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7b42-e733-41f1-a28d-0f2240a5e107 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.080961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7b42-e733-41f1-a28d-0f2240a5e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:22.142587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-150f7b42-e733-41f1-a28d-0f2240a5e107 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:22.147023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-150f7b42-e733-41f1-a28d-0f2240a5e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:22.179788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0856663-b06a-4155-b916-63e2e3e73f43 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:22.182882 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2433/4865] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:22.195736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0856663-b06a-4155-b916-63e2e3e73f43 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:22.215644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:22.216326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.216604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.216874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:22.217553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:22.217858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:22.219455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:22.263386 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2433/4866] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:25:22.268934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7b42-e733-41f1-a28d-0f2240a5e107 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:22.283058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7b42-e733-41f1-a28d-0f2240a5e107 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:22.306566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:22.309583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.310965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.311535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:22.312494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:22.316261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:22.365795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:22.375570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2434/4867] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:22 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:22.388154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a68677-28d9-40f8-b68f-a61f6c92b151 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:22.557692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:22.558488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.558819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.561326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:22.563699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:22.573895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:22.635586 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2434/4868] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:22 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:22.639163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:22.658746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bb774-82e4-4f9f-8578-8019731539db admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:22.680987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:22.683997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.685001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.686881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:22.687767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:22.690736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:22.748110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:22.751439 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2435/4869] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:22.759913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b4d4e-bd23-4442-87a2-f373ad2766c7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:22.782662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c28fd2-9d73-43a1-8ee3-c9f1bbbd14c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:22.783795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28fd2-9d73-43a1-8ee3-c9f1bbbd14c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.784282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28fd2-9d73-43a1-8ee3-c9f1bbbd14c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.784774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28fd2-9d73-43a1-8ee3-c9f1bbbd14c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:22.785978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c28fd2-9d73-43a1-8ee3-c9f1bbbd14c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:22.787890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c28fd2-9d73-43a1-8ee3-c9f1bbbd14c7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:22.814516 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2435/4870] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:22.819931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:22.867858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecdbfb-b428-4ff4-804a-2fe1465369a5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:22.885847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:22.886831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.889879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.890425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] PATH_INFO: `/v3/projects/9daf2c05daaf453ba082038d05cafdcf/users/c2625c948d614f44b9bd6c7a53c0e917/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:22.929133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9daf2c05daaf453ba082038d05cafdcf, user_id=c2625c948d614f44b9bd6c7a53c0e917, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:22.932560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:22.969856 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2436/4871] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:22 2022] PUT /identity/v3/projects/9daf2c05daaf453ba082038d05cafdcf/users/c2625c948d614f44b9bd6c7a53c0e917/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:22.972763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e774-23cd-4047-9bab-6b9c01f28433 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:22.972763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e774-23cd-4047-9bab-6b9c01f28433 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:22.972763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e774-23cd-4047-9bab-6b9c01f28433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:23.030490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7471e774-23cd-4047-9bab-6b9c01f28433 None None] MFA Rules not processed for user `c2625c948d614f44b9bd6c7a53c0e917`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:23.033186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7471e774-23cd-4047-9bab-6b9c01f28433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:23.265957 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2436/4872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:23.290248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:23.292501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:23.428537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ff8b-696b-475d-b73e-b279d2bc16a1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:23.462093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc3bd-33a8-496c-a89b-ed014f1e1cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:23.463024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc3bd-33a8-496c-a89b-ed014f1e1cb7 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:23.463529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc3bd-33a8-496c-a89b-ed014f1e1cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:23.464073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc3bd-33a8-496c-a89b-ed014f1e1cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:23.501481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc3bd-33a8-496c-a89b-ed014f1e1cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:23.501481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc3bd-33a8-496c-a89b-ed014f1e1cb7 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:23.532369 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2437/4873] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:23.587685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e774-23cd-4047-9bab-6b9c01f28433 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:23.629345 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:23.689699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e774-23cd-4047-9bab-6b9c01f28433 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:23.696941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:23.697788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:23.698074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:23.698359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] PATH_INFO: `/v3/users/c2625c948d614f44b9bd6c7a53c0e917` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:23.700010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2625c948d614f44b9bd6c7a53c0e917)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:23.702210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:23.813417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2625c948d614f44b9bd6c7a53c0e917'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:23.815817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2625c948d614f44b9bd6c7a53c0e917'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:23.818666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2625c948d614f44b9bd6c7a53c0e917'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:23.840320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2625c948d614f44b9bd6c7a53c0e917'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:23.861117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2625c948d614f44b9bd6c7a53c0e917'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:23.883131 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2437/4874] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:23 2022] DELETE /identity/v3/users/c2625c948d614f44b9bd6c7a53c0e917 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:23.885775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:23.886372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:23.887015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:23.909972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:23.911427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:23.977113 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:24.004848 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2438/4875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:24.032297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:24.034902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:24.144534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:24.146021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:24.150382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd62f0-2d8a-4240-90c5-015eb721d9be admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:24.155730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:24.156349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:24.156634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:24.156911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:24.175007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e5b9a-6a9f-40d5-bd63-7c35c10f7b55 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:24.198583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:24.198583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:24.208703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:24.208703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:24.208703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:24.208703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] PATH_INFO: `/v3/projects/24dbe11e0c364f5fa481385b016394b5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:24.209292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dbe11e0c364f5fa481385b016394b5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:24.209292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:24.209872 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2438/4876] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:24.316552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dbe11e0c364f5fa481385b016394b5', 'request_id': 'req-122b5919-99d3-4778-a46c-f2aef045851a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.349937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dbe11e0c364f5fa481385b016394b5', 'request_id': 'req-122b5919-99d3-4778-a46c-f2aef045851a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.368755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dbe11e0c364f5fa481385b016394b5', 'request_id': 'req-122b5919-99d3-4778-a46c-f2aef045851a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.391492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] The token cache is being invalidate because project 24dbe11e0c364f5fa481385b016394b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:24.391793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.392512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.398173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2439/4877] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:24 2022] DELETE /identity/v3/projects/24dbe11e0c364f5fa481385b016394b5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:24.399911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:24.420045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465d789-e5ca-4978-bff8-f8ec067052cf service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:24.500156 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:24.519495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:24.520208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:24.521654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:24.522484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] PATH_INFO: `/v3/users/c066bb76b20548f3a3307e5754720108` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:24.524546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c066bb76b20548f3a3307e5754720108)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:24.527250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:24.594951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c066bb76b20548f3a3307e5754720108'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.596695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c066bb76b20548f3a3307e5754720108'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.596695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c066bb76b20548f3a3307e5754720108'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.617395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c066bb76b20548f3a3307e5754720108'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.629198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c066bb76b20548f3a3307e5754720108'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:24.665618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2439/4878] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:24 2022] DELETE /identity/v3/users/c066bb76b20548f3a3307e5754720108 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:25.429621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:25.433027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:25.450655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b5919-99d3-4778-a46c-f2aef045851a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:25.564935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:25.565629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:25.565915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:25.566217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] PATH_INFO: `/v3/projects/9daf2c05daaf453ba082038d05cafdcf` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:25.571059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9daf2c05daaf453ba082038d05cafdcf)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:25.575339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:25.599787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:25.601830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:25.628485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaf847-c932-4707-97bc-8f7c30509804 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:25.638950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:25.639885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:25.640327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:25.640763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] PATH_INFO: `/v3/projects/094e892b51ad4329a2d6dca214f4f899` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:25.642860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094e892b51ad4329a2d6dca214f4f899)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:25.644955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:25.672200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9daf2c05daaf453ba082038d05cafdcf', 'request_id': 'req-560e9f1c-89cf-4b53-be72-c51a4517d315'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.691010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9daf2c05daaf453ba082038d05cafdcf', 'request_id': 'req-560e9f1c-89cf-4b53-be72-c51a4517d315'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.715983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9daf2c05daaf453ba082038d05cafdcf', 'request_id': 'req-560e9f1c-89cf-4b53-be72-c51a4517d315'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.740693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094e892b51ad4329a2d6dca214f4f899', 'request_id': 'req-d439eb68-0b0e-4f3e-ae8a-35915de53a35'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.745437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] The token cache is being invalidate because project 9daf2c05daaf453ba082038d05cafdcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:25.749291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094e892b51ad4329a2d6dca214f4f899', 'request_id': 'req-d439eb68-0b0e-4f3e-ae8a-35915de53a35'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.750064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.755390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-560e9f1c-89cf-4b53-be72-c51a4517d315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.756719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094e892b51ad4329a2d6dca214f4f899', 'request_id': 'req-d439eb68-0b0e-4f3e-ae8a-35915de53a35'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.762593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2440/4879] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:25 2022] DELETE /identity/v3/projects/9daf2c05daaf453ba082038d05cafdcf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:25.772155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2c84-d0d1-47e7-b6b3-7769ea208670 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:25.774680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2c84-d0d1-47e7-b6b3-7769ea208670 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:25.775049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2c84-d0d1-47e7-b6b3-7769ea208670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:25.782578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] The token cache is being invalidate because project 094e892b51ad4329a2d6dca214f4f899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:25.782812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.785343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d439eb68-0b0e-4f3e-ae8a-35915de53a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:25.789184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2440/4880] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:25 2022] DELETE /identity/v3/projects/094e892b51ad4329a2d6dca214f4f899 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:25.795401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab4b49-d0af-4129-a16d-07aeb0f492ee None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:25.795907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab4b49-d0af-4129-a16d-07aeb0f492ee None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:25.796397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab4b49-d0af-4129-a16d-07aeb0f492ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:25.797903 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:25.829345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-35fa2c84-d0d1-47e7-b6b3-7769ea208670 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:25.829345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35fa2c84-d0d1-47e7-b6b3-7769ea208670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:25.833140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e0ab4b49-d0af-4129-a16d-07aeb0f492ee None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:25.835764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e0ab4b49-d0af-4129-a16d-07aeb0f492ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:25.906496 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:25.921110 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2441/4881] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:25.926370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3ace-fd2b-49d1-b627-b7dfb4e94b7e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:25.926664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3ace-fd2b-49d1-b627-b7dfb4e94b7e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:25.927158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3ace-fd2b-49d1-b627-b7dfb4e94b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:25.940151 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2441/4882] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:25.942892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabf44e-f022-45ee-be3c-365e260c8ee4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:25.946831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabf44e-f022-45ee-be3c-365e260c8ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:25.946831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabf44e-f022-45ee-be3c-365e260c8ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:25.949659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4bcd3ace-fd2b-49d1-b627-b7dfb4e94b7e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:25.951136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4bcd3ace-fd2b-49d1-b627-b7dfb4e94b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:25.964140 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2442/4883] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:25.966007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3ace-fd2b-49d1-b627-b7dfb4e94b7e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:25.975088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6dabf44e-f022-45ee-be3c-365e260c8ee4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:25.976512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3ace-fd2b-49d1-b627-b7dfb4e94b7e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:25.976842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6dabf44e-f022-45ee-be3c-365e260c8ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:25.982524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:25.983476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:25.983616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:25.983787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:25.984445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:25.984750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:25.986663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:25.991053 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2442/4884] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:25.995894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabf44e-f022-45ee-be3c-365e260c8ee4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.009627 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2443/4885] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:26.010127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabf44e-f022-45ee-be3c-365e260c8ee4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.010946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.017295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.017920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.018196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.018464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.019115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:26.019419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.021219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.039392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2443/4886] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:26.040292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.042278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb0927-0304-421b-bcb8-9c42cf60f370 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.054074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.054695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.055197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.055377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.055973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.061864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.086275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8579c58-4cbf-45bf-bcca-b2ae843798c5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.100692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.102097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.103556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.103838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.104925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.107561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.117506 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2444/4887] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:26.118249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.162141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2444/4888] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/projects => generated 397 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:26.165822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.207742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e8368-2263-40ce-af39-711ac4cef543 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.248735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7309df-f6ff-4e90-8ee3-750366909aa4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.253618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.254359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.254741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.255250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.255993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.258190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.270111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.271374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.271673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.271932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.272622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.274752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.282822 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2445/4889] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/users => generated 305 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:26.283902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.285603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:26.296284 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:26.301354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ad94-eab0-481e-b2ff-df7b80da4b01 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.306095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2445/4890] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:26.307275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.309756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.310553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.310832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.311108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] PATH_INFO: `/v3/users/9998871b511b4475ba58cefde0ac19c9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.312308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9998871b511b4475ba58cefde0ac19c9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.314371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.319479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dd065-9bd9-4677-a5c5-b07fcd613f49 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.324881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.325614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.325966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.326506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.327229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.329734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.341988 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2446/4891] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:26.343124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.354220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd4c0-9e48-42a0-b234-99245e74273a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.359671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.360281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.360759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.360980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.361663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.363385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.374290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9998871b511b4475ba58cefde0ac19c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:26.377928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9998871b511b4475ba58cefde0ac19c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:26.378334 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2447/4892] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:26.378334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.378334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:26.378936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9998871b511b4475ba58cefde0ac19c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:26.391460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d0e29-8a99-47c5-8a8f-7a70972f3ce9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.392491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9998871b511b4475ba58cefde0ac19c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:26.397724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a0464-2a5a-48c4-a343-e72469d8cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.398384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0464-2a5a-48c4-a343-e72469d8cd1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.398669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0464-2a5a-48c4-a343-e72469d8cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.398944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0464-2a5a-48c4-a343-e72469d8cd1c admin admin] PATH_INFO: `/v3/projects/7c3a26764fba41af99ac4b1c48ce9349/users/c3b75f7c7f75471abcdf15230e7fa06d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.400941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9998871b511b4475ba58cefde0ac19c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:26.415729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a0464-2a5a-48c4-a343-e72469d8cd1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3a26764fba41af99ac4b1c48ce9349, user_id=c3b75f7c7f75471abcdf15230e7fa06d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.420439 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2446/4893] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:26 2022] DELETE /identity/v3/users/9998871b511b4475ba58cefde0ac19c9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:26.420439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.420674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a0464-2a5a-48c4-a343-e72469d8cd1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.420775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:26.434289 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:26.438633 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2448/4894] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:26 2022] PUT /identity/v3/projects/7c3a26764fba41af99ac4b1c48ce9349/users/c3b75f7c7f75471abcdf15230e7fa06d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:26.438633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5527e-ec28-4e8b-a69b-84bb8d324b62 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.438633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5527e-ec28-4e8b-a69b-84bb8d324b62 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.438633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5527e-ec28-4e8b-a69b-84bb8d324b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.462317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4fd5527e-ec28-4e8b-a69b-84bb8d324b62 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:26.463700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4fd5527e-ec28-4e8b-a69b-84bb8d324b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:26.499945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572fa24-31f4-4a33-946c-b288407ae412 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.538263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2449/4895] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:26.542085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5527e-ec28-4e8b-a69b-84bb8d324b62 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.554084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5527e-ec28-4e8b-a69b-84bb8d324b62 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.560626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.562234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.562511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.562893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.563534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.565257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.575964 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2450/4896] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:26.576800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.578515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:26.580863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.581778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.582730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.583432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.584719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.587024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.598907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2447/4897] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:26.599919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.613717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4afd57-eef4-448b-bc32-845fa88d952f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.620930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.621809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.622109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.622370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] PATH_INFO: `/v3/projects/7c3a26764fba41af99ac4b1c48ce9349/users/c3b75f7c7f75471abcdf15230e7fa06d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.624989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3a26764fba41af99ac4b1c48ce9349, user_id=c3b75f7c7f75471abcdf15230e7fa06d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.627637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.642481 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2448/4898] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:26 2022] PUT /identity/v3/projects/7c3a26764fba41af99ac4b1c48ce9349/users/c3b75f7c7f75471abcdf15230e7fa06d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:26.643418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.643666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae489-52e4-4359-94a5-aa54b14c5078 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.694080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e053be-2523-456f-9adf-b90468e157ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.694813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e053be-2523-456f-9adf-b90468e157ac service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.695159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e053be-2523-456f-9adf-b90468e157ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.695503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e053be-2523-456f-9adf-b90468e157ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.710111 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:26.720793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146490b5-9e8f-42ae-aed7-5ed67d3d0614 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:26.731547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42ef82-178c-4c56-b8f2-6fb647a925c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:26.732502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ef82-178c-4c56-b8f2-6fb647a925c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.732850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ef82-178c-4c56-b8f2-6fb647a925c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.733708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42ef82-178c-4c56-b8f2-6fb647a925c3 admin admin] PATH_INFO: `/v3/projects/59f963b5369341a1a29b835156c791ac/users/20a97b298402451fba82a70380d1e8a6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.760161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42ef82-178c-4c56-b8f2-6fb647a925c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f963b5369341a1a29b835156c791ac, user_id=20a97b298402451fba82a70380d1e8a6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.763012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42ef82-178c-4c56-b8f2-6fb647a925c3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.774063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e053be-2523-456f-9adf-b90468e157ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:26.775536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e053be-2523-456f-9adf-b90468e157ac service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:26.779840 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2449/4899] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:26 2022] PUT /identity/v3/projects/59f963b5369341a1a29b835156c791ac/users/20a97b298402451fba82a70380d1e8a6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:26.781350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936bff6-6020-47cf-a0a7-a2e8397ecac6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.781814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936bff6-6020-47cf-a0a7-a2e8397ecac6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.782242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936bff6-6020-47cf-a0a7-a2e8397ecac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.789145 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2451/4900] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:26.799300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:26.799646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:26.800676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:26.828284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c936bff6-6020-47cf-a0a7-a2e8397ecac6 None None] MFA Rules not processed for user `c3b75f7c7f75471abcdf15230e7fa06d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:26.830193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c936bff6-6020-47cf-a0a7-a2e8397ecac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:26.841329 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:26.850328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] MFA Rules not processed for user `20a97b298402451fba82a70380d1e8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:26.852289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:26.931145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2450/4901] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:26.937154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936bff6-6020-47cf-a0a7-a2e8397ecac6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.949246 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2452/4902] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:26.979933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:26.981346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.030603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936bff6-6020-47cf-a0a7-a2e8397ecac6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.035435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.036133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.036522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.036858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.037721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.040040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.071689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2451/4903] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:26 2022] POST /identity/v3/projects => generated 395 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:27.072811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.074611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.088187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622a66d-655c-44bd-bc82-04af2b759bd8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.130641 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:27.150048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b0548-edda-4810-b3ef-c1cdd21f17e0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.157364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.158252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.158529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.158918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] PATH_INFO: `/v3/projects/69b607cfa67f43108a4e79cf4e96b6b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.160684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b607cfa67f43108a4e79cf4e96b6b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.162127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.164789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.165558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.165938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.166310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.213240 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:27.233870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.234943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b607cfa67f43108a4e79cf4e96b6b1', 'request_id': 'req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.235544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.242533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b607cfa67f43108a4e79cf4e96b6b1', 'request_id': 'req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.249439 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2453/4904] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:27.250476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.254492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b607cfa67f43108a4e79cf4e96b6b1', 'request_id': 'req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.261351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2a2f-6560-4203-ab09-83db4ac7bc1f service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.273517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] The token cache is being invalidate because project 69b607cfa67f43108a4e79cf4e96b6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:27.273881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.274802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-24cd9eeb-2d4e-461e-98a7-bec6fbe49b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:27.276425 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2452/4905] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:27 2022] DELETE /identity/v3/projects/69b607cfa67f43108a4e79cf4e96b6b1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:27.281669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7dc7-4ffc-4b5c-bdfb-c11e2ebea01c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.282027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7dc7-4ffc-4b5c-bdfb-c11e2ebea01c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.282375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7dc7-4ffc-4b5c-bdfb-c11e2ebea01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.302208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d17d7dc7-4ffc-4b5c-bdfb-c11e2ebea01c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:27.304530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d17d7dc7-4ffc-4b5c-bdfb-c11e2ebea01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.332261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.332893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.333266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.333616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.334426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.336538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.366738 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2454/4906] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:27.370700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.373367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.383312 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2453/4907] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:27.389010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99f65b-7825-4171-b401-e2ccc970a644 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.391210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6bbfa-53b7-4523-b05a-7ebf37893241 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.391500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6bbfa-53b7-4523-b05a-7ebf37893241 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.391774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6bbfa-53b7-4523-b05a-7ebf37893241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.395369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.396075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.396504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.396882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.397751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.399755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.413984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b4f6bbfa-53b7-4523-b05a-7ebf37893241 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:27.414472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2455/4908] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:27.417234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b4f6bbfa-53b7-4523-b05a-7ebf37893241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.419444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.426522 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2454/4909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:27.430751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00224-4fc3-489a-a0fc-b50128d07cda admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.431753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6bbfa-53b7-4523-b05a-7ebf37893241 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.436049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.436692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.437219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.437513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.438160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.439796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.443023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6bbfa-53b7-4523-b05a-7ebf37893241 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.448025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.448627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.448937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.450007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.451240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:27.451366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.452911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.453083 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2456/4910] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:27.457711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.467641 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2455/4911] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:25:27.472335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa8822-ffdd-47fc-b9a7-09f37f02fe77 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.472684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.478048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf49ee-4aa2-48f1-a58f-b1e4b8f7830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.478856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf49ee-4aa2-48f1-a58f-b1e4b8f7830d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.479291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf49ee-4aa2-48f1-a58f-b1e4b8f7830d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.479422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf49ee-4aa2-48f1-a58f-b1e4b8f7830d admin admin] PATH_INFO: `/v3/projects/10086ed750644c5896d1d494910d1119/users/33ca4886c14b41688316ba49dfbb1c5e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.483622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cade3f-70ac-43b6-a2e7-27edaca18e3e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.488308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.488908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.489213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.489771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.490142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.492154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.499015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf49ee-4aa2-48f1-a58f-b1e4b8f7830d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10086ed750644c5896d1d494910d1119, user_id=33ca4886c14b41688316ba49dfbb1c5e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.502648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf49ee-4aa2-48f1-a58f-b1e4b8f7830d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.525296 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2457/4912] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:27 2022] PUT /identity/v3/projects/10086ed750644c5896d1d494910d1119/users/33ca4886c14b41688316ba49dfbb1c5e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:27.531812 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2456/4913] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:27.537170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.537442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.537571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.537715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.572063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] MFA Rules not processed for user `33ca4886c14b41688316ba49dfbb1c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:27.573308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.580118 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:27.634345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f06ca-2b97-4ff3-b183-7496d2ebc769 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.636321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.637597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.637967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.638250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.638910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.640994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.660059 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2458/4914] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:27.673121 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2457/4915] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/users => generated 303 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:27.674410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.675763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.677159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.691335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8214675-9baa-4831-a06b-be763ac46b7b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.696209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.696823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.697151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.697428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.698081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.701957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.708009 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:27.720965 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2458/4916] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:27.721126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.733564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39156385-e574-4a5b-885e-8f6c1008dd64 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.739211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.739824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.740104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.740511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.741186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.742907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.756243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2459/4917] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:27.762134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.772331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c5ab5-98bd-4e71-8aca-b8b890b447b8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.778375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ceb3-723a-42bd-b4dd-3d89ddaf839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.778589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aed5b-8b23-4f45-95de-7d0917bbca3c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:27.779399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ceb3-723a-42bd-b4dd-3d89ddaf839c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.779834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ceb3-723a-42bd-b4dd-3d89ddaf839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.780248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ceb3-723a-42bd-b4dd-3d89ddaf839c admin admin] PATH_INFO: `/v3/projects/581b00a803d240ad9dedefd70055d1cb/users/d58d6862868f44fbbbf3fdb54b3f127e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.784029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:27.784667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.784920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.785217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.787605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.803595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ceb3-723a-42bd-b4dd-3d89ddaf839c admin admin] RBAC: Authorizing `identity:create_grant(project_id=581b00a803d240ad9dedefd70055d1cb, user_id=d58d6862868f44fbbbf3fdb54b3f127e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.807293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ceb3-723a-42bd-b4dd-3d89ddaf839c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.824923 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2460/4918] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:27 2022] PUT /identity/v3/projects/581b00a803d240ad9dedefd70055d1cb/users/d58d6862868f44fbbbf3fdb54b3f127e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:27.836178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16af7d-24c5-4eb9-a1c7-9fb03a073972 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:27.836460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16af7d-24c5-4eb9-a1c7-9fb03a073972 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:27.836733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16af7d-24c5-4eb9-a1c7-9fb03a073972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:27.861344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:27.862877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:27.867245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-be16af7d-24c5-4eb9-a1c7-9fb03a073972 None None] MFA Rules not processed for user `d58d6862868f44fbbbf3fdb54b3f127e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:27.868599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-be16af7d-24c5-4eb9-a1c7-9fb03a073972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:27.874870 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2459/4919] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:27.945192 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2461/4920] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:27.949244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:27.960395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b101382-ad3a-4866-8b52-5b1b29b00717 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.110282 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:28.131759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.132705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.133106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.133486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.134334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.136794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.178019 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2460/4921] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:27 2022] POST /identity/v3/projects => generated 403 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:28.182808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16af7d-24c5-4eb9-a1c7-9fb03a073972 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.213836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16af7d-24c5-4eb9-a1c7-9fb03a073972 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.324235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.325198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.325198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.325627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.326594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.328739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.388966 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2462/4922] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/users => generated 308 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:28.392632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.404648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef37eb7-0388-4899-aebf-b0095b3a1a8c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.410534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.411557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.412102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.412491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.413275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.415033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.429446 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2461/4923] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:28.434517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.437479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.445962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756484-db65-46ef-9bbf-8bf17b9f3dcf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.451037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ea73-48e8-41a9-aa05-ecdf71d340e0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.451570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.452396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.452778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.453223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] PATH_INFO: `/v3/users/c3b75f7c7f75471abcdf15230e7fa06d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.454644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b75f7c7f75471abcdf15230e7fa06d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.456713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.457479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.458253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.458479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.458757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] PATH_INFO: `/v3/projects/57ea955a4ea343bd888e6aeb929aad0c/users/dc25095a835d45eba29024e2a58436a9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.480361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ea955a4ea343bd888e6aeb929aad0c, user_id=dc25095a835d45eba29024e2a58436a9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.485844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.510921 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2462/4924] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:28 2022] PUT /identity/v3/projects/57ea955a4ea343bd888e6aeb929aad0c/users/dc25095a835d45eba29024e2a58436a9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:28.512208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.517468 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:28.525707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b75f7c7f75471abcdf15230e7fa06d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.526555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b75f7c7f75471abcdf15230e7fa06d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.528123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b75f7c7f75471abcdf15230e7fa06d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.546937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b75f7c7f75471abcdf15230e7fa06d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.560315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d19a7b7d-38fa-4d2c-aac2-70704f165468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b75f7c7f75471abcdf15230e7fa06d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:28.580378 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2463/4925] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:28 2022] DELETE /identity/v3/users/c3b75f7c7f75471abcdf15230e7fa06d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:28.581696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548ddb4-c9fd-4754-a389-53cfe0395472 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.582649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548ddb4-c9fd-4754-a389-53cfe0395472 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.589284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548ddb4-c9fd-4754-a389-53cfe0395472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.612885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc857b0-4d49-486c-befc-dce96fde8902 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.618863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a548ddb4-c9fd-4754-a389-53cfe0395472 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:28.620878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a548ddb4-c9fd-4754-a389-53cfe0395472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.703365 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2464/4926] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:28.708051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.708051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.708051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.711890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.712509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.712823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.713049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.713722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.716371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.734406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:28.736015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.755370 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2463/4927] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:28.760160 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2465/4928] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:28.763534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.767027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.770873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.772669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.798010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95903e6a-d7a7-4156-9847-697b295f9b72 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.821410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6ad20-2d28-442c-8b77-cb8da286ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.822080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6ad20-2d28-442c-8b77-cb8da286ae63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.822357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6ad20-2d28-442c-8b77-cb8da286ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.822640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6ad20-2d28-442c-8b77-cb8da286ae63 admin admin] PATH_INFO: `/v3/projects/57ea955a4ea343bd888e6aeb929aad0c/users/dc25095a835d45eba29024e2a58436a9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.825876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6ad20-2d28-442c-8b77-cb8da286ae63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ea955a4ea343bd888e6aeb929aad0c, user_id=dc25095a835d45eba29024e2a58436a9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:28.828510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6ad20-2d28-442c-8b77-cb8da286ae63 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:28.842952 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2464/4929] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:28 2022] PUT /identity/v3/projects/57ea955a4ea343bd888e6aeb929aad0c/users/dc25095a835d45eba29024e2a58436a9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:28.854657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.854944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.855215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.866623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2cd9-2c56-41ea-b8bf-9d73bbfcbbd5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:28.891029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] MFA Rules not processed for user `dc25095a835d45eba29024e2a58436a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:28.892533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:28.927113 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:28.938223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:28.938843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:28.939116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:28.939382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:28.967653 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:28.983723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2465/4930] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:28.992906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:28.994636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:29.009941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:29.011508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:29.024056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2466/4931] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:29.081337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8120cf-ed6f-4898-a9e6-7410495b39ab None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:29.085269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523734-983a-4467-9587-e75d8e2ffa58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:29.085887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523734-983a-4467-9587-e75d8e2ffa58 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:29.086168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523734-983a-4467-9587-e75d8e2ffa58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:29.086443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523734-983a-4467-9587-e75d8e2ffa58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:29.095956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1523734-983a-4467-9587-e75d8e2ffa58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:29.097441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1523734-983a-4467-9587-e75d8e2ffa58 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:29.107778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2466/4932] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:29.250998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:29.261537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948f1b1-18d1-44cc-8311-860cfc206804 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:29.267543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:29.268174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:29.268450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:29.268722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] PATH_INFO: `/v3/users/d58d6862868f44fbbbf3fdb54b3f127e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:29.269901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58d6862868f44fbbbf3fdb54b3f127e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:29.271803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:29.334047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58d6862868f44fbbbf3fdb54b3f127e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:29.334524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58d6862868f44fbbbf3fdb54b3f127e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:29.335377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58d6862868f44fbbbf3fdb54b3f127e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:29.352998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58d6862868f44fbbbf3fdb54b3f127e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:29.362223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58d6862868f44fbbbf3fdb54b3f127e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:29.377828 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2467/4933] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:29 2022] DELETE /identity/v3/users/d58d6862868f44fbbbf3fdb54b3f127e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:29.382614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:29.382926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:29.383200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:29.404444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:29.405698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:29.470851 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2467/4934] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:29.480772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:29.482276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:29.563021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef158e4-0f3c-4ae3-89b3-c33eb52fd45a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:29.568173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:29.568784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:29.569070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:29.569363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:29.582344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:29.584171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:29.603328 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2468/4935] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:29.870874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:29.873168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:29.891698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d540b7-2fc2-4689-8231-832158cd2ce6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:29.897789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:29.899283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:29.899675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:29.900040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] PATH_INFO: `/v3/projects/7c3a26764fba41af99ac4b1c48ce9349` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:29.901564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3a26764fba41af99ac4b1c48ce9349)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:29.904470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:29.965316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3a26764fba41af99ac4b1c48ce9349', 'request_id': 'req-ec0d869a-d059-412d-9926-0a86e77aebd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:29.978377 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:29.987852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3a26764fba41af99ac4b1c48ce9349', 'request_id': 'req-ec0d869a-d059-412d-9926-0a86e77aebd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.009446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3a26764fba41af99ac4b1c48ce9349', 'request_id': 'req-ec0d869a-d059-412d-9926-0a86e77aebd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.066122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] The token cache is being invalidate because project 7c3a26764fba41af99ac4b1c48ce9349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:30.066421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.068342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.074429 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2468/4936] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:29 2022] DELETE /identity/v3/projects/7c3a26764fba41af99ac4b1c48ce9349 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:30.078115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:30.090365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb641e3-7dc0-4804-b261-40831f8836af service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:30.184642 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:30.203723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:30.206900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:30.236524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:30.237362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:30.238041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:30.238041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] PATH_INFO: `/v3/users/33ca4886c14b41688316ba49dfbb1c5e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:30.239052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ca4886c14b41688316ba49dfbb1c5e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:30.241363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:30.311108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ca4886c14b41688316ba49dfbb1c5e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.311908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ca4886c14b41688316ba49dfbb1c5e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.312595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ca4886c14b41688316ba49dfbb1c5e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.339056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ca4886c14b41688316ba49dfbb1c5e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.351051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d869a-d059-412d-9926-0a86e77aebd3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:30.354035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ca4886c14b41688316ba49dfbb1c5e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.361809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:30.362617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:30.363164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:30.363509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] PATH_INFO: `/v3/projects/581b00a803d240ad9dedefd70055d1cb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:30.364794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581b00a803d240ad9dedefd70055d1cb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:30.366919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:30.379186 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2469/4937] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:30 2022] DELETE /identity/v3/users/33ca4886c14b41688316ba49dfbb1c5e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:30.446997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581b00a803d240ad9dedefd70055d1cb', 'request_id': 'req-a0a7e103-28f0-447d-b878-81fce347be44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.458978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581b00a803d240ad9dedefd70055d1cb', 'request_id': 'req-a0a7e103-28f0-447d-b878-81fce347be44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.484384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581b00a803d240ad9dedefd70055d1cb', 'request_id': 'req-a0a7e103-28f0-447d-b878-81fce347be44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.530643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] The token cache is being invalidate because project 581b00a803d240ad9dedefd70055d1cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:30.531195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.532229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.535274 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2469/4938] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:30 2022] DELETE /identity/v3/projects/581b00a803d240ad9dedefd70055d1cb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:30.539696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:30.542303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:30.624057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f2387-cc9b-4e13-8353-4c12832e7bb2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:30.706368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:30.707368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:30.707744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:30.708211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] PATH_INFO: `/v3/users/dc25095a835d45eba29024e2a58436a9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:30.709791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc25095a835d45eba29024e2a58436a9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:30.712166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:30.715727 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:30.778296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc25095a835d45eba29024e2a58436a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.779746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc25095a835d45eba29024e2a58436a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.780468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc25095a835d45eba29024e2a58436a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.802729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc25095a835d45eba29024e2a58436a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.813543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc25095a835d45eba29024e2a58436a9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:30.834015 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2470/4939] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:30 2022] DELETE /identity/v3/users/dc25095a835d45eba29024e2a58436a9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:30.946542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:30.948316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:30.966796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7e103-28f0-447d-b878-81fce347be44 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:31.047983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:31.048634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.049145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.049259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] PATH_INFO: `/v3/projects/10086ed750644c5896d1d494910d1119` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.062973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10086ed750644c5896d1d494910d1119)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:31.072788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:31.087624 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:31.190907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10086ed750644c5896d1d494910d1119', 'request_id': 'req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.199037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10086ed750644c5896d1d494910d1119', 'request_id': 'req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.214410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10086ed750644c5896d1d494910d1119', 'request_id': 'req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.248257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:31.249566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] The token cache is being invalidate because project 10086ed750644c5896d1d494910d1119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:31.249774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:31.250280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.252762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b39b9695-69b3-4984-90ed-13d4e3e3ea0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.254772 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2470/4940] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:30 2022] DELETE /identity/v3/projects/10086ed750644c5896d1d494910d1119 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:31.262315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6350-0bef-40c4-baab-9decf3366731 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.262876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6350-0bef-40c4-baab-9decf3366731 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.263377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6350-0bef-40c4-baab-9decf3366731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.268458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfad4-97c8-4dd6-9c1e-ef6ad915cbde admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:31.309976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e63b6350-0bef-40c4-baab-9decf3366731 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:31.312269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e63b6350-0bef-40c4-baab-9decf3366731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:31.374567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:31.375336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.375740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.376077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] PATH_INFO: `/v3/projects/57ea955a4ea343bd888e6aeb929aad0c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.377562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ea955a4ea343bd888e6aeb929aad0c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:31.382274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:31.445513 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2471/4941] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:31.453312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185c54-4831-44be-af49-348b4d55f21c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.453648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185c54-4831-44be-af49-348b4d55f21c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.453928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185c54-4831-44be-af49-348b4d55f21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.469961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ea955a4ea343bd888e6aeb929aad0c', 'request_id': 'req-8776dd84-4b3f-45d6-9ce7-2152478eaca1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.476612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ea955a4ea343bd888e6aeb929aad0c', 'request_id': 'req-8776dd84-4b3f-45d6-9ce7-2152478eaca1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.484012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7d185c54-4831-44be-af49-348b4d55f21c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:31.485484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ea955a4ea343bd888e6aeb929aad0c', 'request_id': 'req-8776dd84-4b3f-45d6-9ce7-2152478eaca1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.486505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7d185c54-4831-44be-af49-348b4d55f21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:31.514711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] The token cache is being invalidate because project 57ea955a4ea343bd888e6aeb929aad0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:31.516613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.517709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8776dd84-4b3f-45d6-9ce7-2152478eaca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:31.521122 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2471/4942] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:31 2022] DELETE /identity/v3/projects/57ea955a4ea343bd888e6aeb929aad0c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:31.529166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d4d9-5699-48fc-84ce-7f1d64bc9a91 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.529166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d4d9-5699-48fc-84ce-7f1d64bc9a91 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.529166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d4d9-5699-48fc-84ce-7f1d64bc9a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.557386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ed92d4d9-5699-48fc-84ce-7f1d64bc9a91 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:31.558998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ed92d4d9-5699-48fc-84ce-7f1d64bc9a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:31.565722 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:31.597223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2472/4943] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:31.600416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185c54-4831-44be-af49-348b4d55f21c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:31.613114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185c54-4831-44be-af49-348b4d55f21c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:31.618059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:31.618959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.619098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.619391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.620028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:31.620330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:31.622750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:31.638234 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2473/4944] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:25:31.642890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:31.668591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dd7a5-fadd-42a1-8ffd-b386a60bafc3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:31.678150 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2472/4945] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:31.679762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c914-faf2-4029-8c63-9ecf89049ff7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.680151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c914-faf2-4029-8c63-9ecf89049ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.680558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c914-faf2-4029-8c63-9ecf89049ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.693382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:31.694800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.696459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.697182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.698876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:31.704417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0285c914-faf2-4029-8c63-9ecf89049ff7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:31.705456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:31.706184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0285c914-faf2-4029-8c63-9ecf89049ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:31.719744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2473/4946] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:31.720919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c914-faf2-4029-8c63-9ecf89049ff7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:31.732462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c914-faf2-4029-8c63-9ecf89049ff7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:31.739743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:31.739743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.739743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.740625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.741338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:31.741797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:31.743924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:31.763437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2474/4947] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:31.764515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:31.790149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528e22b-debf-4f19-84ac-522a3ef4c07b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:31.797967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:31.799026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:31.799517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:31.799980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:31.800804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:31.803091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:31.806192 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2474/4948] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:31.812417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:31.829971 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:31.869465 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2475/4949] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:31.873503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:31.955240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c602f-1f1a-43be-96f9-7a13af8e16c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.014608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7a92-502f-4c8a-8d31-8751881371af admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.020760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.021665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.022121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.023507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.024747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.029533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.065852 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2476/4950] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:32.070028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.087066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316792-7a47-4843-96fd-c77798f24a93 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.094224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.096163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.096578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.096965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.097664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.099963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.118551 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2477/4951] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:32.119742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.127907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.128859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.129781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.130294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.131195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.133280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42044880-3e9c-48cf-b778-aca2556c8c63 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.133707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.144668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.146327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.146613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.146881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.147681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.149900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.169836 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2478/4952] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:32.172033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.186737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5750f1-4b56-44b8-ac1b-1fafed0acf98 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.192533 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2475/4953] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:31 2022] POST /identity/v3/users => generated 292 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:32.196369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68da84-7e81-4dc4-99a2-8c20275f9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.197207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68da84-7e81-4dc4-99a2-8c20275f9e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.197416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68da84-7e81-4dc4-99a2-8c20275f9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.197687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68da84-7e81-4dc4-99a2-8c20275f9e0b admin admin] PATH_INFO: `/v3/projects/8161d5d34f094267983d859220b593b3/users/1c905511ad5149498d06c5e38aa7c555/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.199916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.210753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981839-3829-4727-86bb-03dea67fa100 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.232138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68da84-7e81-4dc4-99a2-8c20275f9e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8161d5d34f094267983d859220b593b3, user_id=1c905511ad5149498d06c5e38aa7c555, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.238023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.238660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.238942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.239251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.239914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.241591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68da84-7e81-4dc4-99a2-8c20275f9e0b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.247367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.264064 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2476/4954] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:32.269030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.284991 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2479/4955] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:32 2022] PUT /identity/v3/projects/8161d5d34f094267983d859220b593b3/users/1c905511ad5149498d06c5e38aa7c555/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:32.289905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.290196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.290626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.299662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8430f27-e48d-4cce-9518-ba1c3d6f3b42 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.369874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:32.380977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:32.484063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.486591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.488253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.490681 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:32.491294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.494165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.504659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.555940 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2477/4956] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:32.557161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.605289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea1bf-bde4-4a8b-9c44-ce471a3883e5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.618307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3711f37-bb43-438a-aeb0-bcaf4737f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.618990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3711f37-bb43-438a-aeb0-bcaf4737f78e admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.619273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3711f37-bb43-438a-aeb0-bcaf4737f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.619552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3711f37-bb43-438a-aeb0-bcaf4737f78e admin admin] PATH_INFO: `/v3/projects/ba0cd60f0a7f478ba7a6f0b8f02684f0/users/06da13a9746b4f318e4c4b75409edc76/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.638097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2480/4957] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:32.651355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3711f37-bb43-438a-aeb0-bcaf4737f78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0cd60f0a7f478ba7a6f0b8f02684f0, user_id=06da13a9746b4f318e4c4b75409edc76, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.656438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3711f37-bb43-438a-aeb0-bcaf4737f78e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:32.673400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.675922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:32.694257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2478/4958] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:32 2022] PUT /identity/v3/projects/ba0cd60f0a7f478ba7a6f0b8f02684f0/users/06da13a9746b4f318e4c4b75409edc76/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:32.705962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5986-3fce-49c9-b2c0-fd14b44e7cd9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.706701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5986-3fce-49c9-b2c0-fd14b44e7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.706991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5986-3fce-49c9-b2c0-fd14b44e7cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.739245 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:32.789271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a92f5986-3fce-49c9-b2c0-fd14b44e7cd9 None None] MFA Rules not processed for user `06da13a9746b4f318e4c4b75409edc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:32.790768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a92f5986-3fce-49c9-b2c0-fd14b44e7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:32.808028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522382e-b02c-4a36-a027-ce1a6b8daa59 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.893643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:32.894577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:32.894805 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2479/4959] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:32.895173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:32.895468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:32.899113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f5986-3fce-49c9-b2c0-fd14b44e7cd9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:32.994027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:32.995174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f5986-3fce-49c9-b2c0-fd14b44e7cd9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:32.995517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.001357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.002521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.002903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.003280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.004246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.006750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.024606 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2481/4960] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:33.062197 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2480/4961] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:32 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:33.065704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.076779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aae740-7412-4628-aafa-f65f6c58d4df service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.108276 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:33.191450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.192136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.192465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.192742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.193463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.195773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.237890 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2482/4962] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:33 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:33.239529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.255618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843d812-720e-4db1-9bdc-667069f903ab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.263565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.264282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.264649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.264991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.265751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.267593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.287925 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2481/4963] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:33.289657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.307950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b1eab-3be6-47fb-8d5b-550223459b7c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.316640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3ce51-d671-44d6-86bb-24ac6bbaf2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.317571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ce51-d671-44d6-86bb-24ac6bbaf2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.317930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ce51-d671-44d6-86bb-24ac6bbaf2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.318372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ce51-d671-44d6-86bb-24ac6bbaf2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.320472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3ce51-d671-44d6-86bb-24ac6bbaf2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.322544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3ce51-d671-44d6-86bb-24ac6bbaf2a1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.341679 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2483/4964] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:33.343447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.357711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fc2d-9ea1-44c2-bdb4-fb6363a1b991 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.364691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.365839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.366229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.366605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] PATH_INFO: `/v3/projects/555160230ca546a2843033d1c5dbf24e/users/f578681902934dd19266b7aee7be5fd5/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.387569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555160230ca546a2843033d1c5dbf24e, user_id=f578681902934dd19266b7aee7be5fd5, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.390657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:33.418670 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2482/4965] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:33 2022] PUT /identity/v3/projects/555160230ca546a2843033d1c5dbf24e/users/f578681902934dd19266b7aee7be5fd5/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:33.420923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.421278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.421563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.487168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] MFA Rules not processed for user `f578681902934dd19266b7aee7be5fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:33.488948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:33.640379 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2484/4966] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:33.655806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.657766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:33.793927 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:33.830365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:33.832467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:33.836068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322f38-8114-44fd-b172-79176eb00c26 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:33.864148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9370e7-ce1e-4ce0-894e-e354ba94dda2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:33.865026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9370e7-ce1e-4ce0-894e-e354ba94dda2 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:33.865549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9370e7-ce1e-4ce0-894e-e354ba94dda2 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:33.866019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9370e7-ce1e-4ce0-894e-e354ba94dda2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:33.992322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9370e7-ce1e-4ce0-894e-e354ba94dda2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:33.994167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9370e7-ce1e-4ce0-894e-e354ba94dda2 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:34.024093 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2483/4967] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:34.104627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5e675-00fc-4715-a0e5-dea62d07701b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:34.141523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532cbd-60e9-4679-9568-9dafd5528f65 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:34.141919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532cbd-60e9-4679-9568-9dafd5528f65 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:34.142205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532cbd-60e9-4679-9568-9dafd5528f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:34.158843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:34.159469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:34.159754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:34.160028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:34.173479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:34.195876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-74532cbd-60e9-4679-9568-9dafd5528f65 None None] MFA Rules not processed for user `1c905511ad5149498d06c5e38aa7c555`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:34.197463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-74532cbd-60e9-4679-9568-9dafd5528f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:34.279662 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:34.348400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:34.350120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:34.351695 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2484/4968] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:34.352935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:34.353360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:34.353917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:34.376208 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2485/4969] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:34.377100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:34.399345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb471-f0f5-4070-b6a5-e6aa73bd8e9d service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:34.408702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:34.412330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:34.412963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:34.413748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:34.413748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:34.426511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:34.434246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:34.434246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:34.473167 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2486/4970] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:34.474106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:34.630525 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2485/4971] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:34.684019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:34.685575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:34.701133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c61c6-9bf8-4219-9739-380329bb955b service glance] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:34.715283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:34.715998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:34.716279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:34.716550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:34.717267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:34.719206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:34.748758 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:34.780656 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2487/4972] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:34 2022] POST /identity/v3/projects => generated 403 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:34.785827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:34.857219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b9fe9-0f6d-4db6-b66b-cfeb4a5f7ba6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:34.989110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14969db-cdb2-4006-817c-d25d38dd6996 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:35.004530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:35.006551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.006845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.007100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.008895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:35.016076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:35.032651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:35.033305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.033581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.033848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.067055 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2488/4973] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:34 2022] POST /identity/v3/users => generated 308 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:35.070612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:35.099465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65593-18ef-4697-aa74-c6724b396a04 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:35.113118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:35.113879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.114165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.114479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.115133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:35.119892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:35.151910 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2489/4974] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:35.155678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:35.177039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3aae2-0bdd-4fdf-8f7d-10388a003179 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:35.184979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:35.186586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:35.189081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:35.190363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.190647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.190914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] PATH_INFO: `/v3/projects/41a47a5495eb4fe2aa9eb034bc98580a/users/3effd9b1a84f476c91a417eb103666b0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.249992 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2486/4975] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:25:35.268169 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:35.273716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a47a5495eb4fe2aa9eb034bc98580a, user_id=3effd9b1a84f476c91a417eb103666b0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:35.278618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:35.309944 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2490/4976] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:35 2022] PUT /identity/v3/projects/41a47a5495eb4fe2aa9eb034bc98580a/users/3effd9b1a84f476c91a417eb103666b0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:35.314787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:35.336971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:35.340951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659d250-6efd-4635-8772-fd9718fe35b3 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:35.425743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c99818-af6e-4891-9344-657d9d1b9ee4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:35.437509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:35.438381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.440219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.440691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] PATH_INFO: `/v3/users/06da13a9746b4f318e4c4b75409edc76` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.444550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06da13a9746b4f318e4c4b75409edc76)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:35.446737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:35.503828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:35.504371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.504648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.504918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.505640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:35.507609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:35.546961 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2487/4977] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:35.548184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:35.566158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4da7d7-2121-4bd5-bf3b-b4662bd69b48 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:35.567860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06da13a9746b4f318e4c4b75409edc76'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:35.568659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06da13a9746b4f318e4c4b75409edc76'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:35.569982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06da13a9746b4f318e4c4b75409edc76'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:35.580873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a7932-4c59-47a5-a16e-4d5c8a45f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:35.582539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7932-4c59-47a5-a16e-4d5c8a45f8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.582539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7932-4c59-47a5-a16e-4d5c8a45f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.582539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7932-4c59-47a5-a16e-4d5c8a45f8f1 admin admin] PATH_INFO: `/v3/projects/41a47a5495eb4fe2aa9eb034bc98580a/users/3effd9b1a84f476c91a417eb103666b0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.596098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a7932-4c59-47a5-a16e-4d5c8a45f8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a47a5495eb4fe2aa9eb034bc98580a, user_id=3effd9b1a84f476c91a417eb103666b0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:35.598810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a7932-4c59-47a5-a16e-4d5c8a45f8f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:35.621959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06da13a9746b4f318e4c4b75409edc76'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:35.633585 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:35.636131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06da13a9746b4f318e4c4b75409edc76'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:35.649306 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2488/4978] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:35 2022] PUT /identity/v3/projects/41a47a5495eb4fe2aa9eb034bc98580a/users/3effd9b1a84f476c91a417eb103666b0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:35.678431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2491/4979] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:35 2022] DELETE /identity/v3/users/06da13a9746b4f318e4c4b75409edc76 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:35.685765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788f2a-85f4-46cc-91ff-89178f7d9765 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:35.686288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788f2a-85f4-46cc-91ff-89178f7d9765 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:35.686288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79788f2a-85f4-46cc-91ff-89178f7d9765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:35.739776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79788f2a-85f4-46cc-91ff-89178f7d9765 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:35.742100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79788f2a-85f4-46cc-91ff-89178f7d9765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:35.849803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2489/4980] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:35.862897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:35.864538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:35.998083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a00646-6059-4755-a36a-ad91ece6a44c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:36.011303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:36.014348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:36.014713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:36.018804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:36.051240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:36.052983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:36.079352 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2492/4981] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:36.591421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcce3e-bd7f-4628-ba8b-4b36d558939b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:36.591778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcce3e-bd7f-4628-ba8b-4b36d558939b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:36.591992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcce3e-bd7f-4628-ba8b-4b36d558939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:36.622644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-94fcce3e-bd7f-4628-ba8b-4b36d558939b None None] MFA Rules not processed for user `3effd9b1a84f476c91a417eb103666b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:36.624054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-94fcce3e-bd7f-4628-ba8b-4b36d558939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:36.736185 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2490/4982] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:37.128282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:37.129970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:37.186426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc14acc-70c5-488f-b0dd-89aef3355333 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:37.193413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:37.194085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:37.195283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:37.195565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] PATH_INFO: `/v3/projects/ba0cd60f0a7f478ba7a6f0b8f02684f0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:37.196921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0cd60f0a7f478ba7a6f0b8f02684f0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:37.199349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:37.234032 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:37.307045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0cd60f0a7f478ba7a6f0b8f02684f0', 'request_id': 'req-f079fafa-acbf-4c48-bf07-cef4847e7513'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.314125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0cd60f0a7f478ba7a6f0b8f02684f0', 'request_id': 'req-f079fafa-acbf-4c48-bf07-cef4847e7513'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.320998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0cd60f0a7f478ba7a6f0b8f02684f0', 'request_id': 'req-f079fafa-acbf-4c48-bf07-cef4847e7513'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.341448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] The token cache is being invalidate because project ba0cd60f0a7f478ba7a6f0b8f02684f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:37.341764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.342512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.347326 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2493/4983] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:37 2022] DELETE /identity/v3/projects/ba0cd60f0a7f478ba7a6f0b8f02684f0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:37.348711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcce3e-bd7f-4628-ba8b-4b36d558939b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:37.371395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcce3e-bd7f-4628-ba8b-4b36d558939b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:37.453705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:37.462496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:37.466363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:37.466758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] PATH_INFO: `/v3/users/f578681902934dd19266b7aee7be5fd5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:37.470287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f578681902934dd19266b7aee7be5fd5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:37.472232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:37.505457 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:37.535508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f578681902934dd19266b7aee7be5fd5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.536831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f578681902934dd19266b7aee7be5fd5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.536831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f578681902934dd19266b7aee7be5fd5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.545255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f578681902934dd19266b7aee7be5fd5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.557592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f578681902934dd19266b7aee7be5fd5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:37.571996 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2491/4984] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:37 2022] DELETE /identity/v3/users/f578681902934dd19266b7aee7be5fd5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:38.060831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.063383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.091874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079fafa-acbf-4c48-bf07-cef4847e7513 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.206038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.207055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.207348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.207626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] PATH_INFO: `/v3/projects/555160230ca546a2843033d1c5dbf24e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.208839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555160230ca546a2843033d1c5dbf24e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.210789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.257261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.259653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.277397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c106a07-dcd1-4930-9754-9366f80f34a9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.282271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555160230ca546a2843033d1c5dbf24e', 'request_id': 'req-02f84342-a1f0-40ea-94cb-9ef006f95201'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.290977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555160230ca546a2843033d1c5dbf24e', 'request_id': 'req-02f84342-a1f0-40ea-94cb-9ef006f95201'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.299387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555160230ca546a2843033d1c5dbf24e', 'request_id': 'req-02f84342-a1f0-40ea-94cb-9ef006f95201'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.319875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] The token cache is being invalidate because project 555160230ca546a2843033d1c5dbf24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:38.320208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.320878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02f84342-a1f0-40ea-94cb-9ef006f95201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.322907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2494/4985] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:38 2022] DELETE /identity/v3/projects/555160230ca546a2843033d1c5dbf24e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:38.330321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046ff5a-fdc0-41bc-88e0-f1dc37af7161 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.330667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046ff5a-fdc0-41bc-88e0-f1dc37af7161 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.330882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046ff5a-fdc0-41bc-88e0-f1dc37af7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.352083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3046ff5a-fdc0-41bc-88e0-f1dc37af7161 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:38.353506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3046ff5a-fdc0-41bc-88e0-f1dc37af7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.357258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.358463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.358944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.359418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] PATH_INFO: `/v3/users/1c905511ad5149498d06c5e38aa7c555` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.361433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c905511ad5149498d06c5e38aa7c555)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.363600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.370569 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2495/4986] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:38.372549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5160-0be0-47d3-9594-05ee582687e0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.373091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5160-0be0-47d3-9594-05ee582687e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.373369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5160-0be0-47d3-9594-05ee582687e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.396465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1a0b5160-0be0-47d3-9594-05ee582687e0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:38.397823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1a0b5160-0be0-47d3-9594-05ee582687e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.413216 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2496/4987] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:38.415288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5160-0be0-47d3-9594-05ee582687e0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.426194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5160-0be0-47d3-9594-05ee582687e0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.433766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.434532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.434867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.435146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.435800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:38.436103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.438297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.441215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c905511ad5149498d06c5e38aa7c555'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.443248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c905511ad5149498d06c5e38aa7c555'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.444024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c905511ad5149498d06c5e38aa7c555'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.453913 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:38.457600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c905511ad5149498d06c5e38aa7c555'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.461272 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2497/4988] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:38.466103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.473470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.477300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c905511ad5149498d06c5e38aa7c555'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:38.500983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5e752-c310-4bc5-ad6b-d9db40eb65e7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.506590 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2492/4989] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:38 2022] DELETE /identity/v3/users/1c905511ad5149498d06c5e38aa7c555 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:38.591642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.592262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.592545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.592821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.594347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.596584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.647341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.660801 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2498/4990] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:38 2022] POST /identity/v3/projects => generated 391 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:38.661888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d5077-8740-418c-a170-ce12c4e0c276 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.689543 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:38.749415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.750037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.750315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.750585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.751281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.753147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.787602 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2493/4991] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:38 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:38.793443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.804462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8c223-9d67-4f2a-90e5-df00593cca3a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.827451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.829163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.829354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.829612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.830713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.832484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.854825 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2499/4992] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:38.856899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.874357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.876504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:38.877016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d3cee-5bb0-4f80-9580-283c617377df admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.891394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.892042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.892978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.892978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.893234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.895043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.899019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0f27-1831-4f2e-b226-7f43f3d87c02 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.907232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.908272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.908796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.912278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2494/4993] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:38.912763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] PATH_INFO: `/v3/projects/8161d5d34f094267983d859220b593b3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.913349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:38.914782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8161d5d34f094267983d859220b593b3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.917037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.926237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fad2e2-690d-4e6d-9851-09a283775632 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:38.932357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efb1b0-2ca1-41b8-9f7f-168e2f00a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:38.933782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efb1b0-2ca1-41b8-9f7f-168e2f00a135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.934405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efb1b0-2ca1-41b8-9f7f-168e2f00a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.934941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efb1b0-2ca1-41b8-9f7f-168e2f00a135 admin admin] PATH_INFO: `/v3/projects/c866496c3e914dc8beb2e7243fd8f5da/users/19b1d8a0aee74ce5af80ec8b9e1833d1/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:38.954135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efb1b0-2ca1-41b8-9f7f-168e2f00a135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c866496c3e914dc8beb2e7243fd8f5da, user_id=19b1d8a0aee74ce5af80ec8b9e1833d1, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:38.957720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efb1b0-2ca1-41b8-9f7f-168e2f00a135 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:38.984465 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2495/4994] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:38 2022] PUT /identity/v3/projects/c866496c3e914dc8beb2e7243fd8f5da/users/19b1d8a0aee74ce5af80ec8b9e1833d1/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:38.997519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:38.997801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:38.998815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:39.036133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8161d5d34f094267983d859220b593b3', 'request_id': 'req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.047904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] MFA Rules not processed for user `19b1d8a0aee74ce5af80ec8b9e1833d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:39.049348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:39.054133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8161d5d34f094267983d859220b593b3', 'request_id': 'req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.097812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8161d5d34f094267983d859220b593b3', 'request_id': 'req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.118068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] The token cache is being invalidate because project 8161d5d34f094267983d859220b593b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:39.119662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.122003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.130438 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2500/4995] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:38 2022] DELETE /identity/v3/projects/8161d5d34f094267983d859220b593b3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:39.133733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:39.135538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:39.209725 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2496/4996] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:39.214235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:39.217647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:39.282967 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:39.289825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6c00a-aff6-48ff-aa8d-17bf4572b81b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:39.313123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:39.313788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:39.314074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:39.314393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] PATH_INFO: `/v3/users/3effd9b1a84f476c91a417eb103666b0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:39.315647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3effd9b1a84f476c91a417eb103666b0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:39.317592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:39.423327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184166-b5f4-477b-a8ab-e9433ae619ab None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:39.428538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:39.429301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:39.429679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:39.430071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:39.431448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:39.434779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:39.442383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3effd9b1a84f476c91a417eb103666b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.444452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3effd9b1a84f476c91a417eb103666b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.445808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3effd9b1a84f476c91a417eb103666b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.472750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3effd9b1a84f476c91a417eb103666b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.480805 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:39.487838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3effd9b1a84f476c91a417eb103666b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:39.507755 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2497/4997] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:39 2022] POST /identity/v3/projects => generated 389 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:39.515986 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2501/4998] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:39 2022] DELETE /identity/v3/users/3effd9b1a84f476c91a417eb103666b0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:39.525226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:39.533221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:39.674815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fd49a-0a26-4aae-b527-06c0aa7e5b4f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:39.791617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:39.793055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:39.794278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:39.794754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:39.795694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:39.800228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:39.836516 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2498/4999] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:39 2022] POST /identity/v3/users => generated 301 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:39.841170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:39.854914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf41138-cfe9-444e-a514-5163d34fc634 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:39.869445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:39.870075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:39.870356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:39.870668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:39.872265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:39.873906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:39.903175 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2502/5000] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:39.907798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:39.928622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e336c8-9f63-44fa-bf0e-f1eb97a4e15e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:39.944306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:39.945383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:39.945810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:39.946257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] PATH_INFO: `/v3/projects/1453a0db2393493fb6df63b817778156/users/cb6c397884c5412cad1d7eb1cb623f63/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:39.984035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1453a0db2393493fb6df63b817778156, user_id=cb6c397884c5412cad1d7eb1cb623f63, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:39.988918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:40.036512 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2499/5001] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:39 2022] PUT /identity/v3/projects/1453a0db2393493fb6df63b817778156/users/cb6c397884c5412cad1d7eb1cb623f63/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:40.040363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:40.061102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fd1b-7da6-47c9-b05c-7f7bc2c81874 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:40.144305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:40.146280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:40.256086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:40.262490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:40.262775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:40.263052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:40.263709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:40.265424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:40.284264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2503/5002] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:40.288610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:40.339221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eb74d-0c9a-4aec-bea6-725d17bba89d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:40.340584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e570-6f81-439b-ac6b-aa758292ee1f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:40.351376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e724cb-7261-4e91-8f7d-29ee41ba88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:40.354020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e724cb-7261-4e91-8f7d-29ee41ba88ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:40.354554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:40.355498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:40.356022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e724cb-7261-4e91-8f7d-29ee41ba88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:40.356506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e724cb-7261-4e91-8f7d-29ee41ba88ef admin admin] PATH_INFO: `/v3/projects/1453a0db2393493fb6df63b817778156/users/cb6c397884c5412cad1d7eb1cb623f63/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:40.357011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:40.358491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] PATH_INFO: `/v3/projects/41a47a5495eb4fe2aa9eb034bc98580a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:40.360750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a47a5495eb4fe2aa9eb034bc98580a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:40.362662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e724cb-7261-4e91-8f7d-29ee41ba88ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1453a0db2393493fb6df63b817778156, user_id=cb6c397884c5412cad1d7eb1cb623f63, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:40.365665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:40.369862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e724cb-7261-4e91-8f7d-29ee41ba88ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:40.413725 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:40.435480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2504/5003] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:40 2022] PUT /identity/v3/projects/1453a0db2393493fb6df63b817778156/users/cb6c397884c5412cad1d7eb1cb623f63/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:40.454095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2f717-cd5a-45d0-9808-04cecb623d44 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:40.458263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2f717-cd5a-45d0-9808-04cecb623d44 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:40.458835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2f717-cd5a-45d0-9808-04cecb623d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:40.587079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b2e2f717-cd5a-45d0-9808-04cecb623d44 None None] MFA Rules not processed for user `cb6c397884c5412cad1d7eb1cb623f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:40.588697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b2e2f717-cd5a-45d0-9808-04cecb623d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:40.617879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a47a5495eb4fe2aa9eb034bc98580a', 'request_id': 'req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.623857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a47a5495eb4fe2aa9eb034bc98580a', 'request_id': 'req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.642170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a47a5495eb4fe2aa9eb034bc98580a', 'request_id': 'req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.660427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] The token cache is being invalidate because project 41a47a5495eb4fe2aa9eb034bc98580a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:40.660718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.662364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.666387 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2500/5004] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:40 2022] DELETE /identity/v3/projects/41a47a5495eb4fe2aa9eb034bc98580a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:40.667470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:40.669300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:40.704204 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:40.760034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c32c5e-b9c7-4f73-8ea2-abbe6f0b9fac admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:40.771695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:40.772949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:40.773474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:40.774258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] PATH_INFO: `/v3/users/20a97b298402451fba82a70380d1e8a6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:40.775893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a97b298402451fba82a70380d1e8a6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:40.779055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:40.787100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2505/5005] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:40.787100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:40.787100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:40.787100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:40.857834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a97b298402451fba82a70380d1e8a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.858839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a97b298402451fba82a70380d1e8a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.859079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:40.859920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a97b298402451fba82a70380d1e8a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.860455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:40.876096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a97b298402451fba82a70380d1e8a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.882371 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2506/5006] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:40.883215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:40.887268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:40.914041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-60d95865-0ccc-4c01-b46c-ee19498e9791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a97b298402451fba82a70380d1e8a6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:40.945521 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2501/5007] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:40 2022] DELETE /identity/v3/users/20a97b298402451fba82a70380d1e8a6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:40.950558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0aba7-c5d7-4878-be8e-bee8be853af2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:40.950908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0aba7-c5d7-4878-be8e-bee8be853af2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:40.953627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0aba7-c5d7-4878-be8e-bee8be853af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:40.986541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb657086-01fc-4b2b-8e1d-b58320d7d8b0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.026700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0fc0aba7-c5d7-4878-be8e-bee8be853af2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:41.033010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0fc0aba7-c5d7-4878-be8e-bee8be853af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:41.059434 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:41.085388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9654738-bba2-417f-9fdd-8998e3a624b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.086004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9654738-bba2-417f-9fdd-8998e3a624b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.086279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9654738-bba2-417f-9fdd-8998e3a624b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.086627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9654738-bba2-417f-9fdd-8998e3a624b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.089203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e9654738-bba2-417f-9fdd-8998e3a624b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:41.171497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9654738-bba2-417f-9fdd-8998e3a624b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.172956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9654738-bba2-417f-9fdd-8998e3a624b1 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.188744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2507/5008] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:41.189735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2502/5009] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:41.203584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0aba7-c5d7-4878-be8e-bee8be853af2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:41.204050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8bdc-3adf-4ebe-97b6-90eb1e96021d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.204339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8bdc-3adf-4ebe-97b6-90eb1e96021d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.204605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8bdc-3adf-4ebe-97b6-90eb1e96021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.218270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0aba7-c5d7-4878-be8e-bee8be853af2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.229347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.232070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.233251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.233971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.236170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:41.237533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.240880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.253347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3cbe8bdc-3adf-4ebe-97b6-90eb1e96021d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:41.254976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3cbe8bdc-3adf-4ebe-97b6-90eb1e96021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:41.269120 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2508/5010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:41.271052 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2503/5011] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:41.276723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe8bdc-3adf-4ebe-97b6-90eb1e96021d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:41.284498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:41.287084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:41.307332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd838434-1a34-4568-8c41-e0489dabb262 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.310285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe8bdc-3adf-4ebe-97b6-90eb1e96021d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.316209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.317496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.317795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.318074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.344495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.345742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.347562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.347812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.348483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.348959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.349814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.356580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.391381 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2504/5012] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:41.435797 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2509/5013] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:41 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:41.440820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:41.454740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e33cd-0e3b-423e-8f6a-2322db2514c7 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.592686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.595061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.596146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.597314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.599556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.607778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.692073 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2505/5014] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:41 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:41.696543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:41.719155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f1048-e90b-4d9a-8c05-edbc9bee606e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.726583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.727092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.727450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.727803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.733180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.733406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.738131 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:41.753939 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2510/5015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:41.754604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:41.778110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711f080-4fd9-41eb-a670-6e15613db469 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.786636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb2d6e-3e8f-48df-92c2-5743695bbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.787663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2d6e-3e8f-48df-92c2-5743695bbf4e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.788487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2d6e-3e8f-48df-92c2-5743695bbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.788915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb2d6e-3e8f-48df-92c2-5743695bbf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.789795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb2d6e-3e8f-48df-92c2-5743695bbf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.795004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb2d6e-3e8f-48df-92c2-5743695bbf4e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.818725 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2506/5016] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:41.823826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:41.847090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45407a8d-c7ae-4a35-a2ba-631515f68825 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:41.862278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:41.862966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.863252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.863525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] PATH_INFO: `/v3/projects/4d48702b322940b785f50fe60a89d306/users/4c51f9278a9042f2a44a620339938fac/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:41.921970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d48702b322940b785f50fe60a89d306, user_id=4c51f9278a9042f2a44a620339938fac, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:41.927407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:41.971127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2511/5017] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:41 2022] PUT /identity/v3/projects/4d48702b322940b785f50fe60a89d306/users/4c51f9278a9042f2a44a620339938fac/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:41.972363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:41.972814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:41.973271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.014300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] MFA Rules not processed for user `4c51f9278a9042f2a44a620339938fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:42.017164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:42.167779 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:42.174580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:42.176711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:42.198453 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2507/5018] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:42.208660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:42.215695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:42.339835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951b224-6a54-44b0-8f94-e26d31e35e25 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:42.341219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a455-c9ee-4097-b02b-9f2c21a70040 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:42.352274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:42.352902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.353350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.353830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.355550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:42.356174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.356691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.357192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] PATH_INFO: `/v3/projects/59f963b5369341a1a29b835156c791ac` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.362012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f963b5369341a1a29b835156c791ac)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:42.364495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:42.393845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:42.398038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:42.423836 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2508/5019] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:42.443459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:42.458249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f963b5369341a1a29b835156c791ac', 'request_id': 'req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.461155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37db0d-ad37-496c-aeb7-5dff382ebe47 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:42.470481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f963b5369341a1a29b835156c791ac', 'request_id': 'req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.480768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f963b5369341a1a29b835156c791ac', 'request_id': 'req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.498896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] The token cache is being invalidate because project 59f963b5369341a1a29b835156c791ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:42.499284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.500171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4507f6f-f9f0-40b9-80f3-9d2afe5fe4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.506071 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2512/5020] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:42 2022] DELETE /identity/v3/projects/59f963b5369341a1a29b835156c791ac => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:42.507558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ca0c-0277-4c45-84d9-a6d14df25c0a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.507912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ca0c-0277-4c45-84d9-a6d14df25c0a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.508252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ca0c-0277-4c45-84d9-a6d14df25c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.535461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a444ca0c-0277-4c45-84d9-a6d14df25c0a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:42.537544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a444ca0c-0277-4c45-84d9-a6d14df25c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:42.564468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:42.565204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.565418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.565684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] PATH_INFO: `/v3/users/4c51f9278a9042f2a44a620339938fac` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.567145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c51f9278a9042f2a44a620339938fac)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:42.569377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:42.643888 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2513/5021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:42.651485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5f7a-1e8c-4266-b3e8-e02973d613ef None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.652389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5f7a-1e8c-4266-b3e8-e02973d613ef None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.652675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5f7a-1e8c-4266-b3e8-e02973d613ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.662015 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:42.671255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c51f9278a9042f2a44a620339938fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.671799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c51f9278a9042f2a44a620339938fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.672434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c51f9278a9042f2a44a620339938fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.676661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b14e5f7a-1e8c-4266-b3e8-e02973d613ef None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:42.678342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b14e5f7a-1e8c-4266-b3e8-e02973d613ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:42.687644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c51f9278a9042f2a44a620339938fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.689457 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2514/5022] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:42.693786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5f7a-1e8c-4266-b3e8-e02973d613ef None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:42.706027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5f7a-1e8c-4266-b3e8-e02973d613ef None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:42.711430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:42.712293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.712697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.713225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.713981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:42.714425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:42.717416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:42.717765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ed7f83af-0b28-45b7-b05a-b74f3a905593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c51f9278a9042f2a44a620339938fac'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:42.735627 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2515/5023] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:42.736634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:42.748955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7caa87-5a57-40c3-8c2f-1e4d3fa48814 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:42.754903 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2509/5024] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:42 2022] DELETE /identity/v3/users/4c51f9278a9042f2a44a620339938fac => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:42.756289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.756571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.756844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.816467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:42.820085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:42.854797 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:42.884104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:42.884891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:42.885743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:42.886406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:42.888586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:42.893163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:42.957593 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2516/5025] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:42 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:42.961114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2510/5026] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:42.961581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:42.979101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:42.981842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:43.099009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db136c5-3caf-4c7f-8e0e-b483875f2fec admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:43.112570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:43.114629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.115024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.115399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.116152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:43.119475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86c263-2e4d-45ca-8583-6eb2edbb1761 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:43.121053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:43.168960 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2517/5027] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:42 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:43.170163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:43.189404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de3d39-c8a5-4be8-b563-da7717830e44 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:43.205433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:43.206574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.206861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.207139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.207787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:43.209631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:43.212045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:43.212509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.212840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.213207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.225996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:43.227687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:43.237454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2518/5028] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:43.241580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:43.242395 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2511/5029] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:43.255593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4733-e4ed-4acc-b5b2-c89ed7347758 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:43.260407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee0531-e751-4b04-90c5-35789e0eef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:43.261009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0531-e751-4b04-90c5-35789e0eef60 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.262807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0531-e751-4b04-90c5-35789e0eef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.263100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0531-e751-4b04-90c5-35789e0eef60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.263746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee0531-e751-4b04-90c5-35789e0eef60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:43.265543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee0531-e751-4b04-90c5-35789e0eef60 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:43.276331 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2519/5030] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:43.281127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:43.291890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da075-bee6-46c9-928a-362bfd962106 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:43.299295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:43.300668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.301050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.301422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] PATH_INFO: `/v3/projects/c0ece619d6f843e285e5da86161faa6b/users/ac32dd4ebc0b44c98e9ac53bc21a3449/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.322366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ece619d6f843e285e5da86161faa6b, user_id=ac32dd4ebc0b44c98e9ac53bc21a3449, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:43.326065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:43.353300 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2512/5031] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:43 2022] PUT /identity/v3/projects/c0ece619d6f843e285e5da86161faa6b/users/ac32dd4ebc0b44c98e9ac53bc21a3449/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:43.356417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.356946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.357238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.418995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] MFA Rules not processed for user `ac32dd4ebc0b44c98e9ac53bc21a3449`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:43.420311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:43.452811 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:43.499051 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2520/5032] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:43.517105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:43.519639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:43.597728 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:43.629644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424146-67b5-4d9e-9f2a-9b130d2a4d22 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:43.639983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:43.641437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.641841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.642317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.655305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:43.657944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:43.675622 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2513/5033] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:43.829493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:43.832270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:43.938383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cddf13-c514-4952-a42a-2960b226ae46 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:43.943438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:43.944287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:43.944662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:43.945209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] PATH_INFO: `/v3/projects/4d48702b322940b785f50fe60a89d306` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:43.946439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d48702b322940b785f50fe60a89d306)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:43.948426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:43.998789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.012409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc7089-5836-4b6d-aed8-42bbd9c649cd service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.028269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d48702b322940b785f50fe60a89d306', 'request_id': 'req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.045865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d48702b322940b785f50fe60a89d306', 'request_id': 'req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.060617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d48702b322940b785f50fe60a89d306', 'request_id': 'req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.087087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] The token cache is being invalidate because project 4d48702b322940b785f50fe60a89d306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:44.087372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.088142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-76baf384-5fb3-4c7c-ba0b-85b01c2d1c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.096443 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2521/5034] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:43 2022] DELETE /identity/v3/projects/4d48702b322940b785f50fe60a89d306 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:44.098322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109a0a-3c97-4dac-893b-b279cf3285eb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.098605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109a0a-3c97-4dac-893b-b279cf3285eb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.098873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109a0a-3c97-4dac-893b-b279cf3285eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.138958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ca109a0a-3c97-4dac-893b-b279cf3285eb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:44.139209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ca109a0a-3c97-4dac-893b-b279cf3285eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:44.158670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.159323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.159868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.160153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] PATH_INFO: `/v3/users/ac32dd4ebc0b44c98e9ac53bc21a3449` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.161353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac32dd4ebc0b44c98e9ac53bc21a3449)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.163280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:44.227617 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:44.256810 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2522/5035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:44.264129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f0e0-a248-4b9a-aab5-223d2fce720a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.265000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f0e0-a248-4b9a-aab5-223d2fce720a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.265490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f0e0-a248-4b9a-aab5-223d2fce720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.272760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac32dd4ebc0b44c98e9ac53bc21a3449'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.275528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac32dd4ebc0b44c98e9ac53bc21a3449'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.276325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac32dd4ebc0b44c98e9ac53bc21a3449'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.294780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac32dd4ebc0b44c98e9ac53bc21a3449'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.319214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2063f0e0-a248-4b9a-aab5-223d2fce720a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:44.321224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2063f0e0-a248-4b9a-aab5-223d2fce720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:44.332329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b186f6c2-b6c6-4a0d-8ed4-efc5b36c42dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac32dd4ebc0b44c98e9ac53bc21a3449'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:44.333810 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2523/5036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:44.338397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063f0e0-a248-4b9a-aab5-223d2fce720a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.350195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063f0e0-a248-4b9a-aab5-223d2fce720a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.356643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.357360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.357899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.358179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.358901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:44.359122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.361216 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2514/5037] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:43 2022] DELETE /identity/v3/users/ac32dd4ebc0b44c98e9ac53bc21a3449 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:44.362095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:44.364426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54c184-ae9f-4441-bb56-d8536adee6de None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.367113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54c184-ae9f-4441-bb56-d8536adee6de None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.367507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54c184-ae9f-4441-bb56-d8536adee6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.391718 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2524/5038] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:44.394862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.418255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607d7cf-7704-4385-b8b8-d60db59d3fea admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.435526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1f54c184-ae9f-4441-bb56-d8536adee6de None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:44.440614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1f54c184-ae9f-4441-bb56-d8536adee6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:44.543214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.544402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.544402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.544603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.545778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.547928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:44.588654 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2525/5039] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:44 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:44.589024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.591496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:44.634831 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:44.658748 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2515/5040] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:44.663456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54c184-ae9f-4441-bb56-d8536adee6de None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.687171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54c184-ae9f-4441-bb56-d8536adee6de None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.689113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd69a-f717-4c89-ad2d-b6f0d9fcfbb7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.693731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.694422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.694706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.694978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.697324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:44.777472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.778783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.779344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.779851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.780803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.782952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:44.814480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2516/5041] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:44 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:44.815421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.824913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.827907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:44.836341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2419-a669-455e-9318-023777c50fa7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.843367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.846966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.847375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.847719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.852693 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2526/5042] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:44.855268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.872805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.874473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:44.887967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc74a1-b755-48e3-8d67-2b2d4889379a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.897433 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2517/5043] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:44.903420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.904068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.904420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.904766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.905930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.910530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:44.940891 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2527/5044] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:44.945172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:44.970124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe2a08-ff07-48f1-8d4c-664c37c48720 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:44.983361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c37fb-d89f-4898-a08c-669eb2c22355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:44.984090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c37fb-d89f-4898-a08c-669eb2c22355 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:44.984453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c37fb-d89f-4898-a08c-669eb2c22355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:44.984947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c37fb-d89f-4898-a08c-669eb2c22355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:44.985858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c37fb-d89f-4898-a08c-669eb2c22355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:44.987585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c37fb-d89f-4898-a08c-669eb2c22355 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:45.029147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2518/5045] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:45.034930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:45.044066 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:45.060539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6c68-d4b1-4e37-a9d7-bc759793b9d0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:45.075276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:45.077845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:45.080062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:45.082127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] PATH_INFO: `/v3/projects/8592ed873c4143d696005902dfc93491/users/5d1747c4e79544c2abfcadb9ad25c285/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:45.130923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8592ed873c4143d696005902dfc93491, user_id=5d1747c4e79544c2abfcadb9ad25c285, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:45.141430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:45.211787 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2528/5046] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:45 2022] PUT /identity/v3/projects/8592ed873c4143d696005902dfc93491/users/5d1747c4e79544c2abfcadb9ad25c285/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:45.213721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869beb-5c04-4af4-9491-f4daf497022a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:45.214016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869beb-5c04-4af4-9491-f4daf497022a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:45.214368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8869beb-5c04-4af4-9491-f4daf497022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:45.301546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b8869beb-5c04-4af4-9491-f4daf497022a None None] MFA Rules not processed for user `5d1747c4e79544c2abfcadb9ad25c285`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:45.303051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b8869beb-5c04-4af4-9491-f4daf497022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:45.414152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2519/5047] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:45.419109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:45.561572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b697-75d5-4c71-b49a-e0f5eb0b29bf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:45.566921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:45.567548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:45.567825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:45.568098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:45.568735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:45.570947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:45.617182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2529/5048] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:45 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:45.617799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8869beb-5c04-4af4-9491-f4daf497022a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:45.637980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8869beb-5c04-4af4-9491-f4daf497022a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:45.638622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:45.640462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:45.760881 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:45.772361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:45.773189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:45.773568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:45.773936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:45.774897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ffc15-9a0a-475e-ab67-906b66485282 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:45.775646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:45.779761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:45.781443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:45.782098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:45.782377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:45.782766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] PATH_INFO: `/v3/projects/c0ece619d6f843e285e5da86161faa6b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:45.783953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ece619d6f843e285e5da86161faa6b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:45.785933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:45.814783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2520/5049] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:45 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:45.820537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:45.841943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5fd9f-5bd6-4c33-a13e-69fd71047be3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:45.847920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:45.848687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:45.849126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:45.849447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:45.850684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:45.852617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:45.875831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2521/5050] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:45.876783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ece619d6f843e285e5da86161faa6b', 'request_id': 'req-f592da53-c912-4180-b381-73876dea2b80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:45.878965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:45.893040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ece619d6f843e285e5da86161faa6b', 'request_id': 'req-f592da53-c912-4180-b381-73876dea2b80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:45.900765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be097744-7366-4a34-8c38-6bf9b87c59d6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:45.910139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ece619d6f843e285e5da86161faa6b', 'request_id': 'req-f592da53-c912-4180-b381-73876dea2b80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:45.916079 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:45.949087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] The token cache is being invalidate because project c0ece619d6f843e285e5da86161faa6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:45.949640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:45.950691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f592da53-c912-4180-b381-73876dea2b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:45.953802 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2530/5051] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:45 2022] DELETE /identity/v3/projects/c0ece619d6f843e285e5da86161faa6b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:45.960781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59594-f3cd-4954-890c-4d0f485904c2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:45.961326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59594-f3cd-4954-890c-4d0f485904c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:45.961908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59594-f3cd-4954-890c-4d0f485904c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.004142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4ef59594-f3cd-4954-890c-4d0f485904c2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:46.008964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4ef59594-f3cd-4954-890c-4d0f485904c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:46.012474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.012651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.012943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.013466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.014136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.016963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.031469 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2531/5052] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:46.040106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4b0e-91d6-4daa-a132-ed1b1e86dabf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.040681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4b0e-91d6-4daa-a132-ed1b1e86dabf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.041338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4b0e-91d6-4daa-a132-ed1b1e86dabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.042095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2522/5053] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:46.047770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.051641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:46.068475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc64589-5f53-4871-8109-7ff08c2f5b87 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.081381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1daf2-9559-4fce-896c-b071cc86a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.082838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1daf2-9559-4fce-896c-b071cc86a7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.083913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1daf2-9559-4fce-896c-b071cc86a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.084295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1daf2-9559-4fce-896c-b071cc86a7a1 admin admin] PATH_INFO: `/v3/projects/3ff952f575e24cb2ba0c8b8121e95a51/users/b32cfc131ace4319be2c08616455b60f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.103906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1daf2-9559-4fce-896c-b071cc86a7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff952f575e24cb2ba0c8b8121e95a51, user_id=b32cfc131ace4319be2c08616455b60f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.106475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7f6b4b0e-91d6-4daa-a132-ed1b1e86dabf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:46.107725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7f6b4b0e-91d6-4daa-a132-ed1b1e86dabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:46.107860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1daf2-9559-4fce-896c-b071cc86a7a1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.137294 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2532/5054] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:46.141103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4b0e-91d6-4daa-a132-ed1b1e86dabf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.146156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2523/5055] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:46 2022] PUT /identity/v3/projects/3ff952f575e24cb2ba0c8b8121e95a51/users/b32cfc131ace4319be2c08616455b60f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:46.154085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4b0e-91d6-4daa-a132-ed1b1e86dabf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.162044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d9137-8a2d-430e-9203-3e91084563c6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.162329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d9137-8a2d-430e-9203-3e91084563c6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.162632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d9137-8a2d-430e-9203-3e91084563c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.227274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d24d9137-8a2d-430e-9203-3e91084563c6 None None] MFA Rules not processed for user `b32cfc131ace4319be2c08616455b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:46.232956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d24d9137-8a2d-430e-9203-3e91084563c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:46.293507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.294154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.294603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.294884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.295758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:46.296075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.297714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.333380 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2533/5056] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:46.335536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.374955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829bfd2-7c45-4d5e-9898-9de95a26024c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.389591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.390233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.390564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.390767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.396425 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2524/5057] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:46.397652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d9137-8a2d-430e-9203-3e91084563c6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.398909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.408941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.417454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d9137-8a2d-430e-9203-3e91084563c6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.429833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.430472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.430745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.431010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.431651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.434220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.467625 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2534/5058] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:46 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:46.472126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.501275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2525/5059] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:46 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:46.502953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.540685 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:46.613746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac09d3-dfaf-468a-8c56-f5b54c1d5d8a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.623425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.624228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.624512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.624837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.625651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.625947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb36cde-0894-497a-81f4-ef0ff5755a52 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.628526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.631172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.631997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.632137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.632326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.632959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.635107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.668499 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2535/5060] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:46 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:46.681019 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2526/5061] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:46 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:46.681389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.682383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.702168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2c48-ed01-43a6-82e8-c540ceccafc3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.706950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959d0b2-41dc-4b77-a5e8-82c6adec3c5b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.708378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.708996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.710333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.710623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.712654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.714523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.718548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.719269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.719551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.720036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.720703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.723356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.734807 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2527/5062] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:46.735945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.751735 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2536/5063] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:46.756405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.774969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467de23-3547-4385-b061-4fa20244741b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.779715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac21949-3a94-43cd-ab33-ea9ed2cd0cfe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.788957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.791477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.792111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.792962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.793107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.793283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.793610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.793934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.794167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] PATH_INFO: `/v3/projects/436b61b0a78f4d7a8af203c468c7e200/users/8cbca377d61b401d85f13102c5770b56/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.795547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.821147 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2537/5064] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:46.825250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.834531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=436b61b0a78f4d7a8af203c468c7e200, user_id=8cbca377d61b401d85f13102c5770b56, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.847645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.848209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cf3e7-085f-4ffb-80dd-e3124df7ac42 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:46.862188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e64e0-20a7-4c84-8080-3b719ca88ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:46.864262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e64e0-20a7-4c84-8080-3b719ca88ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.866281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e64e0-20a7-4c84-8080-3b719ca88ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.866413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e64e0-20a7-4c84-8080-3b719ca88ba4 admin admin] PATH_INFO: `/v3/projects/cd540fd08fe64db78b3d0dbce4038ca7/users/688c427e8e9847f193a22febb0c6fead/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:46.872187 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2528/5065] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:46 2022] PUT /identity/v3/projects/436b61b0a78f4d7a8af203c468c7e200/users/8cbca377d61b401d85f13102c5770b56/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:46.876069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:46.907300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e64e0-20a7-4c84-8080-3b719ca88ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd540fd08fe64db78b3d0dbce4038ca7, user_id=688c427e8e9847f193a22febb0c6fead, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:46.911389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e64e0-20a7-4c84-8080-3b719ca88ba4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:46.920274 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:46.950790 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2538/5066] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:46 2022] PUT /identity/v3/projects/cd540fd08fe64db78b3d0dbce4038ca7/users/688c427e8e9847f193a22febb0c6fead/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:46.965674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817654-57f9-4b83-a92c-fe5b0941ea3e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:46.965959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817654-57f9-4b83-a92c-fe5b0941ea3e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:46.966231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817654-57f9-4b83-a92c-fe5b0941ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.029451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cf817654-57f9-4b83-a92c-fe5b0941ea3e None None] MFA Rules not processed for user `688c427e8e9847f193a22febb0c6fead`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:47.034740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aad79-ce99-493a-9122-450f095f5b9a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.035910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cf817654-57f9-4b83-a92c-fe5b0941ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:47.169259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.170073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.170527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.171030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.172059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.174512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.197759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2529/5067] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:47.203249 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2539/5068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:47.211805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:47.212138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf817654-57f9-4b83-a92c-fe5b0941ea3e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:47.226653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf817654-57f9-4b83-a92c-fe5b0941ea3e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.236660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491dd83-b799-4884-9324-834630b13b2f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.239217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.239855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.240130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.240399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.241035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.244855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59125-5868-40c5-a806-d52168e08fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.247222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59125-5868-40c5-a806-d52168e08fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.248192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.248720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59125-5868-40c5-a806-d52168e08fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.249260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59125-5868-40c5-a806-d52168e08fe2 admin admin] PATH_INFO: `/v3/projects/436b61b0a78f4d7a8af203c468c7e200/users/8cbca377d61b401d85f13102c5770b56/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.252410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe59125-5868-40c5-a806-d52168e08fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436b61b0a78f4d7a8af203c468c7e200, user_id=8cbca377d61b401d85f13102c5770b56, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.257254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe59125-5868-40c5-a806-d52168e08fe2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.264598 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:47.275185 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2530/5069] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:47 2022] PUT /identity/v3/projects/436b61b0a78f4d7a8af203c468c7e200/users/8cbca377d61b401d85f13102c5770b56/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:47.285969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.286540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.286987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.329118 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2540/5070] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:47 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:47.329510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] MFA Rules not processed for user `8cbca377d61b401d85f13102c5770b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:47.330982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:47.331800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:47.458944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf08fb-5404-4d67-9949-af1fe93255c5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.469120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.469784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.470038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.470315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.470956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.479237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.504034 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2531/5071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:47.516818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:47.519043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:47.539708 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2541/5072] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:47 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:47.544471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:47.569716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b94bb6-a968-4c4e-be55-76d3eb7e8cb0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.593268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.600218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.601517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.606134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.607655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.613991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.644017 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2542/5073] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:47.654660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:47.685644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547623-a1c8-44fb-a94d-5c2746459f65 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.690474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d5e56-7b5f-4298-8fb6-c2e52ef968d6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.691655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.692438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.692838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.693246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] PATH_INFO: `/v3/projects/541420af71554810928d30add0266103/users/e820fcf549374cc18effd1d689a1a534/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.703184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.703446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.703550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.704117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.708679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:47.726535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=541420af71554810928d30add0266103, user_id=e820fcf549374cc18effd1d689a1a534, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.731050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.769443 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2543/5074] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:47 2022] PUT /identity/v3/projects/541420af71554810928d30add0266103/users/e820fcf549374cc18effd1d689a1a534/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:47.772845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:47.814818 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:47.893496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.894941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.925727 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2532/5075] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:47.946462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a287-c03f-4304-8c87-b85455852c3a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:47.957801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a614f-85c5-4812-852f-5c130ed30d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:47.958443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a614f-85c5-4812-852f-5c130ed30d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:47.958724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a614f-85c5-4812-852f-5c130ed30d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:47.958999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a614f-85c5-4812-852f-5c130ed30d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:47.959651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a614f-85c5-4812-852f-5c130ed30d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:47.961428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a614f-85c5-4812-852f-5c130ed30d63 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:47.988066 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2544/5076] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:47.988611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:48.003820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8ec0e-9874-4003-ab2e-a944d11db44f service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:48.009626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:48.012361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.013157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.013678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] PATH_INFO: `/v3/projects/541420af71554810928d30add0266103/users/e820fcf549374cc18effd1d689a1a534/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.016097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] RBAC: Authorizing `identity:create_grant(project_id=541420af71554810928d30add0266103, user_id=e820fcf549374cc18effd1d689a1a534, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.019360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:48.047697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ac1e-59e0-40f7-80af-b62473a3cd34 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.048115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ac1e-59e0-40f7-80af-b62473a3cd34 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.048434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ac1e-59e0-40f7-80af-b62473a3cd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.051298 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2533/5077] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:47 2022] PUT /identity/v3/projects/541420af71554810928d30add0266103/users/e820fcf549374cc18effd1d689a1a534/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:48.117460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d8e6ac1e-59e0-40f7-80af-b62473a3cd34 None None] MFA Rules not processed for user `e820fcf549374cc18effd1d689a1a534`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:48.119143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d8e6ac1e-59e0-40f7-80af-b62473a3cd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:48.278393 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2545/5078] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:48.282832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:48.298525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6a1f7-a774-4d56-a349-63bf3d06101c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:48.312317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:48.316662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.317236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.318300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.320641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.325989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:48.430593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2534/5079] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:48 2022] POST /identity/v3/projects => generated 350 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:48.434085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6ac1e-59e0-40f7-80af-b62473a3cd34 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:48.448106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6ac1e-59e0-40f7-80af-b62473a3cd34 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:48.630682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:48.631440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.631824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.632217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.632950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.634933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:48.688942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2546/5080] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:25:48 2022] POST /identity/v3/projects => generated 349 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:48.692870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:48.702494 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:48.713902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763fd1f-7a5f-4155-88b2-0b01b02f73df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:48.825845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:48.826527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.826871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.827242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/users/688c427e8e9847f193a22febb0c6fead` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.829026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:get_user(user_id=688c427e8e9847f193a22febb0c6fead)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.832403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:48.841194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2535/5081] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:25:48 2022] GET /identity/v3/users/688c427e8e9847f193a22febb0c6fead => generated 287 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:48.841406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:48.854655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67663c0-812f-4c6d-a701-fac39805badf tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:48.860416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:48.861104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.861677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.861830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.862644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.864640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:48.917100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2547/5082] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Sep 11 01:25:48 2022] POST /identity/v3/credentials => generated 430 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:48.921370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:48.947274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b6b23-ad1d-4c2b-90af-d3b081f9120f tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:48.962769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:48.964122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:48.965813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:48.966249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials/150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:48.968757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.971438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:48.975422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:48.977630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.005679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2536/5083] 10.222.0.16 () {60 vars in 1358 bytes} [Sun Sep 11 01:25:48 2022] PATCH /identity/v3/credentials/150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367 => generated 436 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:49.006918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.018251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cac1f1-8bc1-4e8a-b245-c463cd2230df tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.023392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.024170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.024552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.025073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials/150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.027570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.029445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.034836 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2548/5084] 10.222.0.16 () {58 vars in 1335 bytes} [Sun Sep 11 01:25:49 2022] GET /identity/v3/credentials/150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367 => generated 436 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:49.036410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.056389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb955087-a559-41a4-8e00-591e64fb6c55 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.073296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.074847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.075362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.076285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials/150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.080283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.082341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.117379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2537/5085] 10.222.0.16 () {58 vars in 1338 bytes} [Sun Sep 11 01:25:49 2022] DELETE /identity/v3/credentials/150cf8ff82fc3f983fa73d44ab2618b974b11b36503d8ea5bb22cff676b7d367 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:49.118364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.129473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb639c-2688-4638-8edb-ed0e11124c93 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.135059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.135832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.136824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.137723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.138091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.141611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.145778 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:49.171704 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2549/5086] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Sep 11 01:25:49 2022] POST /identity/v3/credentials => generated 431 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:49.171944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.191246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fdce9-f369-4d47-a545-fd567dadf9e0 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.196257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.196865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.197201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.197480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.198131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.205742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.228576 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2538/5087] 10.222.0.16 () {60 vars in 1162 bytes} [Sun Sep 11 01:25:49 2022] POST /identity/v3/credentials => generated 431 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:49.230015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.243871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f735d5-a972-4fba-8566-2dd7a87451da tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.251470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.252304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.252757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.253259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.254206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.258660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.260808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:49.262397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.273264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.275818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.278071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.280914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.283594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2550/5088] 10.222.0.16 () {58 vars in 1140 bytes} [Sun Sep 11 01:25:49 2022] GET /identity/v3/credentials => generated 947 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:49.287301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.298691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337d41e-a7f6-4161-a876-a572eb0a57b6 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.304153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.305229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.305670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.309906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials/6c9306ed5f982832eeac8abd549fddec667f2d57868e09309fdea45110d57f0e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.312131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=6c9306ed5f982832eeac8abd549fddec667f2d57868e09309fdea45110d57f0e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.314011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.334518 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2551/5089] 10.222.0.16 () {58 vars in 1338 bytes} [Sun Sep 11 01:25:49 2022] DELETE /identity/v3/credentials/6c9306ed5f982832eeac8abd549fddec667f2d57868e09309fdea45110d57f0e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:49.338369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.351828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd5eab-573c-48ec-bcc0-d364870badcd tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.359462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.360310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.360664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.361036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/credentials/88c3ab0457d8cf66bfec92fdba3bfa1a6c47640bdd3171f510c5f323ad366fd0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.365176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=88c3ab0457d8cf66bfec92fdba3bfa1a6c47640bdd3171f510c5f323ad366fd0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.367401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.369726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164dad-560b-412e-b14f-5940d8b54a26 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.377447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.377889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.378278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.378559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] PATH_INFO: `/v3/users/19b1d8a0aee74ce5af80ec8b9e1833d1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.380457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b1d8a0aee74ce5af80ec8b9e1833d1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.383533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.397810 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2552/5090] 10.222.0.16 () {58 vars in 1338 bytes} [Sun Sep 11 01:25:49 2022] DELETE /identity/v3/credentials/88c3ab0457d8cf66bfec92fdba3bfa1a6c47640bdd3171f510c5f323ad366fd0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:49.403380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.422722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4f75-cd77-443d-a975-615c780b783c tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.430151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.430934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.431385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.431769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/projects/764be3fb6a3a4c599c2cc0821aef5ec7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.433684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=764be3fb6a3a4c599c2cc0821aef5ec7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.435751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.472504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b1d8a0aee74ce5af80ec8b9e1833d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.473355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b1d8a0aee74ce5af80ec8b9e1833d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.474177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b1d8a0aee74ce5af80ec8b9e1833d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.491443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b1d8a0aee74ce5af80ec8b9e1833d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.522197 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:49.534688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9eefe7e6-c061-4b81-9af4-5919a1b5b1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b1d8a0aee74ce5af80ec8b9e1833d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.555963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764be3fb6a3a4c599c2cc0821aef5ec7', 'request_id': 'req-71684503-7d9f-4d9d-a6a5-c824fd7fe655'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.568722 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2539/5091] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:49 2022] DELETE /identity/v3/users/19b1d8a0aee74ce5af80ec8b9e1833d1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:49.572237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764be3fb6a3a4c599c2cc0821aef5ec7', 'request_id': 'req-71684503-7d9f-4d9d-a6a5-c824fd7fe655'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.573225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.578249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.581785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.601785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764be3fb6a3a4c599c2cc0821aef5ec7', 'request_id': 'req-71684503-7d9f-4d9d-a6a5-c824fd7fe655'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.626000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] The token cache is being invalidate because project 764be3fb6a3a4c599c2cc0821aef5ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:49.626301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.627362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.627701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:49.628968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:49.630336 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2553/5092] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:49 2022] DELETE /identity/v3/projects/764be3fb6a3a4c599c2cc0821aef5ec7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:49.635236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.637910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:49.740965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71684503-7d9f-4d9d-a6a5-c824fd7fe655 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.769222 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2540/5093] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:49.778429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.782125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:49.814061 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:49.836727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e820fcf549374cc18effd1d689a1a534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541420af71554810928d30add0266103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.838316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.838755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.839763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] PATH_INFO: `/v3/projects/3c5eb651f6f04b2e928e4d33d06edae4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.841284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c5eb651f6f04b2e928e4d33d06edae4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.843399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.876788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856bdd8-e2dd-491a-b1dd-0094ce56616d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:49.881380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:49.882112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:49.882628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:49.882973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:49.896171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:49.898058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:49.902649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5eb651f6f04b2e928e4d33d06edae4', 'request_id': 'req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.912101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5eb651f6f04b2e928e4d33d06edae4', 'request_id': 'req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.917309 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2541/5094] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:49.920146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5eb651f6f04b2e928e4d33d06edae4', 'request_id': 'req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.939372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] The token cache is being invalidate because project 3c5eb651f6f04b2e928e4d33d06edae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:49.939799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.940671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:49.945092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2554/5095] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:49 2022] DELETE /identity/v3/projects/3c5eb651f6f04b2e928e4d33d06edae4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:49.947875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:49.950231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:49.964752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72940d60-aca1-46a6-a2af-7ab1e4c41d20 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:50.036985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:50.037782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:50.038057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:50.038326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] PATH_INFO: `/v3/users/688c427e8e9847f193a22febb0c6fead` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:50.039816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688c427e8e9847f193a22febb0c6fead)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:50.041723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:50.089940 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:50.116957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688c427e8e9847f193a22febb0c6fead'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.117679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688c427e8e9847f193a22febb0c6fead'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.118312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688c427e8e9847f193a22febb0c6fead'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.119343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:50.121537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:50.127183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688c427e8e9847f193a22febb0c6fead'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.144743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-211c2e6d-a01a-4f45-b3a1-841719b317d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688c427e8e9847f193a22febb0c6fead'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.154040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ed04f-fb3e-4c0e-9e11-d8a4df872209 tempest-CredentialsTestJSON-455238066 tempest-CredentialsTestJSON-455238066-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:50.160658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:50.161541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:50.161828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:50.162120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] PATH_INFO: `/v3/projects/c866496c3e914dc8beb2e7243fd8f5da` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:50.163491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=c866496c3e914dc8beb2e7243fd8f5da)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:50.165394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:50.169421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2542/5096] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:49 2022] DELETE /identity/v3/users/688c427e8e9847f193a22febb0c6fead => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:50.174195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:50.174561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:50.174838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:50.198051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:50.203374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:50.233175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c866496c3e914dc8beb2e7243fd8f5da', 'request_id': 'req-186ea8ae-3b50-4b14-a504-92182bb07ede'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.243607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c866496c3e914dc8beb2e7243fd8f5da', 'request_id': 'req-186ea8ae-3b50-4b14-a504-92182bb07ede'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.257326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c866496c3e914dc8beb2e7243fd8f5da', 'request_id': 'req-186ea8ae-3b50-4b14-a504-92182bb07ede'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.273684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] The token cache is being invalidate because project c866496c3e914dc8beb2e7243fd8f5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:50.274653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.275817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.279604 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2555/5097] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:50 2022] DELETE /identity/v3/projects/c866496c3e914dc8beb2e7243fd8f5da => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:50.284308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:50.285673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:50.287149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2543/5098] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:50.301265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:50.302914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:50.383382 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:50.387755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1b6e2-d9a1-475b-afea-df2bb8cff19c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:50.388787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ea8ae-3b50-4b14-a504-92182bb07ede admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:50.400825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:50.401213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:50.401614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:50.402673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] PATH_INFO: `/v3/users/cb6c397884c5412cad1d7eb1cb623f63` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:50.404967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6c397884c5412cad1d7eb1cb623f63)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:50.407370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:50.498238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6c397884c5412cad1d7eb1cb623f63'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.499369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6c397884c5412cad1d7eb1cb623f63'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.500347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6c397884c5412cad1d7eb1cb623f63'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.507800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:50.508498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:50.508907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:50.509309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:50.520500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:50.522672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6c397884c5412cad1d7eb1cb623f63'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.548947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6c397884c5412cad1d7eb1cb623f63'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:50.570416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:50.574838 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2556/5099] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:50 2022] DELETE /identity/v3/users/cb6c397884c5412cad1d7eb1cb623f63 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:50.576123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:50.590420 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2544/5100] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:50.686090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:50.687555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:50.820634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbae23-a3e0-4f36-a6f9-23eb8ca1c999 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:50.828551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:50.829249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:50.829528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:50.830585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:50.833145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:50.849980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:50.851695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:50.878135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2557/5101] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:51.030689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.032559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.047891 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:51.075314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.076874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.135699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b65d5b-300b-44b9-8143-2f64228d7ae3 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.150359 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:51.157202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637814-3dee-44fb-98f2-72743cad9963 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.164145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.166706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.166984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.167339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] PATH_INFO: `/v3/projects/1453a0db2393493fb6df63b817778156` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.168591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1453a0db2393493fb6df63b817778156)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.170579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.192534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea5810-87e6-4fc1-8ae8-0c8e17ac653f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.193099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea5810-87e6-4fc1-8ae8-0c8e17ac653f service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.193377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea5810-87e6-4fc1-8ae8-0c8e17ac653f service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.193647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea5810-87e6-4fc1-8ae8-0c8e17ac653f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.196013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9cea5810-87e6-4fc1-8ae8-0c8e17ac653f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.219705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1453a0db2393493fb6df63b817778156', 'request_id': 'req-132d6af5-7cc9-4468-be91-5015515e070e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.225559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1453a0db2393493fb6df63b817778156', 'request_id': 'req-132d6af5-7cc9-4468-be91-5015515e070e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.233334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1453a0db2393493fb6df63b817778156', 'request_id': 'req-132d6af5-7cc9-4468-be91-5015515e070e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.249227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] The token cache is being invalidate because project 1453a0db2393493fb6df63b817778156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:51.249556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.250346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.251856 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2558/5102] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:51 2022] DELETE /identity/v3/projects/1453a0db2393493fb6df63b817778156 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:51.252713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.253992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.268398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea5810-87e6-4fc1-8ae8-0c8e17ac653f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.269851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea5810-87e6-4fc1-8ae8-0c8e17ac653f service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.279317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2545/5103] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:51.280660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e1a53-565b-44e6-9818-4fcc4e69b732 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.281122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e1a53-565b-44e6-9818-4fcc4e69b732 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.281399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e1a53-565b-44e6-9818-4fcc4e69b732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.301913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7b6e1a53-565b-44e6-9818-4fcc4e69b732 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:51.303126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7b6e1a53-565b-44e6-9818-4fcc4e69b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.347243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6af5-7cc9-4468-be91-5015515e070e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.357321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.357949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.358319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.358515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] PATH_INFO: `/v3/projects/cd540fd08fe64db78b3d0dbce4038ca7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.359804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd540fd08fe64db78b3d0dbce4038ca7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.361839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.386697 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2546/5104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:51.392230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c6f12-965c-4e3f-9682-2758be3e0b35 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.392845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c6f12-965c-4e3f-9682-2758be3e0b35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.392845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c6f12-965c-4e3f-9682-2758be3e0b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.416885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2a5c6f12-965c-4e3f-9682-2758be3e0b35 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:51.418735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a5c6f12-965c-4e3f-9682-2758be3e0b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.428482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd540fd08fe64db78b3d0dbce4038ca7', 'request_id': 'req-c137564e-e1be-4be9-8446-44d7f4df282a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.433875 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:51.438642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd540fd08fe64db78b3d0dbce4038ca7', 'request_id': 'req-c137564e-e1be-4be9-8446-44d7f4df282a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.449990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd540fd08fe64db78b3d0dbce4038ca7', 'request_id': 'req-c137564e-e1be-4be9-8446-44d7f4df282a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.470646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] The token cache is being invalidate because project cd540fd08fe64db78b3d0dbce4038ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:51.471458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.471988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.474165 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2559/5105] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:51 2022] DELETE /identity/v3/projects/cd540fd08fe64db78b3d0dbce4038ca7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:51.477874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.480308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.503560 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2547/5106] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:51.507284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c6f12-965c-4e3f-9682-2758be3e0b35 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.521213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c6f12-965c-4e3f-9682-2758be3e0b35 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.521692 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:51.528783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.529686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.530576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.530963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.531723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:51.532273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.535493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.554584 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2548/5107] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:51.559208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.569698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7164d2-3ed7-4b60-a9c0-b7b958ba29df admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.576990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.578529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.578961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.579575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.580503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.582439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.583178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137564e-e1be-4be9-8446-44d7f4df282a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.589719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.590674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.590970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.591276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] PATH_INFO: `/v3/users/e820fcf549374cc18effd1d689a1a534` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.592471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e820fcf549374cc18effd1d689a1a534)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.594727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.617921 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2549/5108] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:51 2022] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:51.623284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.657251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e820fcf549374cc18effd1d689a1a534'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.658074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e820fcf549374cc18effd1d689a1a534'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.658890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e820fcf549374cc18effd1d689a1a534'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.672133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e820fcf549374cc18effd1d689a1a534'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.683640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e820fcf549374cc18effd1d689a1a534'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:51.702908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628739cf-e547-45e5-8b42-052ba9cb9d9c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.705834 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2560/5109] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:51 2022] DELETE /identity/v3/users/e820fcf549374cc18effd1d689a1a534 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:51.774202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.774949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.775243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.775549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.776219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.778801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.812895 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2550/5110] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:51 2022] POST /identity/v3/users => generated 305 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:51.815114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.817468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:51.838516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdca99-ba0b-4b05-a6ed-4d26cbe62ce9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.853265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.854325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.855331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.855660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.856420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.858169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.879228 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2561/5111] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:51.881038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.893166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e6ace-b1c8-4b9c-a92d-051ffe7f20e6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.898880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e60a83-5a12-4fe0-8e20-80772f7d2ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.899488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60a83-5a12-4fe0-8e20-80772f7d2ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.899784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60a83-5a12-4fe0-8e20-80772f7d2ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.900055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60a83-5a12-4fe0-8e20-80772f7d2ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.900867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e60a83-5a12-4fe0-8e20-80772f7d2ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.903845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e60a83-5a12-4fe0-8e20-80772f7d2ec7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.917634 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2551/5112] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:51.921428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:51.934290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb4ce7-49a3-4b4c-914f-6141bc6d89d1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:51.939303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:51.939960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.940235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.941020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] PATH_INFO: `/v3/projects/0985de41a6114034be229f125b922fd4/users/90da3d7617f8405f83c8bd429e678cdb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:51.957585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0985de41a6114034be229f125b922fd4, user_id=90da3d7617f8405f83c8bd429e678cdb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:51.960337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:51.977644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2562/5113] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:51 2022] PUT /identity/v3/projects/0985de41a6114034be229f125b922fd4/users/90da3d7617f8405f83c8bd429e678cdb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:51.986866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:51.987191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:51.987484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.009513 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:52.015513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.017757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.023748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] MFA Rules not processed for user `90da3d7617f8405f83c8bd429e678cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:52.026240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.092541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5e11c-be96-4d50-b921-39ed94cb108b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.096550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.097463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.097748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.098052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.099844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.128464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2552/5114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:52.129345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.130614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.139114 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:52.218942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2b898-ed93-4c73-ada3-c241569399d6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.223771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.224399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.225277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.225745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.226213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.226505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] PATH_INFO: `/v3/projects/541420af71554810928d30add0266103` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.227661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=541420af71554810928d30add0266103)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.230361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.237307 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2563/5115] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:52.238120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.250058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e7f8-5795-43af-bcc7-39f7fa4a0da1 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.255044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.255821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.256149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.256492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.257142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.259026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.316525 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2564/5116] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/projects => generated 409 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:52.318630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.351292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541420af71554810928d30add0266103', 'request_id': 'req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:52.369995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541420af71554810928d30add0266103', 'request_id': 'req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:52.382609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541420af71554810928d30add0266103', 'request_id': 'req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:52.396138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] The token cache is being invalidate because project 541420af71554810928d30add0266103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:52.396797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:52.397266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fe33afe-ab0c-401e-8f25-b3d5556ba91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:52.399282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2553/5117] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:52 2022] DELETE /identity/v3/projects/541420af71554810928d30add0266103 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:52.400586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503860-afd1-4fb9-8a9c-648b52c734d2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.400928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503860-afd1-4fb9-8a9c-648b52c734d2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.401297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503860-afd1-4fb9-8a9c-648b52c734d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.417686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c283c3f-0f4b-4f0b-8ce3-b17154d169f0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.423082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88513f6-7450-45dd-8338-fa7444a09b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.423694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88513f6-7450-45dd-8338-fa7444a09b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.423971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88513f6-7450-45dd-8338-fa7444a09b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.424373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88513f6-7450-45dd-8338-fa7444a09b99 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.425007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88513f6-7450-45dd-8338-fa7444a09b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.425242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-23503860-afd1-4fb9-8a9c-648b52c734d2 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:52.426450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23503860-afd1-4fb9-8a9c-648b52c734d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.426976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88513f6-7450-45dd-8338-fa7444a09b99 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.454162 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2565/5118] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/users => generated 311 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:52.455988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.456418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.456865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.458415 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:52.479642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:52.480747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.489246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2566/5119] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:52.490268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.491563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.502173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2554/5120] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:52.503815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d3c9-b03d-4095-8fca-5f7561791d2e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.504430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d3c9-b03d-4095-8fca-5f7561791d2e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.504618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5fc5-d840-46cf-9876-d7f42df0e52e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.505157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d3c9-b03d-4095-8fca-5f7561791d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.536488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3bc9d3c9-b03d-4095-8fca-5f7561791d2e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:52.538214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3bc9d3c9-b03d-4095-8fca-5f7561791d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:52.539660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.540733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.541353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.542789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.543820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.545683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.552246 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2555/5121] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:52.557314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d3c9-b03d-4095-8fca-5f7561791d2e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.560931 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2567/5122] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:52.562167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.570247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d3c9-b03d-4095-8fca-5f7561791d2e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.573337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18da34f-2ac7-445d-95fe-4ccc8916da20 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.577371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.578236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.578640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.579083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.580140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:52.580580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.580854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.581712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.582352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.582664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.583012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] PATH_INFO: `/v3/projects/314ed72af6614a51ae7b94ebbad0cac4/users/cb36a5872cc04136bcef75eb249e0e5b/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.602531 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2556/5123] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:52.603740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] RBAC: Authorizing `identity:create_grant(project_id=314ed72af6614a51ae7b94ebbad0cac4, user_id=cb36a5872cc04136bcef75eb249e0e5b, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.607668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.608988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.621964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ebd59-e1ed-4d03-94a1-14baa86d7c0d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.627671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.628275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.628560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.628836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.629503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.631421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.633484 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2568/5124] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:52 2022] PUT /identity/v3/projects/314ed72af6614a51ae7b94ebbad0cac4/users/cb36a5872cc04136bcef75eb249e0e5b/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:52.637835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.673929 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2557/5125] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:52.678038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.705624 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:52.746499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ccf60-cdf3-4519-8212-8af0d575087b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.768408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a33c-99c9-40e3-967c-4e66f76b47d7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.773877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.774495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.774778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.775464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.776150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.778774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.816900 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2558/5126] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:52.818364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.828459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.829099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.829400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.829673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.830316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.830835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540447e7-e886-446d-bb8c-ddcd1f7cb8c0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.832071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.837106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.838585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.838881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.839725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.840638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.842704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.845882 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2569/5127] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:52.850261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.859595 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2559/5128] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:52.863563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.866800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8284b-a9fe-446b-9073-b6ba2e157678 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.873159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f98a7-ad37-4d2e-a0cd-ea7f411d09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.873968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f98a7-ad37-4d2e-a0cd-ea7f411d09ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.874343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f98a7-ad37-4d2e-a0cd-ea7f411d09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.874812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f98a7-ad37-4d2e-a0cd-ea7f411d09ab admin admin] PATH_INFO: `/v3/projects/314ed72af6614a51ae7b94ebbad0cac4/users/cb36a5872cc04136bcef75eb249e0e5b/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.877151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f98a7-ad37-4d2e-a0cd-ea7f411d09ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=314ed72af6614a51ae7b94ebbad0cac4, user_id=cb36a5872cc04136bcef75eb249e0e5b, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.878282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878169e-04fc-41e7-823e-e5884fb905cd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.880469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f98a7-ad37-4d2e-a0cd-ea7f411d09ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.889156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:52.890306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.890552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.890846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.891476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:52.893915 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2570/5129] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:52 2022] PUT /identity/v3/projects/314ed72af6614a51ae7b94ebbad0cac4/users/cb36a5872cc04136bcef75eb249e0e5b/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:52.897481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:52.906499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:52.906734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:52.906938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:52.921106 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2560/5130] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:52.922591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:52.939725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4958b-67e5-4c4c-b84a-8a5b08010c6e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:52.953292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] MFA Rules not processed for user `cb36a5872cc04136bcef75eb249e0e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:52.953292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:53.042138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709afeca-9380-4f54-986c-77aecc455f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.045231 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2571/5131] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:53.045938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afeca-9380-4f54-986c-77aecc455f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.046445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afeca-9380-4f54-986c-77aecc455f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.046937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afeca-9380-4f54-986c-77aecc455f04 admin admin] PATH_INFO: `/v3/projects/1f568c76436c4376bfedf1ea436417f1/users/4c03c3f7c3534b30ab763d2864f59190/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.050025 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:53.051375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:53.052941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:53.075837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709afeca-9380-4f54-986c-77aecc455f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f568c76436c4376bfedf1ea436417f1, user_id=4c03c3f7c3534b30ab763d2864f59190, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.078866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709afeca-9380-4f54-986c-77aecc455f04 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.101156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2561/5132] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:52 2022] PUT /identity/v3/projects/1f568c76436c4376bfedf1ea436417f1/users/4c03c3f7c3534b30ab763d2864f59190/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:53.112172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11953020-23c7-4550-8606-611d40d16df9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.112504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11953020-23c7-4550-8606-611d40d16df9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.113052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11953020-23c7-4550-8606-611d40d16df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.139989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281ed7-98e5-4fa2-845e-45818b897593 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:53.150658 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:53.163941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-11953020-23c7-4550-8606-611d40d16df9 None None] MFA Rules not processed for user `4c03c3f7c3534b30ab763d2864f59190`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:53.168222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-11953020-23c7-4550-8606-611d40d16df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:53.240896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.242097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.242387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.242671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.261258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2562/5133] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:53.265332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11953020-23c7-4550-8606-611d40d16df9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:53.334461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.336155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.349048 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2572/5134] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:53.398469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11953020-23c7-4550-8606-611d40d16df9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:53.407817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.408596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.409034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.409750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.410548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.413206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.471703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:53.472762 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2563/5135] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:53 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:53.484828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0558e7-4f37-42a1-8408-d6ca40b78c9a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:53.580408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.581226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.581515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.581794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.582487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.584415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.615308 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2573/5136] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:53 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:53.616769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:53.629974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5ffe0-53a0-44f4-87a8-6a023eae62ae admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:53.640102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.640740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.641191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.641461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.642120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.643745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.659732 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2564/5137] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:53.660494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:53.678089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496c0f-78e2-4c40-8441-393c54f68f0c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:53.686643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.688623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.688913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.691485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] PATH_INFO: `/v3/projects/babfedc51a704994856e63e14920e5ff/users/f0b997cb24f44714aa53a5b79f167fe4/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.715256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babfedc51a704994856e63e14920e5ff, user_id=f0b997cb24f44714aa53a5b79f167fe4, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.719973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.740877 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2574/5138] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:53 2022] PUT /identity/v3/projects/babfedc51a704994856e63e14920e5ff/users/f0b997cb24f44714aa53a5b79f167fe4/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:53.744539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:53.757184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45773-2c7a-4ef1-a39a-fd0c44d6f28e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:53.826181 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:53.845648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d7412-a1e4-44b1-822a-31f2e7cbbe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.846748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d7412-a1e4-44b1-822a-31f2e7cbbe34 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.847264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d7412-a1e4-44b1-822a-31f2e7cbbe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.847770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d7412-a1e4-44b1-822a-31f2e7cbbe34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.848885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d7412-a1e4-44b1-822a-31f2e7cbbe34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.851018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d7412-a1e4-44b1-822a-31f2e7cbbe34 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.867550 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2565/5139] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:53.871541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:53.885502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bb852-0de1-4f36-a5fd-b12d8d7b92a8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:53.892119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:53.893727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.894468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.894989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] PATH_INFO: `/v3/projects/babfedc51a704994856e63e14920e5ff/users/f0b997cb24f44714aa53a5b79f167fe4/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.897483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babfedc51a704994856e63e14920e5ff, user_id=f0b997cb24f44714aa53a5b79f167fe4, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:53.901022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:53.916328 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2575/5140] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:53 2022] PUT /identity/v3/projects/babfedc51a704994856e63e14920e5ff/users/f0b997cb24f44714aa53a5b79f167fe4/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:53.927362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c48f-b2d5-4ffa-90dd-02777d2391c9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:53.928449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c48f-b2d5-4ffa-90dd-02777d2391c9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:53.928942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c48f-b2d5-4ffa-90dd-02777d2391c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:53.970721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-63d7c48f-b2d5-4ffa-90dd-02777d2391c9 None None] MFA Rules not processed for user `f0b997cb24f44714aa53a5b79f167fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:53.975276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-63d7c48f-b2d5-4ffa-90dd-02777d2391c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:54.084468 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2566/5141] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:54.090076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:54.103917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af0c2a-3569-43a5-beb0-0afb8ef9e480 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:54.111695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:54.112868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.113284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.113658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.114780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:54.116927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:54.131672 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:54.150816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c48f-b2d5-4ffa-90dd-02777d2391c9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:54.157031 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2576/5142] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:25:54 2022] POST /identity/v3/domains => generated 246 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:54.161731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c48f-b2d5-4ffa-90dd-02777d2391c9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:54.231889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:54.232514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.232794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.233127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.233768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:54.235860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:54.292456 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2567/5143] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:54 2022] POST /identity/v3/projects => generated 410 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:54.297359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:54.310996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce83ee5-387f-42f1-8248-40787e31cdab tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:54.454259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:54.455025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.455343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.455651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.456337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:54.458430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:54.503104 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2577/5144] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:54 2022] POST /identity/v3/users => generated 348 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:54.514959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:54.534611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2c519-34c8-4ce7-87d0-e279a7be82c6 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:54.549792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8269fb-24ad-47c5-ac52-30576b23f3c7 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:54.550774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8269fb-24ad-47c5-ac52-30576b23f3c7 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.551058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8269fb-24ad-47c5-ac52-30576b23f3c7 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.551332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8269fb-24ad-47c5-ac52-30576b23f3c7 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.551983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8269fb-24ad-47c5-ac52-30576b23f3c7 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:54.553609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8269fb-24ad-47c5-ac52-30576b23f3c7 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:54.577580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2568/5145] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:54.582018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:54.611117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e2dd-6a65-4a78-a295-af61b5fe3ec2 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:54.616396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65454c-b557-4bff-bccb-79282143a54f tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:54.617242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65454c-b557-4bff-bccb-79282143a54f tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.617619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65454c-b557-4bff-bccb-79282143a54f tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.617965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65454c-b557-4bff-bccb-79282143a54f tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/projects/0fcbce587b68434b9e6b3cdfbc3e9a9b/users/af0537d3a0004ef4867a76f728fa62db/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.637984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65454c-b557-4bff-bccb-79282143a54f tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0fcbce587b68434b9e6b3cdfbc3e9a9b, user_id=af0537d3a0004ef4867a76f728fa62db, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:54.640918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65454c-b557-4bff-bccb-79282143a54f tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:54.657236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2578/5146] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:54 2022] PUT /identity/v3/projects/0fcbce587b68434b9e6b3cdfbc3e9a9b/users/af0537d3a0004ef4867a76f728fa62db/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:54.662460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4ace-5c77-4410-830b-fe085b688ffa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.662815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4ace-5c77-4410-830b-fe085b688ffa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.663160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4ace-5c77-4410-830b-fe085b688ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.722488 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:54.790969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6bbd4ace-5c77-4410-830b-fe085b688ffa None None] MFA Rules not processed for user `af0537d3a0004ef4867a76f728fa62db`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:54.792384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6bbd4ace-5c77-4410-830b-fe085b688ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:54.809161 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2569/5147] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:54.823033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f890-ca8e-428e-b645-4a038ea90652 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.823033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f890-ca8e-428e-b645-4a038ea90652 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.823033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f890-ca8e-428e-b645-4a038ea90652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.851882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8ec7f890-ca8e-428e-b645-4a038ea90652 None None] MFA Rules not processed for user `af0537d3a0004ef4867a76f728fa62db`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:54.853098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8ec7f890-ca8e-428e-b645-4a038ea90652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:54.862097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2579/5148] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:54.866390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4ace-5c77-4410-830b-fe085b688ffa None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:54.878020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4ace-5c77-4410-830b-fe085b688ffa None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:54.884049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0537d3a0004ef4867a76f728fa62db', 'user_domain_id': 'b911362655b04a378b57b8d7b900511c', 'system_scope': None, 'project_id': '0fcbce587b68434b9e6b3cdfbc3e9a9b', 'project_domain_id': 'b911362655b04a378b57b8d7b900511c', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:54.884664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:54.884997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:54.885299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:54.895876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:54.897738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:54.913777 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2570/5149] 10.222.0.16 () {56 vars in 1284 bytes} [Sun Sep 11 01:25:54 2022] GET /identity/v3/auth/tokens => generated 3363 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:54.915106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7f890-ca8e-428e-b645-4a038ea90652 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:54.995442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7f890-ca8e-428e-b645-4a038ea90652 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:55.001845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:55.002489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:55.002776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:55.003050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/users/af0537d3a0004ef4867a76f728fa62db` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:55.004195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:delete_user(user_id=af0537d3a0004ef4867a76f728fa62db)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:55.006218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:55.065858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0537d3a0004ef4867a76f728fa62db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.066612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0537d3a0004ef4867a76f728fa62db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.068005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0537d3a0004ef4867a76f728fa62db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.077530 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:55.083203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0537d3a0004ef4867a76f728fa62db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.094531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0537d3a0004ef4867a76f728fa62db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.113927 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2580/5150] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:54 2022] DELETE /identity/v3/users/af0537d3a0004ef4867a76f728fa62db => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:55.118060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:55.142632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af0f76-c5c5-4390-80f5-93cfb48fb13a tempest-test_project-1343220867 tempest-user-1085300568] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:55.210826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:55.211635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:55.211940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:55.212227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/projects/0fcbce587b68434b9e6b3cdfbc3e9a9b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:55.213439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0fcbce587b68434b9e6b3cdfbc3e9a9b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:55.216107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:55.285323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcbce587b68434b9e6b3cdfbc3e9a9b', 'request_id': 'req-766c21b7-576a-4da6-b6c0-5d0c308b50b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.293199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcbce587b68434b9e6b3cdfbc3e9a9b', 'request_id': 'req-766c21b7-576a-4da6-b6c0-5d0c308b50b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.302747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcbce587b68434b9e6b3cdfbc3e9a9b', 'request_id': 'req-766c21b7-576a-4da6-b6c0-5d0c308b50b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.315108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] The token cache is being invalidate because project 0fcbce587b68434b9e6b3cdfbc3e9a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:55.315389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.316060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.317922 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2571/5151] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:55 2022] DELETE /identity/v3/projects/0fcbce587b68434b9e6b3cdfbc3e9a9b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:55.321845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:55.323487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:55.337741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fe8f0-0e57-4e21-bed3-0a683ba8986b tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:55.402597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:55.403238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:55.403512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:55.403782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/domains/b911362655b04a378b57b8d7b900511c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:55.405011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b911362655b04a378b57b8d7b900511c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:55.406665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:55.430594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b911362655b04a378b57b8d7b900511c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.431421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b911362655b04a378b57b8d7b900511c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.459834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b911362655b04a378b57b8d7b900511c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.460612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cb4c5275-2e2e-4d9e-bfd2-2131f7ac3615 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b911362655b04a378b57b8d7b900511c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.463993 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2581/5152] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:25:55 2022] PATCH /identity/v3/domains/b911362655b04a378b57b8d7b900511c => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:55.468064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:55.469715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:55.498643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c21b7-576a-4da6-b6c0-5d0c308b50b9 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:55.567564 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:55.626071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0b997cb24f44714aa53a5b79f167fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'babfedc51a704994856e63e14920e5ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:55.626859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:55.627427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:55.627888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] PATH_INFO: `/v3/domains/b911362655b04a378b57b8d7b900511c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:55.646610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b911362655b04a378b57b8d7b900511c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:55.648327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:55.691597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b911362655b04a378b57b8d7b900511c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.695863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b911362655b04a378b57b8d7b900511c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.760837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:55.761267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:55.761596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:55.782672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:55.784176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:55.823953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b911362655b04a378b57b8d7b900511c', 'request_id': 'req-9cb13270-9abf-4f1c-836c-57f48644b4e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.835060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b911362655b04a378b57b8d7b900511c', 'request_id': 'req-9cb13270-9abf-4f1c-836c-57f48644b4e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.850055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b911362655b04a378b57b8d7b900511c', 'request_id': 'req-9cb13270-9abf-4f1c-836c-57f48644b4e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.864462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] The token cache is being invalidate because project b911362655b04a378b57b8d7b900511c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:55.864749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.865516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.876765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b911362655b04a378b57b8d7b900511c', 'request_id': 'req-9cb13270-9abf-4f1c-836c-57f48644b4e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.877550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b911362655b04a378b57b8d7b900511c', 'request_id': 'req-9cb13270-9abf-4f1c-836c-57f48644b4e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.881910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b911362655b04a378b57b8d7b900511c', 'request_id': 'req-9cb13270-9abf-4f1c-836c-57f48644b4e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:55.883276 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2582/5153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:55.883917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:55.885482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:55.898362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2572/5154] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:25:55 2022] DELETE /identity/v3/domains/b911362655b04a378b57b8d7b900511c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:55.905945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:55.908561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:55.965901 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:55.995943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb75f8-6bd6-4c27-9c36-0c6d1a25f959 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:56.005770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:56.006592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:56.006877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:56.007277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] PATH_INFO: `/v3/users/90da3d7617f8405f83c8bd429e678cdb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:56.008507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90da3d7617f8405f83c8bd429e678cdb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:56.019331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:56.064782 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:56.076962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb13270-9abf-4f1c-836c-57f48644b4e1 tempest-TestDefaultProjectId-631897432 tempest-TestDefaultProjectId-631897432-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:56.091692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:56.092352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:56.092634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:56.092917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] PATH_INFO: `/v3/users/4c03c3f7c3534b30ab763d2864f59190` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:56.094407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c03c3f7c3534b30ab763d2864f59190)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:56.096975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:56.114291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90da3d7617f8405f83c8bd429e678cdb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.116371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90da3d7617f8405f83c8bd429e678cdb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.117023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90da3d7617f8405f83c8bd429e678cdb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.138509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90da3d7617f8405f83c8bd429e678cdb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.146538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-35d1164a-a658-4440-9388-f624838d820e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90da3d7617f8405f83c8bd429e678cdb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.184588 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2583/5155] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:55 2022] DELETE /identity/v3/users/90da3d7617f8405f83c8bd429e678cdb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:56.190291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:56.190814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:56.191383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:56.199206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c03c3f7c3534b30ab763d2864f59190'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.199922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c03c3f7c3534b30ab763d2864f59190'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.201569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c03c3f7c3534b30ab763d2864f59190'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.217393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c03c3f7c3534b30ab763d2864f59190'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.230547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:56.231976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:56.235849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e2aeadc-0ae7-46e4-b566-0d7f1f11829b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c03c3f7c3534b30ab763d2864f59190'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:56.263343 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2573/5156] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:55 2022] DELETE /identity/v3/users/4c03c3f7c3534b30ab763d2864f59190 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:56.265235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:56.265811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:56.266361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:56.298963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:56.300387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:56.311432 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2584/5157] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:56.326054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:56.327496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:56.389980 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2574/5158] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:56.400508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:56.400722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a7d0-fec5-488b-a358-abffc0cd4d19 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:56.413119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:56.421664 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:56.469944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:56.470379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:56.470646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:56.470920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:56.481640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:56.483120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:56.502540 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2585/5159] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:25:56.518961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ca77-948e-4e63-8bfa-d4d9488957b1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:56.523846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:56.524543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:56.524896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:56.525277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:56.546455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:56.548036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:56.562127 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2575/5160] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:56.968622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:56.970730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:57.030641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b58b8-b778-4df4-ad5e-a5159111d4e8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:57.032243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:57.033863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:57.033863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:57.033863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] PATH_INFO: `/v3/projects/1f568c76436c4376bfedf1ea436417f1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:57.035469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f568c76436c4376bfedf1ea436417f1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:57.040059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:57.072404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:57.074784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:57.090216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a29ce-faf9-4681-8eb3-3c858c44c3f7 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:57.109683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:57.111231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:57.113569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:57.114283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] PATH_INFO: `/v3/projects/0985de41a6114034be229f125b922fd4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:57.116994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0985de41a6114034be229f125b922fd4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:57.119704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:57.139241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f568c76436c4376bfedf1ea436417f1', 'request_id': 'req-19b56b68-b78e-4781-9728-16af730b26b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.143077 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:57.147174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f568c76436c4376bfedf1ea436417f1', 'request_id': 'req-19b56b68-b78e-4781-9728-16af730b26b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.161471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f568c76436c4376bfedf1ea436417f1', 'request_id': 'req-19b56b68-b78e-4781-9728-16af730b26b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.207849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] The token cache is being invalidate because project 1f568c76436c4376bfedf1ea436417f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:57.207849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.207849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.207849 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2586/5161] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:56 2022] DELETE /identity/v3/projects/1f568c76436c4376bfedf1ea436417f1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:57.220059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:57.225371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:57.235805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0985de41a6114034be229f125b922fd4', 'request_id': 'req-6f2865a5-1355-4339-ab54-ae02a4975ff7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.251801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0985de41a6114034be229f125b922fd4', 'request_id': 'req-6f2865a5-1355-4339-ab54-ae02a4975ff7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.287452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0985de41a6114034be229f125b922fd4', 'request_id': 'req-6f2865a5-1355-4339-ab54-ae02a4975ff7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.324920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] The token cache is being invalidate because project 0985de41a6114034be229f125b922fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:57.325285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.327551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.333584 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2576/5162] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:57 2022] DELETE /identity/v3/projects/0985de41a6114034be229f125b922fd4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:57.334705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:57.338738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:57.399409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56b68-b78e-4781-9728-16af730b26b5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:57.458771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2865a5-1355-4339-ab54-ae02a4975ff7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:57.459546 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:57.464691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:57.465438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:57.465820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:57.466200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] PATH_INFO: `/v3/users/cb36a5872cc04136bcef75eb249e0e5b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:57.467836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb36a5872cc04136bcef75eb249e0e5b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:57.469938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:57.471425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:57.472633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:57.474158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:57.475681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] PATH_INFO: `/v3/users/f0b997cb24f44714aa53a5b79f167fe4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:57.477957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b997cb24f44714aa53a5b79f167fe4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:57.482271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:57.552569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb36a5872cc04136bcef75eb249e0e5b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.553580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb36a5872cc04136bcef75eb249e0e5b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.554332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb36a5872cc04136bcef75eb249e0e5b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.560314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b997cb24f44714aa53a5b79f167fe4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.561502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b997cb24f44714aa53a5b79f167fe4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.562669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b997cb24f44714aa53a5b79f167fe4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.564354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb36a5872cc04136bcef75eb249e0e5b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.581279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb36a5872cc04136bcef75eb249e0e5b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.583264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b997cb24f44714aa53a5b79f167fe4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.594666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b997cb24f44714aa53a5b79f167fe4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:57.607890 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2577/5163] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:57 2022] DELETE /identity/v3/users/cb36a5872cc04136bcef75eb249e0e5b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:57.616174 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2587/5164] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:25:57 2022] DELETE /identity/v3/users/f0b997cb24f44714aa53a5b79f167fe4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:57.852380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:57.855040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:57.911279 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:57.968897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:57.971632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:57.982939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e3b1c-3212-48e8-b9f3-9e31189bcbc4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.068900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60275397-e815-4cd6-be40-fe087850f13e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.074689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.075399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.076107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.076447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.076784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] PATH_INFO: `/v3/projects/babfedc51a704994856e63e14920e5ff` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.078236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=babfedc51a704994856e63e14920e5ff)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.078676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.079325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.080014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] PATH_INFO: `/v3/projects/314ed72af6614a51ae7b94ebbad0cac4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.080387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.081655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=314ed72af6614a51ae7b94ebbad0cac4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.083936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.170455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314ed72af6614a51ae7b94ebbad0cac4', 'request_id': 'req-6d5820df-3f06-4cd6-a638-b85841d7eea6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.175011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babfedc51a704994856e63e14920e5ff', 'request_id': 'req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.184943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babfedc51a704994856e63e14920e5ff', 'request_id': 'req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.185799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314ed72af6614a51ae7b94ebbad0cac4', 'request_id': 'req-6d5820df-3f06-4cd6-a638-b85841d7eea6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.194071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babfedc51a704994856e63e14920e5ff', 'request_id': 'req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.200610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314ed72af6614a51ae7b94ebbad0cac4', 'request_id': 'req-6d5820df-3f06-4cd6-a638-b85841d7eea6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.216123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] The token cache is being invalidate because project babfedc51a704994856e63e14920e5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:58.216375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.217031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b4b40b0-a02a-46a8-9fc9-e89534c3a814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.219003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] The token cache is being invalidate because project 314ed72af6614a51ae7b94ebbad0cac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:25:58.223011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.223163 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2588/5165] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:57 2022] DELETE /identity/v3/projects/babfedc51a704994856e63e14920e5ff => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:58.223253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d5820df-3f06-4cd6-a638-b85841d7eea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:25:58.225132 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2578/5166] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:25:57 2022] DELETE /identity/v3/projects/314ed72af6614a51ae7b94ebbad0cac4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:58.225712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128dd3c-3ff0-4de8-955e-fde8b451ab53 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.226041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128dd3c-3ff0-4de8-955e-fde8b451ab53 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.226340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128dd3c-3ff0-4de8-955e-fde8b451ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.230609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f070796-db90-4400-8363-d45f7c757ca9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.231479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f070796-db90-4400-8363-d45f7c757ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.231921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f070796-db90-4400-8363-d45f7c757ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.244528 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:58.256249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0f070796-db90-4400-8363-d45f7c757ca9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:58.257820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0f070796-db90-4400-8363-d45f7c757ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:58.270403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9128dd3c-3ff0-4de8-955e-fde8b451ab53 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:58.272715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9128dd3c-3ff0-4de8-955e-fde8b451ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:58.361400 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:58.390738 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2589/5167] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:58.393009 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2579/5168] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:58.394622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb9dcf-5baa-47c1-9082-54da6fd49f28 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.394985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb9dcf-5baa-47c1-9082-54da6fd49f28 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.395886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb9dcf-5baa-47c1-9082-54da6fd49f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.401089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6391a26-4ffc-4306-ac5f-cc3ccaaa88f1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.401956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6391a26-4ffc-4306-ac5f-cc3ccaaa88f1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.402967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6391a26-4ffc-4306-ac5f-cc3ccaaa88f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.438922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3efb9dcf-5baa-47c1-9082-54da6fd49f28 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:58.440191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3efb9dcf-5baa-47c1-9082-54da6fd49f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:58.442751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e6391a26-4ffc-4306-ac5f-cc3ccaaa88f1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:58.444134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e6391a26-4ffc-4306-ac5f-cc3ccaaa88f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:58.449323 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2590/5169] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:58.453486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb9dcf-5baa-47c1-9082-54da6fd49f28 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.461182 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2580/5170] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:58.462402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6391a26-4ffc-4306-ac5f-cc3ccaaa88f1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.466231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb9dcf-5baa-47c1-9082-54da6fd49f28 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.474436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.475332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.475598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.476024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.476759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:58.477227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.478161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6391a26-4ffc-4306-ac5f-cc3ccaaa88f1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.479145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.484711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.485754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.486210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.486702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.487558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:25:58.488169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.490176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.501333 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2591/5171] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:58.506806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.517199 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2581/5172] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:25:58.521883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.528886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a846a-b032-4bc4-9371-911b01e3223e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.536966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b541-a208-4e47-95fa-44d06d31cccb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.541261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.541933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.542880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.543012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.543313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.543618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.543869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.544067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.544194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.544809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.546185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.546754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.581288 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2582/5173] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:58.582218 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2592/5174] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:58.583229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.585460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.656501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bf492-4bc7-4b35-ad16-c4d74500743e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.669383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.669383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.669383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.669383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.669752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.669856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb6c08-3006-4bc2-a544-92a4fb6cb94b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.669954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.674117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.674802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.675154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.675403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.676115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.678523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.690685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2593/5175] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:58.694548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.706276 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2583/5176] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:58.706442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212a39e-e8e9-4750-bdb2-6d1839b5a00d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.710676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.711247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.711854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.712147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.712411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.713054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.714859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.722029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e381-7269-42b8-b08e-dad4b2f7571c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.726788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.727384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.727673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.727935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.728565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.730079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2594/5177] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:58.733597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.733830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.744147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54295f-03de-490c-bf41-3da9b2f935ac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.749912 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2584/5178] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:58.753421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.753641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.754182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.754514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.754834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.755587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.757267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.764711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c58704-cd23-4036-8b30-b364b3022be5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.768893 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2595/5179] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:58.772801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.774251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.774833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.775193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.775382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.776011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.777947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.785657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae847e-2e79-4c56-8777-7356cef4634d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.789127 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2585/5180] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:58.793736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.794815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093d0b-387f-44af-925a-ec6da6d683e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.795555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093d0b-387f-44af-925a-ec6da6d683e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.795911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093d0b-387f-44af-925a-ec6da6d683e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.796341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093d0b-387f-44af-925a-ec6da6d683e2 admin admin] PATH_INFO: `/v3/projects/7122f50f734648ffbed6e866f91f4a11/users/c1f11301cfa145da840dc121c355cc1f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.803549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a240369-91ab-442c-93d7-aaae4f696864 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:58.808908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f82ae-12b6-4eca-93de-32a90ce235a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:58.809589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f82ae-12b6-4eca-93de-32a90ce235a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.809865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f82ae-12b6-4eca-93de-32a90ce235a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.810133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f82ae-12b6-4eca-93de-32a90ce235a8 admin admin] PATH_INFO: `/v3/projects/ba3439f4a3b041bfb2ddc309980b18aa/users/a4a592c990e94832b7c01888930f9a46/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.820626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093d0b-387f-44af-925a-ec6da6d683e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7122f50f734648ffbed6e866f91f4a11, user_id=c1f11301cfa145da840dc121c355cc1f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.824745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093d0b-387f-44af-925a-ec6da6d683e2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.824939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f82ae-12b6-4eca-93de-32a90ce235a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3439f4a3b041bfb2ddc309980b18aa, user_id=a4a592c990e94832b7c01888930f9a46, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:58.827554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f82ae-12b6-4eca-93de-32a90ce235a8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:58.841720 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2596/5181] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:58 2022] PUT /identity/v3/projects/7122f50f734648ffbed6e866f91f4a11/users/c1f11301cfa145da840dc121c355cc1f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:58.842150 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2586/5182] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:58 2022] PUT /identity/v3/projects/ba3439f4a3b041bfb2ddc309980b18aa/users/a4a592c990e94832b7c01888930f9a46/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:58.852751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.853036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.853360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.854940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b905b9-1531-4a12-a389-8bfc14bf7583 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:58.855763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b905b9-1531-4a12-a389-8bfc14bf7583 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:58.855763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b905b9-1531-4a12-a389-8bfc14bf7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:58.867012 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:58.886911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] MFA Rules not processed for user `c1f11301cfa145da840dc121c355cc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:58.888586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-61b905b9-1531-4a12-a389-8bfc14bf7583 None None] MFA Rules not processed for user `a4a592c990e94832b7c01888930f9a46`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:58.889270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:58.890031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-61b905b9-1531-4a12-a389-8bfc14bf7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:58.953573 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:58.977715 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2587/5183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:25:58.984233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b905b9-1531-4a12-a389-8bfc14bf7583 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:58.993495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2597/5184] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:59.006000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.007466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:59.072108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b905b9-1531-4a12-a389-8bfc14bf7583 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.079642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.080315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206a13-bea4-4687-bbc3-52e1a9265051 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.080412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.080652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.080774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.081457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.083383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.084179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.084797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.085096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.085377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.097628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.099605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.111594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2598/5185] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:25:59.116570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2588/5186] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:25:58 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:25:59.117762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.132035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b01f6e-fcdc-4334-af92-ca8f140a96d3 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.223347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.224193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.224567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.225237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.226047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.230840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.266005 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2599/5187] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:25:59 2022] POST /identity/v3/users => generated 301 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:59.269608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.284402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05643649-c3b8-4c0c-90f0-421b52ba69fe admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.290922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.291596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.292520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.293119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.293797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.307740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.321119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2589/5188] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:25:59.324088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.338141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8ceb-9509-4360-b3f9-d279dfc8580f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.346200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba1bfb-a463-42b9-aad6-a7c792d26f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.346883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba1bfb-a463-42b9-aad6-a7c792d26f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.347159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba1bfb-a463-42b9-aad6-a7c792d26f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.347431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba1bfb-a463-42b9-aad6-a7c792d26f12 admin admin] PATH_INFO: `/v3/projects/328810a43d72469194b2054cb8d1d666/users/451574212586499faa0b58ca72750b60/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.379684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba1bfb-a463-42b9-aad6-a7c792d26f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328810a43d72469194b2054cb8d1d666, user_id=451574212586499faa0b58ca72750b60, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.383836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba1bfb-a463-42b9-aad6-a7c792d26f12 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.421090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2600/5189] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:59 2022] PUT /identity/v3/projects/328810a43d72469194b2054cb8d1d666/users/451574212586499faa0b58ca72750b60/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:25:59.425253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.437309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280424-ab6f-4308-9e60-03615b364b5d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.519077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e4f71-1f95-4e13-bf15-40b04bddcd25 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.520079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e4f71-1f95-4e13-bf15-40b04bddcd25 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.520664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e4f71-1f95-4e13-bf15-40b04bddcd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.541129 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:25:59.570522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d63e4f71-1f95-4e13-bf15-40b04bddcd25 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:59.572216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d63e4f71-1f95-4e13-bf15-40b04bddcd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:59.581908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.582950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.583502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.584126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.586231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.589686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.614508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2590/5190] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:25:59.619348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.659747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b89ac6-7876-4562-9dad-cc62ee020642 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.670230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.673743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.673964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.674244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] PATH_INFO: `/v3/projects/328810a43d72469194b2054cb8d1d666/users/451574212586499faa0b58ca72750b60/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.682196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328810a43d72469194b2054cb8d1d666, user_id=451574212586499faa0b58ca72750b60, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.689533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.696366 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2601/5191] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:59.726049 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2591/5192] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:25:59 2022] PUT /identity/v3/projects/328810a43d72469194b2054cb8d1d666/users/451574212586499faa0b58ca72750b60/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:25:59.735208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.735566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.735913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.779264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] MFA Rules not processed for user `451574212586499faa0b58ca72750b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:25:59.780835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:25:59.881567 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2602/5193] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:25:59.888085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.904225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ca70c-3c0d-43b6-9ab7-2709f607e149 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:25:59.920721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:25:59.921519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:25:59.921878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:25:59.922224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:25:59.922982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:25:59.924751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:25:59.956281 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2592/5194] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:25:59 2022] POST /identity/v3/domains => generated 275 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:25:59.960448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.962180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:25:59.962302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:00.030140 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:00.102503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19cf6a-8565-4a59-a817-b16857ffc6d5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.110078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.110877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.111265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.111645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15/config` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.112484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=b1fae61652674b428f0731a175576b15)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.113766 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:00.113766 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:00.113766 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:00.115171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.166811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3d1f3-d005-47ad-844c-c3eb28229be0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.198915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2593/5195] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:25:59 2022] PUT /identity/v3/domains/b1fae61652674b428f0731a175576b15/config => generated 138 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:00.203287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.239013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ab754-2654-4f3c-9666-45959ab680a3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.269875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.270867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.271262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.272244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15/config/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.272994 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:00.275131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=b1fae61652674b428f0731a175576b15, group=identity)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.281306 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:00.281306 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:00.281306 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:00.288805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.310658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2594/5196] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 11 01:26:00 2022] GET /identity/v3/domains/b1fae61652674b428f0731a175576b15/config/identity => generated 45 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:00.316588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.330019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cc9d3-4dfa-4670-967f-2d789ebd97d1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.337848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.338584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.338872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.339641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15/config/identity/driver` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.341671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=b1fae61652674b428f0731a175576b15, group=identity, option=driver)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.344243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.353263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2595/5197] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 11 01:26:00 2022] GET /identity/v3/domains/b1fae61652674b428f0731a175576b15/config/identity/driver => generated 31 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:00.358878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.376864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ca1f7-c794-4d00-81b0-2a3795deba3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.377934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.378573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.378850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.379120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.383279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.384521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.384800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.385103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15/config/ldap` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.386875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=b1fae61652674b428f0731a175576b15, group=ldap)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.388823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.389909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:00.399278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2596/5198] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 11 01:26:00 2022] GET /identity/v3/domains/b1fae61652674b428f0731a175576b15/config/ldap => generated 106 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:00.400193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.412229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11152ca-01b2-4ae5-ba86-314d50d2c76b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.419664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.420338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.420620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.420898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15/config/ldap/url` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.422187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=b1fae61652674b428f0731a175576b15, group=ldap, option=url)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.424546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.436104 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2597/5199] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 11 01:26:00 2022] GET /identity/v3/domains/b1fae61652674b428f0731a175576b15/config/ldap/url => generated 46 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:00.441580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.468961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33a3cf-dfc4-44ef-898d-14bc0dbd007c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.477471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.478035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.478314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.478584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15/config/ldap/user_tree_dn` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.484993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=b1fae61652674b428f0731a175576b15, group=ldap, option=user_tree_dn)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.486857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.504701 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2598/5200] 10.222.0.16 () {58 vars in 1302 bytes} [Sun Sep 11 01:26:00 2022] GET /identity/v3/domains/b1fae61652674b428f0731a175576b15/config/ldap/user_tree_dn => generated 63 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:00.505644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.528277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542d2d-75a6-44cd-8b10-19fe54109574 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.528277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b075fa-340d-47fc-9e89-9f8d7825b537 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.528277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b075fa-340d-47fc-9e89-9f8d7825b537 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.528574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b075fa-340d-47fc-9e89-9f8d7825b537 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.528574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b075fa-340d-47fc-9e89-9f8d7825b537 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15/config` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.528574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b075fa-340d-47fc-9e89-9f8d7825b537 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=b1fae61652674b428f0731a175576b15)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.528574 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-73b075fa-340d-47fc-9e89-9f8d7825b537 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:00.528574 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:00.528574 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:00.532531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b075fa-340d-47fc-9e89-9f8d7825b537 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.532702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.532702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.548075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2599/5201] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:26:00 2022] DELETE /identity/v3/domains/b1fae61652674b428f0731a175576b15/config => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:00.553224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.554166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.555179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.570517 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2603/5202] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:00.571346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.584018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:00.587135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:00.596236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad971764-3581-4e45-a62b-f9c505432b72 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.610094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.610513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.610796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.611232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.612406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b1fae61652674b428f0731a175576b15)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.614158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.663122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b1fae61652674b428f0731a175576b15'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:00.669513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b1fae61652674b428f0731a175576b15'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:00.721418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b1fae61652674b428f0731a175576b15'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:00.724995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b1fae61652674b428f0731a175576b15'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:00.726490 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2600/5203] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:00.728662 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2604/5204] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:26:00 2022] PATCH /identity/v3/domains/b1fae61652674b428f0731a175576b15 => generated 276 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:00.734018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:00.735686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:00.755448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75dcb4-608d-4c7c-b58f-a429ab14db4d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:00.827246 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:00.858548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:00.859370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:00.859663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:00.860360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:00.891345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b1fae61652674b428f0731a175576b15)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:00.896615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:00.954683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b1fae61652674b428f0731a175576b15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:00.964733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b1fae61652674b428f0731a175576b15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.046643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fae61652674b428f0731a175576b15', 'request_id': 'req-562afca3-5e03-4ab2-b679-245ed7c9b4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.057094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fae61652674b428f0731a175576b15', 'request_id': 'req-562afca3-5e03-4ab2-b679-245ed7c9b4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.068687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fae61652674b428f0731a175576b15', 'request_id': 'req-562afca3-5e03-4ab2-b679-245ed7c9b4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.100377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] The token cache is being invalidate because project b1fae61652674b428f0731a175576b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:01.100688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.107402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.118655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b1fae61652674b428f0731a175576b15', 'request_id': 'req-562afca3-5e03-4ab2-b679-245ed7c9b4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.121518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b1fae61652674b428f0731a175576b15', 'request_id': 'req-562afca3-5e03-4ab2-b679-245ed7c9b4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.126291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b1fae61652674b428f0731a175576b15', 'request_id': 'req-562afca3-5e03-4ab2-b679-245ed7c9b4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:01.137096 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2601/5205] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:00 2022] DELETE /identity/v3/domains/b1fae61652674b428f0731a175576b15 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:01.141373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.142934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:01.180566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41bb1f-8c13-472a-908f-6f57d4444139 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:01.308731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff7703-5972-44fb-8a0b-319317ffe5b5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:01.309386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7703-5972-44fb-8a0b-319317ffe5b5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.309665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7703-5972-44fb-8a0b-319317ffe5b5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.309939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7703-5972-44fb-8a0b-319317ffe5b5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.310603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff7703-5972-44fb-8a0b-319317ffe5b5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:01.312201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff7703-5972-44fb-8a0b-319317ffe5b5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:01.347053 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2605/5206] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:26:01 2022] POST /identity/v3/domains => generated 276 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:01.350870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.352311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:01.368850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562afca3-5e03-4ab2-b679-245ed7c9b4f3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:01.457094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0e674-3e86-4b59-b368-79e57231a88f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.457094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0e674-3e86-4b59-b368-79e57231a88f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.457094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0e674-3e86-4b59-b368-79e57231a88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.485799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2dd0e674-3e86-4b59-b368-79e57231a88f None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:01.487960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2dd0e674-3e86-4b59-b368-79e57231a88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:01.503065 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:01.524022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:01.531257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.531257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.531257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.531257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:01.533132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:01.595894 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2602/5207] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:26:01 2022] PUT /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config => generated 138 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:01.597026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.609179 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2606/5208] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:01.626632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799e271-67da-4a8d-a920-8137d1b3e1d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:01.649440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:01.650463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.650960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.651955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.653175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:01.654535 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:01.654535 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:01.654535 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:01.657312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:01.659972 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:01.701522 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2603/5209] 10.222.0.16 () {60 vars in 1271 bytes} [Sun Sep 11 01:26:01 2022] PATCH /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config => generated 141 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:01.705083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0e674-3e86-4b59-b368-79e57231a88f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.717583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0e674-3e86-4b59-b368-79e57231a88f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:01.723003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:01.723649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.723926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.724199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.739541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:01.741392 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:01.741392 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:01.741392 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:01.742308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:01.762505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.763082 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2607/5210] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:01 2022] GET /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config => generated 141 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:01.797308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a145ee-f1cb-4d0c-bae9-db36d40b7548 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:01.810983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:01.811922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.812367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.812809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.813440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:01.815117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:01.835623 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2604/5211] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:26:01 2022] DELETE /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:01.843169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.882365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3f00-8a77-40fe-b75b-97c785943f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:01.890500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:01.892874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.893281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.893635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.900438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:01.903305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Could not find any options in domain configuration for domain ed99ab6b6f4c4ad391c98a34f80e9d24.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ed99ab6b6f4c4ad391c98a34f80e9d24. Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 11 01:26:01.913686 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ed99ab6b6f4c4ad391c98a34f80e9d24. Sep 11 01:26:01.915599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:26:01.925501 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2608/5212] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:01 2022] GET /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config => generated 151 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:26:01.926714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.943752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6a1e6-0ebb-453c-a778-f85a28d45972 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:01.957005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:01.957664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:01.957942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:01.958215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:01.958821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:01.974515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:01.985110 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2605/5213] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:26:01 2022] DELETE /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24/config => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:01.987833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:01.999862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cb02-733a-4647-8235-b32f9e3b6da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:02.015033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:02.016337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.016785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.017096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.018473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:02.020155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:02.049591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.050376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.121777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.122441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-14f85c37-0e60-4a71-bbd4-b111747b0b0b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.125804 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2609/5214] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:26:01 2022] PATCH /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24 => generated 277 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:02.129616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:02.131474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:02.148951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01efb0-1017-4a38-ae3f-d2dfbbb456d7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:02.276189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c69e8-b40c-4bee-aef6-5e2e9936e012 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.276750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c69e8-b40c-4bee-aef6-5e2e9936e012 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.277388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c69e8-b40c-4bee-aef6-5e2e9936e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.281997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:02.282729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.283017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.283297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.306070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2e3c69e8-b40c-4bee-aef6-5e2e9936e012 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:02.307438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2e3c69e8-b40c-4bee-aef6-5e2e9936e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:02.318270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ed99ab6b6f4c4ad391c98a34f80e9d24)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:02.320159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:02.351480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.357016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.408245 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2610/5215] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:02.423859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24', 'request_id': 'req-42526ac0-7aad-40af-8803-4bf3e131a51d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.431764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24', 'request_id': 'req-42526ac0-7aad-40af-8803-4bf3e131a51d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.440900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24', 'request_id': 'req-42526ac0-7aad-40af-8803-4bf3e131a51d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.456247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] The token cache is being invalidate because project ed99ab6b6f4c4ad391c98a34f80e9d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:02.456781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.477681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.497304 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=20,keystone:INSERT=4,keystone:SELECT=76 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:02.501414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24', 'request_id': 'req-42526ac0-7aad-40af-8803-4bf3e131a51d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.503153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24', 'request_id': 'req-42526ac0-7aad-40af-8803-4bf3e131a51d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.511169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ed99ab6b6f4c4ad391c98a34f80e9d24', 'request_id': 'req-42526ac0-7aad-40af-8803-4bf3e131a51d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:02.536657 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2606/5216] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:02 2022] DELETE /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:02.536968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c69e8-b40c-4bee-aef6-5e2e9936e012 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:02.559509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c69e8-b40c-4bee-aef6-5e2e9936e012 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:02.685009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:02.685954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.686342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.686722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.687487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:02.689399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:02.712988 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:02.729202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:02.731066 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2611/5217] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:26:02 2022] POST /identity/v3/domains => generated 276 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:02.731231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:02.746287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526ac0-7aad-40af-8803-4bf3e131a51d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:02.821845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:02.823119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.823119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.823119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.824246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:02.826123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:02.877330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:02.890196 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2607/5218] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:26:02 2022] PUT /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config => generated 138 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:02.892683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414837e-d7c7-48db-bc81-81437a3d4da1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:02.898327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:02.898992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.899241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.899516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.900483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc, group=identity)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:02.903425 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:02.903425 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:02.903425 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:02.904745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:02.958756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:02.959827 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2612/5219] 10.222.0.16 () {60 vars in 1297 bytes} [Sun Sep 11 01:26:02 2022] PATCH /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity => generated 177 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:02.971270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8482eb-e76f-402f-b9e0-910f62e35f77 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:02.976799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:02.977451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:02.977731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:02.978290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity/driver` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:02.979033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc, group=identity, option=driver)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:02.981040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.015100 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2608/5220] 10.222.0.16 () {60 vars in 1318 bytes} [Sun Sep 11 01:26:02 2022] PATCH /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity/driver => generated 177 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:03.019350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.032738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e1c7-0ec4-49b5-bb72-55c471ae0aa0 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.056049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.056996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.057512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.057750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity/driver` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.058840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc, group=identity, option=driver)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.059895 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:03.059895 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:03.059895 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:03.060891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.101565 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2613/5221] 10.222.0.16 () {58 vars in 1299 bytes} [Sun Sep 11 01:26:03 2022] DELETE /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity/driver => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:03.102704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.114206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01481c40-d31e-4116-bad3-5a83adfa4dd7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.120661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.121945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.121945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.122214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity/driver` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.123948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc, group=identity, option=driver)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.125749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Could not find option driver in group identity in domain configuration for domain 777802f7a79b4da0852b82d2fc84d0fc.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 777802f7a79b4da0852b82d2fc84d0fc. Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:26:03.152736 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 777802f7a79b4da0852b82d2fc84d0fc. Sep 11 01:26:03.154142 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:26:03.159208 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2609/5222] 10.222.0.16 () {58 vars in 1296 bytes} [Sun Sep 11 01:26:03 2022] GET /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity/driver => generated 171 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:26:03.162358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.176304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bd479-dba9-4451-afbc-9dd9f7432981 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.183484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.184263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.184617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.184957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.185672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc, group=identity)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.187503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.224059 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2614/5223] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 11 01:26:03 2022] DELETE /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:03.228406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.250294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb65c2c-f9d5-4a74-bcc1-a5b108c022a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.257222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.258270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.258712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.259136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.261236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc, group=identity)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.263622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Could not find group identity in domain configuration for domain 777802f7a79b4da0852b82d2fc84d0fc.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 777802f7a79b4da0852b82d2fc84d0fc. Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:26:03.275891 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 777802f7a79b4da0852b82d2fc84d0fc. Sep 11 01:26:03.277851 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:26:03.281273 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2610/5224] 10.222.0.16 () {58 vars in 1275 bytes} [Sun Sep 11 01:26:03 2022] GET /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config/identity => generated 154 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:26:03.285694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.302241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69f05-5779-473a-8968-44049b7c316c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.318735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.319445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.319722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.320309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.320597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=777802f7a79b4da0852b82d2fc84d0fc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.322548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.343012 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2615/5225] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:26:03 2022] DELETE /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc/config => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:03.348069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.361486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e734c7-396f-4bf7-8b13-b5f42e8f0c1c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.367974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.368764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.369054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.369408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.371125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=777802f7a79b4da0852b82d2fc84d0fc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.372791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.401664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.404411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:03.418777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.419617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.470842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.471584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.476910 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2611/5226] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:26:03 2022] PATCH /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc => generated 277 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:03.479875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.484691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:03.532163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba188c35-808d-4957-b85f-114f5653c7e7 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.575122 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:03.630283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52350849-2666-4e3d-956d-ee33ae272ce9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:03.633901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.635015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.635015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.635295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] PATH_INFO: `/v3/users/5d1747c4e79544c2abfcadb9ad25c285` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.637565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1747c4e79544c2abfcadb9ad25c285)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.639494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.641742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:03.642515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.643124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.643262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.666341 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:03.667466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=777802f7a79b4da0852b82d2fc84d0fc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:03.674841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:03.721189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1747c4e79544c2abfcadb9ad25c285'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.722358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1747c4e79544c2abfcadb9ad25c285'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.728765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1747c4e79544c2abfcadb9ad25c285'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.734858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.741927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.759507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1747c4e79544c2abfcadb9ad25c285'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.775451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8bf18d8-946e-4a1c-8fb5-22fb24a58c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1747c4e79544c2abfcadb9ad25c285'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.802379 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2616/5227] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:03 2022] DELETE /identity/v3/users/5d1747c4e79544c2abfcadb9ad25c285 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:03.807845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.808495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.810411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.854737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc', 'request_id': 'req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.861463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:03.865453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:03.876092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc', 'request_id': 'req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.888419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc', 'request_id': 'req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.903830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] The token cache is being invalidate because project 777802f7a79b4da0852b82d2fc84d0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:03.904132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.904855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.913780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc', 'request_id': 'req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.914460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc', 'request_id': 'req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.918588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '777802f7a79b4da0852b82d2fc84d0fc', 'request_id': 'req-f1474bac-7f99-47f5-bb63-9ab0e088bc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:03.933250 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2612/5228] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:03 2022] DELETE /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:03.933250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:03.933250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:03.933250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:03.954881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:03.956099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:03.986557 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2617/5229] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:03.987003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:03.988474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:04.043714 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2613/5230] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:04.044590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.050738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:04.098287 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:04.100114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5205d-2a7b-4a88-ba9a-a03c11e980fa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.107028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.107998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.108843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.109232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.109808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.112385 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:04.112385 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:04.112385 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:04.113484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.119552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2618/5231] 10.222.0.16 () {58 vars in 1173 bytes} [Sun Sep 11 01:26:03 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:04.123995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.149107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b308887-0c33-4a4f-a99b-f0d0a45c5515 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.166186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.167835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.168520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.169134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.170666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.173273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.177405 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2619/5232] 10.222.0.16 () {58 vars in 1200 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:04.180043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.196001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa46c3-fdf1-4271-9be0-0a961c5a4d6b tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.204106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.205388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.205989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.206493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.207199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.209211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.215108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2620/5233] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.217838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.234670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898861e1-550a-4d45-ab9c-fcf9017a26dc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.235170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa7bb-071a-4d88-b592-c7b522ba6b0f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.242000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.242955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.243458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.243781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.257490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.258769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.259494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.260227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.261282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.262096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.263199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.265086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.266451 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2621/5234] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.275772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.282856 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2614/5235] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:04.298919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95eba53-91f7-4901-a024-de7527ea9f7f tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.304606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.305292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.305600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.305888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.306566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.309342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.314739 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2622/5236] 10.222.0.16 () {58 vars in 1188 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:04.315541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.329787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef2ae1-82f5-453d-b765-8031f6414065 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.335780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.336452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.336734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.337006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.338522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.340301 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:04.340301 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:04.340301 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:04.341302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.345617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2615/5237] 10.222.0.16 () {58 vars in 1200 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:04.346607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.362690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440969f3-b080-431e-bfd4-463668aa2e90 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.373760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.374763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.375247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.375890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.376674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.378504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.380316 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2623/5238] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.384427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.397325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb4cb5-47d9-40b9-b634-de23500d5575 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.404066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.404788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.405091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.405380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.406066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.407829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.412461 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2616/5239] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.413685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.426450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f1ef-02f7-483d-8a2b-83dec55e4e82 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.433100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.433688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.433984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.434266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.434929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.436554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.440733 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2624/5240] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.442092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.453548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45356a5d-8763-4c8b-b1ae-b0de29378b11 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.464688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.464688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.464688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.465201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.465201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.466412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.467719 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2617/5241] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.472535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.486790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e07e4-ec76-47ce-b807-e7c68d71ddd5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.494642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.496716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.497137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.497564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.498263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.500205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.506564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.523114 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2625/5242] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.540934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bd6c-7b51-47de-aa2e-9a6ac3175613 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.547943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.548959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.549375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.549873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.550773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.552948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.561597 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2618/5243] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.562388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.575308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ba71b-239b-4546-ab0a-52bf2c7f3730 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.583181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.584729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.585289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.585744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.586636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.589418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.592747 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2626/5244] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.597486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.610779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad56c1-4a04-4769-b6f9-addef22213fc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.617767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.621266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.621614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.621899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.623163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.625099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.631555 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2619/5245] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.635138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.667539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3619d-bf47-4b09-b885-4776913ae06d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.674744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.676284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.677596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.678073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.678900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.680857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.686673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2627/5246] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.687024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.699084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497c073-c0f7-4684-be54-f91ed8071393 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.723782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.724502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.724812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.725073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.725700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.733525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.737094 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2620/5247] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:04.739317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.749886 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:04.757931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b2a4-9ea7-4940-ba90-6a14754ede3a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.759375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.761728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:04.762031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.763251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.763823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.764304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.765592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.768009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.772589 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2628/5248] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.773563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.785740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf8282-ff66-455d-91c0-1043c20e16f6 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.793021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34130b3-eaa7-4d56-97bf-44d95585896c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.796764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.797467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.797963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.798103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.798592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.800186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.802018 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2629/5249] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.807487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.808796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.809559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.809733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.810159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] PATH_INFO: `/v3/projects/8592ed873c4143d696005902dfc93491` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.811838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8592ed873c4143d696005902dfc93491)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.814313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.831421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca5dd-876d-464f-8037-16d7121564b9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.841085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.842366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.843643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.844381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.845555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.847953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.850111 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2630/5250] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.856613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.880785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea6ebd-1e3b-445e-aaa3-a618f579667a tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.890860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:04.891960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:04.892525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:04.892906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:04.894167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:04.896499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:04.898856 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2631/5251] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:04.910645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:04.930287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ec40-ce0c-49b4-949c-3bb1a9b0c1af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:04.949975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8592ed873c4143d696005902dfc93491', 'request_id': 'req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:04.959031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8592ed873c4143d696005902dfc93491', 'request_id': 'req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:04.977651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8592ed873c4143d696005902dfc93491', 'request_id': 'req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:04.995593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] The token cache is being invalidate because project 8592ed873c4143d696005902dfc93491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:04.996293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:04.997190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:05.000007 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2621/5252] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:04 2022] DELETE /identity/v3/projects/8592ed873c4143d696005902dfc93491 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:05.006862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.008477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:05.033372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.034453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.036016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.036568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.040226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.045550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.047179 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2632/5253] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:04 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.053192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.059402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:05.084467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03c4ca-2fe4-4488-aa0e-0735acadc047 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.095011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.095783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.096168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.096545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.097294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.099131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.100734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2633/5254] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.104895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.124748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68ec43-bba2-4fa1-be8b-30c55a6bd776 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.133385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.135273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.136364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.136784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.137417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.140434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.141810 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2634/5255] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.143194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41265eae-5936-4b7f-8fc4-ac86aaba0e2e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.146122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.149972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.150693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.151040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.151423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] PATH_INFO: `/v3/users/b32cfc131ace4319be2c08616455b60f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.153102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32cfc131ace4319be2c08616455b60f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.155934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.161662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85313a-f461-4902-b5b0-dbbf07c99392 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.170886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.171713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.172374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.172657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.173716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.177637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.178829 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2635/5256] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.186364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.188075 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:05.203465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3331d-0b67-4c86-9ab1-cc16b0eedc76 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.215110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.217466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.217749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.218027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.218622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.220251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.221744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2636/5257] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.225307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.236034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a84d64-a82d-4916-a858-45411338ea96 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.236270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32cfc131ace4319be2c08616455b60f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:05.238081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32cfc131ace4319be2c08616455b60f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:05.238773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32cfc131ace4319be2c08616455b60f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:05.241779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.242538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.242922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.243300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.244006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.246444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.247895 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2637/5258] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.259943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.279233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:05.279836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32cfc131ace4319be2c08616455b60f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:05.314589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058695-9a87-4d7d-831f-1079fc4ec031 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.316096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32cfc131ace4319be2c08616455b60f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:05.341963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a65943-4edb-4eb2-9424-d7b644ee0fa2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.342669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a65943-4edb-4eb2-9424-d7b644ee0fa2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.342955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a65943-4edb-4eb2-9424-d7b644ee0fa2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.343259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a65943-4edb-4eb2-9424-d7b644ee0fa2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.343890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a65943-4edb-4eb2-9424-d7b644ee0fa2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.345439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a65943-4edb-4eb2-9424-d7b644ee0fa2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.350126 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2638/5259] 10.222.0.16 () {58 vars in 1290 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.356552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c20d-04bd-483a-90f4-dd6513d05336 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.356869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c20d-04bd-483a-90f4-dd6513d05336 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.357170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c20d-04bd-483a-90f4-dd6513d05336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.359140 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2622/5260] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:05 2022] DELETE /identity/v3/users/b32cfc131ace4319be2c08616455b60f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:05.361438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.430800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6063c20d-04bd-483a-90f4-dd6513d05336 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:05.432026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6063c20d-04bd-483a-90f4-dd6513d05336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:05.461403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d502-8ecd-43dc-ac45-dce50939c2a0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.473584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.474503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.474798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.475177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.475930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.478507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.482107 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2623/5261] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.485985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.500554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7df0b-10f4-45a2-8975-26bcadc45038 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.509434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.519959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.520496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.520880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.539896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.543182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.548126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2624/5262] 10.222.0.16 () {58 vars in 1266 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:05.550637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.563127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2639/5263] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:05.565938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d442a21-1def-40a2-8238-52f55be4eb02 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.594365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.595309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.595843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.596196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.597032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.598846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.600520 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2625/5264] 10.222.0.16 () {58 vars in 1308 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.606384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c20d-04bd-483a-90f4-dd6513d05336 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.627503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c20d-04bd-483a-90f4-dd6513d05336 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.633993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.634808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.635149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.635978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.636682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.638490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.640149 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2640/5265] 10.222.0.16 () {58 vars in 1290 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.644158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.657270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a495-2a0b-4345-8796-8c115aa92daa tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.671320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.672289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.672674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.673050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.673926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.675668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.676968 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2626/5266] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.681517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.696319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f0357-ad63-45a0-8ff8-47f5a4d73da2 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.702799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.703761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.704269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.704656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.705583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.707287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.711418 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2641/5267] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.716189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.733038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2422e-900d-4219-a890-9289ca468170 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.738941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.739861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.740463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.741009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.767691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.771667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.775924 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2627/5268] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.781371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.797187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed648b-2d83-4753-aae9-7e29c3a0e9ef tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.806234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.808563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.809156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.809540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.810241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.812649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.815398 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2642/5269] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.819120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.830535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4bc9-fc21-42f9-8200-26804f39fbc3 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.836460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.837157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.837440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.837712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.838308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.841098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.845146 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2628/5270] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.846539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.858306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bd5fe-22e7-45f6-b3a1-91332dc6e2a9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.882076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.883517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.883949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.885221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.887297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.890017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.898336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.899400 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2643/5271] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.915509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f107e88-3dae-4f45-b2ea-5158e42b3f19 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.930025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.930696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.930973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.931248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.931846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.935989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.937943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2629/5272] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:05.942571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:05.960941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddab657-72f2-4210-a6c6-4ed3ea4c1bcc tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:05.978240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:05.978921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:05.979256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:05.979741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:05.982608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:05.982768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:05.985407 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2644/5273] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:05.989864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.010176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15fb06-1315-465a-b176-794e07078a0d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.020638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.021316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.021599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.021875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.022516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.024262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.027637 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2630/5274] 10.222.0.16 () {58 vars in 1257 bytes} [Sun Sep 11 01:26:05 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.032932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.047756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3cd29-e1bf-4ed5-bb2d-33464bfe4650 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.062971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.063899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.064180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.064455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.065048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.081530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.086913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.087465 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2645/5275] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.101180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac348e-3cb0-4a97-8d8b-e14473fb4c74 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.115813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.116787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.117270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.117719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.118473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.121371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.123663 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2631/5276] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:06.127300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.140437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb1fe-32f9-48ba-a07e-19761749343c tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.145602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.146337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.146737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.147078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.147731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.151320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.157271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.158038 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2646/5277] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.169204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad187f-9ff8-4978-94fa-59256feda75e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.174147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.174864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.175207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.175671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.176324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.178075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.183545 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2632/5278] 10.222.0.16 () {58 vars in 1212 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.184583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.198614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3dd79-6c87-4779-9cbc-6368edf9493e tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.205696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.206371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.206650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.206949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.207505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.210101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.214296 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2647/5279] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:06.215586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.230851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236af01-c089-47a2-92cb-b929b4a253d9 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.237607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.238537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.238825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.239183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.239777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.241922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.246570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2633/5280] 10.222.0.16 () {58 vars in 1215 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.251961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.267898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d20d2d-a98b-41f7-9269-1cb63be10497 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.280178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.281983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.282482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.282958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.283750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.285614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.286935 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2648/5281] 10.222.0.16 () {58 vars in 1218 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.291506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.302783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9e0a6-8ca3-4e80-89b8-0e22cbdba362 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.308857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.309690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.309970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.310258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.311044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.313187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.318799 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2634/5282] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.320701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.336764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c05cf-e6fc-42dc-8dc4-e98a420d76df tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.343120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.343768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.344048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.344319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.346005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.348405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.352551 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2649/5283] 10.222.0.16 () {58 vars in 1239 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.353725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.369165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419e7e7-f857-44c6-9b13-4e8e5bf0c74d tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.376698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.377413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.378041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.378321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.379304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.381440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.385118 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2635/5284] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:06.388077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.405018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb48f7f-3151-40b3-92c4-5d0a0b6d87ee tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.414383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.415979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.418025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.418784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.419606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.422673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.427520 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2650/5285] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.440040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.453825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2834605-6f63-4f77-a75f-b209d788bc57 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.459377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.460356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.460637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.460961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.461724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.463296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.465959 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2636/5286] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.470156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.482683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308732-6ee8-4df2-828a-07976b7dd8f1 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.487806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.488562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.488942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.489353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.490033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.492148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.494749 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2651/5287] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:26:06.500709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.518615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381055e0-4caa-443d-8b48-fe3a178fc4af tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.540322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb15d5-a898-40c4-b304-c25d72471096 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.541031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb15d5-a898-40c4-b304-c25d72471096 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.544536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb15d5-a898-40c4-b304-c25d72471096 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.544851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb15d5-a898-40c4-b304-c25d72471096 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.548075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb15d5-a898-40c4-b304-c25d72471096 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.550830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb15d5-a898-40c4-b304-c25d72471096 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.559711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.560159 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2637/5288] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 11 01:26:06 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 11 01:26:06.570540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b93b3a-1c2c-4aaf-b86c-e26f9004e4bf tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.582272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.583868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.584165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.584443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/777802f7a79b4da0852b82d2fc84d0fc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.608661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb84b-9719-4efe-a807-11254a051652 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.608946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb84b-9719-4efe-a807-11254a051652 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.609663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb84b-9719-4efe-a807-11254a051652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.610517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Could not find domain: 777802f7a79b4da0852b82d2fc84d0fc.: keystone.exception.DomainNotFound: Could not find domain: 777802f7a79b4da0852b82d2fc84d0fc. Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 777802f7a79b4da0852b82d2fc84d0fc. Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:26:06.619166 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:26:06.621127 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:26:06.622337 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 777802f7a79b4da0852b82d2fc84d0fc. Sep 11 01:26:06.627314 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:26:06.627314 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2652/5289] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:26:06 2022] PATCH /identity/v3/domains/777802f7a79b4da0852b82d2fc84d0fc => generated 112 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:26:06.631573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.663691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914788b8-134d-495f-83d6-a2a6397d8ec5 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.668847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e7cfb84b-9719-4efe-a807-11254a051652 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:06.670104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7cfb84b-9719-4efe-a807-11254a051652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:06.671612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.673395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.674121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.674979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.678478 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:06.689679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:26:06.690851 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2638/5290] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Could not find domain: ed99ab6b6f4c4ad391c98a34f80e9d24.: keystone.exception.DomainNotFound: Could not find domain: ed99ab6b6f4c4ad391c98a34f80e9d24. Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ed99ab6b6f4c4ad391c98a34f80e9d24. Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:26:06.699722 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:26:06.700977 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:26:06.702211 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ed99ab6b6f4c4ad391c98a34f80e9d24. Sep 11 01:26:06.703469 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:26:06.705951 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2653/5291] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:26:06 2022] PATCH /identity/v3/domains/ed99ab6b6f4c4ad391c98a34f80e9d24 => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:26:06.710033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfb84b-9719-4efe-a807-11254a051652 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.725603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfb84b-9719-4efe-a807-11254a051652 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.732797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451574212586499faa0b58ca72750b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328810a43d72469194b2054cb8d1d666', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.733567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.733847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.734204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] PATH_INFO: `/v3/domains/b1fae61652674b428f0731a175576b15` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.743844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Could not find domain: b1fae61652674b428f0731a175576b15.: keystone.exception.DomainNotFound: Could not find domain: b1fae61652674b428f0731a175576b15. Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b1fae61652674b428f0731a175576b15. Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:26:06.755084 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:26:06.756139 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:26:06.757672 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b1fae61652674b428f0731a175576b15. Sep 11 01:26:06.758952 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:26:06.758952 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2639/5292] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:26:06 2022] PATCH /identity/v3/domains/b1fae61652674b428f0731a175576b15 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:26:06.760460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.762445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:06.783669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:06.786557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:06.856091 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:06.867132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e4111-b845-443e-bdf2-9ea0bc405441 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.876299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.877324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.877912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.878390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] PATH_INFO: `/v3/users/a4a592c990e94832b7c01888930f9a46` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.879781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a592c990e94832b7c01888930f9a46)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.882239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.922384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f635b-4b6b-4b0a-baf5-5f559932d631 tempest-DomainConfigurationTestJSON-359560257 tempest-DomainConfigurationTestJSON-359560257-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:06.928128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:06.929128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:06.929801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:06.930334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] PATH_INFO: `/v3/projects/3ff952f575e24cb2ba0c8b8121e95a51` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:06.931795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff952f575e24cb2ba0c8b8121e95a51)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:06.934511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:06.978204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a592c990e94832b7c01888930f9a46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:06.979090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a592c990e94832b7c01888930f9a46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:06.979958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a592c990e94832b7c01888930f9a46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.013486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a592c990e94832b7c01888930f9a46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.024605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff952f575e24cb2ba0c8b8121e95a51', 'request_id': 'req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.030681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1aa7fb52-2982-4384-a20e-1c37415e6d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a592c990e94832b7c01888930f9a46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.046094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff952f575e24cb2ba0c8b8121e95a51', 'request_id': 'req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.077183 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2654/5293] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:06 2022] DELETE /identity/v3/users/a4a592c990e94832b7c01888930f9a46 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:07.083730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff952f575e24cb2ba0c8b8121e95a51', 'request_id': 'req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.087988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:07.089315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:07.089606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:07.119128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] The token cache is being invalidate because project 3ff952f575e24cb2ba0c8b8121e95a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:07.119665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.121884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.130114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2640/5294] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:06 2022] DELETE /identity/v3/projects/3ff952f575e24cb2ba0c8b8121e95a51 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:07.131552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:07.136334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:07.161918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:07.166583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:07.257624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c7ec-2227-44e6-a7b0-a218ea4b8bb3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:07.325643 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2655/5295] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:07.378253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:07.378798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:07.407812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:07.408462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:07.408736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:07.409004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] PATH_INFO: `/v3/users/8cbca377d61b401d85f13102c5770b56` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:07.410451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbca377d61b401d85f13102c5770b56)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:07.413017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:07.416616 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:07.420976 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:07.518908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8f98c-770f-46a0-82d1-9b6efb5b5a74 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:07.525205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbca377d61b401d85f13102c5770b56'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.533574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbca377d61b401d85f13102c5770b56'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.533817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:07.533817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:07.533817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:07.533817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:07.534183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:07.534278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbca377d61b401d85f13102c5770b56'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.549360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:07.554185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:07.561271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbca377d61b401d85f13102c5770b56'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.583470 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2656/5296] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:07.587723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64a4114c-183f-4f15-b705-2eff7e6c3e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbca377d61b401d85f13102c5770b56'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:07.627014 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2641/5297] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:07 2022] DELETE /identity/v3/users/8cbca377d61b401d85f13102c5770b56 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:08.572537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:08.575286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:08.596836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e6c0b-b693-424d-a189-cad3f7cf8214 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:08.644042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:08.644042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:08.644042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:08.683025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:08.686611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:08.756947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:08.757642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:08.758004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:08.758244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] PATH_INFO: `/v3/projects/436b61b0a78f4d7a8af203c468c7e200` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:08.759473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=436b61b0a78f4d7a8af203c468c7e200)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:08.762901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:08.807757 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2642/5298] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:08.810387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:08.813386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:08.847396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b598631-e2c1-498e-b907-6c03e1db6ea6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:08.849478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436b61b0a78f4d7a8af203c468c7e200', 'request_id': 'req-2da53bd0-4346-4670-8cff-9c39a37d05dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:08.860682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436b61b0a78f4d7a8af203c468c7e200', 'request_id': 'req-2da53bd0-4346-4670-8cff-9c39a37d05dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:08.875373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436b61b0a78f4d7a8af203c468c7e200', 'request_id': 'req-2da53bd0-4346-4670-8cff-9c39a37d05dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:08.907847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] The token cache is being invalidate because project 436b61b0a78f4d7a8af203c468c7e200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:08.908244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:08.909561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2da53bd0-4346-4670-8cff-9c39a37d05dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:08.915562 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2657/5299] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:08 2022] DELETE /identity/v3/projects/436b61b0a78f4d7a8af203c468c7e200 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:08.920008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8c14-865c-4c32-9f04-b403a0e0c73a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:08.920667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8c14-865c-4c32-9f04-b403a0e0c73a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:08.921170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8c14-865c-4c32-9f04-b403a0e0c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:08.957296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0d6b8c14-865c-4c32-9f04-b403a0e0c73a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:08.958915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d6b8c14-865c-4c32-9f04-b403a0e0c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:08.977994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:08.979132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:08.979431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:08.979700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] PATH_INFO: `/v3/projects/ba3439f4a3b041bfb2ddc309980b18aa` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:08.982860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3439f4a3b041bfb2ddc309980b18aa)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:08.987465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.049570 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:09.051439 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:09.086678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3439f4a3b041bfb2ddc309980b18aa', 'request_id': 'req-002ef3ed-ff44-4474-a512-fafa387f8c0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.098584 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2658/5300] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:09.098979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3439f4a3b041bfb2ddc309980b18aa', 'request_id': 'req-002ef3ed-ff44-4474-a512-fafa387f8c0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.100855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9f71f-1f87-4283-961c-5f0241cb0d44 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.101407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9f71f-1f87-4283-961c-5f0241cb0d44 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.101687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9f71f-1f87-4283-961c-5f0241cb0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.121957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3439f4a3b041bfb2ddc309980b18aa', 'request_id': 'req-002ef3ed-ff44-4474-a512-fafa387f8c0a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.141609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-48d9f71f-1f87-4283-961c-5f0241cb0d44 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:09.143340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-48d9f71f-1f87-4283-961c-5f0241cb0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:09.144996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] The token cache is being invalidate because project ba3439f4a3b041bfb2ddc309980b18aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:09.145547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.146544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.152627 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2643/5301] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:08 2022] DELETE /identity/v3/projects/ba3439f4a3b041bfb2ddc309980b18aa => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:09.154947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:09.158059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:09.261264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2659/5302] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:09.261511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ef3ed-ff44-4474-a512-fafa387f8c0a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:09.264243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9f71f-1f87-4283-961c-5f0241cb0d44 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:09.274341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:09.274680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9f71f-1f87-4283-961c-5f0241cb0d44 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:09.275594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.276199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.277278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] PATH_INFO: `/v3/users/451574212586499faa0b58ca72750b60` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.278470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=451574212586499faa0b58ca72750b60)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:09.280608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.281100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:09.283679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.283679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.283679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.283679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:09.283679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:09.284920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.304613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2660/5303] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:09.305845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:09.321830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75628d89-04b7-4908-8f5d-4d8f4c9cf868 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:09.329270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:09.330230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.330909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.331637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.332460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:09.335324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.347497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451574212586499faa0b58ca72750b60'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.348376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451574212586499faa0b58ca72750b60'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.349193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451574212586499faa0b58ca72750b60'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.360660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451574212586499faa0b58ca72750b60'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.374498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451574212586499faa0b58ca72750b60'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:09.377328 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2661/5304] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:09 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:09.379426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:09.381330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:09.400581 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2644/5305] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:09 2022] DELETE /identity/v3/users/451574212586499faa0b58ca72750b60 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:09.545131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395b685-7fe9-4402-ac0b-0f43f6c6cf59 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:09.628876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:09.634980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.636271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.636700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.637693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:09.640269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.691898 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:09.737330 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2662/5306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:09 2022] POST /identity/v3/users => generated 285 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:09.741727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:09.757592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101827-35dd-4ce2-876f-b4befeb36e9a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:09.764201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:09.764890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.765219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.765541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.766619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:09.769033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.788779 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2645/5307] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:26:09.793277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:09.806864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a001a-c528-4fc5-b26e-acb938dd3ce8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:09.813301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef25e96-d7f4-4009-9e12-36e46e20a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:09.814269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef25e96-d7f4-4009-9e12-36e46e20a4de admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.814553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef25e96-d7f4-4009-9e12-36e46e20a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.814827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef25e96-d7f4-4009-9e12-36e46e20a4de admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.815686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef25e96-d7f4-4009-9e12-36e46e20a4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:09.818118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef25e96-d7f4-4009-9e12-36e46e20a4de admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.839637 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2663/5308] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:09.844343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:09.859438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1802d1-f76b-4865-96c4-600fb6b989fc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:09.864357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:09.866211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.867207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.868019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] PATH_INFO: `/v3/projects/fbc44981cf6a4e6d90be72010b0f26d7/users/49ff66090c3742f6b5c70d3abef11732/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.892317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc44981cf6a4e6d90be72010b0f26d7, user_id=49ff66090c3742f6b5c70d3abef11732, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:09.898689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:09.917747 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:09.925312 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2646/5309] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:09 2022] PUT /identity/v3/projects/fbc44981cf6a4e6d90be72010b0f26d7/users/49ff66090c3742f6b5c70d3abef11732/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:09.950356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:09.950654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:09.950839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:09.993329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] MFA Rules not processed for user `49ff66090c3742f6b5c70d3abef11732`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:09.994586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:10.095131 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2664/5310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:10.110275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:10.112948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:10.203251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:10.204596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:10.278633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6139-edde-4d0a-8416-5f1ab76ec34b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:10.291501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde448e3-4afe-471f-aaf0-e415b81874fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:10.293498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde448e3-4afe-471f-aaf0-e415b81874fb service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:10.294045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde448e3-4afe-471f-aaf0-e415b81874fb service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:10.295702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde448e3-4afe-471f-aaf0-e415b81874fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:10.312623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde448e3-4afe-471f-aaf0-e415b81874fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:10.316695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde448e3-4afe-471f-aaf0-e415b81874fb service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:10.341116 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2647/5311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:10.411579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65660c16-9c15-4192-a921-db2cd7bfa0c8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:10.434332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:10.434903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:10.437822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:10.438095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] PATH_INFO: `/v3/projects/328810a43d72469194b2054cb8d1d666` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:10.441319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=328810a43d72469194b2054cb8d1d666)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:10.443572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:10.573990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328810a43d72469194b2054cb8d1d666', 'request_id': 'req-4a516387-6dda-4f53-a75f-88035fb92a1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:10.589360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328810a43d72469194b2054cb8d1d666', 'request_id': 'req-4a516387-6dda-4f53-a75f-88035fb92a1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:10.603890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328810a43d72469194b2054cb8d1d666', 'request_id': 'req-4a516387-6dda-4f53-a75f-88035fb92a1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:10.633829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] The token cache is being invalidate because project 328810a43d72469194b2054cb8d1d666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:10.634403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:10.641522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a516387-6dda-4f53-a75f-88035fb92a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:10.643758 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2665/5312] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:10 2022] DELETE /identity/v3/projects/328810a43d72469194b2054cb8d1d666 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:10.648446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9190c-1732-41f1-8bf1-5fd3b385423f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:10.648922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9190c-1732-41f1-8bf1-5fd3b385423f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:10.649354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9190c-1732-41f1-8bf1-5fd3b385423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:10.690369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-beb9190c-1732-41f1-8bf1-5fd3b385423f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:10.691873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-beb9190c-1732-41f1-8bf1-5fd3b385423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:10.849674 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2648/5313] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:10.850349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f8cc-4a5d-4318-a0e8-845f24dd6074 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:10.850349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f8cc-4a5d-4318-a0e8-845f24dd6074 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:10.850517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f8cc-4a5d-4318-a0e8-845f24dd6074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:10.876122 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:10.901159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a343f8cc-4a5d-4318-a0e8-845f24dd6074 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:10.903693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a343f8cc-4a5d-4318-a0e8-845f24dd6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:10.930626 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2666/5314] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:10.936487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9190c-1732-41f1-8bf1-5fd3b385423f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:10.954989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9190c-1732-41f1-8bf1-5fd3b385423f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:10.962591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:10.966131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:10.967227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:10.967812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:10.969025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:10.969688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:10.971687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:10.996929 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2649/5315] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:10.998892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343f8cc-4a5d-4318-a0e8-845f24dd6074 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:11.012066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343f8cc-4a5d-4318-a0e8-845f24dd6074 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:11.021240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:11.021865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:11.022145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:11.022415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:11.023049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:11.024983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:11.084991 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2667/5316] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:10 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:11.088150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:11.161991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ef896-d091-4f63-9d3d-45ea3dd35342 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:11.430087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:11.431945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:11.432431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:11.432776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:11.436907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:11.439260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:11.482126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2650/5317] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:11 2022] POST /identity/v3/users => generated 285 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:11.483725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:11.498180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2417-14a4-43ca-9387-2f07563cecdc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:11.504711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:11.505627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:11.506124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:11.506609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:11.507491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:11.524224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:11.555460 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2668/5318] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:11.558484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:11.583904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd4e8-de91-4be6-aedc-6def501dcf29 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:11.597365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef191f3-83eb-46a3-b345-71c33bfc256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:11.599552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef191f3-83eb-46a3-b345-71c33bfc256b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:11.599820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef191f3-83eb-46a3-b345-71c33bfc256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:11.600162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef191f3-83eb-46a3-b345-71c33bfc256b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:11.601931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef191f3-83eb-46a3-b345-71c33bfc256b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:11.603637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef191f3-83eb-46a3-b345-71c33bfc256b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:11.649329 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2651/5319] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:11.654907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:11.674678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fb3d6-8f24-4080-abb9-8846e7c1b80b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:11.683652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:11.684663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:11.685721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:11.686194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] PATH_INFO: `/v3/projects/f76882bf1d384a9eab8dbe83b3c8fdd9/users/9581683489f84c56bc407c847c35dbf0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:11.706792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76882bf1d384a9eab8dbe83b3c8fdd9, user_id=9581683489f84c56bc407c847c35dbf0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:11.710076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:11.752609 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2669/5320] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:11 2022] PUT /identity/v3/projects/f76882bf1d384a9eab8dbe83b3c8fdd9/users/9581683489f84c56bc407c847c35dbf0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:11.763723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481b49-00c4-4aa8-a432-1936c915ffc5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:11.764509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481b49-00c4-4aa8-a432-1936c915ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:11.766302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93481b49-00c4-4aa8-a432-1936c915ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:11.800976 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:11.827275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-93481b49-00c4-4aa8-a432-1936c915ffc5 None None] MFA Rules not processed for user `9581683489f84c56bc407c847c35dbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:11.829694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-93481b49-00c4-4aa8-a432-1936c915ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:11.973789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2652/5321] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:11.974427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:12.198385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0170f-2e97-405a-876d-749f23751b57 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:12.210021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:12.210841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:12.211244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:12.211604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:12.212489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:12.217371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:12.278285 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2670/5322] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:11 2022] POST /identity/v3/projects => generated 369 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:12.281013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93481b49-00c4-4aa8-a432-1936c915ffc5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:12.294953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93481b49-00c4-4aa8-a432-1936c915ffc5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:12.499422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:12.500070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:12.502660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:12.503017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:12.510488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:12.512766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:12.570053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:12.571678 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2653/5323] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:12 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:12.588347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:12.591392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:12.592792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe93e-197e-4125-ac83-194ecb25f76a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:12.600039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:12.600761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:12.601139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:12.601485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:12.602199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:12.605236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:12.640426 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2671/5324] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:12.643865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:12.672186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3d49-ba92-408a-b6a8-96e69aeb4ab4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:12.688870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:12.689789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:12.690073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:12.690593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] PATH_INFO: `/v3/projects/c6e6f068763f4524b4115387c5b82079/users/0ec7cab0f22e442cb315a8631e5561d9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:12.720279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e6f068763f4524b4115387c5b82079, user_id=0ec7cab0f22e442cb315a8631e5561d9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:12.726696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:12.767559 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2672/5325] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:12 2022] PUT /identity/v3/projects/c6e6f068763f4524b4115387c5b82079/users/0ec7cab0f22e442cb315a8631e5561d9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:12.773096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:12.786952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd441-3142-4411-8a56-16d23b6638c3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:12.857646 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:12.873974 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:12.909316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d6e6-9c94-4b01-a70c-2960f0bec9d8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:12.922396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:12.923020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:12.923297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:12.924218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:12.924868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:12.926506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:12.934625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe235c-af8e-46d3-bd71-424331df7f76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:12.936349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe235c-af8e-46d3-bd71-424331df7f76 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:12.939231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe235c-af8e-46d3-bd71-424331df7f76 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:12.939503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe235c-af8e-46d3-bd71-424331df7f76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:12.943515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2fe235c-af8e-46d3-bd71-424331df7f76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:12.948974 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2673/5326] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:12.952549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:12.972601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe235c-af8e-46d3-bd71-424331df7f76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:12.974976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe235c-af8e-46d3-bd71-424331df7f76 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:12.976883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb0197-6bce-4282-b97b-46b3f285de2b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:12.987971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:12.990979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:12.991535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:12.992561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] PATH_INFO: `/v3/projects/c6e6f068763f4524b4115387c5b82079/users/0ec7cab0f22e442cb315a8631e5561d9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:12.995756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e6f068763f4524b4115387c5b82079, user_id=0ec7cab0f22e442cb315a8631e5561d9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:12.999969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:13.032321 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2654/5327] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:13.056526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc7d77-6318-4b09-8bb7-9ba4d62ff7ff None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:13.056711 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2674/5328] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:12 2022] PUT /identity/v3/projects/c6e6f068763f4524b4115387c5b82079/users/0ec7cab0f22e442cb315a8631e5561d9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:13.056815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc7d77-6318-4b09-8bb7-9ba4d62ff7ff None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:13.057135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc7d77-6318-4b09-8bb7-9ba4d62ff7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:13.116394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c9fc7d77-6318-4b09-8bb7-9ba4d62ff7ff None None] MFA Rules not processed for user `0ec7cab0f22e442cb315a8631e5561d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:13.117891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c9fc7d77-6318-4b09-8bb7-9ba4d62ff7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:13.273255 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2655/5329] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:13.277928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:13.291815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff46913-5676-472d-81fa-ce1ed9f44463 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:13.300014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:13.300014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:13.300014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:13.300414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:13.300414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:13.302667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:13.328689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2675/5330] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:26:13 2022] POST /identity/v3/domains => generated 275 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:13.334149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc7d77-6318-4b09-8bb7-9ba4d62ff7ff None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:13.347288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc7d77-6318-4b09-8bb7-9ba4d62ff7ff None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:13.513970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:13.514799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:13.515168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:13.515554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:13.516369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:13.517658 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:13.517658 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:13.517658 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:13.519292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:13.565123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2656/5331] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:26:13 2022] POST /identity/v3/groups => generated 280 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:13.566761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:13.587443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522deeea-6fd8-4bdf-8b02-157d3e1ee4ea tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:13.592339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:13.592982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:13.594089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:13.594089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/0e358572e6704adc919bd6baeea01b59` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:13.601055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:update_group(group_id=0e358572e6704adc919bd6baeea01b59)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:13.602876 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:13.602876 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:13.602876 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:13.604688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:13.644798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2676/5332] 10.222.0.16 () {60 vars in 1247 bytes} [Sun Sep 11 01:26:13 2022] PATCH /identity/v3/groups/0e358572e6704adc919bd6baeea01b59 => generated 291 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:13.647283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:13.678095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0334e35-c542-419b-a8e4-50c68ced664d tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:13.684844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:13.685526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:13.685810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:13.686085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/0e358572e6704adc919bd6baeea01b59` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:13.693962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:get_group(group_id=0e358572e6704adc919bd6baeea01b59)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:13.695278 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:13.695278 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:13.695278 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:13.696903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:13.701141 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2657/5333] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:13 2022] GET /identity/v3/groups/0e358572e6704adc919bd6baeea01b59 => generated 291 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:13.711275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:13.733632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff0d67-0625-4abf-996c-23ca97bc7422 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:13.749053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:13.752104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:13.753014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:13.753606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/0e358572e6704adc919bd6baeea01b59` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:13.755347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:update_group(group_id=0e358572e6704adc919bd6baeea01b59)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:13.761632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:13.819969 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2677/5334] 10.222.0.16 () {60 vars in 1246 bytes} [Sun Sep 11 01:26:13 2022] PATCH /identity/v3/groups/0e358572e6704adc919bd6baeea01b59 => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:13.827633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:13.844356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851428e2-5299-4999-99c4-f9647619714f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:13.852025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:13.853253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:13.853832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:13.854878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/0e358572e6704adc919bd6baeea01b59` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:13.863747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0e358572e6704adc919bd6baeea01b59)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:13.890303 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:13.890303 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:13.890303 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:13.891842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:13.916242 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:13.998240 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2658/5335] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:13 2022] DELETE /identity/v3/groups/0e358572e6704adc919bd6baeea01b59 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:14.003321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:14.016172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc6ad-7fa5-46e4-9972-5dcfc12b0b0f tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:14.105391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:14.106942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:14.107390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:14.107852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:14.108697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:14.111071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:14.173968 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2678/5336] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:26:14 2022] POST /identity/v3/groups => generated 326 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:14.176698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:14.192180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6b8e3-7d24-4342-a188-68dae2e5a0ef tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:14.197900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:14.198556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:14.198839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:14.199112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:14.199751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:14.201893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:14.259071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:14.259484 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2659/5337] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:14 2022] POST /identity/v3/users => generated 323 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:14.279011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1018b1c-1cb3-4d8e-b7e8-09c94a5a27c1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:14.299473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:14.300404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:14.301674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:14.302173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/602f3aca20dd4de09afe2ff64637ed61` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:14.348772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=682ec544f9894226bb4b63af42207223, user_id=602f3aca20dd4de09afe2ff64637ed61)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:14.350330 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:14.350330 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:14.350330 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:14.352207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:14.455961 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2679/5338] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:26:14 2022] PUT /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/602f3aca20dd4de09afe2ff64637ed61 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:14.461705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:14.479560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80783e-01d9-4314-9075-e52496edddb9 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:14.681088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:14.681088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:14.681088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:14.681540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:14.681540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:14.681540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:14.790810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2660/5339] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:14 2022] POST /identity/v3/users => generated 321 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:14.795510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:14.828184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be0058-bd03-4c4f-9169-9ac9dba172c6 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:14.837768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:14.838805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:14.839094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:14.839375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/6a5b3c126ee04403ae59549fcb5ead2b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:14.881329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=682ec544f9894226bb4b63af42207223, user_id=6a5b3c126ee04403ae59549fcb5ead2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:14.883664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:14.927265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:14.938547 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2680/5340] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:26:14 2022] PUT /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/6a5b3c126ee04403ae59549fcb5ead2b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:14.943438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:14.967751 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:15.109157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5c473-33ed-40c9-942c-8470efe32472 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:15.115566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:15.121954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:15.134271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:15.137771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:15.138706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:15.142657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:15.207266 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2681/5341] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:14 2022] POST /identity/v3/users => generated 323 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:15.209316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:15.236195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11855420-b0be-455a-bb6b-3513c1956550 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:15.313397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:15.314860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:15.315640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:15.316727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/d57f796f3d6b41bebb269b71fedfaf4f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:15.340268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=682ec544f9894226bb4b63af42207223, user_id=d57f796f3d6b41bebb269b71fedfaf4f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:15.343710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:15.396407 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2682/5342] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:26:15 2022] PUT /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/d57f796f3d6b41bebb269b71fedfaf4f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:15.402790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:15.409951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326637a-001d-41dc-af85-801fd1059bdf tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:15.486592 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:15.542316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:15.543093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:15.544026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:15.545128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:15.551369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:15.594924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:15.596727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:15.596860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b823ec-18fd-4716-bdde-07702da0f7fd tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:15.607257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:15.609386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:15.612172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:15.612558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:15.615510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=682ec544f9894226bb4b63af42207223)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:15.621099 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:15.621099 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:15.621099 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:15.622679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:15.623616 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2661/5343] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:15.669834 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2683/5344] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 11 01:26:15 2022] GET /identity/v3/groups/682ec544f9894226bb4b63af42207223/users => generated 1083 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:15.670818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:15.735744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16fb40-f904-43a3-8763-c92972ff3c05 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:15.757481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:15.758577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:15.759070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:15.760244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/602f3aca20dd4de09afe2ff64637ed61` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:15.766181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=682ec544f9894226bb4b63af42207223, user_id=602f3aca20dd4de09afe2ff64637ed61)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:15.770229 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:15.770229 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:15.770229 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:15.774089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:15.825786 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2662/5345] 10.222.0.16 () {58 vars in 1342 bytes} [Sun Sep 11 01:26:15 2022] HEAD /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/602f3aca20dd4de09afe2ff64637ed61 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:15.831415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:15.843360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3e874-40ab-4bf6-a149-b3de81999196 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:15.869106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:15.870965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:15.873054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:15.874507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/602f3aca20dd4de09afe2ff64637ed61` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:15.878050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=682ec544f9894226bb4b63af42207223, user_id=602f3aca20dd4de09afe2ff64637ed61)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:15.880214 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:15.880214 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:15.880214 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:15.882512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:15.914597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '602f3aca20dd4de09afe2ff64637ed61'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:15.940451 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2684/5346] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:26:15 2022] DELETE /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/602f3aca20dd4de09afe2ff64637ed61 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:15.944653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:15.971673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea732ad-8c36-4cd4-9b46-a55e3e0a8c98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:16.150351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:16.151072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:16.151427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:16.151711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/6a5b3c126ee04403ae59549fcb5ead2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:16.154151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=682ec544f9894226bb4b63af42207223, user_id=6a5b3c126ee04403ae59549fcb5ead2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:16.156061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:16.182463 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2663/5347] 10.222.0.16 () {58 vars in 1342 bytes} [Sun Sep 11 01:26:15 2022] HEAD /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/6a5b3c126ee04403ae59549fcb5ead2b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:16.188080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:16.202808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0beb48-d0fa-4590-bee9-6c23749fd2de tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:16.221684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:16.222356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:16.223484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:16.223771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/6a5b3c126ee04403ae59549fcb5ead2b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:16.239113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=682ec544f9894226bb4b63af42207223, user_id=6a5b3c126ee04403ae59549fcb5ead2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:16.240949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:16.268429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6a5b3c126ee04403ae59549fcb5ead2b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:16.300714 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2685/5348] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:26:16 2022] DELETE /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/6a5b3c126ee04403ae59549fcb5ead2b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:16.305166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:16.319277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e18c-8734-460a-886e-69e0e337f239 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:16.433861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:16.434523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:16.434937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:16.435217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/d57f796f3d6b41bebb269b71fedfaf4f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:16.437028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=682ec544f9894226bb4b63af42207223, user_id=d57f796f3d6b41bebb269b71fedfaf4f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:16.439062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:16.504134 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2664/5349] 10.222.0.16 () {58 vars in 1342 bytes} [Sun Sep 11 01:26:16 2022] HEAD /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/d57f796f3d6b41bebb269b71fedfaf4f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:16.508378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:16.521592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a554b-b9e4-4cac-84f1-2a418f36ec74 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:16.560527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:16.566943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:16.568961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:16.569529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users/d57f796f3d6b41bebb269b71fedfaf4f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:16.576848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=682ec544f9894226bb4b63af42207223, user_id=d57f796f3d6b41bebb269b71fedfaf4f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:16.581629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:16.620767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd57f796f3d6b41bebb269b71fedfaf4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:16.626692 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:16.663681 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2686/5350] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:26:16 2022] DELETE /identity/v3/groups/682ec544f9894226bb4b63af42207223/users/d57f796f3d6b41bebb269b71fedfaf4f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:16.668544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:16.689729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ace039-7d8f-4e89-bf91-5168570e00e3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:16.793913 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:16.833744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:16.834283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:16.834569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:16.834842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:16.837995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=682ec544f9894226bb4b63af42207223)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:16.839443 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:16.839443 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:16.839443 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:16.840842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:16.887760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2665/5351] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 11 01:26:16 2022] GET /identity/v3/groups/682ec544f9894226bb4b63af42207223/users => generated 145 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:16.889206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:16.918315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53967d87-ef4e-41d9-990b-a07aedb04d25 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:16.964118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:16.964787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:16.969636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:16.970039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users/d57f796f3d6b41bebb269b71fedfaf4f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:16.974261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d57f796f3d6b41bebb269b71fedfaf4f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:16.976791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:17.137997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57f796f3d6b41bebb269b71fedfaf4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.139706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57f796f3d6b41bebb269b71fedfaf4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.141308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57f796f3d6b41bebb269b71fedfaf4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.191867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57f796f3d6b41bebb269b71fedfaf4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.226187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57f796f3d6b41bebb269b71fedfaf4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.253708 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2687/5352] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:16 2022] DELETE /identity/v3/users/d57f796f3d6b41bebb269b71fedfaf4f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:17.261039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:17.265276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:17.293735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205c10b-8ec4-400b-87ec-140cb9a292e5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:17.362637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:17.364654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:17.505792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:17.506510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:17.507001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:17.507326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users/6a5b3c126ee04403ae59549fcb5ead2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:17.509823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a5b3c126ee04403ae59549fcb5ead2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:17.526122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:17.582105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972aa16-b374-44ee-b5c4-d675edc9030b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:17.594960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:17.605146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:17.605146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:17.605146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] PATH_INFO: `/v3/users/c1f11301cfa145da840dc121c355cc1f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:17.605146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f11301cfa145da840dc121c355cc1f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:17.605146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:17.646018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5b3c126ee04403ae59549fcb5ead2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.647095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5b3c126ee04403ae59549fcb5ead2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.647740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5b3c126ee04403ae59549fcb5ead2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.663395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5b3c126ee04403ae59549fcb5ead2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.708447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5b3c126ee04403ae59549fcb5ead2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.708697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f11301cfa145da840dc121c355cc1f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.712729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f11301cfa145da840dc121c355cc1f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.714947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f11301cfa145da840dc121c355cc1f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.763574 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2666/5353] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:17 2022] DELETE /identity/v3/users/6a5b3c126ee04403ae59549fcb5ead2b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:17.767490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:17.769217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:17.779993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f11301cfa145da840dc121c355cc1f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.785043 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=2,keystone:DELETE=20,keystone:SELECT=78 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:17.810835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e3c670c8-39d9-497d-a5c0-11cd7c3ed938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f11301cfa145da840dc121c355cc1f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:17.861628 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2688/5354] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:17 2022] DELETE /identity/v3/users/c1f11301cfa145da840dc121c355cc1f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:17.867945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:17.868234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:17.868505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:17.921732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:17.923070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:18.001217 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:18.010808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd6da-997a-4688-b632-4ccc300c4779 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.088928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2689/5355] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:18.099698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:18.111658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:18.121141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:18.122171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.122557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.122929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users/602f3aca20dd4de09afe2ff64637ed61` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.124284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_user(user_id=602f3aca20dd4de09afe2ff64637ed61)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:18.127069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:18.217925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602f3aca20dd4de09afe2ff64637ed61'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:18.219737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3133bcd-6a02-4ac4-904c-082d749f0707 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.221450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602f3aca20dd4de09afe2ff64637ed61'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:18.223968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602f3aca20dd4de09afe2ff64637ed61'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:18.224775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:18.225679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.226201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.226690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.229881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:18.240296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602f3aca20dd4de09afe2ff64637ed61'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:18.250886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:18.253945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:18.258167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602f3aca20dd4de09afe2ff64637ed61'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:18.264840 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2690/5356] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:26:18.296898 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2667/5357] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:17 2022] DELETE /identity/v3/users/602f3aca20dd4de09afe2ff64637ed61 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:18.298586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:18.300148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:18.328100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045b8e-a1e3-4f68-a94e-eb4919d45f4f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.427049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1220-795e-4155-a4b7-a702e3d6f992 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:18.427958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1220-795e-4155-a4b7-a702e3d6f992 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.428252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1220-795e-4155-a4b7-a702e3d6f992 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.428533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1220-795e-4155-a4b7-a702e3d6f992 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/682ec544f9894226bb4b63af42207223` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.429864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1220-795e-4155-a4b7-a702e3d6f992 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_group(group_id=682ec544f9894226bb4b63af42207223)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:18.434303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1220-795e-4155-a4b7-a702e3d6f992 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:18.474601 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:18.498614 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2691/5358] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:18 2022] DELETE /identity/v3/groups/682ec544f9894226bb4b63af42207223 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:18.505347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:18.531784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554655b0-f8bf-4a9d-bebb-99d5940c0da5 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.608858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157fa4e-67df-4b84-bdd0-85ac2f160dd1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.609231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157fa4e-67df-4b84-bdd0-85ac2f160dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.609492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157fa4e-67df-4b84-bdd0-85ac2f160dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.637599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:18.642372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.642752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.643051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.644195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:18.647498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:18.647756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4157fa4e-67df-4b84-bdd0-85ac2f160dd1 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:18.649345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4157fa4e-67df-4b84-bdd0-85ac2f160dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:18.685002 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2668/5359] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:26:18 2022] POST /identity/v3/groups => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:18.686077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:18.689863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:18.725705 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2692/5360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:18.726934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157fa4e-67df-4b84-bdd0-85ac2f160dd1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:18.740214 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:18.756113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157fa4e-67df-4b84-bdd0-85ac2f160dd1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.776350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:18.779293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.779595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.779877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.783868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:18.785433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:18.824845 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2693/5361] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:26:18 2022] POST /identity/v3/groups => generated 327 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:18.825999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:18.853315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fdef-0269-48be-a2d6-5b4e6d62af81 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.858974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:18.859737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.860121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.860522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] PATH_INFO: `/v3/projects/7122f50f734648ffbed6e866f91f4a11` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.861237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b0b0-f2f9-4b8a-aeac-c12f5428bddc tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.861924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7122f50f734648ffbed6e866f91f4a11)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:18.864207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:18.883647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:18.884285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:18.884571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:18.884849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:18.886067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:18.910350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:18.946051 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2694/5362] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:26:18 2022] POST /identity/v3/groups => generated 325 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:18.950271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:18.967116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaca79-3e04-499c-b341-4d508e1489c4 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:18.970911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7122f50f734648ffbed6e866f91f4a11', 'request_id': 'req-8e5550a1-050e-4b68-ad1f-029dff485132'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:18.980938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7122f50f734648ffbed6e866f91f4a11', 'request_id': 'req-8e5550a1-050e-4b68-ad1f-029dff485132'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:19.008525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7122f50f734648ffbed6e866f91f4a11', 'request_id': 'req-8e5550a1-050e-4b68-ad1f-029dff485132'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:19.058019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] The token cache is being invalidate because project 7122f50f734648ffbed6e866f91f4a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:19.060663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:19.063617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e5550a1-050e-4b68-ad1f-029dff485132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:19.066109 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2669/5363] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:18 2022] DELETE /identity/v3/projects/7122f50f734648ffbed6e866f91f4a11 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:19.078066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eada7e-5e7b-4cc3-8fcb-c1587f108c32 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.078392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eada7e-5e7b-4cc3-8fcb-c1587f108c32 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.078672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eada7e-5e7b-4cc3-8fcb-c1587f108c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.093590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.094444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.094813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.095161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.095907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.096996 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:19.096996 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:26:19.096996 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:26:19.099161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.106783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-83eada7e-5e7b-4cc3-8fcb-c1587f108c32 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:19.107997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-83eada7e-5e7b-4cc3-8fcb-c1587f108c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:19.109504 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2695/5364] 10.222.0.16 () {58 vars in 1125 bytes} [Sun Sep 11 01:26:18 2022] GET /identity/v3/groups => generated 1489 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:26:19.113368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.115422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:19.147224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324e82-1fdf-4f69-9fad-d556f948f1f7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.160161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.162374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.162911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.163993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/4bdf8adcb961493a87aadccacccdcd4d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.174762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4bdf8adcb961493a87aadccacccdcd4d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.177412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.231600 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2670/5365] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:19.233204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569cf5f-9778-4f6c-95da-0f67ecfae433 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.233697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569cf5f-9778-4f6c-95da-0f67ecfae433 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.234097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569cf5f-9778-4f6c-95da-0f67ecfae433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.262897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e569cf5f-9778-4f6c-95da-0f67ecfae433 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:19.266979 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2696/5366] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:19 2022] DELETE /identity/v3/groups/4bdf8adcb961493a87aadccacccdcd4d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:19.271149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e569cf5f-9778-4f6c-95da-0f67ecfae433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:19.272506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.288596 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:19.330883 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:19.355874 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2671/5367] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:19.357777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4cb1-2a68-46cd-9ad7-66b576aa2683 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.358626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4cb1-2a68-46cd-9ad7-66b576aa2683 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.359246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4cb1-2a68-46cd-9ad7-66b576aa2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.364460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034569b-131d-413f-8050-082693fb3d40 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.371172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.371843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.372127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.372407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/bc2c8e5a5e7244c7b574f9ce99a9454d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.378469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bc2c8e5a5e7244c7b574f9ce99a9454d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.380424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.391217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-54cb4cb1-2a68-46cd-9ad7-66b576aa2683 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:19.392482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-54cb4cb1-2a68-46cd-9ad7-66b576aa2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:19.446364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2697/5368] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:19 2022] DELETE /identity/v3/groups/bc2c8e5a5e7244c7b574f9ce99a9454d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:19.448700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.466905 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2672/5369] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:19.468020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4cb1-2a68-46cd-9ad7-66b576aa2683 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.480935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4cb1-2a68-46cd-9ad7-66b576aa2683 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.571062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973cba-68f8-4e62-939e-906420d19d98 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.579323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.579958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.580243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.580522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.581346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:19.581552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.583434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.602132 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2698/5370] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:19.603571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.616644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.618240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.620173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.620563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/642240203a9242b9861d300c73c905a7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.621637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563012-fdd2-4b17-a02a-4289ca2eb151 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.627314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.628273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.628571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.628835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.629512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.631864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.636804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_group(group_id=642240203a9242b9861d300c73c905a7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.642800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.683498 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2699/5371] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:19 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:19.690468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.721728 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2673/5372] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:19 2022] DELETE /identity/v3/groups/642240203a9242b9861d300c73c905a7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:19.727279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.746987 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:19.790611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01164a8-e6a0-4bf9-86c7-d7fd68af3a1e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.846971 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:19.879999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94080ac-828b-415e-b57a-c0a1db9dd753 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.886870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.887521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.888272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.888404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.889048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.890963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.907326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.909669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.910127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.911265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.912269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.914251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.928441 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2674/5373] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:19 2022] POST /identity/v3/users => generated 321 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:19.930471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.947413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf44f5-0517-4821-b34d-fe8010d670a3 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.956380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:19.957699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:19.958360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:19.958987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:19.960197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:19.965177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:19.965990 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2700/5374] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:19 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:19.970857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:19.991707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054b70-9833-443b-963a-01fedc3ae6ea admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:19.993189 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2675/5375] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:26:19 2022] POST /identity/v3/groups => generated 327 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:19.995139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.005942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.006568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.006851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.007129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.007275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c3c8-742a-45dc-a76e-2c198af3b582 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.007788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.010781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.012474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.013700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.014253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.014532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/f8a3577af8c74a8d9584cf4669216c4c/users/490b6a1f31b145118186827a32b071bc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.040600 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2701/5376] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:20.042792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f8a3577af8c74a8d9584cf4669216c4c, user_id=490b6a1f31b145118186827a32b071bc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.044542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.046721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.061890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196076b-7648-44dc-842e-0fd8c85bc803 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.075968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.076831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.077859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.079648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.080492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.081374 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2676/5377] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:26:19 2022] PUT /identity/v3/groups/f8a3577af8c74a8d9584cf4669216c4c/users/490b6a1f31b145118186827a32b071bc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:20.084588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.085203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.110853 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2702/5378] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:20.112156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.138510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abeb71-a13d-4c5d-8edb-a89ba98abd15 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.180187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b6fb-64eb-47c2-ae30-724d0fc05ad1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.187372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.188054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.188341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.188617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.189502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.191533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.220757 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2677/5379] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:26:20 2022] POST /identity/v3/groups => generated 326 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:20.221775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.238011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb04807-54f2-46dd-bd1e-ae9f2064ea51 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.246457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.247176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.247459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.248284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/bf4f334e84ae4d8baaa07d78c229fb57/users/490b6a1f31b145118186827a32b071bc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.278434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bf4f334e84ae4d8baaa07d78c229fb57, user_id=490b6a1f31b145118186827a32b071bc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.285158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.293600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee7df-d503-4f56-88bd-221437175ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.294602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee7df-d503-4f56-88bd-221437175ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.295005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee7df-d503-4f56-88bd-221437175ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.295377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee7df-d503-4f56-88bd-221437175ae1 admin admin] PATH_INFO: `/v3/projects/bc0978f728b144c7aeffc0851bac6692/users/81738e694f1744df948daca1f37b0497/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.320621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ee7df-d503-4f56-88bd-221437175ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0978f728b144c7aeffc0851bac6692, user_id=81738e694f1744df948daca1f37b0497, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.329788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ee7df-d503-4f56-88bd-221437175ae1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.350551 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2678/5380] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:26:20 2022] PUT /identity/v3/groups/bf4f334e84ae4d8baaa07d78c229fb57/users/490b6a1f31b145118186827a32b071bc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:20.352699 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2703/5381] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:20 2022] PUT /identity/v3/projects/bc0978f728b144c7aeffc0851bac6692/users/81738e694f1744df948daca1f37b0497/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:20.362379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.364005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.364292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.364564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.410572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] MFA Rules not processed for user `81738e694f1744df948daca1f37b0497`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:20.411825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:20.435162 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:20.465116 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:20.473475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307067ee-8143-49b2-b5ad-5a72faba7a2c tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.528199 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2704/5382] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:20.543153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.544872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:20.610268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.611196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.611548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.611926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users/490b6a1f31b145118186827a32b071bc/groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.613275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=490b6a1f31b145118186827a32b071bc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.616680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.649257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2679/5383] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 11 01:26:20 2022] GET /identity/v3/users/490b6a1f31b145118186827a32b071bc/groups => generated 839 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:20.650400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.656099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d17ee-a404-4306-b7f2-fd261962cab2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.665804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.666008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4ea0b-6273-4556-a499-f2b5761538e1 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.667539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.668482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.669712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.673107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.673832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.674855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.675230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/bf4f334e84ae4d8baaa07d78c229fb57` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.676930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bf4f334e84ae4d8baaa07d78c229fb57)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.679013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.690843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.692318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:20.712437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2705/5384] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:20.750527 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2680/5385] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:20 2022] DELETE /identity/v3/groups/bf4f334e84ae4d8baaa07d78c229fb57 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:20.755808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:20.784084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c5eba-dab9-478f-a5db-923cca70e6ab service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:20.910829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:20.914139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:20.914570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:20.915398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/groups/f8a3577af8c74a8d9584cf4669216c4c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:20.917691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f8a3577af8c74a8d9584cf4669216c4c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:20.924895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:21.040814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2706/5386] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:26:20 2022] DELETE /identity/v3/groups/f8a3577af8c74a8d9584cf4669216c4c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:21.043259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:21.058457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5499c-a429-47b4-a7bb-da50031f4d6b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:21.164592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:21.165585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:21.166091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:21.166832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/users/490b6a1f31b145118186827a32b071bc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:21.168330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_user(user_id=490b6a1f31b145118186827a32b071bc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:21.170527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:21.276493 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:21.279856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490b6a1f31b145118186827a32b071bc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.281528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490b6a1f31b145118186827a32b071bc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.283421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490b6a1f31b145118186827a32b071bc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.299107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490b6a1f31b145118186827a32b071bc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.321647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490b6a1f31b145118186827a32b071bc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.343504 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2681/5387] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:21 2022] DELETE /identity/v3/users/490b6a1f31b145118186827a32b071bc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:21.350410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:21.353346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:21.380703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c690e6d-c410-4dc7-8677-7ee979eed889 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:21.438156 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:21.504871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:21.505567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:21.505852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:21.506321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/domains/37a501d63c614e568d8891f4fae4ba69` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:21.507658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=37a501d63c614e568d8891f4fae4ba69)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:21.509447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:21.550687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '37a501d63c614e568d8891f4fae4ba69'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.552123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '37a501d63c614e568d8891f4fae4ba69'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.594642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '37a501d63c614e568d8891f4fae4ba69'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.595385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '37a501d63c614e568d8891f4fae4ba69'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.599080 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2707/5388] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:26:21 2022] PATCH /identity/v3/domains/37a501d63c614e568d8891f4fae4ba69 => generated 276 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:26:21.602481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:21.614970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a4076-4c32-42d4-b58a-8ce00301b8a7 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:21.705183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec7cab0f22e442cb315a8631e5561d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6e6f068763f4524b4115387c5b82079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:21.708758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:21.709368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:21.709879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] PATH_INFO: `/v3/domains/37a501d63c614e568d8891f4fae4ba69` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:21.725106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=37a501d63c614e568d8891f4fae4ba69)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:21.727452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:21.768783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '37a501d63c614e568d8891f4fae4ba69'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.773590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '37a501d63c614e568d8891f4fae4ba69'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.849578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a501d63c614e568d8891f4fae4ba69', 'request_id': 'req-45499763-3ac6-401d-a68a-0af2509a0539'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.863364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a501d63c614e568d8891f4fae4ba69', 'request_id': 'req-45499763-3ac6-401d-a68a-0af2509a0539'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.875532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a501d63c614e568d8891f4fae4ba69', 'request_id': 'req-45499763-3ac6-401d-a68a-0af2509a0539'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.899467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] The token cache is being invalidate because project 37a501d63c614e568d8891f4fae4ba69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:21.899834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.900409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.910462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '37a501d63c614e568d8891f4fae4ba69', 'request_id': 'req-45499763-3ac6-401d-a68a-0af2509a0539'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.911116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '37a501d63c614e568d8891f4fae4ba69', 'request_id': 'req-45499763-3ac6-401d-a68a-0af2509a0539'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.915328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45499763-3ac6-401d-a68a-0af2509a0539 tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '37a501d63c614e568d8891f4fae4ba69', 'request_id': 'req-45499763-3ac6-401d-a68a-0af2509a0539'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:21.919249 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:21.925511 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2682/5389] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:21 2022] DELETE /identity/v3/domains/37a501d63c614e568d8891f4fae4ba69 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:21.930130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:21.934266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:22.028886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2f7f-a461-44da-88af-c20b9150a30b tempest-GroupsV3TestJSON-1279974810 tempest-GroupsV3TestJSON-1279974810-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:22.100018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:22.100676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:22.100898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:22.101207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] PATH_INFO: `/v3/users/9581683489f84c56bc407c847c35dbf0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:22.102523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9581683489f84c56bc407c847c35dbf0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:22.105490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:22.164295 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:22.176164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9581683489f84c56bc407c847c35dbf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:22.177524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9581683489f84c56bc407c847c35dbf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:22.178757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9581683489f84c56bc407c847c35dbf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:22.199690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9581683489f84c56bc407c847c35dbf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:22.208423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9581683489f84c56bc407c847c35dbf0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:22.227852 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2708/5390] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:21 2022] DELETE /identity/v3/users/9581683489f84c56bc407c847c35dbf0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:22.232620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:22.233247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:22.233537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:22.269568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:22.272072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:22.397695 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2683/5391] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:22.410865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:22.412810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:22.537838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049751d-bb08-4e3b-ab81-9151a7a381f7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:22.543894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:22.544755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:22.545325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:22.546704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:22.571066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:22.573044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:22.597688 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2709/5392] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:23.396427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:23.402954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:23.454306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb745-4221-4531-92d7-09e9b16cbc64 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:23.460825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:23.461492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:23.461768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:23.462033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] PATH_INFO: `/v3/projects/f76882bf1d384a9eab8dbe83b3c8fdd9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:23.464944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76882bf1d384a9eab8dbe83b3c8fdd9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:23.466881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:23.556617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76882bf1d384a9eab8dbe83b3c8fdd9', 'request_id': 'req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.569036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76882bf1d384a9eab8dbe83b3c8fdd9', 'request_id': 'req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.588784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76882bf1d384a9eab8dbe83b3c8fdd9', 'request_id': 'req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.623963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] The token cache is being invalidate because project f76882bf1d384a9eab8dbe83b3c8fdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:23.624252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.628146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.636804 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2684/5393] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:23 2022] DELETE /identity/v3/projects/f76882bf1d384a9eab8dbe83b3c8fdd9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:23.638233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:23.660945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccf4a4-7be6-4ddc-91ca-822511a7ca68 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:23.809936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:23.811691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:23.811988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:23.815406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] PATH_INFO: `/v3/users/0ec7cab0f22e442cb315a8631e5561d9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:23.816847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec7cab0f22e442cb315a8631e5561d9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:23.819749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:23.926360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec7cab0f22e442cb315a8631e5561d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.927558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec7cab0f22e442cb315a8631e5561d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.928773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec7cab0f22e442cb315a8631e5561d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.940630 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:23.946356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec7cab0f22e442cb315a8631e5561d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.959334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391c9a21-f0f1-4079-b553-97f33497b8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec7cab0f22e442cb315a8631e5561d9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:23.988939 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2710/5394] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:23 2022] DELETE /identity/v3/users/0ec7cab0f22e442cb315a8631e5561d9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:24.356139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:24.358243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:24.387221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2818d-4e3b-4fa2-87e8-397a8bf3f529 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:24.550883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:24.553046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:24.554415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:24.555497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] PATH_INFO: `/v3/projects/c6e6f068763f4524b4115387c5b82079` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:24.560235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e6f068763f4524b4115387c5b82079)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:24.563897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:24.610635 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:24.667802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e6f068763f4524b4115387c5b82079', 'request_id': 'req-155908a8-27b3-4717-bc44-7b603f9636e2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:24.684616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e6f068763f4524b4115387c5b82079', 'request_id': 'req-155908a8-27b3-4717-bc44-7b603f9636e2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:24.703676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e6f068763f4524b4115387c5b82079', 'request_id': 'req-155908a8-27b3-4717-bc44-7b603f9636e2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:24.728520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] The token cache is being invalidate because project c6e6f068763f4524b4115387c5b82079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:24.730109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:24.731400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-155908a8-27b3-4717-bc44-7b603f9636e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:24.738439 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2685/5395] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:24 2022] DELETE /identity/v3/projects/c6e6f068763f4524b4115387c5b82079 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:24.742514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70686e5-bb4f-4f45-a648-098d3e411dd3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:24.745516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70686e5-bb4f-4f45-a648-098d3e411dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:24.746209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70686e5-bb4f-4f45-a648-098d3e411dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.019937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b70686e5-bb4f-4f45-a648-098d3e411dd3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:25.024235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b70686e5-bb4f-4f45-a648-098d3e411dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:25.154620 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2711/5396] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:25.259769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d936-f450-466b-9678-b6c3d1032ad6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.260634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d936-f450-466b-9678-b6c3d1032ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.261412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d936-f450-466b-9678-b6c3d1032ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.331097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b048d936-f450-466b-9678-b6c3d1032ad6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:25.332372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b048d936-f450-466b-9678-b6c3d1032ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:25.350394 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2686/5397] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:25.354586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70686e5-bb4f-4f45-a648-098d3e411dd3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:25.373164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70686e5-bb4f-4f45-a648-098d3e411dd3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:25.380481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:25.381477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.382521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.382521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.382925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:25.383339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:25.387075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:25.405582 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2712/5398] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:25.411129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d936-f450-466b-9678-b6c3d1032ad6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:25.424843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d936-f450-466b-9678-b6c3d1032ad6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:25.439845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:25.440906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.441227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.441510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.442214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:25.445018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:25.493283 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2687/5399] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:25 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:25.495750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:25.511045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb41b82-fad2-4b69-92c8-1ff3bf700f60 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:25.676519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:25.677231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.677514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.677791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.678801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:25.680791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:25.721712 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2713/5400] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:25 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:25.723970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:25.739675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327d005-3679-4d1e-add8-746d69fc30ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:25.746319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:25.746949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.747356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.747510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.748243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:25.749940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:25.771742 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2688/5401] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:25.774030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:25.790249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1faf5-7bd0-4201-9cbb-311a13dc9a61 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:25.803882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ff047-33fd-441f-adeb-bc15e08e9909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:25.805508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff047-33fd-441f-adeb-bc15e08e9909 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.805793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff047-33fd-441f-adeb-bc15e08e9909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.806068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff047-33fd-441f-adeb-bc15e08e9909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.808957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ff047-33fd-441f-adeb-bc15e08e9909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:25.815180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ff047-33fd-441f-adeb-bc15e08e9909 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:25.838392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2714/5402] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:25.844581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:25.861587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5453d-a995-41c2-b8ad-53bd341813e5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:25.877138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:25.877837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.878123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.879378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] PATH_INFO: `/v3/projects/5508fdf3c7474e33952496ca77cb4457/users/d8dbea99b6734756bde1fcd19d395653/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:25.913816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5508fdf3c7474e33952496ca77cb4457, user_id=d8dbea99b6734756bde1fcd19d395653, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:25.917072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:25.951006 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2689/5403] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:25 2022] PUT /identity/v3/projects/5508fdf3c7474e33952496ca77cb4457/users/d8dbea99b6734756bde1fcd19d395653/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:25.952166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16a45-1a13-42bd-8e5a-bd29f5d9a677 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:25.952827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16a45-1a13-42bd-8e5a-bd29f5d9a677 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:25.970478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16a45-1a13-42bd-8e5a-bd29f5d9a677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:26.046840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1fa16a45-1a13-42bd-8e5a-bd29f5d9a677 None None] MFA Rules not processed for user `d8dbea99b6734756bde1fcd19d395653`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:26.048154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1fa16a45-1a13-42bd-8e5a-bd29f5d9a677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:26.129596 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:26.221769 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2715/5404] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:26.228187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:26.386002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257fa27-782f-4a1f-b328-aa2cd00e9cab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:26.403877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:26.404623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:26.405111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:26.405393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:26.406307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:26.409047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:26.462781 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2690/5405] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:26 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:26.466654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16a45-1a13-42bd-8e5a-bd29f5d9a677 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:26.484685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16a45-1a13-42bd-8e5a-bd29f5d9a677 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:26.662679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:26.663394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:26.663676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:26.663964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:26.667530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:26.671787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:26.769616 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2716/5406] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:26 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:26.773425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:26.798683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fb0c0-826a-449c-a388-1502e6e11d94 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:26.814353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:26.815552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:26.816065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:26.817485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:26.818377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:26.820266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:26.844737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2691/5407] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:26.847687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:26.858988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043138c-3bca-44e1-a9a3-21636d19413a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:26.864112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:26.864813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:26.865049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:26.865355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] PATH_INFO: `/v3/projects/a7be349f18ea411d87b90757a45d9fe0/users/ca1782361f294012bf4b50c467aad9f0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:26.890145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7be349f18ea411d87b90757a45d9fe0, user_id=ca1782361f294012bf4b50c467aad9f0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:26.893603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:26.925221 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2717/5408] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:26 2022] PUT /identity/v3/projects/a7be349f18ea411d87b90757a45d9fe0/users/ca1782361f294012bf4b50c467aad9f0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:26.929536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:26.951337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8677-f3a1-4457-90ad-c5607c13d87d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:26.979373 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:27.041821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ba6ed-38d5-4d99-b9a1-a6c42e21ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:27.042827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ba6ed-38d5-4d99-b9a1-a6c42e21ac42 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:27.043341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ba6ed-38d5-4d99-b9a1-a6c42e21ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:27.043845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ba6ed-38d5-4d99-b9a1-a6c42e21ac42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:27.044782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ba6ed-38d5-4d99-b9a1-a6c42e21ac42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:27.046956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ba6ed-38d5-4d99-b9a1-a6c42e21ac42 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:27.064676 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2692/5409] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:27.068551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:27.091065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fac34-fb18-4df9-9964-f077fdc51f28 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:27.126584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:27.129288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:27.130939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:27.131981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] PATH_INFO: `/v3/projects/a7be349f18ea411d87b90757a45d9fe0/users/ca1782361f294012bf4b50c467aad9f0/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:27.136168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7be349f18ea411d87b90757a45d9fe0, user_id=ca1782361f294012bf4b50c467aad9f0, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:27.140924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:27.160089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2718/5410] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:27 2022] PUT /identity/v3/projects/a7be349f18ea411d87b90757a45d9fe0/users/ca1782361f294012bf4b50c467aad9f0/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:27.170589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c78b0-330f-46d4-8434-345cc2362efb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:27.171306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c78b0-330f-46d4-8434-345cc2362efb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:27.171909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c78b0-330f-46d4-8434-345cc2362efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:27.226196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-044c78b0-330f-46d4-8434-345cc2362efb None None] MFA Rules not processed for user `ca1782361f294012bf4b50c467aad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:27.230016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-044c78b0-330f-46d4-8434-345cc2362efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:27.413675 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2693/5411] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:27.416698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:27.440724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1289ee-a743-430f-9d60-5949beff587e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:27.457333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:27.457969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:27.458254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:27.458531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:27.459900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:27.461923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:27.568992 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2719/5412] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:27 2022] POST /identity/v3/projects => generated 358 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:27.570273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c78b0-330f-46d4-8434-345cc2362efb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:27.584916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c78b0-330f-46d4-8434-345cc2362efb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:27.768173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:27.769384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:27.770006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:27.770345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:27.771194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:27.773266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:27.820068 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2694/5413] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:27 2022] POST /identity/v3/users => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:27.825918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:27.843322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a5cb7-7490-4056-8392-95e276e88e11 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:27.861449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:27.862804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:27.863297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:27.863867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/e85ae02f744a47ef8e563b2882493408` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:27.932495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:get_user(user_id=e85ae02f744a47ef8e563b2882493408)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:27.937561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:27.945910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:27.946419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2720/5414] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:26:27 2022] GET /identity/v3/users/e85ae02f744a47ef8e563b2882493408 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:27.962025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e225cb-42e9-4db0-86b6-235854bcac7f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:27.983886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:27.985287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:27.986360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:27.986639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/e85ae02f744a47ef8e563b2882493408` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:28.005102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e85ae02f744a47ef8e563b2882493408)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:28.011945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:28.080063 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:28.143777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85ae02f744a47ef8e563b2882493408'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.147280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85ae02f744a47ef8e563b2882493408'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.148258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85ae02f744a47ef8e563b2882493408'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.160758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85ae02f744a47ef8e563b2882493408'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.184994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85ae02f744a47ef8e563b2882493408'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.219345 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2695/5415] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:27 2022] DELETE /identity/v3/users/e85ae02f744a47ef8e563b2882493408 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:28.224203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:28.229769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:28.267295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072a32-1de5-4947-bc90-2c2fea5bee2f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:28.397431 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:28.435208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:28.436004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:28.436363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:28.436784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/7bc5d205f9364066925616ea6759e9fd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:28.438374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7bc5d205f9364066925616ea6759e9fd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:28.440969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:28.583554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc5d205f9364066925616ea6759e9fd', 'request_id': 'req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.598352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc5d205f9364066925616ea6759e9fd', 'request_id': 'req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.617383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc5d205f9364066925616ea6759e9fd', 'request_id': 'req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.651826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] The token cache is being invalidate because project 7bc5d205f9364066925616ea6759e9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:28.652599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.653901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:28.664909 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2721/5416] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:28 2022] DELETE /identity/v3/projects/7bc5d205f9364066925616ea6759e9fd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:28.678819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:28.704680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e846bb-a3e9-4470-a274-116e02f02237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:28.864479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:28.868908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:28.871591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:28.872105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:28.874372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:28.877872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:28.971463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:28.972440 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2696/5417] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:28 2022] POST /identity/v3/projects => generated 359 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:28.973162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:29.001282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c6b1-83b2-4fe4-8d44-c52234e7e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.175588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:29.176923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:29.177504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:29.177964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:29.178858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:29.182328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:29.241399 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2722/5418] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:28 2022] POST /identity/v3/users => generated 417 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:29.246880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:29.273191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ee176-aadb-4e11-add1-2955cd87980c tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.286023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:29.287282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:29.288934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:29.292456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:29.293419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:29.295668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:29.345397 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2697/5419] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:26:29 2022] POST /identity/v3/roles => generated 239 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:29.349815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:29.366373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02112a13-61ba-491c-b5e6-3adf1791fb14 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.382345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:29.383368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:29.383819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:29.384458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/d675b30585964b4baf1d14cb33ecd8fd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:29.425375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:get_user(user_id=d675b30585964b4baf1d14cb33ecd8fd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:29.431057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:29.433736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2723/5420] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:26:29 2022] GET /identity/v3/users/d675b30585964b4baf1d14cb33ecd8fd => generated 417 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:29.438146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:29.459002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155dc4-2a9b-45b2-82d8-f4429433b4e6 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.470851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:29.471515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:29.471797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:29.472069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/roles/3c2f5ad697cb497c883508169e3bba25` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:29.477202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:get_role(role_id=3c2f5ad697cb497c883508169e3bba25)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:29.480817 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:29.480817 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:29.480817 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:29.482037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:29.485423 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2698/5421] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:26:29 2022] GET /identity/v3/roles/3c2f5ad697cb497c883508169e3bba25 => generated 239 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:29.487785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:29.503936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f262d-aac5-4549-82ad-1b418d682237 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.525008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:29.525795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:29.526138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:29.526510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:29.532056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:29.532056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:29.612739 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2724/5422] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:29 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:29.617819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:29.637807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483d6fc-e667-4580-b3a6-49fb0c9c6f38 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.818767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:29.819440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:29.819722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:29.820151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/44a818f973c548b0a2ede5f118d32c9a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:29.821438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:get_project(project_id=44a818f973c548b0a2ede5f118d32c9a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:29.824007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:29.828243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2699/5423] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:29 2022] GET /identity/v3/projects/44a818f973c548b0a2ede5f118d32c9a => generated 357 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:29.830220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:29.858040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2cd68-d9ca-47a5-99b8-6dc17f1b4340 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.880743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:29.882295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:29.882586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:29.883029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/44a818f973c548b0a2ede5f118d32c9a/users/d675b30585964b4baf1d14cb33ecd8fd/roles/3c2f5ad697cb497c883508169e3bba25` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:29.885430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_grant(project_id=44a818f973c548b0a2ede5f118d32c9a, user_id=d675b30585964b4baf1d14cb33ecd8fd, role_id=3c2f5ad697cb497c883508169e3bba25)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:29.888930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:29.926344 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2725/5424] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:29 2022] PUT /identity/v3/projects/44a818f973c548b0a2ede5f118d32c9a/users/d675b30585964b4baf1d14cb33ecd8fd/roles/3c2f5ad697cb497c883508169e3bba25 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:29.926556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:29.940362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae89c65-c53e-4428-859c-97a6ad743589 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:29.974179 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:30.070514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:30.072086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:30.072904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:30.074757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:30.076181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:30.078149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:30.151687 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2700/5425] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:29 2022] POST /identity/v3/projects => generated 359 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:30.156861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:30.170762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e7478-35bb-426f-8953-0a8d01a754a7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:30.194048 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:30.342644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:30.343526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:30.344584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:30.344584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/d4fe93985f564e70ae0e9f97ff7d178c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:30.345647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4fe93985f564e70ae0e9f97ff7d178c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:30.348243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:30.351206 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2726/5426] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:26:30 2022] GET /identity/v3/projects/d4fe93985f564e70ae0e9f97ff7d178c => generated 359 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:30.355797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:30.372414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad78708-1f8b-42d4-9f12-e1448fdf6991 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:30.378035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:30.378975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:30.379339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:30.379686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/d4fe93985f564e70ae0e9f97ff7d178c/users/d675b30585964b4baf1d14cb33ecd8fd/roles/3c2f5ad697cb497c883508169e3bba25` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:30.382914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d4fe93985f564e70ae0e9f97ff7d178c, user_id=d675b30585964b4baf1d14cb33ecd8fd, role_id=3c2f5ad697cb497c883508169e3bba25)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:30.386290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:30.415253 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2701/5427] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:30 2022] PUT /identity/v3/projects/d4fe93985f564e70ae0e9f97ff7d178c/users/d675b30585964b4baf1d14cb33ecd8fd/roles/3c2f5ad697cb497c883508169e3bba25 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:30.421574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:30.443665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48efd0-197d-48b4-b976-e3a1248b972f tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:30.585208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:30.586269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:30.586559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:30.587083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/d675b30585964b4baf1d14cb33ecd8fd/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:30.589910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=d675b30585964b4baf1d14cb33ecd8fd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:30.592422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:30.691611 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2727/5428] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:26:30 2022] GET /identity/v3/users/d675b30585964b4baf1d14cb33ecd8fd/projects => generated 840 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:30.695647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:30.718220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5a317-5251-462b-8126-ee19c421d36a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:30.723522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:30.724522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:30.725041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:30.725590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/d4fe93985f564e70ae0e9f97ff7d178c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:30.727804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4fe93985f564e70ae0e9f97ff7d178c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:30.731857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:30.858802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fe93985f564e70ae0e9f97ff7d178c', 'request_id': 'req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:30.874984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fe93985f564e70ae0e9f97ff7d178c', 'request_id': 'req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:30.904127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fe93985f564e70ae0e9f97ff7d178c', 'request_id': 'req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:30.922950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] The token cache is being invalidate because project d4fe93985f564e70ae0e9f97ff7d178c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:30.925009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:30.926499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:30.930245 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2702/5429] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:30 2022] DELETE /identity/v3/projects/d4fe93985f564e70ae0e9f97ff7d178c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:30.934860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:30.936862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:30.960515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbb312-7147-407e-b8ca-e49e2d44772d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:31.123255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:31.123255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:31.123255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:31.123633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/44a818f973c548b0a2ede5f118d32c9a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:31.126382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=44a818f973c548b0a2ede5f118d32c9a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:31.131188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:31.233988 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:31.293812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a818f973c548b0a2ede5f118d32c9a', 'request_id': 'req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:31.319481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a818f973c548b0a2ede5f118d32c9a', 'request_id': 'req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:31.342277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a818f973c548b0a2ede5f118d32c9a', 'request_id': 'req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:31.409703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] The token cache is being invalidate because project 44a818f973c548b0a2ede5f118d32c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:31.409703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:31.409703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:31.428104 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2728/5430] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:30 2022] DELETE /identity/v3/projects/44a818f973c548b0a2ede5f118d32c9a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:31.430536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:31.472209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdefc6-c8c8-4d14-aa68-f66ad9defc02 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:31.639174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:31.640050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:31.640507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:31.640948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/roles/3c2f5ad697cb497c883508169e3bba25` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:31.643274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c2f5ad697cb497c883508169e3bba25)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:31.645187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:31.673038 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:31.734453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invalidating the token cache because role 3c2f5ad697cb497c883508169e3bba25 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:31.735356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:31.739192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-acef0515-74e4-4841-8e6b-a83997aa75cc tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:31.748658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2703/5431] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:31 2022] DELETE /identity/v3/roles/3c2f5ad697cb497c883508169e3bba25 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:31.752752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:31.754525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:31.788848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ca6d8-7d60-420c-b4b6-05fc8b0df5c7 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:31.943911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:31.944651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:31.944940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:31.947323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/d675b30585964b4baf1d14cb33ecd8fd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:31.949942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d675b30585964b4baf1d14cb33ecd8fd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:31.952036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:32.071574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd675b30585964b4baf1d14cb33ecd8fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.072630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd675b30585964b4baf1d14cb33ecd8fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.073717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd675b30585964b4baf1d14cb33ecd8fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.084249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb9dda-b4bf-4000-b138-4426d2702f19 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:32.084718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb9dda-b4bf-4000-b138-4426d2702f19 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:32.084987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb9dda-b4bf-4000-b138-4426d2702f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:32.105746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd675b30585964b4baf1d14cb33ecd8fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.123644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd675b30585964b4baf1d14cb33ecd8fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.133082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-19fb9dda-b4bf-4000-b138-4426d2702f19 None None] MFA Rules not processed for user `8b1dfbbafa304ec6958dcbdd6e847ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:32.134673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-19fb9dda-b4bf-4000-b138-4426d2702f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:32.154758 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2729/5432] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:31 2022] DELETE /identity/v3/users/d675b30585964b4baf1d14cb33ecd8fd => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:32.158616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:32.160299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:32.227127 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2704/5433] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:32.292708 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:32.330398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a710f7e-f30d-4077-a9fc-ded7102d26b0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:32.335531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:32.336247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:32.336529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:32.336809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/0c9a01e6f90b47f4af6a333e3b1a7134` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:32.338431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0c9a01e6f90b47f4af6a333e3b1a7134)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:32.343190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:32.435053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9a01e6f90b47f4af6a333e3b1a7134', 'request_id': 'req-385509ef-1027-49b2-bfbc-66ef5b2346eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.445519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9a01e6f90b47f4af6a333e3b1a7134', 'request_id': 'req-385509ef-1027-49b2-bfbc-66ef5b2346eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.456652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9a01e6f90b47f4af6a333e3b1a7134', 'request_id': 'req-385509ef-1027-49b2-bfbc-66ef5b2346eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.483564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] The token cache is being invalidate because project 0c9a01e6f90b47f4af6a333e3b1a7134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:32.483946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.486428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-385509ef-1027-49b2-bfbc-66ef5b2346eb tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.488158 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2730/5434] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:32 2022] DELETE /identity/v3/projects/0c9a01e6f90b47f4af6a333e3b1a7134 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:32.497209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb9dda-b4bf-4000-b138-4426d2702f19 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:32.524751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb9dda-b4bf-4000-b138-4426d2702f19 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:32.637836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:32.639132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:32.639423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:32.640259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/d8dbea99b6734756bde1fcd19d395653` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:32.641544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:update_user(user_id=d8dbea99b6734756bde1fcd19d395653)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:32.643116 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:26:32.643116 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:26:32.643116 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:26:32.644325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:32.698401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.710534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invalidating the token cache because user d8dbea99b6734756bde1fcd19d395653 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:32.711501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.714239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.719206 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2705/5435] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 11 01:26:32 2022] PATCH /identity/v3/users/d8dbea99b6734756bde1fcd19d395653 => generated 296 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:32.723605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c916-21d0-458b-b4d8-c7d34b9b975f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:32.724119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c916-21d0-458b-b4d8-c7d34b9b975f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:32.725201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c916-21d0-458b-b4d8-c7d34b9b975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:32.792744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0243c916-21d0-458b-b4d8-c7d34b9b975f None None] MFA Rules not processed for user `d8dbea99b6734756bde1fcd19d395653`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:32.794001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0243c916-21d0-458b-b4d8-c7d34b9b975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:32.798680 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2731/5436] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:32 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 01:26:32.802776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:32.804329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:32.823200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa91db-26d8-4bd9-b029-7b7240914d19 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:32.832248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:32.833244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:32.834187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:32.834646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/d8dbea99b6734756bde1fcd19d395653` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:32.842627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:update_user(user_id=d8dbea99b6734756bde1fcd19d395653)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:32.846050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:32.963492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.997739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invalidating the token cache because user d8dbea99b6734756bde1fcd19d395653 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:32.998579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:32.999774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-595af5c7-52a8-426b-ae54-025a59fba870 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.005712 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2706/5437] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 11 01:26:32 2022] PATCH /identity/v3/users/d8dbea99b6734756bde1fcd19d395653 => generated 296 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:33.007298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c916-21d0-458b-b4d8-c7d34b9b975f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:33.027701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c916-21d0-458b-b4d8-c7d34b9b975f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:33.046410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:33.046410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:33.046410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:33.047155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/d8dbea99b6734756bde1fcd19d395653` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:33.076152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:update_user(user_id=d8dbea99b6734756bde1fcd19d395653)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:33.078577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:33.132093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.148482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invalidating the token cache because user d8dbea99b6734756bde1fcd19d395653 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:33.149570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.150910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.157264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2732/5438] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 11 01:26:33 2022] PATCH /identity/v3/users/d8dbea99b6734756bde1fcd19d395653 => generated 296 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:33.158945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd75a-24e7-4bdf-b373-e4e1aef0eb34 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:33.159440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd75a-24e7-4bdf-b373-e4e1aef0eb34 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:33.159541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd75a-24e7-4bdf-b373-e4e1aef0eb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:33.235181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-833cd75a-24e7-4bdf-b373-e4e1aef0eb34 None None] MFA Rules not processed for user `d8dbea99b6734756bde1fcd19d395653`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:33.236501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-833cd75a-24e7-4bdf-b373-e4e1aef0eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:33.246004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2707/5439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:33 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:26:33.250503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:33.255904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:33.285762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e321b-04ab-45cc-9adb-7cd566735791 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:33.300251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:33.301666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:33.302147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:33.302656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/d8dbea99b6734756bde1fcd19d395653` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:33.311216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:update_user(user_id=d8dbea99b6734756bde1fcd19d395653)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:33.314478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:33.367728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.382821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invalidating the token cache because user d8dbea99b6734756bde1fcd19d395653 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:33.383522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.385475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.388343 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2733/5440] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 11 01:26:33 2022] PATCH /identity/v3/users/d8dbea99b6734756bde1fcd19d395653 => generated 296 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:26:33.393524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cd75a-24e7-4bdf-b373-e4e1aef0eb34 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:33.415038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cd75a-24e7-4bdf-b373-e4e1aef0eb34 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:33.432723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c975d-24f1-474a-9f4a-24b5ab54ae73 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:33.433469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c975d-24f1-474a-9f4a-24b5ab54ae73 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:33.433751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c975d-24f1-474a-9f4a-24b5ab54ae73 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:33.434024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c975d-24f1-474a-9f4a-24b5ab54ae73 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:33.434655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c975d-24f1-474a-9f4a-24b5ab54ae73 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:33.436561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c975d-24f1-474a-9f4a-24b5ab54ae73 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:33.454086 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=3,keystone:UPDATE=2,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:33.478254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2708/5441] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:26:33 2022] POST /identity/v3/users => generated 265 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:33.479190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:33.480613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:33.547487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6f355-aa03-4842-8812-7ce9d6f1124b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:33.552796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ea53-550c-4867-afaa-24cb6d63e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:33.553521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ea53-550c-4867-afaa-24cb6d63e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:33.553809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ea53-550c-4867-afaa-24cb6d63e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:33.554088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ea53-550c-4867-afaa-24cb6d63e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/226adb130d2b42febbb9ec7f7b92a432/password` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:33.635194 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=82,keystone:DELETE=11,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:33.677624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9ec1ea53-550c-4867-afaa-24cb6d63e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '226adb130d2b42febbb9ec7f7b92a432'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:33.694627 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2734/5442] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:26:33 2022] POST /identity/v3/users/226adb130d2b42febbb9ec7f7b92a432/password => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:34.700823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21546ba-7536-4529-ba87-77f268f18685 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:34.701588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21546ba-7536-4529-ba87-77f268f18685 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:34.701588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21546ba-7536-4529-ba87-77f268f18685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:34.724630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b21546ba-7536-4529-ba87-77f268f18685 None None] MFA Rules not processed for user `226adb130d2b42febbb9ec7f7b92a432`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:34.726713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b21546ba-7536-4529-ba87-77f268f18685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:34.734418 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2709/5443] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:34 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:26:34.735237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ea53-550c-4867-afaa-24cb6d63e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:34.756039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ea53-550c-4867-afaa-24cb6d63e2f0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:34.772493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:34.773158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:34.773446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:34.773752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:34.792163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:34.795179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:34.825441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21546ba-7536-4529-ba87-77f268f18685 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:34.829369 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2735/5444] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 11 01:26:34 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 01:26:34.866717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21546ba-7536-4529-ba87-77f268f18685 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:34.877646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:34.878671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:34.879231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:34.879813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/226adb130d2b42febbb9ec7f7b92a432` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:34.881789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_user(user_id=226adb130d2b42febbb9ec7f7b92a432)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:34.888527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:34.976980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226adb130d2b42febbb9ec7f7b92a432'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:34.978915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226adb130d2b42febbb9ec7f7b92a432'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:34.980271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226adb130d2b42febbb9ec7f7b92a432'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:34.990011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226adb130d2b42febbb9ec7f7b92a432'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:35.008542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226adb130d2b42febbb9ec7f7b92a432'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:35.037567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2710/5445] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:34 2022] DELETE /identity/v3/users/226adb130d2b42febbb9ec7f7b92a432 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:35.042619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:35.054145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55244bdc-f81d-46c8-9691-de32a33ca64b tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:35.162107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:35.162934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:35.163340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:35.163626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:35.164273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:35.166416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:35.208227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:35.210297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:35.216094 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2736/5446] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:35 2022] POST /identity/v3/users => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:35.227900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2831-101d-4204-a545-0b2039b98b5d tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:35.234227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:35.234857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:35.235137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:35.235414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:35.236497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:35.239732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:35.303966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:35.313686 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2711/5447] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:35 2022] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:35.325432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e078c-0978-4549-81ea-156b2da065e0 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:35.477468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:35.478130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:35.478982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:35.479269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/be36f007a8e949838d53c3a7c68467b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:35.513703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:update_user(user_id=be36f007a8e949838d53c3a7c68467b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:35.520815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:35.584979 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2737/5448] 10.222.0.16 () {60 vars in 1244 bytes} [Sun Sep 11 01:26:35 2022] PATCH /identity/v3/users/be36f007a8e949838d53c3a7c68467b1 => generated 522 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:35.589093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:35.610408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6412-b97f-4821-ac0d-30429b51f17a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:35.628634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:35.629332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:35.629618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:35.629892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/be36f007a8e949838d53c3a7c68467b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:35.662758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:get_user(user_id=be36f007a8e949838d53c3a7c68467b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:35.665033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:35.667974 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2712/5449] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:26:35 2022] GET /identity/v3/users/be36f007a8e949838d53c3a7c68467b1 => generated 389 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:35.671948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:35.690771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b817976-dc92-46c3-960f-24bb13cc896a tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:35.699639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:35.700065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:35.700349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:35.700625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/projects/858badad93cf436faddf5fefbb2006ef` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:35.702466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=858badad93cf436faddf5fefbb2006ef)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:35.704471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:35.781694 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:35.824794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858badad93cf436faddf5fefbb2006ef', 'request_id': 'req-f536c773-a72b-4297-88f6-3758cc4b53fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:35.841336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858badad93cf436faddf5fefbb2006ef', 'request_id': 'req-f536c773-a72b-4297-88f6-3758cc4b53fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:35.868374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858badad93cf436faddf5fefbb2006ef', 'request_id': 'req-f536c773-a72b-4297-88f6-3758cc4b53fd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:35.899119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] The token cache is being invalidate because project 858badad93cf436faddf5fefbb2006ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:35.899493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:35.901198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:35.904458 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2738/5450] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:35 2022] DELETE /identity/v3/projects/858badad93cf436faddf5fefbb2006ef => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:35.908335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:35.910507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:35.935788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41633b-9ad0-467a-84ef-9a4ce627d7cd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:36.085842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1782361f294012bf4b50c467aad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7be349f18ea411d87b90757a45d9fe0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:36.090052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:36.090542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:36.090982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] PATH_INFO: `/v3/users/be36f007a8e949838d53c3a7c68467b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:36.096100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorizing `identity:delete_user(user_id=be36f007a8e949838d53c3a7c68467b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:36.101830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:36.223443 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=3,keystone:SELECT=83,keystone:DELETE=14 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:36.272451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be36f007a8e949838d53c3a7c68467b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.273371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be36f007a8e949838d53c3a7c68467b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.274117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be36f007a8e949838d53c3a7c68467b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.287232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be36f007a8e949838d53c3a7c68467b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.320702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0c0b8f82-76f0-4d23-b5b6-c37e0cf8dab2 tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be36f007a8e949838d53c3a7c68467b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.349780 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2713/5451] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:35 2022] DELETE /identity/v3/users/be36f007a8e949838d53c3a7c68467b1 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:36.355135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:36.356768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:36.492394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536c773-a72b-4297-88f6-3758cc4b53fd tempest-UsersV3TestJSON-1585114852 tempest-UsersV3TestJSON-1585114852-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:36.616921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:36.617626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:36.617913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:36.618181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] PATH_INFO: `/v3/users/d8dbea99b6734756bde1fcd19d395653` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:36.662453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dbea99b6734756bde1fcd19d395653)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:36.664410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:36.818816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.821740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.822990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.831199 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:36.849546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.867228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dbea99b6734756bde1fcd19d395653'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:36.895658 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2739/5452] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:36 2022] DELETE /identity/v3/users/d8dbea99b6734756bde1fcd19d395653 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:36.900034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:36.900677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:36.901023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:36.954347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:36.955571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:37.067483 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2714/5453] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:37.076895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:37.078465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:37.158050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6da05-1d72-40af-9bcc-ac36605f7677 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:37.177712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:37.178743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:37.179143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:37.179733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:37.208337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:37.211132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:37.227187 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2740/5454] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:37.712046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:37.714124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:37.738502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbb1d0-3d39-4fd6-b28b-4b54222e7e92 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:37.746761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:37.747356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:37.747718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:37.747909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] PATH_INFO: `/v3/projects/5508fdf3c7474e33952496ca77cb4457` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:37.750058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5508fdf3c7474e33952496ca77cb4457)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:37.752413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:37.832548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5508fdf3c7474e33952496ca77cb4457', 'request_id': 'req-b92c1d45-af19-4803-8b23-6c56db3e1f5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:37.841920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5508fdf3c7474e33952496ca77cb4457', 'request_id': 'req-b92c1d45-af19-4803-8b23-6c56db3e1f5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:37.855462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5508fdf3c7474e33952496ca77cb4457', 'request_id': 'req-b92c1d45-af19-4803-8b23-6c56db3e1f5f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:37.896044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] The token cache is being invalidate because project 5508fdf3c7474e33952496ca77cb4457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:37.896362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:37.897267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:37.906230 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2715/5455] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:37 2022] DELETE /identity/v3/projects/5508fdf3c7474e33952496ca77cb4457 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:37.907817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:37.927469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5570-4e28-422c-874b-d41cdf55145b service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:38.046355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:38.047113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:38.047479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:38.047841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] PATH_INFO: `/v3/users/ca1782361f294012bf4b50c467aad9f0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:38.049871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1782361f294012bf4b50c467aad9f0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:38.064119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:38.203171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1782361f294012bf4b50c467aad9f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:38.204045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1782361f294012bf4b50c467aad9f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:38.204814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1782361f294012bf4b50c467aad9f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:38.218699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1782361f294012bf4b50c467aad9f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:38.226576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4719a2e-a5a6-483e-8346-4610f59152bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1782361f294012bf4b50c467aad9f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:38.236485 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:38.263022 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2741/5456] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:37 2022] DELETE /identity/v3/users/ca1782361f294012bf4b50c467aad9f0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:38.901929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:38.906185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:38.945275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c1d45-af19-4803-8b23-6c56db3e1f5f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:39.002895 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:39.061526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:39.063308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.063907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.065513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] PATH_INFO: `/v3/projects/a7be349f18ea411d87b90757a45d9fe0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.068010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7be349f18ea411d87b90757a45d9fe0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:39.072944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:39.161108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7be349f18ea411d87b90757a45d9fe0', 'request_id': 'req-cfa26e68-3e43-42c5-9516-2c56d1d748a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:39.168776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7be349f18ea411d87b90757a45d9fe0', 'request_id': 'req-cfa26e68-3e43-42c5-9516-2c56d1d748a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:39.178986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7be349f18ea411d87b90757a45d9fe0', 'request_id': 'req-cfa26e68-3e43-42c5-9516-2c56d1d748a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:39.192543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] The token cache is being invalidate because project a7be349f18ea411d87b90757a45d9fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:39.193139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:39.193963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cfa26e68-3e43-42c5-9516-2c56d1d748a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:39.200770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2716/5457] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:38 2022] DELETE /identity/v3/projects/a7be349f18ea411d87b90757a45d9fe0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:39.201653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77690c8-e302-44cf-bd45-a76c51d1f18f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.202101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77690c8-e302-44cf-bd45-a76c51d1f18f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.202264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77690c8-e302-44cf-bd45-a76c51d1f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.244530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b77690c8-e302-44cf-bd45-a76c51d1f18f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:39.247068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b77690c8-e302-44cf-bd45-a76c51d1f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:39.357959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec436fd-966e-46c7-a505-980b2b167415 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.358313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec436fd-966e-46c7-a505-980b2b167415 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.358525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec436fd-966e-46c7-a505-980b2b167415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.374805 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2742/5458] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:39.405740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2ec436fd-966e-46c7-a505-980b2b167415 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:39.409041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2ec436fd-966e-46c7-a505-980b2b167415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:39.425724 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2717/5459] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:39.425985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77690c8-e302-44cf-bd45-a76c51d1f18f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:39.443261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77690c8-e302-44cf-bd45-a76c51d1f18f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:39.456201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:39.457075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.457549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.457894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.458857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:39.460750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:39.463964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:39.483004 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2743/5460] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:26:39.487675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec436fd-966e-46c7-a505-980b2b167415 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:39.501522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec436fd-966e-46c7-a505-980b2b167415 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:39.524436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:39.525781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.526171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.526820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.528018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:39.530170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:39.605541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2718/5461] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:39 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:39.609774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:39.633511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ada8c-733d-4e39-87fd-390d3fec1001 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:39.815877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:39.816657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.816945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.817250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.817895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:39.820045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:39.850591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2744/5462] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:39 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:39.857663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:39.868353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf88a5-3612-4b82-a00a-1cae2d193c90 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:39.873488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:39.874092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.874371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.874638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.875277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:39.877085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:39.901200 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2719/5463] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:39.905655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:39.919950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4662-4af8-4b7c-bdf4-228865477ff4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:39.928860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927cdb3-ef06-44a3-9026-f7507100303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:39.929675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927cdb3-ef06-44a3-9026-f7507100303f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:39.930090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927cdb3-ef06-44a3-9026-f7507100303f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:39.930472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927cdb3-ef06-44a3-9026-f7507100303f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:39.931229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927cdb3-ef06-44a3-9026-f7507100303f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:39.934333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927cdb3-ef06-44a3-9026-f7507100303f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:39.989179 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2745/5464] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:26:39.993045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:40.005001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7d71-6bf0-42e1-95d9-d37759a1149a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:40.011872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:40.013033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:40.013582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:40.014812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] PATH_INFO: `/v3/projects/5594d8e500f34868b9f55695409857f1/users/55dc03677b204ddf87d632bd6577f28c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:40.035818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5594d8e500f34868b9f55695409857f1, user_id=55dc03677b204ddf87d632bd6577f28c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:40.038813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:40.069110 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2720/5465] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:39 2022] PUT /identity/v3/projects/5594d8e500f34868b9f55695409857f1/users/55dc03677b204ddf87d632bd6577f28c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:40.082342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593a6e-e6e1-4749-8556-2d1f63f8cc43 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:40.084315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593a6e-e6e1-4749-8556-2d1f63f8cc43 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:40.084702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593a6e-e6e1-4749-8556-2d1f63f8cc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:40.127369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-84593a6e-e6e1-4749-8556-2d1f63f8cc43 None None] MFA Rules not processed for user `55dc03677b204ddf87d632bd6577f28c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:40.128790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84593a6e-e6e1-4749-8556-2d1f63f8cc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:40.232778 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:40.265279 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2746/5466] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:40.271606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:40.299088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401ffdf-3c9b-4016-ba55-4cece081629d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:40.307083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51103772-2873-4196-bb26-742c93fb10a5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:40.308898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51103772-2873-4196-bb26-742c93fb10a5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:40.309460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51103772-2873-4196-bb26-742c93fb10a5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:40.309937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51103772-2873-4196-bb26-742c93fb10a5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:40.311721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51103772-2873-4196-bb26-742c93fb10a5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:create_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:40.314067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51103772-2873-4196-bb26-742c93fb10a5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:40.386803 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:40.449698 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2721/5467] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 11 01:26:40 2022] POST /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 789 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:40.452904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593a6e-e6e1-4749-8556-2d1f63f8cc43 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:40.469666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593a6e-e6e1-4749-8556-2d1f63f8cc43 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:40.477756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:40.479086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:40.479786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:40.480192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/8fec9e52c185498b93bcb71d63a97e27` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:40.498113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:get_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=8fec9e52c185498b93bcb71d63a97e27)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:40.499963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:40.504797 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2747/5468] 10.222.0.16 () {58 vars in 1392 bytes} [Sun Sep 11 01:26:40 2022] GET /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/8fec9e52c185498b93bcb71d63a97e27 => generated 689 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:40.506692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e117da-30e7-4fdf-8792-c92814575b14 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:40.507261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e117da-30e7-4fdf-8792-c92814575b14 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:40.508198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e117da-30e7-4fdf-8792-c92814575b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:40.545034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-29e117da-30e7-4fdf-8792-c92814575b14 None None] MFA Rules not processed for user `55dc03677b204ddf87d632bd6577f28c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:40.547722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-29e117da-30e7-4fdf-8792-c92814575b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:40.837601 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2722/5469] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 11 01:26:40.842886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:40.875532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac126-f5d1-45b5-9f59-c18d7471837f tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:40.899181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:40.901027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:40.901641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:40.902415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/8fec9e52c185498b93bcb71d63a97e27` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:40.906010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=8fec9e52c185498b93bcb71d63a97e27)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:40.908225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:41.007349 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2748/5470] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:26:40 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/8fec9e52c185498b93bcb71d63a97e27 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:41.009325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e117da-30e7-4fdf-8792-c92814575b14 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:41.021965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e117da-30e7-4fdf-8792-c92814575b14 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:41.030303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:41.032581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:41.033194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:41.034081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:41.035232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:create_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:41.037613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:41.199469 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2723/5471] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 11 01:26:41 2022] POST /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 921 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:41.204264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:41.223546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef375f-f025-4635-912b-437dedfd7fe3 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:41.228004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:41.228794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:41.229093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:41.229385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/5db61760e22c4aababbc2fd20bde2123` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:41.287881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=5db61760e22c4aababbc2fd20bde2123)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:41.300338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:41.376813 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2749/5472] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:26:41 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/5db61760e22c4aababbc2fd20bde2123 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:41.382231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:41.404171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6310cab-8b0a-4404-a59c-7ca1bf68adc5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:41.417291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:41.417965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:41.418253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:41.418601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:41.419281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:create_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:41.421542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:41.486799 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:41.618796 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2724/5473] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 11 01:26:41 2022] POST /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 812 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:41.623687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:41.639626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672969-3616-4d67-bbf6-2af5ee50b40d tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:41.649951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:41.651267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:41.651551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:41.651849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/5ea0225bebea4c5c90bee61a178dfe35` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:41.680014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=5ea0225bebea4c5c90bee61a178dfe35)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:41.682873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:41.741511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2750/5474] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:26:41 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/5ea0225bebea4c5c90bee61a178dfe35 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:41.746449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:41.758793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02e3d0-17b1-4216-9a72-f5a1fd970dc9 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:41.774680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:41.776387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:41.777678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:41.781722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:41.782745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:create_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:41.786291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:41.937001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:41.937207 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2725/5475] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 11 01:26:41 2022] POST /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 788 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:41.951950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c3ee2-6aba-4b20-bcc6-e82da81600df tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:41.972308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:41.975728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:41.976138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:41.976420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:41.977189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:create_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:41.978666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.122615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.132805 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2751/5476] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 11 01:26:41 2022] POST /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 789 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:42.137323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d8c60-1e90-411c-9495-86e8988592e5 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.142996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.143983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.144424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.144857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:42.145911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:list_application_credentials(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:42.147961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.162897 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2726/5477] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 11 01:26:42 2022] GET /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 1501 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:42.168212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.178556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58d45-70cd-4d07-ad94-4c15a8fda404 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.184986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.185464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.185911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.186365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/745f1e9284ef4402879bfd0c2e3de389` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:42.197228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=745f1e9284ef4402879bfd0c2e3de389)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:42.199131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.245030 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2752/5478] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:26:42 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/745f1e9284ef4402879bfd0c2e3de389 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:42.246619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.262072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94774-d20c-45ef-bb23-bce2e08e3996 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.274524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.275552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.275879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.276196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/8bdb7e3a37b844b79148f56c3c954b90` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:42.300286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=8bdb7e3a37b844b79148f56c3c954b90)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:42.302079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.352885 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2727/5479] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:26:42 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/8bdb7e3a37b844b79148f56c3c954b90 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:42.360608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.371402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5004-53b5-43e1-936c-a828a6a6d655 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.395470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.398833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.399127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.399415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:42.407207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:create_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:42.410289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.426196 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:42.581989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2753/5480] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 11 01:26:42 2022] POST /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 788 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:42.586505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.601844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d87ad-65da-49f7-84aa-7d90579df290 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.614643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.617548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.618234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.618234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:42.621541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:create_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:42.623878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.769310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2728/5481] 10.222.0.16 () {60 vars in 1314 bytes} [Sun Sep 11 01:26:42 2022] POST /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials => generated 788 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:42.773398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.788789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbd41f-3aca-4d51-8cda-4752db152e1e tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.795817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.796711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.797004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.797430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:42.798628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Adding query filter params (name=tempest-application_credential-815183007) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:42.799172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:list_application_credentials(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:42.802486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.815395 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2754/5482] 10.222.0.16 () {58 vars in 1384 bytes} [Sun Sep 11 01:26:42 2022] GET /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials?name=tempest-application_credential-815183007 => generated 885 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:42.819683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.852634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a4d25-33eb-48ee-8b5c-36bdfd06e542 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.861025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.861941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.862405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.862849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/e5925e2ad8e74476905736ab1b0e8f9f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:42.866590 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:42.886463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=e5925e2ad8e74476905736ab1b0e8f9f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:42.888278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:42.931758 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2729/5483] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:26:42 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/e5925e2ad8e74476905736ab1b0e8f9f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:42.936456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:42.964028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c190b-436d-4161-a978-25637098f2bf tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:42.987269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23670322-381f-4d31-99a8-eed082f40eea tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55dc03677b204ddf87d632bd6577f28c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594d8e500f34868b9f55695409857f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:42.987947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670322-381f-4d31-99a8-eed082f40eea tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:42.988323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670322-381f-4d31-99a8-eed082f40eea tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:42.988501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670322-381f-4d31-99a8-eed082f40eea tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/d4b654bfdf534dc285353624f9026d2c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:43.004786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23670322-381f-4d31-99a8-eed082f40eea tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorizing `identity:delete_application_credential(user_id=55dc03677b204ddf87d632bd6577f28c, application_credential_id=d4b654bfdf534dc285353624f9026d2c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:43.006793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23670322-381f-4d31-99a8-eed082f40eea tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:43.052869 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2755/5484] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:26:42 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c/application_credentials/d4b654bfdf534dc285353624f9026d2c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:43.057614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:43.196262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8947a4-655c-4e3a-9350-a3fa03bdd120 tempest-ApplicationCredentialsV3Test-1898962235 tempest-ApplicationCredentialsV3Test-1898962235-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:43.212268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:43.213554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:43.213835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:43.214110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] PATH_INFO: `/v3/users/55dc03677b204ddf87d632bd6577f28c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:43.224108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55dc03677b204ddf87d632bd6577f28c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:43.224108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:43.352560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55dc03677b204ddf87d632bd6577f28c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:43.353710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55dc03677b204ddf87d632bd6577f28c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:43.354575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55dc03677b204ddf87d632bd6577f28c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:43.366558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55dc03677b204ddf87d632bd6577f28c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:43.413806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55dc03677b204ddf87d632bd6577f28c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:43.458871 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2730/5485] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:43 2022] DELETE /identity/v3/users/55dc03677b204ddf87d632bd6577f28c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:43.464180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:43.464644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:43.464731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:43.492237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:43.495227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:43.675377 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2756/5486] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:43.709287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:43.710778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:43.892507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073ba66-147b-4caa-80f6-0814ea6e0a9b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:43.905720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18f3aa-1f7c-4c27-a4ec-a4a482219f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:43.906459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18f3aa-1f7c-4c27-a4ec-a4a482219f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:43.906835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18f3aa-1f7c-4c27-a4ec-a4a482219f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:43.908403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18f3aa-1f7c-4c27-a4ec-a4a482219f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:43.928062 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:43.936616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18f3aa-1f7c-4c27-a4ec-a4a482219f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:43.941121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18f3aa-1f7c-4c27-a4ec-a4a482219f67 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:43.969449 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2731/5487] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:45.278080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:45.281961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:45.317802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c273d-99f7-4f7b-8638-541fec498f43 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:45.338213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:45.338876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:45.339154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:45.339422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] PATH_INFO: `/v3/projects/5594d8e500f34868b9f55695409857f1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:45.344753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5594d8e500f34868b9f55695409857f1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:45.348224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:45.448776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5594d8e500f34868b9f55695409857f1', 'request_id': 'req-1bec0044-a713-4127-82b1-1dd4240b636a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:45.477440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5594d8e500f34868b9f55695409857f1', 'request_id': 'req-1bec0044-a713-4127-82b1-1dd4240b636a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:45.479318 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:45.506661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5594d8e500f34868b9f55695409857f1', 'request_id': 'req-1bec0044-a713-4127-82b1-1dd4240b636a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:45.574658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] The token cache is being invalidate because project 5594d8e500f34868b9f55695409857f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:45.578948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:45.580166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1bec0044-a713-4127-82b1-1dd4240b636a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:45.583117 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2757/5488] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:45 2022] DELETE /identity/v3/projects/5594d8e500f34868b9f55695409857f1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:45.589446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e6e94-da3c-4493-a671-6953de62d1b3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:45.589991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e6e94-da3c-4493-a671-6953de62d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:45.589991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e6e94-da3c-4493-a671-6953de62d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:45.661111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-819e6e94-da3c-4493-a671-6953de62d1b3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:45.662356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-819e6e94-da3c-4493-a671-6953de62d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:45.831525 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2732/5489] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:45.844638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229878-2fc0-420a-89b9-9b826745f982 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:45.844844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229878-2fc0-420a-89b9-9b826745f982 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:45.845121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229878-2fc0-420a-89b9-9b826745f982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:45.898610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f6229878-2fc0-420a-89b9-9b826745f982 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:45.901204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f6229878-2fc0-420a-89b9-9b826745f982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:45.923975 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2758/5490] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:45.927865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e6e94-da3c-4493-a671-6953de62d1b3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:45.948402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e6e94-da3c-4493-a671-6953de62d1b3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:45.960023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:45.960669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:45.960961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:45.961249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:45.961930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:45.962215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:45.965529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:46.014871 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2733/5491] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:46.019018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6229878-2fc0-420a-89b9-9b826745f982 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:46.042722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6229878-2fc0-420a-89b9-9b826745f982 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:46.066394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:46.067301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:46.067691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:46.068118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:46.068924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:46.076551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:46.201278 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2759/5492] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:46 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:46.202674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:46.216494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d1689-0940-4611-8baa-f57cb74038a0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:46.364453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:46.365634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:46.366466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:46.366466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:46.367380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:46.371596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:46.443374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:46.444378 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2734/5493] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:46 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:46.468003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd37b0-7e56-42c0-9d40-b483f1c1fc12 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:46.482805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:46.483615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:46.484175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:46.484827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:46.485711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:46.487424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:46.531701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:46.548523 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2760/5494] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:46.562590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a77aac-7f30-4c48-a353-2efd3207e14a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:46.585681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dad47-6b09-4270-8314-bb397454a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:46.585681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dad47-6b09-4270-8314-bb397454a848 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:46.585681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dad47-6b09-4270-8314-bb397454a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:46.585681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dad47-6b09-4270-8314-bb397454a848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:46.590064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dad47-6b09-4270-8314-bb397454a848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:46.596624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dad47-6b09-4270-8314-bb397454a848 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:46.625279 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2735/5495] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:46.628983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:46.647105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791322e-87c2-440d-9860-f7474c69bd39 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:46.676685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:46.685692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:46.691797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:46.692111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] PATH_INFO: `/v3/projects/f998ba25d6d347e3a981024a3b7d8d5d/users/c5dd8c28c1ef4f5798ecb25d9341adfc/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:46.757823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f998ba25d6d347e3a981024a3b7d8d5d, user_id=c5dd8c28c1ef4f5798ecb25d9341adfc, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:46.766623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:46.826848 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2761/5496] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:46 2022] PUT /identity/v3/projects/f998ba25d6d347e3a981024a3b7d8d5d/users/c5dd8c28c1ef4f5798ecb25d9341adfc/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:46.827525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbad44-8995-4829-95f7-041a51e56293 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:46.827812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbad44-8995-4829-95f7-041a51e56293 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:46.828082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbad44-8995-4829-95f7-041a51e56293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:46.889541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-57cbad44-8995-4829-95f7-041a51e56293 None None] MFA Rules not processed for user `c5dd8c28c1ef4f5798ecb25d9341adfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:46.891297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-57cbad44-8995-4829-95f7-041a51e56293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:47.007874 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:47.049485 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2736/5497] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:47.054873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:47.086262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849183a6-b420-4614-81fa-b062cf9b1676 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:47.099012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2c7d6-3fa4-4d30-b640-414652a5271f tempest-IdentityCatalogTest-1515389646 tempest-IdentityCatalogTest-1515389646-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5dd8c28c1ef4f5798ecb25d9341adfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f998ba25d6d347e3a981024a3b7d8d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:47.099961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2c7d6-3fa4-4d30-b640-414652a5271f tempest-IdentityCatalogTest-1515389646 tempest-IdentityCatalogTest-1515389646-project] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:47.100804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2c7d6-3fa4-4d30-b640-414652a5271f tempest-IdentityCatalogTest-1515389646 tempest-IdentityCatalogTest-1515389646-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:47.101257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2c7d6-3fa4-4d30-b640-414652a5271f tempest-IdentityCatalogTest-1515389646 tempest-IdentityCatalogTest-1515389646-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:47.101988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2c7d6-3fa4-4d30-b640-414652a5271f tempest-IdentityCatalogTest-1515389646 tempest-IdentityCatalogTest-1515389646-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:47.105408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2c7d6-3fa4-4d30-b640-414652a5271f tempest-IdentityCatalogTest-1515389646 tempest-IdentityCatalogTest-1515389646-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:47.114384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbad44-8995-4829-95f7-041a51e56293 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:47.119403 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2762/5498] 10.222.0.16 () {58 vars in 1143 bytes} [Sun Sep 11 01:26:47 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:47.284349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbad44-8995-4829-95f7-041a51e56293 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:47.315022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:47.315683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:47.316001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:47.316274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] PATH_INFO: `/v3/users/c5dd8c28c1ef4f5798ecb25d9341adfc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:47.322671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5dd8c28c1ef4f5798ecb25d9341adfc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:47.324937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:47.441315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5dd8c28c1ef4f5798ecb25d9341adfc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:47.442027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5dd8c28c1ef4f5798ecb25d9341adfc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:47.442654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5dd8c28c1ef4f5798ecb25d9341adfc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:47.460292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5dd8c28c1ef4f5798ecb25d9341adfc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:47.482927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5dd8c28c1ef4f5798ecb25d9341adfc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:47.507828 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2737/5499] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:47 2022] DELETE /identity/v3/users/c5dd8c28c1ef4f5798ecb25d9341adfc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:47.513654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:47.515141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:47.515691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:47.574131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:47.583604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:47.758117 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2763/5500] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:47.851688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:47.853773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:48.041361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767e50-fa9b-4903-af4f-74a17e6a34c5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:48.058081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c7cab-cbe3-44d2-832b-9e5f6bfee8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:48.058767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c7cab-cbe3-44d2-832b-9e5f6bfee8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:48.059129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c7cab-cbe3-44d2-832b-9e5f6bfee8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:48.059383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c7cab-cbe3-44d2-832b-9e5f6bfee8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:48.098010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c7cab-cbe3-44d2-832b-9e5f6bfee8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:48.102215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c7cab-cbe3-44d2-832b-9e5f6bfee8a5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:48.136322 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2738/5501] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:49.547699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:49.549032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:49.579156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee821b3-b0c6-4f7e-b06b-8010d6fcae3e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:49.614945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:49.615598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:49.615950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:49.616125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] PATH_INFO: `/v3/projects/f998ba25d6d347e3a981024a3b7d8d5d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:49.625493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f998ba25d6d347e3a981024a3b7d8d5d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:49.628074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:49.803676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f998ba25d6d347e3a981024a3b7d8d5d', 'request_id': 'req-517ab31e-6c1f-460e-a586-a58658cae6ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:49.831770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f998ba25d6d347e3a981024a3b7d8d5d', 'request_id': 'req-517ab31e-6c1f-460e-a586-a58658cae6ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:49.857398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f998ba25d6d347e3a981024a3b7d8d5d', 'request_id': 'req-517ab31e-6c1f-460e-a586-a58658cae6ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:49.894471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] The token cache is being invalidate because project f998ba25d6d347e3a981024a3b7d8d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:49.894779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:49.896472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-517ab31e-6c1f-460e-a586-a58658cae6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:49.899295 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2764/5502] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:49 2022] DELETE /identity/v3/projects/f998ba25d6d347e3a981024a3b7d8d5d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:49.906695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76aa24-2366-482c-9727-0178dba67f09 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:49.907255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76aa24-2366-482c-9727-0178dba67f09 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:49.907255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76aa24-2366-482c-9727-0178dba67f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:49.961313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fa76aa24-2366-482c-9727-0178dba67f09 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:49.963405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa76aa24-2366-482c-9727-0178dba67f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:49.979788 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:50.142760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2739/5503] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:50.152378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63b84-7704-4414-8cbc-db8ac500b011 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.152653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63b84-7704-4414-8cbc-db8ac500b011 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.152987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63b84-7704-4414-8cbc-db8ac500b011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.174774 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:50.203888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3eb63b84-7704-4414-8cbc-db8ac500b011 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:50.207139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3eb63b84-7704-4414-8cbc-db8ac500b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:50.245835 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2765/5504] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:50.250161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76aa24-2366-482c-9727-0178dba67f09 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:50.261030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76aa24-2366-482c-9727-0178dba67f09 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:50.281810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:50.282363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.282637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.282892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.283726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:50.284200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:50.285969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:50.308730 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2740/5505] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:50.323760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb63b84-7704-4414-8cbc-db8ac500b011 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:50.341959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb63b84-7704-4414-8cbc-db8ac500b011 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:50.347914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:50.348737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.349218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.349685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.350477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:50.352815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:50.398388 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2766/5506] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:50 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:50.402649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:50.418707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe1bdf-a790-462a-bab3-f82e18793c71 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:50.568055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:50.568901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.569046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.569332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.569854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:50.572272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:50.611373 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2741/5507] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:50 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:50.615237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:50.632983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f14e-7509-4f8d-a0e6-fa26c1aa9e4e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:50.648331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:50.649216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.649672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.650842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.651970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:50.655600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:50.671480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2767/5508] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:50.672565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:50.688075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e78da-fad6-4016-9662-e9b85b584dac admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:50.693620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9187a-ab05-4916-a1a9-21cd47e2a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:50.694234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9187a-ab05-4916-a1a9-21cd47e2a7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.694508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9187a-ab05-4916-a1a9-21cd47e2a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.694778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9187a-ab05-4916-a1a9-21cd47e2a7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.695549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9187a-ab05-4916-a1a9-21cd47e2a7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:50.697249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9187a-ab05-4916-a1a9-21cd47e2a7dd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:50.712184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2742/5509] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:26:50.714314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:50.728723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431451b0-0ed4-49ca-83ac-a19345d33951 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:50.734139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:50.735029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.735412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.735906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] PATH_INFO: `/v3/projects/427d5e2f876f417899947cde70062016/users/bfbbdbe738a349ac8add65192f0c1cf0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.753658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] RBAC: Authorizing `identity:create_grant(project_id=427d5e2f876f417899947cde70062016, user_id=bfbbdbe738a349ac8add65192f0c1cf0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:50.756682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:50.776340 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2768/5510] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:50 2022] PUT /identity/v3/projects/427d5e2f876f417899947cde70062016/users/bfbbdbe738a349ac8add65192f0c1cf0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:50.787887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736d72-a39d-4352-99e4-04f6de26753f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:50.788158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736d72-a39d-4352-99e4-04f6de26753f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:50.788456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736d72-a39d-4352-99e4-04f6de26753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:50.858278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-dc736d72-a39d-4352-99e4-04f6de26753f None None] MFA Rules not processed for user `bfbbdbe738a349ac8add65192f0c1cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:50.859888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc736d72-a39d-4352-99e4-04f6de26753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:50.975029 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2743/5511] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:50.979672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:50.981860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:51.098810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a9de0-fb51-49c4-8031-cecbb111715d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:51.110848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d7097-7ad6-43ac-a0b2-7d726f67237f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:51.111737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7097-7ad6-43ac-a0b2-7d726f67237f service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:51.112180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7097-7ad6-43ac-a0b2-7d726f67237f service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:51.112634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7097-7ad6-43ac-a0b2-7d726f67237f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:51.140751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d7097-7ad6-43ac-a0b2-7d726f67237f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:51.142472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d7097-7ad6-43ac-a0b2-7d726f67237f service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:51.188167 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2769/5512] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:26:51.297546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736d72-a39d-4352-99e4-04f6de26753f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:51.309782 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:51.417424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736d72-a39d-4352-99e4-04f6de26753f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:51.428639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:51.429401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:51.430316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:51.430649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] PATH_INFO: `/v3/users/bfbbdbe738a349ac8add65192f0c1cf0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:51.432029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbbdbe738a349ac8add65192f0c1cf0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:51.434492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:51.491990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbbdbe738a349ac8add65192f0c1cf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:51.492792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbbdbe738a349ac8add65192f0c1cf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:51.493978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbbdbe738a349ac8add65192f0c1cf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:51.504362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbbdbe738a349ac8add65192f0c1cf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:51.561150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbbdbe738a349ac8add65192f0c1cf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:51.586195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2744/5513] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:51 2022] DELETE /identity/v3/users/bfbbdbe738a349ac8add65192f0c1cf0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:51.591468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:51.591807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:51.592011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:51.649988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:51.651224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:51.740648 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2770/5514] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:51.752421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:51.753956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:51.840610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d84dc-a7b3-4820-9059-848c283e1e22 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:51.845969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8ea0-2a04-4889-b07c-054abbd89461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:51.847675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8ea0-2a04-4889-b07c-054abbd89461 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:51.848045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8ea0-2a04-4889-b07c-054abbd89461 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:51.848527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8ea0-2a04-4889-b07c-054abbd89461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:51.862494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e8ea0-2a04-4889-b07c-054abbd89461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:51.864473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e8ea0-2a04-4889-b07c-054abbd89461 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:51.885708 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2745/5515] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:52.435996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:52.441700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:52.469923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1be15-ae58-456d-b73f-fc9434004376 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:52.475404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:52.476176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:52.476521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:52.476857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] PATH_INFO: `/v3/projects/427d5e2f876f417899947cde70062016` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:52.478439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=427d5e2f876f417899947cde70062016)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:52.480863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:52.543938 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:52.580866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427d5e2f876f417899947cde70062016', 'request_id': 'req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:52.595737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427d5e2f876f417899947cde70062016', 'request_id': 'req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:52.604387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427d5e2f876f417899947cde70062016', 'request_id': 'req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:52.633611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] The token cache is being invalidate because project 427d5e2f876f417899947cde70062016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:52.634007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:52.635332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4e3f7222-7cdb-4725-b4b4-62d8f2a40f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:52.640750 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2771/5516] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:52 2022] DELETE /identity/v3/projects/427d5e2f876f417899947cde70062016 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:52.642866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6c2c1-450b-44b4-9dc3-ef37ec193385 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:52.643319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6c2c1-450b-44b4-9dc3-ef37ec193385 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:52.643464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6c2c1-450b-44b4-9dc3-ef37ec193385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:52.683033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-18b6c2c1-450b-44b4-9dc3-ef37ec193385 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:52.684012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-18b6c2c1-450b-44b4-9dc3-ef37ec193385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:52.723118 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:52.789831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747a76-97cc-40e9-9f4b-d26e57a8d662 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:52.791110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747a76-97cc-40e9-9f4b-d26e57a8d662 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:52.791601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747a76-97cc-40e9-9f4b-d26e57a8d662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:52.796432 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2746/5517] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:52.815758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f6747a76-97cc-40e9-9f4b-d26e57a8d662 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:52.817886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f6747a76-97cc-40e9-9f4b-d26e57a8d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:52.833397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6c2c1-450b-44b4-9dc3-ef37ec193385 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:52.841574 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2772/5518] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:52.846049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6c2c1-450b-44b4-9dc3-ef37ec193385 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:52.852057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:52.853734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:52.854245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:52.854726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:52.855591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:52.856117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:52.858374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:52.881859 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2747/5519] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:26:52.883028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747a76-97cc-40e9-9f4b-d26e57a8d662 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:52.898713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747a76-97cc-40e9-9f4b-d26e57a8d662 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:52.939230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:52.939862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:52.940144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:52.940418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:52.941084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:52.942999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:53.013316 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2773/5520] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:52 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:53.017213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:53.034529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126913de-9823-44b6-b525-0f24e43e4776 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:53.179742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:53.180633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.181531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.181960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.182618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:53.184754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:53.216537 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2748/5521] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:53 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:53.217749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:53.239407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f037c-653e-4872-8c66-4c5d5fa0ce1b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:53.254761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:53.255395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.255672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.255938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.256584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:53.258227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:53.279886 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2774/5522] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:53.283295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:53.300848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16385eb-504d-4aca-9c81-76e4aba6e4a1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:53.312789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c41c86-16fd-44b8-b3eb-5673a627d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:53.313892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41c86-16fd-44b8-b3eb-5673a627d4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.314466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41c86-16fd-44b8-b3eb-5673a627d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.314981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41c86-16fd-44b8-b3eb-5673a627d4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.316058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41c86-16fd-44b8-b3eb-5673a627d4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:53.319503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41c86-16fd-44b8-b3eb-5673a627d4f5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:53.334658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2749/5523] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:53.340379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:53.354820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035ddf-89f6-45ce-80c1-996fcede0ed1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:53.363662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:53.364330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.364657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.365011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] PATH_INFO: `/v3/projects/888863fa17e448439ec1cda36084f973/users/c5696b93fa354b8d9cd5e65a92bc5678/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.385033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888863fa17e448439ec1cda36084f973, user_id=c5696b93fa354b8d9cd5e65a92bc5678, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:53.388336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:53.423186 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2775/5524] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:53 2022] PUT /identity/v3/projects/888863fa17e448439ec1cda36084f973/users/c5696b93fa354b8d9cd5e65a92bc5678/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:53.433651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.433942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.434222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.482159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] MFA Rules not processed for user `c5696b93fa354b8d9cd5e65a92bc5678`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:53.483396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:53.638853 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2750/5525] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:53.640025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:53.642086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:53.652441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:53.657334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:53.688323 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:53.729989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734118d-3b49-4671-8d71-2abbbe515110 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:53.733938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6d575-a7ee-46c2-b031-566a3873e43b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:53.734634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6d575-a7ee-46c2-b031-566a3873e43b service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.735037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6d575-a7ee-46c2-b031-566a3873e43b service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.735522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6d575-a7ee-46c2-b031-566a3873e43b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.737600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834df1f-057c-4af4-96a1-c5645dfc3229 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:53.742709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:53.743343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.744219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.744494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] PATH_INFO: `/v3/users/81738e694f1744df948daca1f37b0497` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.745801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81738e694f1744df948daca1f37b0497)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:53.746487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6d575-a7ee-46c2-b031-566a3873e43b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:53.747891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:53.748010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6d575-a7ee-46c2-b031-566a3873e43b service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:53.761828 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2751/5526] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:53.813592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81738e694f1744df948daca1f37b0497'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:53.814576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81738e694f1744df948daca1f37b0497'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:53.815365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81738e694f1744df948daca1f37b0497'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:53.831470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81738e694f1744df948daca1f37b0497'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:53.832924 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:53.842421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81738e694f1744df948daca1f37b0497'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:53.862893 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2776/5527] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:53 2022] DELETE /identity/v3/users/81738e694f1744df948daca1f37b0497 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:53.867240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:53.867590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:53.867977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:53.889938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:53.891269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:53.990820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2752/5528] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:54.002235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:54.003807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:54.166724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed9b2-dfc3-476a-b438-a376bddb1f94 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:54.175158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a46dc-5023-4e26-83a3-1d38afa11a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:54.176663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a46dc-5023-4e26-83a3-1d38afa11a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:54.180133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a46dc-5023-4e26-83a3-1d38afa11a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:54.180653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a46dc-5023-4e26-83a3-1d38afa11a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:54.203962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a46dc-5023-4e26-83a3-1d38afa11a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:54.206193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a46dc-5023-4e26-83a3-1d38afa11a1f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:54.224096 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2777/5529] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:54.356542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:54.358008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:54.389999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4101e-ff4e-4eab-b062-bc7196c51722 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:54.421435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:54.422099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:54.422379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:54.422652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] PATH_INFO: `/v3/users/c5696b93fa354b8d9cd5e65a92bc5678` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:54.436573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5696b93fa354b8d9cd5e65a92bc5678)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:54.438654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:54.636081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5696b93fa354b8d9cd5e65a92bc5678'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:54.638055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5696b93fa354b8d9cd5e65a92bc5678'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:54.638702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5696b93fa354b8d9cd5e65a92bc5678'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:54.659273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5696b93fa354b8d9cd5e65a92bc5678'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:54.684660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5696b93fa354b8d9cd5e65a92bc5678'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:54.718115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2753/5530] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:54 2022] DELETE /identity/v3/users/c5696b93fa354b8d9cd5e65a92bc5678 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:54.719385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:54.719670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:54.719950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:54.763008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:54.764151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:54.803559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:54.805193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:54.904512 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2778/5531] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:54.933982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:54.938618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:54.940994 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:54.991895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084451fd-0330-4a19-a3a2-836648ed5240 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.003289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.003957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.004238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.004513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] PATH_INFO: `/v3/projects/bc0978f728b144c7aeffc0851bac6692` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.005802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0978f728b144c7aeffc0851bac6692)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:55.007950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:55.113556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0db5b-20d3-451f-8559-7b29787248e0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.122984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0978f728b144c7aeffc0851bac6692', 'request_id': 'req-8312112a-2e10-4372-9ca2-d0a40c0954d7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:55.132571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0978f728b144c7aeffc0851bac6692', 'request_id': 'req-8312112a-2e10-4372-9ca2-d0a40c0954d7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:55.152628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0978f728b144c7aeffc0851bac6692', 'request_id': 'req-8312112a-2e10-4372-9ca2-d0a40c0954d7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:55.188989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] The token cache is being invalidate because project bc0978f728b144c7aeffc0851bac6692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:55.189480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:55.191086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8312112a-2e10-4372-9ca2-d0a40c0954d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:55.196042 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2754/5532] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:54 2022] DELETE /identity/v3/projects/bc0978f728b144c7aeffc0851bac6692 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:55.196222 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:55.197800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae04f5-fc89-48e9-a99d-63a52aedcf69 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.198253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae04f5-fc89-48e9-a99d-63a52aedcf69 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.198679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae04f5-fc89-48e9-a99d-63a52aedcf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.213922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.214809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.215296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.215740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.217792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:55.226057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f1ae04f5-fc89-48e9-a99d-63a52aedcf69 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:55.228383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1ae04f5-fc89-48e9-a99d-63a52aedcf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:55.319608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:55.320975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:55.323978 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2755/5533] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:55.331446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1def-85d8-4366-99cf-a4f6e887384d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.331967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1def-85d8-4366-99cf-a4f6e887384d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.332433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a1def-85d8-4366-99cf-a4f6e887384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.335787 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2779/5534] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:55.392799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6b7a1def-85d8-4366-99cf-a4f6e887384d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:55.396390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b7a1def-85d8-4366-99cf-a4f6e887384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:55.429932 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2756/5535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:55.432340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:55.447863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed463233-6ad5-412d-908b-09b468a78f3d service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.470514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.471146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.471431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.471691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.472338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:55.472639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:55.474247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:55.506160 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2780/5536] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:55.507305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a1def-85d8-4366-99cf-a4f6e887384d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:55.519182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a1def-85d8-4366-99cf-a4f6e887384d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.526673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.528154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.528497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.528766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.529780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:55.532155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:55.613724 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2757/5537] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:55 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:55.615031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:55.629362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ea73b-d654-4362-9437-ff696c5825dc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.742870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.745728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.745728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.746246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.747253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:55.749449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:55.794073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:55.795562 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2781/5538] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:55 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:55.808811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d0a99-c19f-4136-84e5-ff158934b84a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.823699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.824441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.824924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.827295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.828766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:55.832718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:55.864926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:55.874213 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2758/5539] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:55.883653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2717e-cbe0-4e51-aef0-6e0807c542dc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.907319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.908063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.908439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.908780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.909762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:55.919084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:55.920582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:55.923050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:55.943489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d4d0a-4636-4d1f-a29d-3fbb8c460dd7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.965235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2782/5540] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:55.965235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:55.974234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32077aa-1849-45ef-9d4f-984421ce1860 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:55.986492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:55.986492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:55.986492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:55.993901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] PATH_INFO: `/v3/projects/888863fa17e448439ec1cda36084f973` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:55.998116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] RBAC: Authorizing `identity:delete_project(project_id=888863fa17e448439ec1cda36084f973)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:56.000035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:56.008192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c3fd3-483c-49ef-a088-bba021e6b94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:56.018456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c3fd3-483c-49ef-a088-bba021e6b94d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.019076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c3fd3-483c-49ef-a088-bba021e6b94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.020043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c3fd3-483c-49ef-a088-bba021e6b94d admin admin] PATH_INFO: `/v3/projects/6d9c1079f590492ba562b579885bd667/users/252616ba03d341cdae67e247d3f4d7a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.068696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c3fd3-483c-49ef-a088-bba021e6b94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9c1079f590492ba562b579885bd667, user_id=252616ba03d341cdae67e247d3f4d7a8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:56.071838 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:56.073662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c3fd3-483c-49ef-a088-bba021e6b94d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:56.102157 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2783/5541] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:55 2022] PUT /identity/v3/projects/6d9c1079f590492ba562b579885bd667/users/252616ba03d341cdae67e247d3f4d7a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:56.113530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.113807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.114090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.115491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888863fa17e448439ec1cda36084f973', 'request_id': 'req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.125075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888863fa17e448439ec1cda36084f973', 'request_id': 'req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.137550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888863fa17e448439ec1cda36084f973', 'request_id': 'req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.162959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] The token cache is being invalidate because project 888863fa17e448439ec1cda36084f973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:56.162959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.163818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-327ecd16-24eb-4f14-b3dc-ae57e7c2228c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.167904 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2759/5542] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:55 2022] DELETE /identity/v3/projects/888863fa17e448439ec1cda36084f973 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:26:56.172888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5951d-295e-4b15-a1ff-e0e5facb6c09 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.173391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5951d-295e-4b15-a1ff-e0e5facb6c09 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.173884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5951d-295e-4b15-a1ff-e0e5facb6c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.173992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] MFA Rules not processed for user `252616ba03d341cdae67e247d3f4d7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:56.176064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.204029 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:56.231461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0ad5951d-295e-4b15-a1ff-e0e5facb6c09 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:56.231461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0ad5951d-295e-4b15-a1ff-e0e5facb6c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.381342 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2784/5543] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:56.387684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:56.396019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.488372 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2760/5544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:56.489720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ade3-d5c1-4a98-9eb2-3c2750248b0b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.490010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ade3-d5c1-4a98-9eb2-3c2750248b0b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.490306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ade3-d5c1-4a98-9eb2-3c2750248b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.539315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edb34d-563e-4fbd-bf60-56ad31923613 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:56.547992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059301a-3ff7-4638-bffb-dbd6443966e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:56.549317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059301a-3ff7-4638-bffb-dbd6443966e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.549614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059301a-3ff7-4638-bffb-dbd6443966e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.549885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059301a-3ff7-4638-bffb-dbd6443966e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.552054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0192ade3-d5c1-4a98-9eb2-3c2750248b0b None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:56.553981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0192ade3-d5c1-4a98-9eb2-3c2750248b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.561519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059301a-3ff7-4638-bffb-dbd6443966e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:56.563461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059301a-3ff7-4638-bffb-dbd6443966e6 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:56.577570 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2785/5545] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:26:56.579244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.580011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.580300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.614833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:56.616215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.629017 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2786/5546] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:56.642954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:56.647294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.668250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e444-84d4-463b-81dd-4596f7c38da8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:56.678636 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2761/5547] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:56.680081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192ade3-d5c1-4a98-9eb2-3c2750248b0b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:56.681733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:56.682388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.682669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.683001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] PATH_INFO: `/v3/users/252616ba03d341cdae67e247d3f4d7a8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.685825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252616ba03d341cdae67e247d3f4d7a8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:56.691178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:56.716663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192ade3-d5c1-4a98-9eb2-3c2750248b0b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:56.731181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:56.731901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.732086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.732355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.733036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:56.733448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:56.735063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:56.760105 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2762/5548] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:56.775439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:56.791998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b131d8-3ad6-40c7-8dad-2bb25b60fbc7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:56.803563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:56.804687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.805093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.805299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.806079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:56.809855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:56.810424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252616ba03d341cdae67e247d3f4d7a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.811460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252616ba03d341cdae67e247d3f4d7a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.812411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252616ba03d341cdae67e247d3f4d7a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.830267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252616ba03d341cdae67e247d3f4d7a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.840281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252616ba03d341cdae67e247d3f4d7a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:56.854136 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2763/5549] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:56 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:56.856470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:56.859778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.863511 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2787/5550] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:26:56 2022] DELETE /identity/v3/users/252616ba03d341cdae67e247d3f4d7a8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:56.867159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:56.870523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:56.906309 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:56.913648 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:56.967704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe907-cf0a-4ce7-b93c-8294c73da360 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:56.973515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf30f5-f97e-4553-bef8-b77e2f1f90f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:56.974539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf30f5-f97e-4553-bef8-b77e2f1f90f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:56.974915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf30f5-f97e-4553-bef8-b77e2f1f90f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:56.975282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf30f5-f97e-4553-bef8-b77e2f1f90f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:56.976007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf30f5-f97e-4553-bef8-b77e2f1f90f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:56.978792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf30f5-f97e-4553-bef8-b77e2f1f90f2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:57.001487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d8729-c2fb-4d52-ac16-592bdf44c5eb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:57.036403 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2788/5551] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:56 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:57.038269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff769-9bf6-4115-9d7b-b67fa948c916 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.038775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff769-9bf6-4115-9d7b-b67fa948c916 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.039284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ff769-9bf6-4115-9d7b-b67fa948c916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.076351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7a8ff769-9bf6-4115-9d7b-b67fa948c916 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:57.078356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7a8ff769-9bf6-4115-9d7b-b67fa948c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:57.088763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2789/5552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:57.093023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ff769-9bf6-4115-9d7b-b67fa948c916 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:57.107119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ff769-9bf6-4115-9d7b-b67fa948c916 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:57.112221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:57.112859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.113182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.113460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.117136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:57.120701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:57.121523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.123124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.123414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.125292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:57.128177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:57.145421 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2790/5553] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:57.146418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:57.148220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:57.253323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:57.255116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:57.263356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482af77b-d533-416d-956e-f9d1365067b1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:57.265711 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2764/5554] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:26:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:26:57.266711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:57.273710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45732562-17ed-45f8-afd2-3172f8fb196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:57.275982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732562-17ed-45f8-afd2-3172f8fb196e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.276518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732562-17ed-45f8-afd2-3172f8fb196e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.276797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45732562-17ed-45f8-afd2-3172f8fb196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.281346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7df5fb-b42c-4d39-b202-cd32edda821c service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:57.308637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:57.308637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.308637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.308637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.309159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:57.309159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:57.317177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45732562-17ed-45f8-afd2-3172f8fb196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:57.318766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45732562-17ed-45f8-afd2-3172f8fb196e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:57.343003 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2765/5555] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:57.344330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:57.348499 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2791/5556] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:26:57.359332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068968dd-bc18-436b-a0e0-71b31b8917f1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:57.365757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:57.366521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.366803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.367072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] PATH_INFO: `/v3/projects/21ba1ba34a424f74a87afc2b97614ba8/users/1ad808347ae74af3bf4bd2c04c393bd6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.388718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ba1ba34a424f74a87afc2b97614ba8, user_id=1ad808347ae74af3bf4bd2c04c393bd6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:57.392506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:57.416661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2766/5557] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:57 2022] PUT /identity/v3/projects/21ba1ba34a424f74a87afc2b97614ba8/users/1ad808347ae74af3bf4bd2c04c393bd6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:57.427145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de95c9-3188-47da-9ebe-5f5d9366eb8f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.427437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de95c9-3188-47da-9ebe-5f5d9366eb8f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.427717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de95c9-3188-47da-9ebe-5f5d9366eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.576056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b8de95c9-3188-47da-9ebe-5f5d9366eb8f None None] MFA Rules not processed for user `1ad808347ae74af3bf4bd2c04c393bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:57.578733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b8de95c9-3188-47da-9ebe-5f5d9366eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:57.731157 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2792/5558] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:57.736682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:57.810530 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:57.874555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17566c-12ce-476d-9082-5a8d4717d017 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:57.886642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:57.887481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:57.887917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:57.888344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:57.889191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:57.891474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:57.941113 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2767/5559] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:57.941940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de95c9-3188-47da-9ebe-5f5d9366eb8f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:57.957804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de95c9-3188-47da-9ebe-5f5d9366eb8f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:58.030667 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:58.051389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:58.058961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:58.122050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:58.122611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.122895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.123199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.123855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:58.125913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:58.158774 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2793/5560] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:57 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:58.164287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:58.185949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c017-3018-4bf7-9c7c-36fd79e41a9a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:58.191389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:58.192117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.192505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.192890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.193683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:58.195473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:58.211910 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2794/5561] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:58.213872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:58.235528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4a4d0-3e58-4c40-9101-73c0061edeae admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:58.238094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8637b1-33d6-4eba-8429-0b3add801a6a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:58.247663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:58.249270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:58.251109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.251449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.251724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] PATH_INFO: `/v3/projects/6d9c1079f590492ba562b579885bd667` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.253015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9c1079f590492ba562b579885bd667)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:58.256025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:58.259883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.261166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.261577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] PATH_INFO: `/v3/projects/70e16d5023be437a87f72027bcb5857f/users/5f802178bc8f46e3acbd85b9a4aa9fa3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.304305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e16d5023be437a87f72027bcb5857f, user_id=5f802178bc8f46e3acbd85b9a4aa9fa3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:58.307634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:58.340792 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2795/5562] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:58 2022] PUT /identity/v3/projects/70e16d5023be437a87f72027bcb5857f/users/5f802178bc8f46e3acbd85b9a4aa9fa3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:58.344800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:58.436067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9c1079f590492ba562b579885bd667', 'request_id': 'req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:58.452033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9c1079f590492ba562b579885bd667', 'request_id': 'req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:58.470749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9c1079f590492ba562b579885bd667', 'request_id': 'req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:58.490815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] The token cache is being invalidate because project 6d9c1079f590492ba562b579885bd667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:26:58.497311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:58.498148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fe5b4d53-afc9-4add-99b8-f5f1151f8b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:26:58.503102 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2768/5563] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:26:58 2022] DELETE /identity/v3/projects/6d9c1079f590492ba562b579885bd667 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:58.504724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffddf40-b846-42ca-8ba9-d0a79df20158 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.505696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffddf40-b846-42ca-8ba9-d0a79df20158 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.505984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffddf40-b846-42ca-8ba9-d0a79df20158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.548921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6ffddf40-b846-42ca-8ba9-d0a79df20158 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:58.550365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6ffddf40-b846-42ca-8ba9-d0a79df20158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:58.564001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad504b1-ad6c-4876-a088-0d0dd4b03661 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:58.708255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:58.708583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.708986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.709402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.710154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:58.718995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:58.739187 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2796/5564] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:58.747677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:58.749891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:58.754081 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:58.781420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa724f8-6547-4b92-9599-60558153f2cf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:58.800095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ab264-444f-46da-b3ec-0037cb97081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:58.800938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ab264-444f-46da-b3ec-0037cb97081c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.801344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ab264-444f-46da-b3ec-0037cb97081c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.801718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ab264-444f-46da-b3ec-0037cb97081c admin admin] PATH_INFO: `/v3/projects/70e16d5023be437a87f72027bcb5857f/users/5f802178bc8f46e3acbd85b9a4aa9fa3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.804156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ab264-444f-46da-b3ec-0037cb97081c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e16d5023be437a87f72027bcb5857f, user_id=5f802178bc8f46e3acbd85b9a4aa9fa3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:58.808102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ab264-444f-46da-b3ec-0037cb97081c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:58.845797 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2797/5565] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:58 2022] PUT /identity/v3/projects/70e16d5023be437a87f72027bcb5857f/users/5f802178bc8f46e3acbd85b9a4aa9fa3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:58.858134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369169a8-4b14-458d-874e-d331b24fd850 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.858555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369169a8-4b14-458d-874e-d331b24fd850 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.858929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369169a8-4b14-458d-874e-d331b24fd850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.861527 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2769/5566] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:58.870741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e0b9-883e-4849-9bf8-090f93f62a22 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:58.871025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e0b9-883e-4849-9bf8-090f93f62a22 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:58.871298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e0b9-883e-4849-9bf8-090f93f62a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:58.928907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-369169a8-4b14-458d-874e-d331b24fd850 None None] MFA Rules not processed for user `5f802178bc8f46e3acbd85b9a4aa9fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:58.930279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-369169a8-4b14-458d-874e-d331b24fd850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:58.953482 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:58.980113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b619e0b9-883e-4849-9bf8-090f93f62a22 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:26:58.986265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b619e0b9-883e-4849-9bf8-090f93f62a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:59.145153 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2770/5567] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:26:59.149126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619e0b9-883e-4849-9bf8-090f93f62a22 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.165623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619e0b9-883e-4849-9bf8-090f93f62a22 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.181291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.182364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.182820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.183094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.183754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:59.184057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.185726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.199512 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2798/5568] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:26:59.204295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369169a8-4b14-458d-874e-d331b24fd850 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.219124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2771/5569] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:59.220908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369169a8-4b14-458d-874e-d331b24fd850 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.222915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.232905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f802178bc8f46e3acbd85b9a4aa9fa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70e16d5023be437a87f72027bcb5857f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.233679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.234054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.234452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.235657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:59.236035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.237868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.246110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f241ba-5d6d-40c8-9c63-92953ea7b37f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.258368 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2799/5570] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:26:59.260924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.261885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.262356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.262971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.264237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.265626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.271246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.282517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62024ddc-ecfe-4ea9-9b10-c1bdd1ed741b tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.288753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f802178bc8f46e3acbd85b9a4aa9fa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70e16d5023be437a87f72027bcb5857f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.289439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.289725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.290001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.291402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.294707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.340669 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2800/5571] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:59 2022] POST /identity/v3/projects => generated 349 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:59.342019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.364179 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2772/5572] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:26:59 2022] POST /identity/v3/projects => generated 355 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:26:59.377109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.491848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792336e-d812-41b1-afe9-3201413f8f28 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.524315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e987d-254e-46a0-8e01-8584e7cf161c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.539921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.545303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.545708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.545992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.547436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.552985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.615876 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2773/5573] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:26:59 2022] POST /identity/v3/users => generated 278 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:26:59.617328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.627397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f802178bc8f46e3acbd85b9a4aa9fa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70e16d5023be437a87f72027bcb5857f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.628306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.628755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.629340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.630173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:26:59.630634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.632615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.641996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66daf-c361-4512-9058-1423f549f932 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.658014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.658673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.658981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.659424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.660112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.661823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.662381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2801/5574] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:26:59.674884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.677080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:26:59.688280 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2774/5575] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:26:59.696673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.697866 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:59.722712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c22a7-9f85-4cd5-a3bd-86aa235bbd0f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.730825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.731601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.731991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.732367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.733646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.736977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.753779 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2775/5576] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:26:59.758236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:26:59.776873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f64094-7caf-472c-857d-d4187ef63044 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.783705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313753-af96-4464-8b97-38dbf2833048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.784660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313753-af96-4464-8b97-38dbf2833048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.785132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313753-af96-4464-8b97-38dbf2833048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.785726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313753-af96-4464-8b97-38dbf2833048 admin admin] PATH_INFO: `/v3/projects/406e069f47154e33908bba41762b90eb/users/35972fec72c54617aee1c59893c4f8ee/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.812956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313753-af96-4464-8b97-38dbf2833048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406e069f47154e33908bba41762b90eb, user_id=35972fec72c54617aee1c59893c4f8ee, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.814247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012bbf9-319b-4afa-9195-52935a2bdf94 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:26:59.818716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313753-af96-4464-8b97-38dbf2833048 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.822915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:26:59.823552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:26:59.823840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:26:59.824106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:26:59.845148 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:26:59.847505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:26:59.849194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:26:59.877464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2776/5577] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:26:59 2022] PUT /identity/v3/projects/406e069f47154e33908bba41762b90eb/users/35972fec72c54617aee1c59893c4f8ee/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:26:59.879410 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2802/5578] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:00.008203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d80a-88b2-4360-ba27-161a2a77dbd1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:00.008483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d80a-88b2-4360-ba27-161a2a77dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:00.008759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d80a-88b2-4360-ba27-161a2a77dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:00.095303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d3f2d80a-88b2-4360-ba27-161a2a77dbd1 None None] MFA Rules not processed for user `35972fec72c54617aee1c59893c4f8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:00.096643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d3f2d80a-88b2-4360-ba27-161a2a77dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:00.361868 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2777/5579] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:00.363461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:00.382512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b411442-2dbb-445e-ac85-09580e1c799f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:00.600525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:00.601783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:00.602337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:00.604595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:00.605830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:00.608673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:00.686958 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2803/5580] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:00 2022] POST /identity/v3/projects => generated 355 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:00.691155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d80a-88b2-4360-ba27-161a2a77dbd1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:00.726680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d80a-88b2-4360-ba27-161a2a77dbd1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:00.836412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:00.837475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:00.837912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:00.838258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:00.840042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:00.842297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:00.883771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2778/5581] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:00 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:00.888712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:00.910592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ac8d-0e7f-4e49-a987-aee6ab70c164 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:00.928690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:00.933080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:00.933373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:00.933651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:00.940174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:00.945044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:01.000259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:01.001236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2804/5582] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:01.016505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac276-3edb-49be-954c-4eab8e92820e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:01.029832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:01.033130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:01.033655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:01.034250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] PATH_INFO: `/v3/projects/eda34ca5e3a1480195fd28d57b9e483e/users/01ed829596604eb39634f9b797db7376/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:01.080230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda34ca5e3a1480195fd28d57b9e483e, user_id=01ed829596604eb39634f9b797db7376, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:01.083552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:01.151315 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2779/5583] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:00 2022] PUT /identity/v3/projects/eda34ca5e3a1480195fd28d57b9e483e/users/01ed829596604eb39634f9b797db7376/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:01.156364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:01.171333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9f8e-f8bf-4762-8e8e-0a0e5e4d0562 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:01.369630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df925a3b-1c3c-4fe8-8853-9ba90332c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:01.372285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925a3b-1c3c-4fe8-8853-9ba90332c4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:01.372825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925a3b-1c3c-4fe8-8853-9ba90332c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:01.373534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df925a3b-1c3c-4fe8-8853-9ba90332c4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:01.378153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925a3b-1c3c-4fe8-8853-9ba90332c4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:01.384682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df925a3b-1c3c-4fe8-8853-9ba90332c4ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:01.428841 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2805/5584] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:01.433345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:01.445429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01870da-4d3d-42b9-a47d-47b557a86d2e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:01.472412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:01.473135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:01.473428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:01.473702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] PATH_INFO: `/v3/projects/eda34ca5e3a1480195fd28d57b9e483e/users/01ed829596604eb39634f9b797db7376/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:01.482608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda34ca5e3a1480195fd28d57b9e483e, user_id=01ed829596604eb39634f9b797db7376, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:01.485346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:01.527797 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2780/5585] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:01 2022] PUT /identity/v3/projects/eda34ca5e3a1480195fd28d57b9e483e/users/01ed829596604eb39634f9b797db7376/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:01.538543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07bc8-15c2-4fbf-8ea5-dfdfc859696f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:01.539016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07bc8-15c2-4fbf-8ea5-dfdfc859696f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:01.539509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07bc8-15c2-4fbf-8ea5-dfdfc859696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:01.607909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-42b07bc8-15c2-4fbf-8ea5-dfdfc859696f None None] MFA Rules not processed for user `01ed829596604eb39634f9b797db7376`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:01.609200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42b07bc8-15c2-4fbf-8ea5-dfdfc859696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:01.642101 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:01.835730 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2806/5586] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:27:01.907538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:01.910755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:02.026082 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:02.075527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4a501-5105-42d9-a8a3-7586f76f51ab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:02.088786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:02.089638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:02.089991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:02.091875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:02.127265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:02.129728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:02.173992 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2781/5587] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:02.531174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b07bc8-15c2-4fbf-8ea5-dfdfc859696f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:02.549911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b07bc8-15c2-4fbf-8ea5-dfdfc859696f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:02.555222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:02.560182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:02.560855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:02.561507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:02.718894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:02.720532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:02.772784 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2807/5588] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:05.717864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:05.954266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d1d6-74a9-4c9c-8de9-c9d5654514e4 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:05.971826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f802178bc8f46e3acbd85b9a4aa9fa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70e16d5023be437a87f72027bcb5857f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:05.974604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:05.974893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:05.975171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] PATH_INFO: `/v3/projects/ce8221a2d79f403a8f67e1b20803ab1a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:05.985325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce8221a2d79f403a8f67e1b20803ab1a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:05.987264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:06.119484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8221a2d79f403a8f67e1b20803ab1a', 'request_id': 'req-788e04ae-d85c-4c85-8077-1016ce3ee3e6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.126592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8221a2d79f403a8f67e1b20803ab1a', 'request_id': 'req-788e04ae-d85c-4c85-8077-1016ce3ee3e6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.143567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8221a2d79f403a8f67e1b20803ab1a', 'request_id': 'req-788e04ae-d85c-4c85-8077-1016ce3ee3e6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.164319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] The token cache is being invalidate because project ce8221a2d79f403a8f67e1b20803ab1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:06.168685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.175664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-788e04ae-d85c-4c85-8077-1016ce3ee3e6 tempest-QuotasNegativeTest-1730667256 tempest-QuotasNegativeTest-1730667256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.187119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2782/5589] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:05 2022] DELETE /identity/v3/projects/ce8221a2d79f403a8f67e1b20803ab1a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:06.195264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:06.544234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd88c1-b38a-4329-8664-30e1527bc07a service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:06.676092 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:06.708502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:06.709748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:06.710014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:06.711923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] PATH_INFO: `/v3/users/1ad808347ae74af3bf4bd2c04c393bd6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:06.714151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad808347ae74af3bf4bd2c04c393bd6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:06.716127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:06.824414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad808347ae74af3bf4bd2c04c393bd6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.825147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad808347ae74af3bf4bd2c04c393bd6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.825941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad808347ae74af3bf4bd2c04c393bd6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.860084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad808347ae74af3bf4bd2c04c393bd6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.877299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad808347ae74af3bf4bd2c04c393bd6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:06.931668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2808/5590] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:06 2022] DELETE /identity/v3/users/1ad808347ae74af3bf4bd2c04c393bd6 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:06.942412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:06.943305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:06.943744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:07.017501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:07.023802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:07.224972 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2783/5591] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:07.236153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:07.237589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:07.413731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9267a-6e27-43a8-aa1f-66bc696215a5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:07.421262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:07.421823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:07.422104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:07.422376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:07.505587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:07.507048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:07.584276 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2809/5592] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:08.123597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:08.125123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:08.153002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3858e-70e8-4fad-8b26-0e4b115b8058 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:08.169120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:08.169775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:08.170466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:08.171413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] PATH_INFO: `/v3/projects/21ba1ba34a424f74a87afc2b97614ba8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:08.172943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ba1ba34a424f74a87afc2b97614ba8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:08.178521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:08.192854 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:08.290797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ba1ba34a424f74a87afc2b97614ba8', 'request_id': 'req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.313553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ba1ba34a424f74a87afc2b97614ba8', 'request_id': 'req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.338641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ba1ba34a424f74a87afc2b97614ba8', 'request_id': 'req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.401395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] The token cache is being invalidate because project 21ba1ba34a424f74a87afc2b97614ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:08.401713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.404154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.407563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2784/5593] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:08 2022] DELETE /identity/v3/projects/21ba1ba34a424f74a87afc2b97614ba8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:08.411815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:08.440216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995a5db-d11f-4ce2-a0a7-bf18f8ec6086 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:08.685322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:08.686907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:08.687666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:08.688264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] PATH_INFO: `/v3/users/5f802178bc8f46e3acbd85b9a4aa9fa3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:08.695695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f802178bc8f46e3acbd85b9a4aa9fa3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:08.707519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:08.754169 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:08.877597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f802178bc8f46e3acbd85b9a4aa9fa3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.879236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f802178bc8f46e3acbd85b9a4aa9fa3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.883063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f802178bc8f46e3acbd85b9a4aa9fa3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:08.953743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f802178bc8f46e3acbd85b9a4aa9fa3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:09.001838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f802178bc8f46e3acbd85b9a4aa9fa3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:09.045094 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2810/5594] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:08 2022] DELETE /identity/v3/users/5f802178bc8f46e3acbd85b9a4aa9fa3 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:09.830629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:09.832126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:09.879355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1fcf-ca6a-4e49-89e4-7d60b7c14b85 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:09.894418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:09.902696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:10.058841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9135db-4689-47ad-9cb4-9d2e727d1dac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:10.069630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe6b73-ef19-4614-ad58-d1ccc5f5bb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:10.072081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6b73-ef19-4614-ad58-d1ccc5f5bb3d service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:10.072569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6b73-ef19-4614-ad58-d1ccc5f5bb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:10.072996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6b73-ef19-4614-ad58-d1ccc5f5bb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:10.077434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0cfe6b73-ef19-4614-ad58-d1ccc5f5bb3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:10.121255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:10.122927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:10.123438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:10.123936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] PATH_INFO: `/v3/projects/70e16d5023be437a87f72027bcb5857f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:10.126723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e16d5023be437a87f72027bcb5857f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:10.129022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:10.278227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e16d5023be437a87f72027bcb5857f', 'request_id': 'req-92c51c6a-9719-4b8b-b616-7218525b82b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:10.291288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e16d5023be437a87f72027bcb5857f', 'request_id': 'req-92c51c6a-9719-4b8b-b616-7218525b82b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:10.313607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe6b73-ef19-4614-ad58-d1ccc5f5bb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:10.317667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe6b73-ef19-4614-ad58-d1ccc5f5bb3d service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:10.320923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e16d5023be437a87f72027bcb5857f', 'request_id': 'req-92c51c6a-9719-4b8b-b616-7218525b82b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:10.338968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] The token cache is being invalidate because project 70e16d5023be437a87f72027bcb5857f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:10.339659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:10.342559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92c51c6a-9719-4b8b-b616-7218525b82b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:10.344723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2785/5595] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:09 2022] DELETE /identity/v3/projects/70e16d5023be437a87f72027bcb5857f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:10.349691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5820c-4c8e-4a50-831f-2b2a7894124b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:10.350255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5820c-4c8e-4a50-831f-2b2a7894124b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:10.350765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5820c-4c8e-4a50-831f-2b2a7894124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:10.362814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2811/5596] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:10.389317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7bc5820c-4c8e-4a50-831f-2b2a7894124b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:10.390912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7bc5820c-4c8e-4a50-831f-2b2a7894124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:10.443622 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:10.545785 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2786/5597] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:27:10.554597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93b19-1641-4160-aca6-52b86e213c5d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:10.554986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93b19-1641-4160-aca6-52b86e213c5d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:10.555170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93b19-1641-4160-aca6-52b86e213c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:10.637805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b4a93b19-1641-4160-aca6-52b86e213c5d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:10.639029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b4a93b19-1641-4160-aca6-52b86e213c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:10.693982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2812/5598] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:10.699904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5820c-4c8e-4a50-831f-2b2a7894124b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:10.715479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5820c-4c8e-4a50-831f-2b2a7894124b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:10.733898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:10.734808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:10.735095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:10.735369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:10.736034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:10.736337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:10.737974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:10.760195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2787/5599] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:10.764842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93b19-1641-4160-aca6-52b86e213c5d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:10.778866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93b19-1641-4160-aca6-52b86e213c5d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:10.791928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:10.792558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:10.792830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:10.793118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:10.793767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:10.799895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:10.855837 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2813/5600] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:10 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:10.859946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:10.879962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dece7-4591-4739-9a3e-4e445736d1ae admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:11.101073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:11.101860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:11.102146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:11.103069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:11.103721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:11.105680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:11.222279 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2788/5601] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:10 2022] POST /identity/v3/users => generated 284 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:11.226234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:11.245446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5ec20-2809-4c62-a951-7eede8ce5aba admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:11.266194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:11.267194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:11.267745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:11.268178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:11.268989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:11.270793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:11.323351 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2814/5602] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:11.327369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:11.344013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c92a24-64a4-4250-b939-564791728ebf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:11.366256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6c1ce-04ff-43ef-9b63-de5b3aa2c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:11.367245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c1ce-04ff-43ef-9b63-de5b3aa2c1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:11.367703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c1ce-04ff-43ef-9b63-de5b3aa2c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:11.368876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6c1ce-04ff-43ef-9b63-de5b3aa2c1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:11.369760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6c1ce-04ff-43ef-9b63-de5b3aa2c1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:11.382442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6c1ce-04ff-43ef-9b63-de5b3aa2c1b4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:11.413270 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2789/5603] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:11.417699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:11.429410 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:11.440247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78057-0be7-4432-a175-870c96e2bbc7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:11.474830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:11.476324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:11.476766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:11.477820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] PATH_INFO: `/v3/projects/c4b06c38593e4b3f96e65c197afce50d/users/6d907e5f4a3049cfafd76b4e0b38e7ed/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:11.507267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b06c38593e4b3f96e65c197afce50d, user_id=6d907e5f4a3049cfafd76b4e0b38e7ed, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:11.513748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:11.567430 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2815/5604] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:11 2022] PUT /identity/v3/projects/c4b06c38593e4b3f96e65c197afce50d/users/6d907e5f4a3049cfafd76b4e0b38e7ed/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:27:11.569709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b350-a361-4bd0-bc57-eb34a4a6ef43 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:11.569908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b350-a361-4bd0-bc57-eb34a4a6ef43 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:11.570233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b350-a361-4bd0-bc57-eb34a4a6ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:11.638273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8ca6b350-a361-4bd0-bc57-eb34a4a6ef43 None None] MFA Rules not processed for user `6d907e5f4a3049cfafd76b4e0b38e7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:11.638526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ca6b350-a361-4bd0-bc57-eb34a4a6ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:11.882463 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2790/5605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:11.887918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:12.136519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d76552-22da-44e1-845c-a15d192df573 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:12.158909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:12.161945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:12.166932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:12.167552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:12.171603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:12.174296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:12.282765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b350-a361-4bd0-bc57-eb34a4a6ef43 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:12.283767 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2816/5606] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:11 2022] POST /identity/v3/projects => generated 367 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:12.301130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b350-a361-4bd0-bc57-eb34a4a6ef43 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:12.409342 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:12.596559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:12.597232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:12.597519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:12.597794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:12.600716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:12.607533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:12.687396 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2791/5607] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:12 2022] POST /identity/v3/users => generated 290 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:12.689294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:12.706588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971117e-8fba-4e4f-ac5f-7dbe86a32627 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:12.715792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:12.716569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:12.716957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:12.717366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:12.718121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:12.719998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:12.749507 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2817/5608] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:12.750746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:12.769317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b16c3-8e8e-415e-a321-13480bd9b892 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:12.785966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:12.788855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:12.796166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:12.797890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] PATH_INFO: `/v3/projects/1e0b2c04b5d3496dad9aa7d58addc24f/users/8831a930e3da4071b22f8b5b4e3578d3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:12.874685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0b2c04b5d3496dad9aa7d58addc24f, user_id=8831a930e3da4071b22f8b5b4e3578d3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:12.888799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:12.971291 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2792/5609] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:12 2022] PUT /identity/v3/projects/1e0b2c04b5d3496dad9aa7d58addc24f/users/8831a930e3da4071b22f8b5b4e3578d3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:27:12.975126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:12.998226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d09bfd-d1cd-4ddd-a575-d08eccd17c0c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:13.259495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d761a9b-32a7-401f-8848-b13b61a1e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:13.266365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761a9b-32a7-401f-8848-b13b61a1e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:13.267793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761a9b-32a7-401f-8848-b13b61a1e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:13.268275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761a9b-32a7-401f-8848-b13b61a1e4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:13.269778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761a9b-32a7-401f-8848-b13b61a1e4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:13.278016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761a9b-32a7-401f-8848-b13b61a1e4a1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:13.324897 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2818/5610] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:13.325931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:13.344347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c7c30-66e5-4728-bc3b-f0b533fa331f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:13.371504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:13.372209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:13.372485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:13.372757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] PATH_INFO: `/v3/projects/1e0b2c04b5d3496dad9aa7d58addc24f/users/8831a930e3da4071b22f8b5b4e3578d3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:13.378491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0b2c04b5d3496dad9aa7d58addc24f, user_id=8831a930e3da4071b22f8b5b4e3578d3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:13.382514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:13.487820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2793/5611] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:13 2022] PUT /identity/v3/projects/1e0b2c04b5d3496dad9aa7d58addc24f/users/8831a930e3da4071b22f8b5b4e3578d3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:13.498772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:13.499298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:13.499738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:13.593230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] MFA Rules not processed for user `8831a930e3da4071b22f8b5b4e3578d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:13.594540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:13.750727 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:13.861348 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2819/5612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:13.869220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:13.871013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:14.208121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f2b3-3706-46c7-9385-6e44be1cc99b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:14.234531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:14.235155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:14.235612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:14.236052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:14.266376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:14.268141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:14.311198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2794/5613] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:21.819189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:21.821902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:22.152461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ef72a-cb2c-41bf-bbd8-248526c6978b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:22.166793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:22.168658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:22.168944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:22.169244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] PATH_INFO: `/v3/users/b061026cc5d644d1a3fe41b2fe05c7bc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:22.219643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b061026cc5d644d1a3fe41b2fe05c7bc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:22.225376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:22.383013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b061026cc5d644d1a3fe41b2fe05c7bc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:22.384182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b061026cc5d644d1a3fe41b2fe05c7bc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:22.385001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b061026cc5d644d1a3fe41b2fe05c7bc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:22.419384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b061026cc5d644d1a3fe41b2fe05c7bc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:22.432645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0f1b89f1-1089-4fc5-bb40-da32441a56c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b061026cc5d644d1a3fe41b2fe05c7bc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:22.475234 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2820/5614] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:21 2022] DELETE /identity/v3/users/b061026cc5d644d1a3fe41b2fe05c7bc => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:23.957378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:23.987736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b96a-a69b-4bdd-887c-0f7c58cd4126 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:24.199168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:24.200055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:24.200324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:24.200597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] PATH_INFO: `/v3/projects/89240e2456784a5fbbb3b5d7c8ddb2ad` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:24.251890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89240e2456784a5fbbb3b5d7c8ddb2ad)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:24.253770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:24.307914 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:24.416583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89240e2456784a5fbbb3b5d7c8ddb2ad', 'request_id': 'req-fca93c99-da87-4b93-ad9f-61badf313292'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:24.442081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89240e2456784a5fbbb3b5d7c8ddb2ad', 'request_id': 'req-fca93c99-da87-4b93-ad9f-61badf313292'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:24.463770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89240e2456784a5fbbb3b5d7c8ddb2ad', 'request_id': 'req-fca93c99-da87-4b93-ad9f-61badf313292'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:24.492952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] The token cache is being invalidate because project 89240e2456784a5fbbb3b5d7c8ddb2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:24.493305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:24.494044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-fca93c99-da87-4b93-ad9f-61badf313292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:24.503820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2795/5615] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:23 2022] DELETE /identity/v3/projects/89240e2456784a5fbbb3b5d7c8ddb2ad => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:24.505424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc60a-16af-45d8-a485-2402dde5d530 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:24.505864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc60a-16af-45d8-a485-2402dde5d530 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:24.505956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc60a-16af-45d8-a485-2402dde5d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:24.567202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-90adc60a-16af-45d8-a485-2402dde5d530 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:24.569954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-90adc60a-16af-45d8-a485-2402dde5d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:24.701641 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:24.767483 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2821/5616] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:24.775648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2c450-2f9a-4072-a21a-07f6605e6215 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:24.775933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2c450-2f9a-4072-a21a-07f6605e6215 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:24.776306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2c450-2f9a-4072-a21a-07f6605e6215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:24.846784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6bf2c450-2f9a-4072-a21a-07f6605e6215 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:24.848100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6bf2c450-2f9a-4072-a21a-07f6605e6215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:24.881943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2796/5617] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:24.886434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adc60a-16af-45d8-a485-2402dde5d530 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:24.907942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adc60a-16af-45d8-a485-2402dde5d530 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:24.932313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:24.933289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:24.934317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:24.936782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:24.937530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:24.940091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:24.945205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:24.972269 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2822/5618] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:24.975714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2c450-2f9a-4072-a21a-07f6605e6215 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:25.005395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2c450-2f9a-4072-a21a-07f6605e6215 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:25.025682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:25.027845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:25.028131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:25.030042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:25.031071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:25.035721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:25.150129 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2797/5619] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:24 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:25.151326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:25.170775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0a7b5-28cc-43d7-88a3-d08fa995e826 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:25.352430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:25.354041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:25.354503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:25.354957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:25.355922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:25.358297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:25.425153 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2823/5620] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:25 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:25.429262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:25.448155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f08cf-74e2-452d-83de-17ed54669e60 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:25.468582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:25.470269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:25.470810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:25.471254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:25.472267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:25.474445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:25.514922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:25.525756 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2798/5621] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:27:25.528413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc44f9-1977-43c0-bbe1-127464c943b7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:25.557636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ed5ff-ac17-46d2-b0d7-47bd6ba54ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:25.558495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ed5ff-ac17-46d2-b0d7-47bd6ba54ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:25.559127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ed5ff-ac17-46d2-b0d7-47bd6ba54ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:25.560022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ed5ff-ac17-46d2-b0d7-47bd6ba54ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:25.561541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ed5ff-ac17-46d2-b0d7-47bd6ba54ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:25.563472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ed5ff-ac17-46d2-b0d7-47bd6ba54ff0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:25.619184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2824/5622] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:25.620493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:25.636887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc54b9-6d4b-43cd-b33e-e51eed8ca9ea admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:25.652679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:25.653552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:25.654109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:25.654995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] PATH_INFO: `/v3/projects/8e658d52e3084fa3b4b59f42ecfb2c45/users/ba74c294736f42db8cac7e59c60bcf04/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:25.691282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e658d52e3084fa3b4b59f42ecfb2c45, user_id=ba74c294736f42db8cac7e59c60bcf04, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:25.694690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:25.734562 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2799/5623] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:25 2022] PUT /identity/v3/projects/8e658d52e3084fa3b4b59f42ecfb2c45/users/ba74c294736f42db8cac7e59c60bcf04/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:25.739634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b10d3-2616-4089-b733-2ec8f437f73d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:25.740042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b10d3-2616-4089-b733-2ec8f437f73d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:25.740434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b10d3-2616-4089-b733-2ec8f437f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:25.798078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-487b10d3-2616-4089-b733-2ec8f437f73d None None] MFA Rules not processed for user `ba74c294736f42db8cac7e59c60bcf04`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:25.802795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-487b10d3-2616-4089-b733-2ec8f437f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:26.006758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:26.007435 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2825/5624] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:26.232051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7721c5-8447-4dc1-903e-aed12129e043 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:26.244878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:26.246090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:26.246491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:26.246898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:26.247682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:26.249742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:26.368721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b10d3-2616-4089-b733-2ec8f437f73d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:26.368950 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2800/5625] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:26 2022] POST /identity/v3/projects => generated 381 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:26.384459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b10d3-2616-4089-b733-2ec8f437f73d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:26.566834 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:26.607568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:26.608107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:26.608387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:26.608658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:26.610293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:26.613544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:26.672188 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2826/5626] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:26 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:26.675522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:26.703533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135d65-8323-48be-8861-7eb7b5086d8f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:26.723344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:26.724158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:26.724560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:26.724979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:26.725894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:26.734905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:26.769089 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2801/5627] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:26.770643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:26.789160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d0c3b-ce0a-4a90-b5a4-39b4f410a5f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:26.805402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:26.806816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:26.807279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:26.807558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] PATH_INFO: `/v3/projects/8439ce4bf4264d189fb0a990dacc9d64/users/6a3a47d35fd64e28b697871966b2e6e7/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:26.855449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8439ce4bf4264d189fb0a990dacc9d64, user_id=6a3a47d35fd64e28b697871966b2e6e7, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:26.866265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:26.919272 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2827/5628] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:26 2022] PUT /identity/v3/projects/8439ce4bf4264d189fb0a990dacc9d64/users/6a3a47d35fd64e28b697871966b2e6e7/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:26.920851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:26.934470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb91a3-4118-4297-bf62-91d95e2194c4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:26.953673 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:27.097095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9c03e-dd4f-46bc-b99a-7fa4e29ed59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:27.097932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9c03e-dd4f-46bc-b99a-7fa4e29ed59f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:27.098373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9c03e-dd4f-46bc-b99a-7fa4e29ed59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:27.098758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9c03e-dd4f-46bc-b99a-7fa4e29ed59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:27.099562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9c03e-dd4f-46bc-b99a-7fa4e29ed59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:27.101473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9c03e-dd4f-46bc-b99a-7fa4e29ed59f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:27.127917 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2802/5629] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:27.129238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:27.143893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dc627-0fd1-43cc-a9aa-d9b7d1ea6c5f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:27.177901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:27.182101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:27.182401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:27.195423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] PATH_INFO: `/v3/projects/8439ce4bf4264d189fb0a990dacc9d64/users/6a3a47d35fd64e28b697871966b2e6e7/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:27.210553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8439ce4bf4264d189fb0a990dacc9d64, user_id=6a3a47d35fd64e28b697871966b2e6e7, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:27.220999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:27.273320 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2828/5630] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:27 2022] PUT /identity/v3/projects/8439ce4bf4264d189fb0a990dacc9d64/users/6a3a47d35fd64e28b697871966b2e6e7/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:27.285362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460845-c34a-4bde-988f-b579b8479ad6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:27.285796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460845-c34a-4bde-988f-b579b8479ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:27.286456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a460845-c34a-4bde-988f-b579b8479ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:27.380371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7a460845-c34a-4bde-988f-b579b8479ad6 None None] MFA Rules not processed for user `6a3a47d35fd64e28b697871966b2e6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:27.390039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a460845-c34a-4bde-988f-b579b8479ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:27.605801 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2803/5631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:27.610426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:27.643098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746756d6-70e3-468e-aaa3-a6ec65ac7376 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:27.655855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:27.657178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:27.658052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:27.659866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:27.661592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:27.674682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invalid input for field 'name': '' is too short Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: On instance['name']: Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: On instance['name']: Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: '' Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise error Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application '' Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:27.716883 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:27:27.718940 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application '' Sep 11 01:27:27.720430 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:27.726798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2829/5632] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:27:27 2022] POST /identity/v3/domains => generated 283 bytes in 117 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:27:27.731808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a460845-c34a-4bde-988f-b579b8479ad6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:27.748213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a460845-c34a-4bde-988f-b579b8479ad6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:27.777679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:27.778406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:27.778700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:27.778981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:27.780572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:27.781655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:27.783802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:27.808132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: On instance['name']: Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: On instance['name']: Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise error Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.858870 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 11 01:27:27.860567 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 11 01:27:27.862079 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:27.869523 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2804/5633] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:27:27 2022] POST /identity/v3/domains => generated 412 bytes in 138 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:27:27.875486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:27.892407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005f431-aa15-4975-8805-58a5f18f7a36 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:27.901804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:27.903029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:27.903522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:27.903963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:27.904794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:27.906775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:27.945354 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2805/5634] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:27:27 2022] POST /identity/v3/domains => generated 277 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:27.949912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:28.138068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83593abb-2e2e-410f-ac1e-f3b631800710 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:28.156625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:28.157763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:28.159223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:28.159512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains/dc9f359200084661a3a1d2323e862156` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:28.168147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4344bf7-3977-4224-8ff8-114575b290b0 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:28.194661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dc9f359200084661a3a1d2323e862156)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:28.196872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:28.221143 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Sep 11 01:27:28.288823 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 11 01:27:28.290177 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:28.301593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2806/5635] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:27:27 2022] DELETE /identity/v3/domains/dc9f359200084661a3a1d2323e862156 => generated 120 bytes in 352 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:27:28.303483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:28.319972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b83ba-9501-4565-8040-7981acb42226 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:28.327641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:28.328326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:28.328611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:28.328887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains/dc9f359200084661a3a1d2323e862156` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:28.334643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dc9f359200084661a3a1d2323e862156)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:28.338535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:28.394090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:28.395118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:28.397362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:28.397759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] PATH_INFO: `/v3/users/49ff66090c3742f6b5c70d3abef11732` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:28.403068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ff66090c3742f6b5c70d3abef11732)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:28.405333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:28.427766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dc9f359200084661a3a1d2323e862156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.428719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dc9f359200084661a3a1d2323e862156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.530028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dc9f359200084661a3a1d2323e862156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.534513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dc9f359200084661a3a1d2323e862156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.543258 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:28.545266 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2807/5636] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:27:28 2022] PATCH /identity/v3/domains/dc9f359200084661a3a1d2323e862156 => generated 278 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:28.549670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:28.557542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:28.577786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ff66090c3742f6b5c70d3abef11732'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.578491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ff66090c3742f6b5c70d3abef11732'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.579143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ff66090c3742f6b5c70d3abef11732'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.611548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ff66090c3742f6b5c70d3abef11732'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.625847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e962def6-b0db-47db-b212-199b9d38cd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ff66090c3742f6b5c70d3abef11732'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:28.651490 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2830/5637] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:27 2022] DELETE /identity/v3/users/49ff66090c3742f6b5c70d3abef11732 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:28.656134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:28.656630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:28.657159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:28.692568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:28.698827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:28.794428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72da83d-7108-4adc-ba38-3b27ca684ae4 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:28.822504 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2831/5638] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:28.833643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:28.837730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:28.965541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:28.967756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:28.969104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:28.971091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains/dc9f359200084661a3a1d2323e862156` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:29.002147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dc9f359200084661a3a1d2323e862156)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:29.004348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:29.051639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886246c5-2a35-4d73-9d85-b93cb47aeba2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:29.063996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:29.064639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:29.064923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:29.065377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:29.084498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dc9f359200084661a3a1d2323e862156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.100111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:29.102287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:29.109920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dc9f359200084661a3a1d2323e862156'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.159742 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2832/5639] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:29.240542 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:29.276562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9f359200084661a3a1d2323e862156', 'request_id': 'req-8caca768-aa9e-4b67-9ac6-dca148ccc697'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.287528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9f359200084661a3a1d2323e862156', 'request_id': 'req-8caca768-aa9e-4b67-9ac6-dca148ccc697'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.325114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9f359200084661a3a1d2323e862156', 'request_id': 'req-8caca768-aa9e-4b67-9ac6-dca148ccc697'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.360759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] The token cache is being invalidate because project dc9f359200084661a3a1d2323e862156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:29.361085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.362973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.391766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dc9f359200084661a3a1d2323e862156', 'request_id': 'req-8caca768-aa9e-4b67-9ac6-dca148ccc697'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.394174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dc9f359200084661a3a1d2323e862156', 'request_id': 'req-8caca768-aa9e-4b67-9ac6-dca148ccc697'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.407301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dc9f359200084661a3a1d2323e862156', 'request_id': 'req-8caca768-aa9e-4b67-9ac6-dca148ccc697'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:29.420172 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2808/5640] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:27:28 2022] DELETE /identity/v3/domains/dc9f359200084661a3a1d2323e862156 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:29.425274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:29.426843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:29.450482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bce9e-d480-4ec3-a6b8-0139fbe85837 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:29.556182 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:29.567188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:29.568380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:29.568980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:29.569601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains/3ab9dabdb83d49c99bacf911202245ee` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:29.582161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Could not find domain: 3ab9dabdb83d49c99bacf911202245ee.: keystone.exception.DomainNotFound: Could not find domain: 3ab9dabdb83d49c99bacf911202245ee. Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ab9dabdb83d49c99bacf911202245ee. Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:29.589088 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:29.590302 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:27:29.591465 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3ab9dabdb83d49c99bacf911202245ee. Sep 11 01:27:29.592843 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.595275 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2833/5641] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:27:29 2022] DELETE /identity/v3/domains/3ab9dabdb83d49c99bacf911202245ee => generated 112 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:27:29.599909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:29.602844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:29.644375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caca768-aa9e-4b67-9ac6-dca148ccc697 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:29.673723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:29.674363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:29.674646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:29.674920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:29.675610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:29.683963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:29.718508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2809/5642] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:27:29 2022] POST /identity/v3/domains => generated 253 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:29.722297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:29.744664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e7b0-a676-43c9-865f-b68f75531b83 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:29.874774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:29.875601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:29.875993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:29.876383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:29.880066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:29.882549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:29.917716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.sql.core [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1101678898' for key 'project.ixu_project_name_domain_id'") Sep 11 01:27:29.917716 n-d-master-1 devstack@keystone.service[81859]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 01:27:29.917716 n-d-master-1 devstack@keystone.service[81859]: [parameters: {'id': 'ebfb27b3c033412cb599656bdd228938', 'name': 'tempest-domain-dup-1101678898', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 11 01:27:29.917716 n-d-master-1 devstack@keystone.service[81859]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81859) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1101678898.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1101678898. Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 01:27:29.943056 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1101678898' for key 'project.ixu_project_name_domain_id'") Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 01:27:29.944526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application yield resource Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise self.value Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application session.commit() Sep 11 01:27:29.946599 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.flush() Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application compat.raise_( Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 01:27:29.948026 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 01:27:29.949431 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 01:27:29.950669 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1101678898' for key 'project.ixu_project_name_domain_id'") Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [parameters: {'id': 'ebfb27b3c033412cb599656bdd228938', 'name': 'tempest-domain-dup-1101678898', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.952001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1101678898. Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:29.960515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1101678898. Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:29.962980 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2834/5643] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:27:29 2022] POST /identity/v3/domains => generated 212 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 01:27:29.965842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:29.987352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:29.988885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:29.990927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b85588-d08c-47a3-b1a4-eabb205d9a08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:30.018888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:30.019567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:30.019854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:30.020185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains/7cbbef5138db492680d1a41d259851b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:30.089934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7cbbef5138db492680d1a41d259851b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:30.092189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:30.145758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7cbbef5138db492680d1a41d259851b4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.146526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7cbbef5138db492680d1a41d259851b4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.203657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7cbbef5138db492680d1a41d259851b4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.204953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7cbbef5138db492680d1a41d259851b4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.206460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b16597-9a26-431f-9b9b-05531b5f4e08 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:30.214091 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2810/5644] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:27:29 2022] PATCH /identity/v3/domains/7cbbef5138db492680d1a41d259851b4 => generated 254 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:27:30.215229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:30.218321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:30.398811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:30.400074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:30.400621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:30.401262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] PATH_INFO: `/v3/projects/fbc44981cf6a4e6d90be72010b0f26d7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:30.403021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc44981cf6a4e6d90be72010b0f26d7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:30.405287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:30.426045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff960a87-c4fd-4290-8ea4-0a6643e278a1 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:30.437455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:30.438417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:30.438705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:30.438981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains/7cbbef5138db492680d1a41d259851b4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:30.467494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7cbbef5138db492680d1a41d259851b4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:30.469715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:30.522527 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:30.536063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc44981cf6a4e6d90be72010b0f26d7', 'request_id': 'req-6dc1999a-49bd-4ae0-ac15-413f5904f65a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.540329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7cbbef5138db492680d1a41d259851b4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.554110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc44981cf6a4e6d90be72010b0f26d7', 'request_id': 'req-6dc1999a-49bd-4ae0-ac15-413f5904f65a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.554450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7cbbef5138db492680d1a41d259851b4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.563843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc44981cf6a4e6d90be72010b0f26d7', 'request_id': 'req-6dc1999a-49bd-4ae0-ac15-413f5904f65a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.574432 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:30.598355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] The token cache is being invalidate because project fbc44981cf6a4e6d90be72010b0f26d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:30.598773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.599556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6dc1999a-49bd-4ae0-ac15-413f5904f65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.601868 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2835/5645] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:29 2022] DELETE /identity/v3/projects/fbc44981cf6a4e6d90be72010b0f26d7 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:30.606672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6e1df-7f37-40b5-b005-cad90c83cacf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:30.607097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6e1df-7f37-40b5-b005-cad90c83cacf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:30.607487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6e1df-7f37-40b5-b005-cad90c83cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:30.649903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-46f6e1df-7f37-40b5-b005-cad90c83cacf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:30.651196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-46f6e1df-7f37-40b5-b005-cad90c83cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:30.725539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbbef5138db492680d1a41d259851b4', 'request_id': 'req-dc4fe38c-57f5-4c24-b405-f26d061758a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.743871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbbef5138db492680d1a41d259851b4', 'request_id': 'req-dc4fe38c-57f5-4c24-b405-f26d061758a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.769726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbbef5138db492680d1a41d259851b4', 'request_id': 'req-dc4fe38c-57f5-4c24-b405-f26d061758a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.821397 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2836/5646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:27:30.822368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] The token cache is being invalidate because project 7cbbef5138db492680d1a41d259851b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:30.823881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.825118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.831921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05ca0-09ab-4b6f-843a-16944fa12323 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:30.832478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05ca0-09ab-4b6f-843a-16944fa12323 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:30.832775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05ca0-09ab-4b6f-843a-16944fa12323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:30.874111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7cbbef5138db492680d1a41d259851b4', 'request_id': 'req-dc4fe38c-57f5-4c24-b405-f26d061758a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.875841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7cbbef5138db492680d1a41d259851b4', 'request_id': 'req-dc4fe38c-57f5-4c24-b405-f26d061758a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.892393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7cbbef5138db492680d1a41d259851b4', 'request_id': 'req-dc4fe38c-57f5-4c24-b405-f26d061758a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:30.926224 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2811/5647] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:27:30 2022] DELETE /identity/v3/domains/7cbbef5138db492680d1a41d259851b4 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:30.927486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:30.929037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:30.952219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5cb05ca0-09ab-4b6f-843a-16944fa12323 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:30.958776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5cb05ca0-09ab-4b6f-843a-16944fa12323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:31.129323 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2837/5648] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:31.134105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05ca0-09ab-4b6f-843a-16944fa12323 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:31.157711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fe38c-57f5-4c24-b405-f26d061758a8 tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:31.167200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05ca0-09ab-4b6f-843a-16944fa12323 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:31.171418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a3a47d35fd64e28b697871966b2e6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8439ce4bf4264d189fb0a990dacc9d64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:31.172091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:31.172378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:31.172655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] PATH_INFO: `/v3/domains/dc9f359200084661a3a1d2323e862156` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:31.186254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:31.187240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:27:31.187973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:31.190210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:31.191267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:31.200564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Could not find domain: dc9f359200084661a3a1d2323e862156.: keystone.exception.DomainNotFound: Could not find domain: dc9f359200084661a3a1d2323e862156. Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dc9f359200084661a3a1d2323e862156. Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:31.202328 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:31.203437 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:27:31.204536 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dc9f359200084661a3a1d2323e862156. Sep 11 01:27:31.207809 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:31.207901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:31.207989 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2812/5649] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:27:30 2022] PATCH /identity/v3/domains/dc9f359200084661a3a1d2323e862156 => generated 112 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:27:31.208564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:31.209729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:31.212496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:31.234938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5327cc1-ece6-4c11-8893-cb90b4b27c0b tempest-DomainsNegativeTestJSON-346059091 tempest-DomainsNegativeTestJSON-346059091-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:31.240086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:31.240738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:31.241016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:31.241331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] PATH_INFO: `/v3/users/ba74c294736f42db8cac7e59c60bcf04` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:31.242623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba74c294736f42db8cac7e59c60bcf04)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:31.245875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:31.260217 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2838/5650] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:31.271634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:31.292413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba40a3-4e1f-4963-94f5-c1d96e062825 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:31.299935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:31.301285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:31.301737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:31.302171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:31.303245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:31.308055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:31.354649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba74c294736f42db8cac7e59c60bcf04'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:31.356593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba74c294736f42db8cac7e59c60bcf04'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:31.357561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba74c294736f42db8cac7e59c60bcf04'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:31.382733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba74c294736f42db8cac7e59c60bcf04'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:31.404500 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:31.406165 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2839/5651] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:31 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:31.408048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:31.411025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:31.419270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ee69fc7-ea12-4504-bc27-d43bffd525c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba74c294736f42db8cac7e59c60bcf04'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:31.463820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2813/5652] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:31 2022] DELETE /identity/v3/users/ba74c294736f42db8cac7e59c60bcf04 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:31.466367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:31.466729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:31.467076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:31.545738 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:31.549616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:31.554448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:31.621534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7398-6112-48c4-9a60-ac28322304f1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:31.734953 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2814/5653] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:27:31.752902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:31.754611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:31.870773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:31.871578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:31.871826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:31.872102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:31.872833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:31.878759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:31.988584 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2840/5654] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:31 2022] POST /identity/v3/users => generated 287 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:31.992485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:32.031912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a105a7-ebd9-4a56-8eda-60bb922e321c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:32.057538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:32.058257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.060129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.064063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.066037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:32.073134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:32.085838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876713c-4a92-49f6-8b26-d3174fd829b2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:32.098803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:32.101739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.129043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.129911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.134157 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2841/5655] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:32.148079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:32.184940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:32.191334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:32.207048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ca530-5de9-49eb-a236-1ebc1dadb83a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:32.214986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:32.215621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.219900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.220376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.221091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:32.224318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:32.225969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2815/5656] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:32.230282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:32.233753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:32.287289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2842/5657] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:32.288396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:32.331833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902e2f6-03fc-4469-a263-d3afdca77b07 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:32.350914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dacff-b5f6-4a53-91e8-7153701c0e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:32.352191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dacff-b5f6-4a53-91e8-7153701c0e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.352472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dacff-b5f6-4a53-91e8-7153701c0e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.352903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dacff-b5f6-4a53-91e8-7153701c0e32 admin admin] PATH_INFO: `/v3/projects/44d248d5f86d405894214f3eedd7fd51/users/938eea77759f48819c2cc6222cc83c30/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.394965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dacff-b5f6-4a53-91e8-7153701c0e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d248d5f86d405894214f3eedd7fd51, user_id=938eea77759f48819c2cc6222cc83c30, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:32.401186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dacff-b5f6-4a53-91e8-7153701c0e32 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:32.431152 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2843/5658] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:32 2022] PUT /identity/v3/projects/44d248d5f86d405894214f3eedd7fd51/users/938eea77759f48819c2cc6222cc83c30/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:32.443272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.443667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.443952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.494158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f513688-8694-4174-8a06-f07e326b4361 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:32.510098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] MFA Rules not processed for user `938eea77759f48819c2cc6222cc83c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:32.519831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:32.619681 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:32.671554 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2844/5659] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:32.688417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:32.689947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:32.697944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8831a930e3da4071b22f8b5b4e3578d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0b2c04b5d3496dad9aa7d58addc24f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:32.699642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.701463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.702006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.703865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:32.705453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:32.709580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:32.743728 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:32.745549 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2816/5660] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:32.751363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:32.776778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b25d-369c-4b94-b2f8-5a1d0a61fb8e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:32.784993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8831a930e3da4071b22f8b5b4e3578d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0b2c04b5d3496dad9aa7d58addc24f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:32.785740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.786109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.786458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.787181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:32.790060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:32.849221 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2817/5661] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:32 2022] POST /identity/v3/projects => generated 348 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:32.853971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:32.874907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dc52d-a2a6-49d6-a0b4-a3d3810f6307 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:32.983925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:32.984964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:32.986706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:32.987160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:32.990804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebf592-5ec3-4990-a827-e5d51d8e873a tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:33.001919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8831a930e3da4071b22f8b5b4e3578d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0b2c04b5d3496dad9aa7d58addc24f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:33.005916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:33.006446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:33.006892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:33.007744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:33.009141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:33.011125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:33.037538 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2818/5662] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:33.132596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:33.135996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:33.146881 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2845/5663] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:33.185009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:33.206670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:33.208374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:33.304511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a69b0b-7188-40d8-86c1-bca76f12ed3e tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:33.310127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:33.311520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:33.311810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:33.312207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] PATH_INFO: `/v3/users/938eea77759f48819c2cc6222cc83c30` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:33.313419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=938eea77759f48819c2cc6222cc83c30)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:33.315335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:33.354673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991560fb-14b3-4eb6-854e-8a97a2b4906b service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:33.366659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:33.368036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:33.368459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:33.368741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] PATH_INFO: `/v3/projects/8e658d52e3084fa3b4b59f42ecfb2c45` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:33.374460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e658d52e3084fa3b4b59f42ecfb2c45)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:33.376414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:33.423249 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:33.426760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938eea77759f48819c2cc6222cc83c30'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.427530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938eea77759f48819c2cc6222cc83c30'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.428643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938eea77759f48819c2cc6222cc83c30'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.439728 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:33.446860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938eea77759f48819c2cc6222cc83c30'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.479993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae1d36ad-fdd8-483f-b575-c22cd46fa697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938eea77759f48819c2cc6222cc83c30'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.499385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e658d52e3084fa3b4b59f42ecfb2c45', 'request_id': 'req-33f1f535-4726-4031-a36e-53e2a53cd800'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.506379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2819/5664] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:33 2022] DELETE /identity/v3/users/938eea77759f48819c2cc6222cc83c30 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:33.511295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:33.511631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:33.514864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:33.515203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e658d52e3084fa3b4b59f42ecfb2c45', 'request_id': 'req-33f1f535-4726-4031-a36e-53e2a53cd800'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.526567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e658d52e3084fa3b4b59f42ecfb2c45', 'request_id': 'req-33f1f535-4726-4031-a36e-53e2a53cd800'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.565309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:33.566383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] The token cache is being invalidate because project 8e658d52e3084fa3b4b59f42ecfb2c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:33.566899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.567795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.568575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:33.575323 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2846/5665] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:33 2022] DELETE /identity/v3/projects/8e658d52e3084fa3b4b59f42ecfb2c45 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:33.577054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:33.580181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:33.731088 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2820/5666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:33.740498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:33.742549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:33.770646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1f535-4726-4031-a36e-53e2a53cd800 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:33.786513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:33.787301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:33.787590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:33.799462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] PATH_INFO: `/v3/users/6a3a47d35fd64e28b697871966b2e6e7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:33.802920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3a47d35fd64e28b697871966b2e6e7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:33.810260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:33.871138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15b4d-daa7-4dcf-9d70-bead5684bd5d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:33.879836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:33.880608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:33.880956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:33.881358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:33.903491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:33.907459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:33.944437 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2821/5667] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:33.951590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3a47d35fd64e28b697871966b2e6e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.954146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3a47d35fd64e28b697871966b2e6e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.955105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3a47d35fd64e28b697871966b2e6e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:33.987631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3a47d35fd64e28b697871966b2e6e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:34.006421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3a47d35fd64e28b697871966b2e6e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:34.042740 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2847/5668] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:33 2022] DELETE /identity/v3/users/6a3a47d35fd64e28b697871966b2e6e7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:35.080013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:35.081541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:35.100668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfe4e-602e-489a-8849-a12e3ea6cb1a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:35.109300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:35.110737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:35.252724 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:35.321434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:35.322231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:35.322516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:35.322786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] PATH_INFO: `/v3/projects/44d248d5f86d405894214f3eedd7fd51` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:35.324888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91fc2-6948-4ff8-94c9-50b6aa691262 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:35.333250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d248d5f86d405894214f3eedd7fd51)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:35.335177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:35.354759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8831a930e3da4071b22f8b5b4e3578d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0b2c04b5d3496dad9aa7d58addc24f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:35.355423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:35.355701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:35.355972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] PATH_INFO: `/v3/projects/4ab9cca9431c4f24a8add1b0cf7db152` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:35.361957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ab9cca9431c4f24a8add1b0cf7db152)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:35.364119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:35.369712 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:35.504027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d248d5f86d405894214f3eedd7fd51', 'request_id': 'req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.516971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab9cca9431c4f24a8add1b0cf7db152', 'request_id': 'req-2073ef7c-fac1-4980-b596-795139a673bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.529159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab9cca9431c4f24a8add1b0cf7db152', 'request_id': 'req-2073ef7c-fac1-4980-b596-795139a673bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.534032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d248d5f86d405894214f3eedd7fd51', 'request_id': 'req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.541655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab9cca9431c4f24a8add1b0cf7db152', 'request_id': 'req-2073ef7c-fac1-4980-b596-795139a673bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.552582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d248d5f86d405894214f3eedd7fd51', 'request_id': 'req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.571996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] The token cache is being invalidate because project 44d248d5f86d405894214f3eedd7fd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:35.573006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.574816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.576687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] The token cache is being invalidate because project 4ab9cca9431c4f24a8add1b0cf7db152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:35.583062 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2822/5669] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:35 2022] DELETE /identity/v3/projects/44d248d5f86d405894214f3eedd7fd51 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:35.583343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.585370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:35.585980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2073ef7c-fac1-4980-b596-795139a673bd tempest-RoutersAdminTest-464662928 tempest-RoutersAdminTest-464662928-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.588617 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2848/5670] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:35 2022] DELETE /identity/v3/projects/4ab9cca9431c4f24a8add1b0cf7db152 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:35.589704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:35.595227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:35.597619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:35.598035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:35.647453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:35.653274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:35.744947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7483e9-dd64-4fcd-a2ef-698d0b63099c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:35.766151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:35.766812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:35.767080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:35.767345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] PATH_INFO: `/v3/projects/8439ce4bf4264d189fb0a990dacc9d64` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:35.769037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8439ce4bf4264d189fb0a990dacc9d64)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:35.771115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:35.796607 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2849/5671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:35.803169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:35.812207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:35.935926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8439ce4bf4264d189fb0a990dacc9d64', 'request_id': 'req-9c224047-ad9e-47e4-9123-c55237533d69'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.955056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8439ce4bf4264d189fb0a990dacc9d64', 'request_id': 'req-9c224047-ad9e-47e4-9123-c55237533d69'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:35.983347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8439ce4bf4264d189fb0a990dacc9d64', 'request_id': 'req-9c224047-ad9e-47e4-9123-c55237533d69'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:36.006186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] The token cache is being invalidate because project 8439ce4bf4264d189fb0a990dacc9d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:36.012520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:36.014516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8546f-436e-4968-86db-9553efc6c8c6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.015419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c224047-ad9e-47e4-9123-c55237533d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:36.017681 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2823/5672] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:35 2022] DELETE /identity/v3/projects/8439ce4bf4264d189fb0a990dacc9d64 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:36.018978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76909-ddba-4083-9fcb-31a9b59c4533 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.019267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76909-ddba-4083-9fcb-31a9b59c4533 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.019539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76909-ddba-4083-9fcb-31a9b59c4533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.097385 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:36.107413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-06c76909-ddba-4083-9fcb-31a9b59c4533 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:36.116732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-06c76909-ddba-4083-9fcb-31a9b59c4533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:36.168921 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:36.191615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995ec22-a49a-4611-aaaa-65ca3f94ff91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.192998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ec22-a49a-4611-aaaa-65ca3f94ff91 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.193657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ec22-a49a-4611-aaaa-65ca3f94ff91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.194152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ec22-a49a-4611-aaaa-65ca3f94ff91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.199364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f995ec22-a49a-4611-aaaa-65ca3f94ff91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:36.277350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2824/5673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:36.278843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b58788-df45-4809-b975-d28efef68c69 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.279225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b58788-df45-4809-b975-d28efef68c69 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.279586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b58788-df45-4809-b975-d28efef68c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.345604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c6b58788-df45-4809-b975-d28efef68c69 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:36.347121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c6b58788-df45-4809-b975-d28efef68c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:36.364012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995ec22-a49a-4611-aaaa-65ca3f94ff91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.365887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995ec22-a49a-4611-aaaa-65ca3f94ff91 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.377720 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2825/5674] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:36.377720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b58788-df45-4809-b975-d28efef68c69 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.386338 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2850/5675] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:36.387929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898c6d-e991-4dad-af7c-ec80a5b84472 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.388499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898c6d-e991-4dad-af7c-ec80a5b84472 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.388955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898c6d-e991-4dad-af7c-ec80a5b84472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.414882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b58788-df45-4809-b975-d28efef68c69 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.415839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c3898c6d-e991-4dad-af7c-ec80a5b84472 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:36.417386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c3898c6d-e991-4dad-af7c-ec80a5b84472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:36.430537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.430537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.431758 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2851/5676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:36.433506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898c6d-e991-4dad-af7c-ec80a5b84472 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.436530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.439673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.440499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:36.442778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.444518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.445564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898c6d-e991-4dad-af7c-ec80a5b84472 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.450891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.451786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.452411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.452879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.453854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:36.454447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.459327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.481047 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2826/5677] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:36.485694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.507594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1c4e1-a703-4daa-8073-78e046163b03 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.523269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.524462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.524846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.525246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.532395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.545467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.548719 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2852/5678] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:36.554204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.580878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e958fb-9ca7-4396-8b9a-0c1d2821f180 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.592062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.592972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.593474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.595146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.597334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.599463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.652612 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2827/5679] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:36 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:36.658686 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2853/5680] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:36 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:36.658894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.660807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.794675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea33a-ad92-4eed-9d59-7706b29f2fdb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.802589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89788349-27ae-4173-bfd0-4a3b5fed3d87 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.805774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.806510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.806792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.807644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.810681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.820034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.822776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.823617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.824078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.824532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.825439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.827709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.865875 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2854/5681] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:36 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:36.866760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2828/5682] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:36 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:36.870104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.870640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.882279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50418f13-cd1c-4e3c-a35b-b7b15575d888 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.888735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad3212-f14b-49c1-a92d-a289119b9ed0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.889622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.890519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.891128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.891547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.892545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.894823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.907643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.908576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.909207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.909662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.910629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.914555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.919795 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2855/5683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:36.923096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.941779 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2829/5684] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:36.945964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f33a0-ae31-43e9-b6c4-aeee0e0fa9ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.947204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:36.959605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.960960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.962570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.963291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.965706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457555ee-4cf8-47f8-b091-c9cb2a289855 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:36.966638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.971288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:36.972121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:36.972571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:36.973012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:36.973664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.974036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:36.976066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:36.993506 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2830/5685] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:36.997124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.001523 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2856/5686] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:37.006261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.023190 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:37.035752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a8acb-cb08-44a2-9e5f-69cbf2d8a712 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:37.039291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72313d2-f5ad-45fd-bbc6-8f720dd90ff8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:37.050191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728b65f-c228-4f64-9446-7f6846f7dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:37.051188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728b65f-c228-4f64-9446-7f6846f7dbff admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.051630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728b65f-c228-4f64-9446-7f6846f7dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.052119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6093f-15da-40a7-a9e4-e5438cd558cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:37.052446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728b65f-c228-4f64-9446-7f6846f7dbff admin admin] PATH_INFO: `/v3/projects/65f8398f8bd544e3b2386b930ea48d68/users/acc4109ff34b49029ba4b893fc74f9bb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.052932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6093f-15da-40a7-a9e4-e5438cd558cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.054148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6093f-15da-40a7-a9e4-e5438cd558cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.054914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6093f-15da-40a7-a9e4-e5438cd558cd admin admin] PATH_INFO: `/v3/projects/686574e20fdd4e8380732f4d3dc01c2b/users/cc036019a43749cabced900f6ff814a2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.101607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6093f-15da-40a7-a9e4-e5438cd558cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=686574e20fdd4e8380732f4d3dc01c2b, user_id=cc036019a43749cabced900f6ff814a2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:37.106124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6093f-15da-40a7-a9e4-e5438cd558cd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:37.115065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728b65f-c228-4f64-9446-7f6846f7dbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f8398f8bd544e3b2386b930ea48d68, user_id=acc4109ff34b49029ba4b893fc74f9bb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:37.127415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728b65f-c228-4f64-9446-7f6846f7dbff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:37.137413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2857/5687] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:37 2022] PUT /identity/v3/projects/686574e20fdd4e8380732f4d3dc01c2b/users/cc036019a43749cabced900f6ff814a2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:37.177615 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2831/5688] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:36 2022] PUT /identity/v3/projects/65f8398f8bd544e3b2386b930ea48d68/users/acc4109ff34b49029ba4b893fc74f9bb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:37.183713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ab0c-4e64-4287-ba07-19442e60e3d0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.184317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ab0c-4e64-4287-ba07-19442e60e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.184765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ab0c-4e64-4287-ba07-19442e60e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.234477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.235144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.236019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.264692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-46a8ab0c-4e64-4287-ba07-19442e60e3d0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:37.266240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-46a8ab0c-4e64-4287-ba07-19442e60e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:37.285669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] MFA Rules not processed for user `cc036019a43749cabced900f6ff814a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:37.287156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:37.330261 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:37.489360 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2858/5689] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:37.502334 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2832/5690] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:37.506709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ab0c-4e64-4287-ba07-19442e60e3d0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.525831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ab0c-4e64-4287-ba07-19442e60e3d0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:37.530983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:37.531622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.532061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.532204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.537309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:37.543205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:37.548349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.549851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:37.617336 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2859/5691] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:37 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:37.618506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.671248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14069a-5637-40bd-a2de-18ee775e21ae None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:37.723484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ea4bb-55f3-4b0c-8eca-48cab44157ac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:37.741681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:37.741681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.742223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.742653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.743706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:37.745926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:37.794638 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2860/5692] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:37 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:37.801143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.812661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:37.813294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.814737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.815020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.827123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663cfbb-2605-47c2-9ac6-0a466f4e3dd4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:37.832401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:37.832778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.833137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.833523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.834164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:37.835945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:37.847711 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2861/5693] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:37.853513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:37.854744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.855108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:37.874372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda72710-52ac-4505-a43f-480ae72a3ef1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:37.879679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2833/5694] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:37.886254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:37.887168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:37.889933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:37.890303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] PATH_INFO: `/v3/projects/72b95edf66114feb8b0003e32277fed2/users/c1b88dce54344a09b9219c0bbdcb3f54/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:37.928473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b95edf66114feb8b0003e32277fed2, user_id=c1b88dce54344a09b9219c0bbdcb3f54, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:37.931922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:37.971267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:37.982907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2862/5695] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:37 2022] PUT /identity/v3/projects/72b95edf66114feb8b0003e32277fed2/users/c1b88dce54344a09b9219c0bbdcb3f54/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:37.987922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82827d1d-0433-4ccc-a23f-c4a8bbe295e0 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:38.127764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db7793-1f06-4c85-a574-bda8762573de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:38.129971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db7793-1f06-4c85-a574-bda8762573de admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:38.130721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db7793-1f06-4c85-a574-bda8762573de admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:38.130721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db7793-1f06-4c85-a574-bda8762573de admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:38.131448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db7793-1f06-4c85-a574-bda8762573de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:38.134673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db7793-1f06-4c85-a574-bda8762573de admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:38.154000 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2834/5696] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:38.156645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:38.174067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15264e4f-8702-459f-b46e-74e0305ceb32 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:38.185327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:38.186523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:38.188113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:38.188611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] PATH_INFO: `/v3/projects/72b95edf66114feb8b0003e32277fed2/users/c1b88dce54344a09b9219c0bbdcb3f54/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:38.194253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b95edf66114feb8b0003e32277fed2, user_id=c1b88dce54344a09b9219c0bbdcb3f54, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:38.202304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:38.220477 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:38.236405 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2863/5697] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:38 2022] PUT /identity/v3/projects/72b95edf66114feb8b0003e32277fed2/users/c1b88dce54344a09b9219c0bbdcb3f54/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:38.238106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b328af-0fa6-4c7e-9a1a-3371fe48af01 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:38.239581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b328af-0fa6-4c7e-9a1a-3371fe48af01 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:38.240206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b328af-0fa6-4c7e-9a1a-3371fe48af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:38.297939 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:38.344481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d7b328af-0fa6-4c7e-9a1a-3371fe48af01 None None] MFA Rules not processed for user `c1b88dce54344a09b9219c0bbdcb3f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:38.355727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d7b328af-0fa6-4c7e-9a1a-3371fe48af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:38.611376 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2835/5698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:38.616122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:38.634693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c625c5a-af5f-44e7-86d9-865735e412b7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:38.659534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:38.660278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:38.660620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:38.660976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:38.661698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:38.663620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:38.730922 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2864/5699] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:38 2022] POST /identity/v3/projects => generated 360 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:38.735014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b328af-0fa6-4c7e-9a1a-3371fe48af01 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:38.746763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b328af-0fa6-4c7e-9a1a-3371fe48af01 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:38.859547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:38.860419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:38.860962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:38.861419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-1092529068` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:38.862970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=f2a2a3dd21434bae9845bf0793d99770, value=tempest-tag-1092529068)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:38.865834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:38.941193 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1092529068. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:27:38.941193 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:27:38.941193 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:27:38.991132 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2836/5700] 10.222.0.16 () {60 vars in 1333 bytes} [Sun Sep 11 01:27:38 2022] PUT /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-1092529068 => generated 0 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Sep 11 01:27:38.993012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.009322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b163c6a-2bc0-41ac-8990-3c38b758ac8b tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.021488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.022625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.023958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.026829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-1092529068` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.061773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.063581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=f2a2a3dd21434bae9845bf0793d99770, value=tempest-tag-1092529068)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:39.064152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:39.066660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:39.143054 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2865/5701] 10.222.0.16 () {58 vars in 1314 bytes} [Sun Sep 11 01:27:38 2022] GET /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-1092529068 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:27:39.147106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.181330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab854-e57b-4d10-b72f-c7e6106c59b0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.210018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.211125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.213547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.214056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.222734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=f2a2a3dd21434bae9845bf0793d99770)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:39.232061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:39.248354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a14977-68b9-4b6b-a279-8dea6b5679af tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.256306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.257453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.258145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.258674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.265534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:39.286388 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:39.363196 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2866/5702] 10.222.0.16 () {60 vars in 1265 bytes} [Sun Sep 11 01:27:39 2022] PUT /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags => generated 140 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:27:39.366917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.388147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea66c7-459a-4c9e-ab99-5877241c6421 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.401362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.402313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.403617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.403617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.441869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=f2a2a3dd21434bae9845bf0793d99770)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:39.444219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:39.465949 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2867/5703] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 11 01:27:39 2022] GET /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags => generated 140 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:27:39.469961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.485945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347a45c-03ce-4939-a6ed-f9f8ec7075e1 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.502624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.503454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.503597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.503821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-229123303` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.506281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:39.507186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=f2a2a3dd21434bae9845bf0793d99770, value=tempest-tag-229123303)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:39.507971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:39.518669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:39.523143 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2837/5704] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:39.642132 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-229123303. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:27:39.642132 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:27:39.642132 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:27:39.657696 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2868/5705] 10.222.0.16 () {58 vars in 1314 bytes} [Sun Sep 11 01:27:39 2022] DELETE /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-229123303 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:27:39.658398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.681516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a5f1-c01f-434d-bac6-42c8a70383fb service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.702644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.703380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.703666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.703944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-229123303` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.731265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=f2a2a3dd21434bae9845bf0793d99770, value=tempest-tag-229123303)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:39.737808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Could not find project tag: tempest-tag-229123303.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-229123303. Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Sep 11 01:27:39.771718 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Sep 11 01:27:39.773168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:39.773168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:39.773168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Sep 11 01:27:39.773168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Sep 11 01:27:39.773168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-229123303. Sep 11 01:27:39.773168 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:27:39.782496 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2838/5706] 10.222.0.16 () {58 vars in 1311 bytes} [Sun Sep 11 01:27:39 2022] GET /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags/tempest-tag-229123303 => generated 106 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:27:39.798328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.812517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cb31b-0cb0-4d0e-90a2-f24575667ab0 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.819333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.820098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.820578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.821505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.822950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=f2a2a3dd21434bae9845bf0793d99770)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:39.825571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:39.899532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:39.900256 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2869/5707] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:27:39 2022] DELETE /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:39.918637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f4fee-bf9c-4f9e-9f4b-f558fa192ce5 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:39.937905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:39.938577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:39.938865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:39.939148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:39.997006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=f2a2a3dd21434bae9845bf0793d99770)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:40.006791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:40.034516 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2839/5708] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 11 01:27:39 2022] GET /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770/tags => generated 66 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 11 01:27:40.041661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:40.053146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350fc84-71bc-46b9-a499-3becc4045433 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:40.064227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1b88dce54344a09b9219c0bbdcb3f54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72b95edf66114feb8b0003e32277fed2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:40.066487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:40.066862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:40.069220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] PATH_INFO: `/v3/projects/f2a2a3dd21434bae9845bf0793d99770` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:40.075326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2a2a3dd21434bae9845bf0793d99770)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:40.077686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:40.189620 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:40.226700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a2a3dd21434bae9845bf0793d99770', 'request_id': 'req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.247300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a2a3dd21434bae9845bf0793d99770', 'request_id': 'req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.261290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a2a3dd21434bae9845bf0793d99770', 'request_id': 'req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.299404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] The token cache is being invalidate because project f2a2a3dd21434bae9845bf0793d99770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:40.306376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.307421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2e1b8e35-9251-4a6c-b822-0d9f25c5eaa7 tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.313624 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2870/5709] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:40 2022] DELETE /identity/v3/projects/f2a2a3dd21434bae9845bf0793d99770 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:40.314769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:40.317023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:40.362962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5d7c-152f-4a63-b8f9-1e190d2f2bed tempest-IdentityV3ProjectTagsTest-1175842990 tempest-IdentityV3ProjectTagsTest-1175842990-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:40.532342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:40.533296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:40.533296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:40.533660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] PATH_INFO: `/v3/users/cc036019a43749cabced900f6ff814a2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:40.536212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc036019a43749cabced900f6ff814a2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:40.538195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:40.693681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc036019a43749cabced900f6ff814a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.695652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc036019a43749cabced900f6ff814a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.697564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc036019a43749cabced900f6ff814a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.716332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc036019a43749cabced900f6ff814a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.729899 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:40.746287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc036019a43749cabced900f6ff814a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:40.781598 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2840/5710] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:40 2022] DELETE /identity/v3/users/cc036019a43749cabced900f6ff814a2 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:40.786749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e0c4-e53f-4b52-b4e7-a6a858d15bd0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:40.786749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e0c4-e53f-4b52-b4e7-a6a858d15bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:40.787319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e0c4-e53f-4b52-b4e7-a6a858d15bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:40.863283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d853e0c4-e53f-4b52-b4e7-a6a858d15bd0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:40.866684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d853e0c4-e53f-4b52-b4e7-a6a858d15bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:41.012070 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2871/5711] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:41.033103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:41.036213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:41.214925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b1903-cba5-4072-8d13-1523d844572d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:41.239385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:41.239895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:41.240164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:41.240516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:41.275185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:41.276961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:41.341324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2841/5712] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:41.776256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd114bcc-971c-4772-a8a2-4a7bc7eca684 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:41.776544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd114bcc-971c-4772-a8a2-4a7bc7eca684 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:41.776818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd114bcc-971c-4772-a8a2-4a7bc7eca684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:41.862799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dd114bcc-971c-4772-a8a2-4a7bc7eca684 None None] MFA Rules not processed for user `acc4109ff34b49029ba4b893fc74f9bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:41.864022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dd114bcc-971c-4772-a8a2-4a7bc7eca684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:42.116828 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2872/5713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:42.121985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:42.127015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:42.160740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2dec-108b-49a4-8df7-aa44c6f8835f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:42.175619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:42.175619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:42.176509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:42.176509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:42.177329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:42.180667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:42.256987 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2842/5714] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:42 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:42.262054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd114bcc-971c-4772-a8a2-4a7bc7eca684 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:42.286532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd114bcc-971c-4772-a8a2-4a7bc7eca684 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:42.372594 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:42.378098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:42.378977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:42.379802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:42.379802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:42.380387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:42.383232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:42.410524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:42.414758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:42.433885 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2873/5715] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:42 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:42.435568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:42.457163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f844c-073b-4e77-82e9-63fc4fd27222 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:42.467238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:42.468074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:42.468453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:42.468879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:42.469706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:42.473375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:42.498923 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2874/5716] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:42.501338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:42.544160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc2573-d714-4427-a855-a5dc6679e748 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:42.557086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:42.559033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:42.560420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:42.561322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] PATH_INFO: `/v3/projects/a8f9ab6368894cbfa20305df37c9476f/users/8e65b86393ce43cc8c69be3ad2f91f93/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:42.609791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d311-2505-4ad0-ab6a-715a67135c53 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:42.610934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f9ab6368894cbfa20305df37c9476f, user_id=8e65b86393ce43cc8c69be3ad2f91f93, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:42.615340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:42.628225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:42.628947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:42.629291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:42.629565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:42.635420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:42.650467 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2875/5717] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:42 2022] PUT /identity/v3/projects/a8f9ab6368894cbfa20305df37c9476f/users/8e65b86393ce43cc8c69be3ad2f91f93/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:42.652274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:42.684591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:42.686099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:42.703458 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2843/5718] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:42.857145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95380-364d-4ca3-aedc-c96a32c6b0fa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:42.878937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:42.879701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:42.880109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:42.880488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:42.881291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:42.883950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:42.914702 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2876/5719] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:27:42.919249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:42.934896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cdbc2-b0bd-4fed-9433-5d481973c8ad service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:42.949713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:42.950728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:42.951195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:42.951637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] PATH_INFO: `/v3/projects/a8f9ab6368894cbfa20305df37c9476f/users/8e65b86393ce43cc8c69be3ad2f91f93/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:42.959186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f9ab6368894cbfa20305df37c9476f, user_id=8e65b86393ce43cc8c69be3ad2f91f93, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:42.967298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:42.989099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2844/5720] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:42 2022] PUT /identity/v3/projects/a8f9ab6368894cbfa20305df37c9476f/users/8e65b86393ce43cc8c69be3ad2f91f93/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:43.411756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:43.414134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:43.441474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761784-6357-46cc-adcd-6e7e2e910c95 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:43.585973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:43.586857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:43.587340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:43.587722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] PATH_INFO: `/v3/projects/686574e20fdd4e8380732f4d3dc01c2b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:43.589224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686574e20fdd4e8380732f4d3dc01c2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:43.591661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:43.669823 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:43.684032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686574e20fdd4e8380732f4d3dc01c2b', 'request_id': 'req-136cd05e-615c-4d25-978d-d42da8deb099'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:43.720760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686574e20fdd4e8380732f4d3dc01c2b', 'request_id': 'req-136cd05e-615c-4d25-978d-d42da8deb099'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:43.735809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686574e20fdd4e8380732f4d3dc01c2b', 'request_id': 'req-136cd05e-615c-4d25-978d-d42da8deb099'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:43.765306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] The token cache is being invalidate because project 686574e20fdd4e8380732f4d3dc01c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:43.765606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:43.769665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:43.775581 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2877/5721] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:43 2022] DELETE /identity/v3/projects/686574e20fdd4e8380732f4d3dc01c2b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:43.777609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:43.780703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:43.819212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8485c-c152-4b9a-8058-75d5ad07514a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:43.912529 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:43.932727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:43.933711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:43.934186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:43.934612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] PATH_INFO: `/v3/users/c1b88dce54344a09b9219c0bbdcb3f54` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:43.936214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b88dce54344a09b9219c0bbdcb3f54)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:43.938671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:44.014621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b88dce54344a09b9219c0bbdcb3f54'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:44.015527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b88dce54344a09b9219c0bbdcb3f54'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:44.016228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b88dce54344a09b9219c0bbdcb3f54'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:44.029502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b88dce54344a09b9219c0bbdcb3f54'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:44.063994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef6be02b-4ea2-49da-9efd-f8e31896b7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b88dce54344a09b9219c0bbdcb3f54'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:44.095033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2845/5722] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:43 2022] DELETE /identity/v3/users/c1b88dce54344a09b9219c0bbdcb3f54 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:44.819226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:44.821604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:44.839583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cd05e-615c-4d25-978d-d42da8deb099 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:44.904208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:44.905315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:44.905852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:44.906358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] PATH_INFO: `/v3/users/35972fec72c54617aee1c59893c4f8ee` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:44.907848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35972fec72c54617aee1c59893c4f8ee)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:44.910279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:45.004373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35972fec72c54617aee1c59893c4f8ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.005586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35972fec72c54617aee1c59893c4f8ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.006414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35972fec72c54617aee1c59893c4f8ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.031273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35972fec72c54617aee1c59893c4f8ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.044508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35972fec72c54617aee1c59893c4f8ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.115223 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2878/5723] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:44 2022] DELETE /identity/v3/users/35972fec72c54617aee1c59893c4f8ee => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:45.120430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9db0-a8c4-42b5-9430-6f0aa7af3a61 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:45.121014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9db0-a8c4-42b5-9430-6f0aa7af3a61 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:45.121014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9db0-a8c4-42b5-9430-6f0aa7af3a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:45.164034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a67c9db0-a8c4-42b5-9430-6f0aa7af3a61 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:45.166338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a67c9db0-a8c4-42b5-9430-6f0aa7af3a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:45.221706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:45.223191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:45.329380 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2846/5724] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:45.357993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c9db0-a8c4-42b5-9430-6f0aa7af3a61 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:45.358519 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:45.370386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927162ce-e7eb-4829-8b7c-8f95b985c605 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:45.380266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3681a6-4336-4c65-b76a-cfe4feae7da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:45.381728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3681a6-4336-4c65-b76a-cfe4feae7da3 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:45.383807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3681a6-4336-4c65-b76a-cfe4feae7da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:45.386438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3681a6-4336-4c65-b76a-cfe4feae7da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:45.390180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6d3681a6-4336-4c65-b76a-cfe4feae7da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:45.394085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c9db0-a8c4-42b5-9430-6f0aa7af3a61 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:45.409178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:45.409875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:45.410160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:45.410433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:45.425684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:45.427136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:45.450235 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2847/5725] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:45.481202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:45.482710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:45.513755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eb71b-00dd-4518-8983-7b3c2a4e0d89 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:45.566683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:45.569193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:45.569805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:45.572680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] PATH_INFO: `/v3/projects/72b95edf66114feb8b0003e32277fed2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:45.576073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b95edf66114feb8b0003e32277fed2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:45.585136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:45.600903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3681a6-4336-4c65-b76a-cfe4feae7da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:45.604151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3681a6-4336-4c65-b76a-cfe4feae7da3 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:45.631369 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2879/5726] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:45.716891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b95edf66114feb8b0003e32277fed2', 'request_id': 'req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.719833 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:45.738697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b95edf66114feb8b0003e32277fed2', 'request_id': 'req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.755681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b95edf66114feb8b0003e32277fed2', 'request_id': 'req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.781580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] The token cache is being invalidate because project 72b95edf66114feb8b0003e32277fed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:45.781872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.782482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f61847e6-bf9e-4585-bb9b-6a1b2d1ecdb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:45.784560 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2848/5727] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:45 2022] DELETE /identity/v3/projects/72b95edf66114feb8b0003e32277fed2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:27:45.790382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a444d-52da-4027-b6d6-26502683ca8e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:45.790672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a444d-52da-4027-b6d6-26502683ca8e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:45.790934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a444d-52da-4027-b6d6-26502683ca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:45.840596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e87a444d-52da-4027-b6d6-26502683ca8e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:45.843195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e87a444d-52da-4027-b6d6-26502683ca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:45.967317 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2880/5728] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:45.967647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102ec21-412c-49dc-9380-89951e6def6d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:45.968073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102ec21-412c-49dc-9380-89951e6def6d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:45.968401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102ec21-412c-49dc-9380-89951e6def6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.027661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0102ec21-412c-49dc-9380-89951e6def6d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:46.028975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0102ec21-412c-49dc-9380-89951e6def6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:46.058852 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2849/5729] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:27:46.063239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a444d-52da-4027-b6d6-26502683ca8e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.080260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a444d-52da-4027-b6d6-26502683ca8e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.101846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.103708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.104362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.104743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.105613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:46.106012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.110768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.130754 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2881/5730] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:46.131138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102ec21-412c-49dc-9380-89951e6def6d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.155727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102ec21-412c-49dc-9380-89951e6def6d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.168388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.169383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.170772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.171120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.172373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.177012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.220165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2850/5731] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:46 2022] POST /identity/v3/projects => generated 395 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:46.220412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.244849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4cec7-44a4-4431-8351-9706fd52664d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.260527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.265785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:46.376063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.376697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.376976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.382313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.383935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.387500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.416491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f184e3-141d-4f40-944b-68fa12e85ac1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.430448 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2882/5732] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:46 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:46.432553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.439294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.443458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.443741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.444035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] PATH_INFO: `/v3/projects/406e069f47154e33908bba41762b90eb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.445931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=406e069f47154e33908bba41762b90eb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.454223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303d30-eafe-4341-abe7-a75544db38e5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.455244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.469638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.470756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.471298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.471785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.473004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.475061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.476916 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:46.506446 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2883/5733] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:46.508328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.534753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e62aac-59da-44f6-8a49-0b81dc2398d0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.549088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.550085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.551506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.551902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.553248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.558697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.567266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406e069f47154e33908bba41762b90eb', 'request_id': 'req-491c40e2-56e8-4d57-8d4e-93d2d00680bf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.576591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406e069f47154e33908bba41762b90eb', 'request_id': 'req-491c40e2-56e8-4d57-8d4e-93d2d00680bf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.592391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406e069f47154e33908bba41762b90eb', 'request_id': 'req-491c40e2-56e8-4d57-8d4e-93d2d00680bf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.592752 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2884/5734] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:46.594021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.607665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416847f-7cd6-4350-8ce0-96c58f4b5056 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.613915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] The token cache is being invalidate because project 406e069f47154e33908bba41762b90eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:46.614139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.615741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.618522 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2851/5735] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:46 2022] DELETE /identity/v3/projects/406e069f47154e33908bba41762b90eb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:46.622451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.624554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:46.692797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa9a6-2792-4da2-9075-a25d55e53a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.693880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa9a6-2792-4da2-9075-a25d55e53a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.694169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa9a6-2792-4da2-9075-a25d55e53a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.705152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa9a6-2792-4da2-9075-a25d55e53a41 admin admin] PATH_INFO: `/v3/projects/5149e6e7e7d74ca593f7156c523c6968/users/3ce01a8687b8476e893d92b69774f8bd/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.714881 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:46.722123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa9a6-2792-4da2-9075-a25d55e53a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5149e6e7e7d74ca593f7156c523c6968, user_id=3ce01a8687b8476e893d92b69774f8bd, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.727997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa9a6-2792-4da2-9075-a25d55e53a41 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.749932 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2885/5736] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:46 2022] PUT /identity/v3/projects/5149e6e7e7d74ca593f7156c523c6968/users/3ce01a8687b8476e893d92b69774f8bd/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:46.750769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c40e2-56e8-4d57-8d4e-93d2d00680bf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:46.765982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.766593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.766916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.823595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] MFA Rules not processed for user `3ce01a8687b8476e893d92b69774f8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:46.825118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:46.832886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:46.833794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:46.834147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:46.834534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] PATH_INFO: `/v3/users/01ed829596604eb39634f9b797db7376` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:46.837148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ed829596604eb39634f9b797db7376)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:46.839583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:46.923050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ed829596604eb39634f9b797db7376'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.924027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ed829596604eb39634f9b797db7376'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.925014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ed829596604eb39634f9b797db7376'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.934761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ed829596604eb39634f9b797db7376'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.945703 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2886/5737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:46.950159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:46.954310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:46.955214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-08cd1a28-6f5a-4695-83a5-9fb21a3a6883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ed829596604eb39634f9b797db7376'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:46.979233 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2852/5738] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:46 2022] DELETE /identity/v3/users/01ed829596604eb39634f9b797db7376 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:27:46.983636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36de2-d514-418a-99a1-be5fbe17bf5c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:47.091788 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:47.120579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb725-ed03-4e01-8d32-d34928a91a2e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.121321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb725-ed03-4e01-8d32-d34928a91a2e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.121833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eb725-ed03-4e01-8d32-d34928a91a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.125363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:47.126004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.126368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.126627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.127291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:47.130025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:47.187440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-009eb725-ed03-4e01-8d32-d34928a91a2e None None] MFA Rules not processed for user `8e65b86393ce43cc8c69be3ad2f91f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:47.189508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-009eb725-ed03-4e01-8d32-d34928a91a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:47.237175 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2887/5739] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:46 2022] POST /identity/v3/projects => generated 395 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:47.240986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:47.294137 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:47.344851 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2853/5740] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:47.356949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.357380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.358044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.384558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] MFA Rules not processed for user `acc4109ff34b49029ba4b893fc74f9bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:47.386305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:47.426088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3d9c-5123-4bdf-9ea8-737c7e8a6c56 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:47.441137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:47.441137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.441137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.441137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.441660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:47.441660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:47.480581 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2888/5741] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:47 2022] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:47.487024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:47.519933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4566d-f7c7-435f-8eaa-ae32cd44e16b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:47.534889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:47.535631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.537336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.537687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.538375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:47.540822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:47.559148 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2889/5742] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:47.563894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:47.572701 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2854/5743] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:47.585264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:47.589575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:47.591751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9a91c-09be-4287-9a5f-57311afffae9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:47.599440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:47.600528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.600973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.601937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] PATH_INFO: `/v3/projects/5bba7c14f1574f64a0937009b2b6b248/users/33b50537f0124c09864359c969668280/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.623760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bba7c14f1574f64a0937009b2b6b248, user_id=33b50537f0124c09864359c969668280, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:47.627020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:47.654720 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2890/5744] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:47 2022] PUT /identity/v3/projects/5bba7c14f1574f64a0937009b2b6b248/users/33b50537f0124c09864359c969668280/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:47.656168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:47.782570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35624e36-dcb2-4fc1-9eb4-c841809c17c7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:47.790195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c3edc-d3db-4b5d-a68b-9d32a4e109ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:47.814526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:47.815203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.816638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.816916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.819754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:47.824815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:47.846773 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2891/5745] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:47.847858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:47.854053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:47.884569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a7208-a54a-4e13-bf0f-80439d29c3ac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:47.893883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:47.895070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.895789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.896298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] PATH_INFO: `/v3/projects/eda34ca5e3a1480195fd28d57b9e483e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.901461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda34ca5e3a1480195fd28d57b9e483e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:47.906267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:47.937468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794eb5ca-9a96-4271-be88-7d1fe5278c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:47.938496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eb5ca-9a96-4271-be88-7d1fe5278c8c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:47.938496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eb5ca-9a96-4271-be88-7d1fe5278c8c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:47.938703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eb5ca-9a96-4271-be88-7d1fe5278c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:47.941599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-794eb5ca-9a96-4271-be88-7d1fe5278c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:47.958427 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:47.984387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda34ca5e3a1480195fd28d57b9e483e', 'request_id': 'req-0b3ff135-722b-4308-a40a-501d2fd036f6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:47.992428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda34ca5e3a1480195fd28d57b9e483e', 'request_id': 'req-0b3ff135-722b-4308-a40a-501d2fd036f6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:48.001366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda34ca5e3a1480195fd28d57b9e483e', 'request_id': 'req-0b3ff135-722b-4308-a40a-501d2fd036f6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:48.015422 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:48.032057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] The token cache is being invalidate because project eda34ca5e3a1480195fd28d57b9e483e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:48.032731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:48.037680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:48.044111 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2892/5746] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:47 2022] DELETE /identity/v3/projects/eda34ca5e3a1480195fd28d57b9e483e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:48.046036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.050459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:48.097825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794eb5ca-9a96-4271-be88-7d1fe5278c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.099747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794eb5ca-9a96-4271-be88-7d1fe5278c8c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.112131 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2855/5747] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:48.114051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49645-7d5c-4712-aed6-3423ddc1a3e8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.114556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49645-7d5c-4712-aed6-3423ddc1a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.115041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49645-7d5c-4712-aed6-3423ddc1a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.141771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-86e49645-7d5c-4712-aed6-3423ddc1a3e8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:48.144283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-86e49645-7d5c-4712-aed6-3423ddc1a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:48.169596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ff135-722b-4308-a40a-501d2fd036f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.175170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e06aa7-dab2-471a-968b-388fcaf57f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.176186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e06aa7-dab2-471a-968b-388fcaf57f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.176186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e06aa7-dab2-471a-968b-388fcaf57f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.176479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e06aa7-dab2-471a-968b-388fcaf57f21 admin admin] PATH_INFO: `/v3/projects/5bba7c14f1574f64a0937009b2b6b248/users/33b50537f0124c09864359c969668280/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.178542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e06aa7-dab2-471a-968b-388fcaf57f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bba7c14f1574f64a0937009b2b6b248, user_id=33b50537f0124c09864359c969668280, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.183269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e06aa7-dab2-471a-968b-388fcaf57f21 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.195335 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2893/5748] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:48 2022] PUT /identity/v3/projects/5bba7c14f1574f64a0937009b2b6b248/users/33b50537f0124c09864359c969668280/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:48.205986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.206362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.206706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.246412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] MFA Rules not processed for user `33b50537f0124c09864359c969668280`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:48.248787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:48.274356 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2856/5749] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:48.284454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce48ab-059a-462d-8845-8faf76c51fe2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.284889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce48ab-059a-462d-8845-8faf76c51fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.285253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce48ab-059a-462d-8845-8faf76c51fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.331818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c3ce48ab-059a-462d-8845-8faf76c51fe2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:48.333995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c3ce48ab-059a-462d-8845-8faf76c51fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:48.367716 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2894/5750] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:27:48.372442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.374576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:48.441670 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2857/5751] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:48.443027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce48ab-059a-462d-8845-8faf76c51fe2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.456872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce48ab-059a-462d-8845-8faf76c51fe2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.458261 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:48.469028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.470137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.470618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.471175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.473574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:48.474337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.481388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.514956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7dc89-43d2-4306-a949-e82ce8ad3009 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.533123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2858/5752] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:48.534054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ce01a8687b8476e893d92b69774f8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5149e6e7e7d74ca593f7156c523c6968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.535155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.535280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.535559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.536252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.536545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Sep 11 01:27:48.543372 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 11 01:27:48.544476 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.545420 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2895/5753] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/projects => generated 136 bytes in 173 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:27:48.550780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.562677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce25a-ca29-4bd8-b5a9-25ad56564ad5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.571254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.572216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.572736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d1f0b-8615-4947-871d-962d978ba215 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.572887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.573635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.574568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.577593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.577860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b50537f0124c09864359c969668280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bba7c14f1574f64a0937009b2b6b248', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.578452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.578733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.580281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.580992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.583655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Invalid input for field 'name': '' is too short Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: On instance['name']: Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: On instance['name']: Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: '' Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise error Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application '' Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.594526 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:27:48.596353 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application '' Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.598105 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2896/5754] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/projects => generated 283 bytes in 47 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:27:48.602324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.618674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba9e21-68bb-40da-a91e-09dc466a3b59 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.631762 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2859/5755] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:48.632002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b50537f0124c09864359c969668280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bba7c14f1574f64a0937009b2b6b248', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.632713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.632987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.633278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.633897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.635740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.636372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: On instance['name']: Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: On instance['name']: Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise error Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:48.652987 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:48.654633 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['name']: Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.655871 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2897/5756] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/projects => generated 412 bytes in 53 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:27:48.659975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.672919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff2e3-2779-4199-8d46-92462b8549f8 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.699926 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:48.743742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf608f-1314-4410-89ce-508f30b5d4fc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.753255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.753903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.754187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.754952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.755676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.757053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b50537f0124c09864359c969668280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bba7c14f1574f64a0937009b2b6b248', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.758500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.758651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.759133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.759603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] PATH_INFO: `/v3/projects/607c5a15bbd94a6c9288576848b22d63` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.768166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=607c5a15bbd94a6c9288576848b22d63)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.770902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Could not find project: 607c5a15bbd94a6c9288576848b22d63.: keystone.exception.ProjectNotFound: Could not find project: 607c5a15bbd94a6c9288576848b22d63. Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 11 01:27:48.786338 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 607c5a15bbd94a6c9288576848b22d63. Sep 11 01:27:48.787515 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.788220 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2860/5757] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:48.791133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.792713 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2898/5758] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:48 2022] DELETE /identity/v3/projects/607c5a15bbd94a6c9288576848b22d63 => generated 113 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:27:48.797866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.806723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825348b3-f1d7-4d31-aded-6757564d2c05 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.813099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.813950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.814410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.814817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.815682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.818016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.832881 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2861/5759] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:27:48.837716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.850574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10843bb0-5ca4-42f0-8f27-fdf13ebc8e0f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.859300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.859932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.860595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.860595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.862433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.864864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.885104 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2862/5760] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:48.888017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea068720-09e0-4aa7-8ddd-514239a49665 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.889333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.893001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ce01a8687b8476e893d92b69774f8bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5149e6e7e7d74ca593f7156c523c6968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.894118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.894441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.894742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.895696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Sep 11 01:27:48.903944 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._list_projects() Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 11 01:27:48.905185 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:48.906706 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2899/5761] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:27:48 2022] GET /identity/v3/projects => generated 135 bytes in 109 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:27:48.910026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d428a-167d-4f3a-b1dc-c99f39948ab1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.911795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:48.917761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6e9b3-9537-46e6-a60e-3c2c6e26ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.918898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e9b3-9537-46e6-a60e-3c2c6e26ea63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.919356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e9b3-9537-46e6-a60e-3c2c6e26ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.919925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6e9b3-9537-46e6-a60e-3c2c6e26ea63 admin admin] PATH_INFO: `/v3/projects/094cf8bf8e9e43e499ab10f88cd02781/users/16c02eb6734a49eda0b126e3c5231f2a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.931285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb95ae-e8a9-401c-953d-5ed34d81a415 tempest-ProjectsNegativeStaticTestJSON-947395437 tempest-ProjectsNegativeStaticTestJSON-947395437-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:48.939851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b50537f0124c09864359c969668280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bba7c14f1574f64a0937009b2b6b248', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:48.940707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.941178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.941522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:48.942309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6e9b3-9537-46e6-a60e-3c2c6e26ea63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094cf8bf8e9e43e499ab10f88cd02781, user_id=16c02eb6734a49eda0b126e3c5231f2a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.942444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:48.944405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.947064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6e9b3-9537-46e6-a60e-3c2c6e26ea63 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:48.972752 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2863/5762] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:48 2022] PUT /identity/v3/projects/094cf8bf8e9e43e499ab10f88cd02781/users/16c02eb6734a49eda0b126e3c5231f2a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:48.984671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48704-1326-45e0-bd6d-96bcff5a98ed None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:48.988600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48704-1326-45e0-bd6d-96bcff5a98ed None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:48.989271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48704-1326-45e0-bd6d-96bcff5a98ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:49.005101 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2900/5763] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/projects => generated 357 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:49.009429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:49.035169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8fd48704-1326-45e0-bd6d-96bcff5a98ed None None] MFA Rules not processed for user `16c02eb6734a49eda0b126e3c5231f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:49.036561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8fd48704-1326-45e0-bd6d-96bcff5a98ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:49.110142 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:49.138172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96b16-3a4d-4c66-8fc2-91b719787d81 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:49.149584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b50537f0124c09864359c969668280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bba7c14f1574f64a0937009b2b6b248', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:49.150227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:49.150513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:49.150793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:49.154907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:49.157035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:49.169304 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2864/5764] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:49.170978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd48704-1326-45e0-bd6d-96bcff5a98ed None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:49.212103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.sql.core [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-792531281' for key 'project.ixu_project_name_domain_id'") Sep 11 01:27:49.212103 n-d-master-1 devstack@keystone.service[81859]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 01:27:49.212103 n-d-master-1 devstack@keystone.service[81859]: [parameters: {'id': 'f8b495745d65462e9f9c51479be908e9', 'name': 'tempest-project-dup-792531281', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 01:27:49.212103 n-d-master-1 devstack@keystone.service[81859]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81859) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-792531281, project id f8b495745d65462e9f9c51479be908e9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-792531281, project id f8b495745d65462e9f9c51479be908e9. Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 01:27:49.236237 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-792531281' for key 'project.ixu_project_name_domain_id'") Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 01:27:49.237373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application yield resource Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application next(self.gen) Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise self.value Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 01:27:49.238570 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application session.commit() Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.session.flush() Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application compat.raise_( Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 01:27:49.239796 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 01:27:49.241018 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application conn.query(q) Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application result.read() Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 01:27:49.242801 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-792531281' for key 'project.ixu_project_name_domain_id'") Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [parameters: {'id': 'f8b495745d65462e9f9c51479be908e9', 'name': 'tempest-project-dup-792531281', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:49.244123 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-792531281 at domain ID default. Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:27:49.249478 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-792531281, project id f8b495745d65462e9f9c51479be908e9. Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2901/5765] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:27:49 2022] POST /identity/v3/projects => generated 284 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 01:27:49.253006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:49.268202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ef261-aab7-4620-a00e-6ad48a8d747d tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:49.291299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33b50537f0124c09864359c969668280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bba7c14f1574f64a0937009b2b6b248', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:49.292924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:49.293316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:49.295121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] PATH_INFO: `/v3/projects/a9372faef7b1473096ecdcf62c0110d3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:49.296582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9372faef7b1473096ecdcf62c0110d3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:49.303476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:49.318317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd48704-1326-45e0-bd6d-96bcff5a98ed None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:49.331611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:49.332810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:49.332810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:49.333889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:49.334829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:49.338247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:49.358597 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:49.381115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2865/5766] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:49 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:49.381735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:49.463343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c45c-50c0-472f-af6e-3ae8bfcf3c45 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:49.490866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9372faef7b1473096ecdcf62c0110d3', 'request_id': 'req-6734e331-f7ea-4a3c-9ba0-a695d7653329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.507920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9372faef7b1473096ecdcf62c0110d3', 'request_id': 'req-6734e331-f7ea-4a3c-9ba0-a695d7653329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.536871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9372faef7b1473096ecdcf62c0110d3', 'request_id': 'req-6734e331-f7ea-4a3c-9ba0-a695d7653329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.578551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] The token cache is being invalidate because project a9372faef7b1473096ecdcf62c0110d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:49.578551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.580014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.584473 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2902/5767] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:49 2022] DELETE /identity/v3/projects/a9372faef7b1473096ecdcf62c0110d3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:49.585861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:49.590632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:49.613343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:49.613883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:49.614171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:49.614450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:49.617292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:49.626501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:49.703306 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2866/5768] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:49 2022] POST /identity/v3/users => generated 291 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:49.704347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:49.710364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:49.727376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966a760-41c8-422f-a123-dd715f20a621 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:49.742378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:49.744272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:49.744612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:49.745316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] PATH_INFO: `/v3/users/3ce01a8687b8476e893d92b69774f8bd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:49.746279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce01a8687b8476e893d92b69774f8bd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:49.748278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:49.806404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734e331-f7ea-4a3c-9ba0-a695d7653329 tempest-ProjectsNegativeStaticTestJSON-103195919 tempest-ProjectsNegativeStaticTestJSON-103195919-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:49.824075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80aea7-44de-45ca-9b35-20b2f9613e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:49.824656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80aea7-44de-45ca-9b35-20b2f9613e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:49.824935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80aea7-44de-45ca-9b35-20b2f9613e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:49.825227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80aea7-44de-45ca-9b35-20b2f9613e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:49.827026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ab80aea7-44de-45ca-9b35-20b2f9613e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:49.938996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce01a8687b8476e893d92b69774f8bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.939998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce01a8687b8476e893d92b69774f8bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.940646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce01a8687b8476e893d92b69774f8bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.950111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce01a8687b8476e893d92b69774f8bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:49.964977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce01a8687b8476e893d92b69774f8bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:50.005770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2867/5769] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:49 2022] DELETE /identity/v3/users/3ce01a8687b8476e893d92b69774f8bd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:50.005770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:50.005770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:50.016197 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:50.026108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80aea7-44de-45ca-9b35-20b2f9613e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:50.031415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80aea7-44de-45ca-9b35-20b2f9613e05 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:50.071460 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2903/5770] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:50.073465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75746ff6-f05e-494c-b3ff-decde8db18df None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.073887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75746ff6-f05e-494c-b3ff-decde8db18df None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.074364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75746ff6-f05e-494c-b3ff-decde8db18df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.091184 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:50.149945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-75746ff6-f05e-494c-b3ff-decde8db18df None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:50.151501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-75746ff6-f05e-494c-b3ff-decde8db18df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:50.182440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c7424-d6f5-49fa-bbb3-07807274ee2a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:50.197611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:50.198549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.198977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.199259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.199923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:50.207065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:50.246891 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2904/5771] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:50.248516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc860-c624-4a93-b746-748f6fdfad35 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.248814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc860-c624-4a93-b746-748f6fdfad35 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.249192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc860-c624-4a93-b746-748f6fdfad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.254862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2868/5772] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:50.261306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:50.272831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e12c-dcd0-4c36-913c-bdca3f67e40b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:50.278791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:50.279464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.279747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.280023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] PATH_INFO: `/v3/projects/091134bb5e93496dbbfa058b854dbbdb/users/48ae99c77f8b48159376422dbc707de5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.297715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=091134bb5e93496dbbfa058b854dbbdb, user_id=48ae99c77f8b48159376422dbc707de5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:50.300342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e52bc860-c624-4a93-b746-748f6fdfad35 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:50.300490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:50.303466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e52bc860-c624-4a93-b746-748f6fdfad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:50.323136 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2869/5773] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:50 2022] PUT /identity/v3/projects/091134bb5e93496dbbfa058b854dbbdb/users/48ae99c77f8b48159376422dbc707de5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:50.324012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:50.331827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:50.568577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63ce7e-ee8e-4d6b-93b3-15fc5c5bdacb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:50.583401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:50.584042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.584322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.584597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.611534 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2905/5774] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:50.611534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc860-c624-4a93-b746-748f6fdfad35 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:50.643493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc860-c624-4a93-b746-748f6fdfad35 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:50.659778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:50.660594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.660884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.661292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.661954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:50.665339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:50.711041 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2906/5775] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:50.713234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:50.719170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:50.723089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:50.725255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:50.766193 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2870/5776] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:27:50.767207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:50.796100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee50315-9266-4222-b016-20ce559f82c3 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:50.809915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700554e-f2a0-4581-a496-1ed73d441ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:50.810615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700554e-f2a0-4581-a496-1ed73d441ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.810894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700554e-f2a0-4581-a496-1ed73d441ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.811178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700554e-f2a0-4581-a496-1ed73d441ab8 admin admin] PATH_INFO: `/v3/projects/091134bb5e93496dbbfa058b854dbbdb/users/48ae99c77f8b48159376422dbc707de5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.814532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700554e-f2a0-4581-a496-1ed73d441ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091134bb5e93496dbbfa058b854dbbdb, user_id=48ae99c77f8b48159376422dbc707de5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:50.821034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700554e-f2a0-4581-a496-1ed73d441ab8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:50.823986 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:50.852161 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2871/5777] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:50 2022] PUT /identity/v3/projects/091134bb5e93496dbbfa058b854dbbdb/users/48ae99c77f8b48159376422dbc707de5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:50.863503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:50.863797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:50.864110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:50.904734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] MFA Rules not processed for user `48ae99c77f8b48159376422dbc707de5`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:50.906093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:50.966377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc53caa-6840-4ff3-8514-b43190aa0696 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:51.029803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2872/5778] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:51.031018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:51.032541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:51.068855 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:51.125612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1788f-4e90-45f3-ab8f-1367b35e1aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:51.127486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1788f-4e90-45f3-ab8f-1367b35e1aae service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:51.127779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1788f-4e90-45f3-ab8f-1367b35e1aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:51.128091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1788f-4e90-45f3-ab8f-1367b35e1aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:51.173258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed99d1f-a608-4970-8164-0c3f06fad2b6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:51.206519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:51.208275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:51.209442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:51.209837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:51.264144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:51.267516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:51.271092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1788f-4e90-45f3-ab8f-1367b35e1aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:51.272465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1788f-4e90-45f3-ab8f-1367b35e1aae service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:51.292193 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2907/5779] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:51.293538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:51.293828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:51.294107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:51.327912 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2873/5780] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:51.329183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] MFA Rules not processed for user `f01b6459a5c54bafba0ddf73cfd1e399`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:51.330415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:51.428207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:51.428946 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2908/5781] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:51.434851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:51.477158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d30f4b-917e-4e82-a4a3-45ebb1b71a35 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:51.490883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:51.491564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:51.492459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:51.492912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:51.502064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:51.765675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:51.770807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:51.838093 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2874/5782] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:27:52.987927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:52.989465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:53.018504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cbd00-bb1b-4357-a511-c6e8d2c54d0f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:53.030676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:53.031458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:53.033559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:53.033957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] PATH_INFO: `/v3/projects/5149e6e7e7d74ca593f7156c523c6968` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:53.041833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5149e6e7e7d74ca593f7156c523c6968)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:53.044005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:53.158405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5149e6e7e7d74ca593f7156c523c6968', 'request_id': 'req-dc4dec50-13d9-42fc-9821-32128f1f5226'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.179619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5149e6e7e7d74ca593f7156c523c6968', 'request_id': 'req-dc4dec50-13d9-42fc-9821-32128f1f5226'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.190071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5149e6e7e7d74ca593f7156c523c6968', 'request_id': 'req-dc4dec50-13d9-42fc-9821-32128f1f5226'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.224133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] The token cache is being invalidate because project 5149e6e7e7d74ca593f7156c523c6968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:53.224484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.225904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.230848 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2909/5783] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:52 2022] DELETE /identity/v3/projects/5149e6e7e7d74ca593f7156c523c6968 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:53.235766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:53.266938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f67fa-1c2d-47d5-a9c6-fd533e1ce4d2 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:53.302663 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:53.417880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:53.418558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:53.418839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:53.419307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] PATH_INFO: `/v3/users/33b50537f0124c09864359c969668280` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:53.421334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b50537f0124c09864359c969668280)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:53.423578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:53.564616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b50537f0124c09864359c969668280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.565475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b50537f0124c09864359c969668280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.566466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b50537f0124c09864359c969668280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.578989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b50537f0124c09864359c969668280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.653846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b50537f0124c09864359c969668280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:53.678047 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2875/5784] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:53 2022] DELETE /identity/v3/users/33b50537f0124c09864359c969668280 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:53.778388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:53.780673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:53.818808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dec50-13d9-42fc-9821-32128f1f5226 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:53.845860 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:54.018504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:54.019209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:54.019431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:54.019711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] PATH_INFO: `/v3/users/5570c8ed79ec4196aa73b96a03ee17c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:54.020898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5570c8ed79ec4196aa73b96a03ee17c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:54.022982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:54.189820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5570c8ed79ec4196aa73b96a03ee17c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:54.192055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5570c8ed79ec4196aa73b96a03ee17c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:54.193015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5570c8ed79ec4196aa73b96a03ee17c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:54.248265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5570c8ed79ec4196aa73b96a03ee17c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:54.270148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5570c8ed79ec4196aa73b96a03ee17c7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:54.314787 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2910/5785] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:53 2022] DELETE /identity/v3/users/5570c8ed79ec4196aa73b96a03ee17c7 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:55.651587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:55.653915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:55.683469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356f6a-d553-4954-89d0-fb2e9cbe8893 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:55.951173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:55.951870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:55.952158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:55.952437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] PATH_INFO: `/v3/projects/5bba7c14f1574f64a0937009b2b6b248` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:55.966739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bba7c14f1574f64a0937009b2b6b248)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:55.985726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:56.122559 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:56.134438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bba7c14f1574f64a0937009b2b6b248', 'request_id': 'req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.152431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bba7c14f1574f64a0937009b2b6b248', 'request_id': 'req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.165870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bba7c14f1574f64a0937009b2b6b248', 'request_id': 'req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.180698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:56.182172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:56.212961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] The token cache is being invalidate because project 5bba7c14f1574f64a0937009b2b6b248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:56.221530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.222246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ffd2c-3d0d-4ff7-bb3f-0b807903f940 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:56.223413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b309bcc-ee48-40d0-81b7-6a1ea3e17c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.233107 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2876/5786] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:55 2022] DELETE /identity/v3/projects/5bba7c14f1574f64a0937009b2b6b248 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:56.241346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82873-1db4-4772-a66a-b311b95fd2b8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:56.242300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82873-1db4-4772-a66a-b311b95fd2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:56.242535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f82873-1db4-4772-a66a-b311b95fd2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:56.324216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a2f82873-1db4-4772-a66a-b311b95fd2b8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:56.342926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a2f82873-1db4-4772-a66a-b311b95fd2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:56.522368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:56.525150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:56.525849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:56.527465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] PATH_INFO: `/v3/projects/5e482bb6669345ee89472fa739a9cc9f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:56.531939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e482bb6669345ee89472fa739a9cc9f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:56.549504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:56.636198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2877/5787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:56.636198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123147a5-6d9d-4d61-aa73-808cbba69250 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:56.636198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123147a5-6d9d-4d61-aa73-808cbba69250 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:56.636198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123147a5-6d9d-4d61-aa73-808cbba69250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:56.698629 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:56.717017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-123147a5-6d9d-4d61-aa73-808cbba69250 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:56.718327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-123147a5-6d9d-4d61-aa73-808cbba69250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:56.728456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e482bb6669345ee89472fa739a9cc9f', 'request_id': 'req-8dfeb754-f8c5-4784-a36b-348f77ffacad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.745495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e482bb6669345ee89472fa739a9cc9f', 'request_id': 'req-8dfeb754-f8c5-4784-a36b-348f77ffacad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.763413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e482bb6669345ee89472fa739a9cc9f', 'request_id': 'req-8dfeb754-f8c5-4784-a36b-348f77ffacad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.787452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] The token cache is being invalidate because project 5e482bb6669345ee89472fa739a9cc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:27:56.789830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.791187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8dfeb754-f8c5-4784-a36b-348f77ffacad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:56.796524 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2911/5788] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:27:56 2022] DELETE /identity/v3/projects/5e482bb6669345ee89472fa739a9cc9f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:27:56.800981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693e38-734a-4ea8-85df-676d6a04f782 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:56.802315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693e38-734a-4ea8-85df-676d6a04f782 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:56.802904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693e38-734a-4ea8-85df-676d6a04f782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:56.880106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fa693e38-734a-4ea8-85df-676d6a04f782 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:56.887593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fa693e38-734a-4ea8-85df-676d6a04f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:56.940661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2878/5789] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:56.955373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123147a5-6d9d-4d61-aa73-808cbba69250 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:56.975757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123147a5-6d9d-4d61-aa73-808cbba69250 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.008796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.009599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.009925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.010307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.010931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:57.011235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.013414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:57.060470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2879/5790] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:27:57.064544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:57.074141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2912/5791] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:57.084156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f480-c50a-4ce2-a514-ab591db781e2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.084643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f480-c50a-4ce2-a514-ab591db781e2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.085106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f480-c50a-4ce2-a514-ab591db781e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.095625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60514fd4-299b-4981-9370-fa0f7e7059ca admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.108733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.110720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.112259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.114770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.115883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.123603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:57.130243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dd66f480-c50a-4ce2-a514-ab591db781e2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:57.135286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dd66f480-c50a-4ce2-a514-ab591db781e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:57.162078 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2913/5792] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:27:57.167338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f480-c50a-4ce2-a514-ab591db781e2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:57.181307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f480-c50a-4ce2-a514-ab591db781e2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.194093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.197660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.198103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.199271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.201465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:27:57.202366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.209965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:57.223718 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2880/5793] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:57 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:57.233000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:57.252846 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2914/5794] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:27:57.254449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:57.281869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c62946-5dfd-4a9c-bed3-832ce13568b4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.322641 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:57.416635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f21c-e98c-48e2-8c5e-884b876b286a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.431967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.434304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.434593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.437761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.438531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.445818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:57.494164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.494991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.495317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.495594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.496231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.499395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:57.563147 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2915/5795] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:57 2022] POST /identity/v3/projects => generated 373 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:57.564319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:57.592539 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2881/5796] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:57 2022] POST /identity/v3/users => generated 300 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:57.593947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:57.667887 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:57.678780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2c77-bd6f-4ba8-9529-e66379569835 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.775566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14089f-7a35-4109-80d1-b6432103d054 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.786940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.787529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.787817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.788133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.790467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.792714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:57.824313 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2916/5797] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:57.832546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:57.890912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3be39-5629-4014-99cd-7c5d360962a5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:57.904708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.906602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.906888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.907296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] PATH_INFO: `/v3/projects/551ca62cf15f4c39a1d879133546a4f6/users/394f6347268f43719b1608c72dc831c5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.921427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:57.922420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:57.922537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:57.923155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:57.928794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.934115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:57.968272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551ca62cf15f4c39a1d879133546a4f6, user_id=394f6347268f43719b1608c72dc831c5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:57.971852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:58.003316 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2917/5798] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:57 2022] PUT /identity/v3/projects/551ca62cf15f4c39a1d879133546a4f6/users/394f6347268f43719b1608c72dc831c5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:58.003316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:58.005801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:58.009651 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2882/5799] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:57 2022] POST /identity/v3/users => generated 287 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:58.011371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:58.031048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e24e81-106a-4b81-a8ab-3dedc13ca2d3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:58.136868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffad93a-4e88-425d-ba23-c3d1c5f2dc65 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:58.151622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:58.152633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.157284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.157784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] PATH_INFO: `/v3/users/16c02eb6734a49eda0b126e3c5231f2a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.159582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c02eb6734a49eda0b126e3c5231f2a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:58.162276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:58.224382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:58.225212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.225666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.227308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.228136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:58.230018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:58.263317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2883/5800] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:58.264598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:58.293886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646f074-2064-4e74-af2e-49d2aa2989f4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:58.302547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c02eb6734a49eda0b126e3c5231f2a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:58.303537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c02eb6734a49eda0b126e3c5231f2a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:58.305186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c02eb6734a49eda0b126e3c5231f2a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:58.325602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:58.329160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.329160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.329160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.337261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:58.339369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:58.362139 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2884/5801] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:58.362967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c02eb6734a49eda0b126e3c5231f2a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:58.365332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:58.380717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:58.387335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c02eb6734a49eda0b126e3c5231f2a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:27:58.404957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20857401-ea18-492a-810d-5f15097b3511 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:58.414080 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2918/5802] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:27:57 2022] DELETE /identity/v3/users/16c02eb6734a49eda0b126e3c5231f2a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:58.415312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:58.420502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:58.476494 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:58.482036 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:58.509237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab154-c827-4eb9-9670-eb53c3f5b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:58.510042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab154-c827-4eb9-9670-eb53c3f5b91e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.510509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab154-c827-4eb9-9670-eb53c3f5b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.510890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab154-c827-4eb9-9670-eb53c3f5b91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.511915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab154-c827-4eb9-9670-eb53c3f5b91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:58.513956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab154-c827-4eb9-9670-eb53c3f5b91e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:58.527424 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2885/5803] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:58.529019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baabe9-6987-49d9-b073-7e57a4341cb4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.529437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baabe9-6987-49d9-b073-7e57a4341cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.529820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baabe9-6987-49d9-b073-7e57a4341cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.580475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-10baabe9-6987-49d9-b073-7e57a4341cb4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:58.596952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-10baabe9-6987-49d9-b073-7e57a4341cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:58.598874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0461d-17eb-45e4-836b-2e44f396cdd1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:58.618154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f17f3-a465-4ca8-8167-029b6023777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:58.618821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f17f3-a465-4ca8-8167-029b6023777f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.619144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f17f3-a465-4ca8-8167-029b6023777f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.619403 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2886/5804] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:58.626340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f17f3-a465-4ca8-8167-029b6023777f admin admin] PATH_INFO: `/v3/projects/551ca62cf15f4c39a1d879133546a4f6/users/394f6347268f43719b1608c72dc831c5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.635726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baabe9-6987-49d9-b073-7e57a4341cb4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:58.636982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f17f3-a465-4ca8-8167-029b6023777f admin admin] RBAC: Authorizing `identity:create_grant(project_id=551ca62cf15f4c39a1d879133546a4f6, user_id=394f6347268f43719b1608c72dc831c5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:58.650135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f17f3-a465-4ca8-8167-029b6023777f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:58.662481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baabe9-6987-49d9-b073-7e57a4341cb4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:58.678004 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2919/5805] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:58 2022] PUT /identity/v3/projects/551ca62cf15f4c39a1d879133546a4f6/users/394f6347268f43719b1608c72dc831c5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:58.692211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375423f-42a3-4de9-9832-692b3028dc57 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.693001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375423f-42a3-4de9-9832-692b3028dc57 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.693467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375423f-42a3-4de9-9832-692b3028dc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.747857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4375423f-42a3-4de9-9832-692b3028dc57 None None] MFA Rules not processed for user `394f6347268f43719b1608c72dc831c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:58.751552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4375423f-42a3-4de9-9832-692b3028dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:58.824258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:58.824949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:58.825267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:58.825543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] PATH_INFO: `/v3/projects/d7aa9b860a3445edb02e3e42d2779695/users/5f3534b3b8a74eeca871571ea42da1e7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:58.867305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7aa9b860a3445edb02e3e42d2779695, user_id=5f3534b3b8a74eeca871571ea42da1e7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:58.871208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:58.912941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2887/5806] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:58 2022] PUT /identity/v3/projects/d7aa9b860a3445edb02e3e42d2779695/users/5f3534b3b8a74eeca871571ea42da1e7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:27:58.919909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:58.924530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:59.020262 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2920/5807] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:59.021794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898746fa-ce9b-45ec-9281-efa877480778 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.022032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898746fa-ce9b-45ec-9281-efa877480778 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.022131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898746fa-ce9b-45ec-9281-efa877480778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.087758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-898746fa-ce9b-45ec-9281-efa877480778 None None] MFA Rules not processed for user `5f3534b3b8a74eeca871571ea42da1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:27:59.089021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-898746fa-ce9b-45ec-9281-efa877480778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:59.123625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70bc5-2314-4569-a14b-f5ddcf450b8c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:59.138783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:59.139440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.139765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.140042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.195874 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2921/5808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:27:59.196974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898746fa-ce9b-45ec-9281-efa877480778 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:59.268035 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:59.331476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:59.333512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:59.360154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898746fa-ce9b-45ec-9281-efa877480778 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:59.361240 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2888/5809] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:27:59.368550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:59.369782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.370323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.370882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.372001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:59.374812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:59.441283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2922/5810] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:27:59 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:27:59.442211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:59.449585 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:27:59.465289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88fed5-d74f-4648-acb4-95fd6e43364f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:59.646817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:59.649108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:27:59.668896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:59.670574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.670951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.675605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.676510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:59.689729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:59.746536 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2889/5811] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:27:59 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:27:59.751426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:59.779368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95bd87-4f64-4847-b7de-97a01f776a67 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:59.793259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:59.793882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.794587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.794856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.797662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:59.800410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:59.839063 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2890/5812] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:59.841288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:59.856972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001beb6-da48-4886-a000-50ef4a42b035 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:59.864240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:59.864988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.865324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.865639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.866895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:59.870965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:59.881518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e977e-4fc7-4898-96d6-199f27b33114 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:59.891780 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2891/5813] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:27:59.892798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:27:59.901740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:59.902898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.903377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.903884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.906271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a842ee4-fa89-48e9-9aa7-31223d45c258 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:27:59.912629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371a257-a848-445d-8158-c5d2622fe482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:27:59.913370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371a257-a848-445d-8158-c5d2622fe482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:27:59.914333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371a257-a848-445d-8158-c5d2622fe482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:27:59.914711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371a257-a848-445d-8158-c5d2622fe482 admin admin] PATH_INFO: `/v3/projects/a8fbaeeb0e294dde824d0f7f77d1aaff/users/a053b128a73c40fc9554800d2b161a93/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:27:59.938571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371a257-a848-445d-8158-c5d2622fe482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fbaeeb0e294dde824d0f7f77d1aaff, user_id=a053b128a73c40fc9554800d2b161a93, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:27:59.942958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371a257-a848-445d-8158-c5d2622fe482 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:27:59.993016 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2892/5814] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:27:59 2022] PUT /identity/v3/projects/a8fbaeeb0e294dde824d0f7f77d1aaff/users/a053b128a73c40fc9554800d2b161a93/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:00.022189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:00.026787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:00.027300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:00.110535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:00.112496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:00.125704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] MFA Rules not processed for user `a053b128a73c40fc9554800d2b161a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:00.126865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:00.148796 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2923/5815] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:27:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:00.380357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:00.382284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:00.425940 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2893/5816] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:00.432645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:00.432787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7b82e-9467-41ea-8adc-76548f8415fb service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:00.434918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:00.572911 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:00.603359 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:00.624525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:00.625267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:00.625609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:00.625887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] PATH_INFO: `/v3/projects/094cf8bf8e9e43e499ab10f88cd02781` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:00.627077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094cf8bf8e9e43e499ab10f88cd02781)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:00.633234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:00.640107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fed1-76b3-4679-9da2-f7ba6c8378ec None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:00.651358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:00.652951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:00.653697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:00.654271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:00.740349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094cf8bf8e9e43e499ab10f88cd02781', 'request_id': 'req-c48ffac8-3a4e-46a7-8224-52936c887be5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:00.758472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094cf8bf8e9e43e499ab10f88cd02781', 'request_id': 'req-c48ffac8-3a4e-46a7-8224-52936c887be5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:00.768631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094cf8bf8e9e43e499ab10f88cd02781', 'request_id': 'req-c48ffac8-3a4e-46a7-8224-52936c887be5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:00.797433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] The token cache is being invalidate because project 094cf8bf8e9e43e499ab10f88cd02781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:00.797659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:00.798292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:00.802886 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2924/5817] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:00 2022] DELETE /identity/v3/projects/094cf8bf8e9e43e499ab10f88cd02781 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:00.806080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:00.807492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:00.826655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:00.828664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:00.868942 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2894/5818] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:28:01.142874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ffac8-3a4e-46a7-8224-52936c887be5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:01.156252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:01.158046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:01.158330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:01.158603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] PATH_INFO: `/v3/users/48ae99c77f8b48159376422dbc707de5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:01.161793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ae99c77f8b48159376422dbc707de5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:01.166858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:01.281737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ae99c77f8b48159376422dbc707de5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:01.282535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ae99c77f8b48159376422dbc707de5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:01.284656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ae99c77f8b48159376422dbc707de5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:01.313777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ae99c77f8b48159376422dbc707de5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:01.331638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-835d3d7a-cf23-45da-a54c-36d9d3089457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ae99c77f8b48159376422dbc707de5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:01.353353 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:01.362433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2925/5819] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:00 2022] DELETE /identity/v3/users/48ae99c77f8b48159376422dbc707de5 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:01.787771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:01.805623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3bb44-334d-40eb-bfea-f70c7d22ae98 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:01.948846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:01.949421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:01.949703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:01.949978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] PATH_INFO: `/v3/users/394f6347268f43719b1608c72dc831c5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:01.957259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] RBAC: Authorizing `identity:delete_user(user_id=394f6347268f43719b1608c72dc831c5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:01.959304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:02.067388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394f6347268f43719b1608c72dc831c5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:02.072135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394f6347268f43719b1608c72dc831c5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:02.072880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394f6347268f43719b1608c72dc831c5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:02.090027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394f6347268f43719b1608c72dc831c5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:02.115483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394f6347268f43719b1608c72dc831c5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:02.143812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2895/5820] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:01 2022] DELETE /identity/v3/users/394f6347268f43719b1608c72dc831c5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:02.149455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:02.150067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:02.150067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:02.192577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:02.193816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:02.386351 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2926/5821] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:02.436961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:02.439112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:02.455485 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:02.627279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c6a38-c815-4fd9-a34c-74ef1547582c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:02.631426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bc69a-1d2f-4089-ade0-72acd95bc61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:02.632580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bc69a-1d2f-4089-ade0-72acd95bc61a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:02.633368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bc69a-1d2f-4089-ade0-72acd95bc61a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:02.633368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bc69a-1d2f-4089-ade0-72acd95bc61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:02.649809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bc69a-1d2f-4089-ade0-72acd95bc61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:02.655967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bc69a-1d2f-4089-ade0-72acd95bc61a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:02.687347 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2896/5822] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:03.486208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:03.487823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:03.515923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0787f-eb66-4ddb-8371-b8ba1045c932 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:03.539602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:03.540269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:03.561974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:03.562535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] PATH_INFO: `/v3/projects/091134bb5e93496dbbfa058b854dbbdb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:03.566517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091134bb5e93496dbbfa058b854dbbdb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:03.569501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:03.749300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091134bb5e93496dbbfa058b854dbbdb', 'request_id': 'req-9de7318f-5feb-4724-9916-7dbc916ac926'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:03.760816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091134bb5e93496dbbfa058b854dbbdb', 'request_id': 'req-9de7318f-5feb-4724-9916-7dbc916ac926'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:03.769769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091134bb5e93496dbbfa058b854dbbdb', 'request_id': 'req-9de7318f-5feb-4724-9916-7dbc916ac926'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:03.871194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] The token cache is being invalidate because project 091134bb5e93496dbbfa058b854dbbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:03.876929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:03.879918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:03.886523 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2927/5823] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:03 2022] DELETE /identity/v3/projects/091134bb5e93496dbbfa058b854dbbdb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:03.891269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e469031-70a0-4fde-98fb-0fe9fc48e75b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:03.892229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e469031-70a0-4fde-98fb-0fe9fc48e75b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:03.892998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e469031-70a0-4fde-98fb-0fe9fc48e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:03.960460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0e469031-70a0-4fde-98fb-0fe9fc48e75b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:03.961902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0e469031-70a0-4fde-98fb-0fe9fc48e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:04.112077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:04.114882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:04.298113 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2897/5824] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:04.326975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0af7a-9a58-44e0-947c-8af50dc1b8e0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:04.327595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7318f-5feb-4724-9916-7dbc916ac926 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:04.329214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0af7a-9a58-44e0-947c-8af50dc1b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:04.337418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:04.337418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:04.337418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:04.337418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] PATH_INFO: `/v3/projects/551ca62cf15f4c39a1d879133546a4f6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:04.338507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=551ca62cf15f4c39a1d879133546a4f6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:04.343811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:04.352174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0af7a-9a58-44e0-947c-8af50dc1b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:04.419721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-90f0af7a-9a58-44e0-947c-8af50dc1b8e0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:04.422331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-90f0af7a-9a58-44e0-947c-8af50dc1b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:04.432069 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:04.458745 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2898/5825] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:04.463725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0af7a-9a58-44e0-947c-8af50dc1b8e0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:04.488438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0af7a-9a58-44e0-947c-8af50dc1b8e0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:04.499607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551ca62cf15f4c39a1d879133546a4f6', 'request_id': 'req-57305472-c646-4dde-b6dd-88500b9f0b92'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:04.528222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551ca62cf15f4c39a1d879133546a4f6', 'request_id': 'req-57305472-c646-4dde-b6dd-88500b9f0b92'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:04.541711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551ca62cf15f4c39a1d879133546a4f6', 'request_id': 'req-57305472-c646-4dde-b6dd-88500b9f0b92'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:04.586833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] The token cache is being invalidate because project 551ca62cf15f4c39a1d879133546a4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:04.587369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:04.591573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:04.597142 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2928/5826] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:04 2022] DELETE /identity/v3/projects/551ca62cf15f4c39a1d879133546a4f6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:04.602373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:04.607899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:04.692717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:04.694403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:04.697601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:04.714084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:04.715034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:04.717218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:04.722699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:04.778190 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2899/5827] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:04.782759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:04.787860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:04.859410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305472-c646-4dde-b6dd-88500b9f0b92 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:04.860836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd65c7d-164d-4f87-81d0-0bfb256d3ca0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:04.881577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:04.883310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:04.885546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:04.885888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:04.886164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:04.886822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:04.888802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:04.892074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:04.892356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:04.892650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] PATH_INFO: `/v3/users/a053b128a73c40fc9554800d2b161a93` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:04.897637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a053b128a73c40fc9554800d2b161a93)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:04.906333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:05.028168 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2900/5828] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:04 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:05.030572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:05.087404 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:05.094310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a053b128a73c40fc9554800d2b161a93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:05.097403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a053b128a73c40fc9554800d2b161a93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:05.099569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a053b128a73c40fc9554800d2b161a93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:05.150664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a053b128a73c40fc9554800d2b161a93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:05.170905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a053b128a73c40fc9554800d2b161a93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:05.199780 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2929/5829] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:04 2022] DELETE /identity/v3/users/a053b128a73c40fc9554800d2b161a93 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:05.262097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c260d8-28a4-416a-ba2a-351572ec546e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:05.419375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:05.420190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:05.420571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:05.420948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:05.421722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:05.424484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:05.457357 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2901/5830] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:05 2022] POST /identity/v3/users => generated 289 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:05.460923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:05.462484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:05.500792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25cab7-8933-4c56-b2b3-e96960ca28f1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:05.518597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:05.519154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:05.519438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:05.541691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:05.545039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:05.564916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:05.606208 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2930/5831] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:05.609215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:05.629956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74aa5db-3883-4da1-8c15-9b62df2f4fb2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:05.649447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e89a4-7c3f-4853-a752-b3e6babc8447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:05.650998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e89a4-7c3f-4853-a752-b3e6babc8447 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:05.651398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e89a4-7c3f-4853-a752-b3e6babc8447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:05.651773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e89a4-7c3f-4853-a752-b3e6babc8447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:05.656943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e89a4-7c3f-4853-a752-b3e6babc8447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:05.660992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e89a4-7c3f-4853-a752-b3e6babc8447 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:05.687532 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2902/5832] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:05.692193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:05.717008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf1691-d72c-4a68-9afc-37a91976387b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:05.738981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:05.742447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:05.742779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:05.743059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] PATH_INFO: `/v3/projects/09f21886b0b8477b9c8aca4ec1652f6c/users/2698a357c998434eaad892eda1e30644/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:05.777940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f21886b0b8477b9c8aca4ec1652f6c, user_id=2698a357c998434eaad892eda1e30644, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:05.780651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:05.785685 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:05.803546 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2931/5833] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:05 2022] PUT /identity/v3/projects/09f21886b0b8477b9c8aca4ec1652f6c/users/2698a357c998434eaad892eda1e30644/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:05.813472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe360-2e43-451d-a1c3-a7a6bc49f242 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:05.814039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe360-2e43-451d-a1c3-a7a6bc49f242 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:05.814626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe360-2e43-451d-a1c3-a7a6bc49f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:05.858729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-14bfe360-2e43-451d-a1c3-a7a6bc49f242 None None] MFA Rules not processed for user `2698a357c998434eaad892eda1e30644`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:05.860156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-14bfe360-2e43-451d-a1c3-a7a6bc49f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:05.967976 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2903/5834] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:05.969409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.076860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59440a5c-ce33-4218-8814-2debe33700a2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:06.083927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:06.085376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:06.085897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:06.086476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:06.087915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:06.090699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:06.127924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2932/5835] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:05 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:06.133226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfe360-2e43-451d-a1c3-a7a6bc49f242 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.162664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfe360-2e43-451d-a1c3-a7a6bc49f242 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:06.211773 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:06.311602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:06.312240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:06.312518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:06.312787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:06.313466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:06.316096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:06.357948 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2904/5836] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:06 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:06.361678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.375356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80694905-1fce-4ad5-b94e-64f0dd60c49f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:06.380776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:06.381643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:06.383611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:06.384055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:06.384985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:06.387117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:06.405618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2933/5837] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:28:06.411019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.427211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285449e9-cc09-4091-abb0-e594374d3760 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:06.434441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:06.435619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:06.436378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:06.436770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] PATH_INFO: `/v3/projects/6ebf018095db4dbcae97202edb749ee7/users/15604bc770f147829fd85bf55a698687/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:06.458806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf018095db4dbcae97202edb749ee7, user_id=15604bc770f147829fd85bf55a698687, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:06.462390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:06.519982 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2905/5838] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:06 2022] PUT /identity/v3/projects/6ebf018095db4dbcae97202edb749ee7/users/15604bc770f147829fd85bf55a698687/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:06.524525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.537796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d5d08-85bd-408b-823d-f06b08dc9d6f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:06.659508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499cfbf-3d42-4711-8d44-e17e6c2e071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:06.660133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499cfbf-3d42-4711-8d44-e17e6c2e071d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:06.660415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499cfbf-3d42-4711-8d44-e17e6c2e071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:06.660687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499cfbf-3d42-4711-8d44-e17e6c2e071d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:06.661398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499cfbf-3d42-4711-8d44-e17e6c2e071d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:06.662998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499cfbf-3d42-4711-8d44-e17e6c2e071d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:06.679994 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2934/5839] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:06.681333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.693857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4be3a-f468-49ab-af81-e7dee3fc18b3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:06.699559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:06.701198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:06.701491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:06.701768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] PATH_INFO: `/v3/projects/6ebf018095db4dbcae97202edb749ee7/users/15604bc770f147829fd85bf55a698687/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:06.703856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebf018095db4dbcae97202edb749ee7, user_id=15604bc770f147829fd85bf55a698687, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:06.707800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:06.741896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:06.742798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:06.742798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:06.745703 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2906/5840] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:06 2022] PUT /identity/v3/projects/6ebf018095db4dbcae97202edb749ee7/users/15604bc770f147829fd85bf55a698687/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:06.783063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] MFA Rules not processed for user `15604bc770f147829fd85bf55a698687`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:06.797595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:06.902807 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:06.927135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.929127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:06.939287 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2935/5841] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:06.951046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:06.952861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:07.095379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea278a1-2843-4830-bd85-e4e2bba14472 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:07.108469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d21bc-5134-49b8-a6df-4f0f95b7a32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:07.109292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d21bc-5134-49b8-a6df-4f0f95b7a32c service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.110115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d21bc-5134-49b8-a6df-4f0f95b7a32c service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.110409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d21bc-5134-49b8-a6df-4f0f95b7a32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.134899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d21bc-5134-49b8-a6df-4f0f95b7a32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:07.136852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d21bc-5134-49b8-a6df-4f0f95b7a32c service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:07.137282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09121c87-715a-41ab-9d41-8b6f262e1470 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:07.160750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:07.161492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.161719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.161989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] PATH_INFO: `/v3/projects/a8fbaeeb0e294dde824d0f7f77d1aaff` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.162114 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2936/5842] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:28:07.165575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8fbaeeb0e294dde824d0f7f77d1aaff)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:07.169680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:07.280797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8fbaeeb0e294dde824d0f7f77d1aaff', 'request_id': 'req-1234e6b7-c988-4bfe-9c40-3f0ac9898944'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:07.297212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8fbaeeb0e294dde824d0f7f77d1aaff', 'request_id': 'req-1234e6b7-c988-4bfe-9c40-3f0ac9898944'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:07.326766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8fbaeeb0e294dde824d0f7f77d1aaff', 'request_id': 'req-1234e6b7-c988-4bfe-9c40-3f0ac9898944'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:07.347235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] The token cache is being invalidate because project a8fbaeeb0e294dde824d0f7f77d1aaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:07.347612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:07.350897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1234e6b7-c988-4bfe-9c40-3f0ac9898944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:07.353316 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2907/5843] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:06 2022] DELETE /identity/v3/projects/a8fbaeeb0e294dde824d0f7f77d1aaff => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:07.361572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a738-1d87-458c-9295-d6fd33cf1bba None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.361859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a738-1d87-458c-9295-d6fd33cf1bba None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.362135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1a738-1d87-458c-9295-d6fd33cf1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.407205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-98b1a738-1d87-458c-9295-d6fd33cf1bba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:07.410679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98b1a738-1d87-458c-9295-d6fd33cf1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:07.570303 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2937/5844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:07.577695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66943037-8a81-40dc-8737-0eceea41f7e4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.577987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66943037-8a81-40dc-8737-0eceea41f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.578317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66943037-8a81-40dc-8737-0eceea41f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.619192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-66943037-8a81-40dc-8737-0eceea41f7e4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:07.626723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-66943037-8a81-40dc-8737-0eceea41f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:07.660031 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2908/5845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:07.667625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a738-1d87-458c-9295-d6fd33cf1bba None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:07.685425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1a738-1d87-458c-9295-d6fd33cf1bba None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:07.691487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:07.692168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.692465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.693343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.694010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:07.694949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:07.697161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:07.716723 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2938/5846] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:07.720948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66943037-8a81-40dc-8737-0eceea41f7e4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:07.728271 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:07.733535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66943037-8a81-40dc-8737-0eceea41f7e4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:07.744393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:07.745020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.745622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.746286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.747156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:07.749325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:07.789908 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2909/5847] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:07 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:07.795387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:07.806973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33c17e-48da-4266-8fec-1a00b535984e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:07.822053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:07.825216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:07.946069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:07.946808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.947083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.947351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.947995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:07.949969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:07.966942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da099b0-9ce1-4312-9e3c-2d1621cba99a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:07.984851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:07.984851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:07.984851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:07.985356 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2939/5848] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:07 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:07.986747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:07.986880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] PATH_INFO: `/v3/users/2698a357c998434eaad892eda1e30644` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:07.988334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2698a357c998434eaad892eda1e30644)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:07.995615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:08.008388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7fba-a469-4caa-a153-bf7905418bb3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:08.028693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:08.029439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:08.029782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:08.030882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:08.032035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:08.036808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:08.048573 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:08.073293 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2940/5849] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:08.080707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:08.105665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03920857-1713-450f-ae95-dc780f9a80fc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:08.114165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2698a357c998434eaad892eda1e30644'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:08.115135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2698a357c998434eaad892eda1e30644'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:08.115942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2698a357c998434eaad892eda1e30644'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:08.119678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:08.120484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:08.123963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:08.124532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:08.125457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:08.127324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:08.141648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2698a357c998434eaad892eda1e30644'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:08.160242 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2941/5850] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:08.166479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:08.166864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9634e161-343a-44c5-85d8-1a37febc7199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2698a357c998434eaad892eda1e30644'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:08.170938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:08.209200 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2910/5851] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:07 2022] DELETE /identity/v3/users/2698a357c998434eaad892eda1e30644 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:08.214258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628549-d9e5-4741-bc37-18ef2718a42c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:08.214555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628549-d9e5-4741-bc37-18ef2718a42c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:08.214838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628549-d9e5-4741-bc37-18ef2718a42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:08.219205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac7e9c-c71b-49b7-8208-0dc8b1733dfb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:08.250013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-51628549-d9e5-4741-bc37-18ef2718a42c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:08.251037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-51628549-d9e5-4741-bc37-18ef2718a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:08.371547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:08.373051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:08.373356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:08.373675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] PATH_INFO: `/v3/projects/1f1001a55f8f4696bd210928d20b433b/users/55d006fe06664224a55ca66e66092dfa/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:08.406350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2911/5852] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:08.408142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1001a55f8f4696bd210928d20b433b, user_id=55d006fe06664224a55ca66e66092dfa, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:08.410928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:08.443838 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2942/5853] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:08 2022] PUT /identity/v3/projects/1f1001a55f8f4696bd210928d20b433b/users/55d006fe06664224a55ca66e66092dfa/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:08.455240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530647-703f-4196-8ead-6720809849fb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:08.455627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530647-703f-4196-8ead-6720809849fb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:08.455827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530647-703f-4196-8ead-6720809849fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:08.463497 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:08.494118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aa530647-703f-4196-8ead-6720809849fb None None] MFA Rules not processed for user `55d006fe06664224a55ca66e66092dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:08.495244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa530647-703f-4196-8ead-6720809849fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:08.506983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:08.509969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:08.680468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83098efd-a76f-4ef4-8751-55131c4f8c00 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:08.688704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:08.689542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:08.690005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:08.690454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:08.694119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2912/5854] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:08.697275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa530647-703f-4196-8ead-6720809849fb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:08.702220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aa530647-703f-4196-8ead-6720809849fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:08.813488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa530647-703f-4196-8ead-6720809849fb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:08.823389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:08.824022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:08.824320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:08.824589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:08.825018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:08.826503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:08.850204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:08.852609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:08.854946 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2943/5855] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:08.876065 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2913/5856] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:09.095193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:09.095915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:09.131015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e9b4-d5a5-4eac-8d9c-951a06a506b4 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:09.145539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:09.146203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:09.146508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:09.146796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] PATH_INFO: `/v3/users/5f3534b3b8a74eeca871571ea42da1e7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:09.149262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3534b3b8a74eeca871571ea42da1e7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:09.151074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:09.233959 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:09.301776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3534b3b8a74eeca871571ea42da1e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.302947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3534b3b8a74eeca871571ea42da1e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.303220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3534b3b8a74eeca871571ea42da1e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.322278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3534b3b8a74eeca871571ea42da1e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.332938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7cb0719f-7311-4dac-b148-be3b51d99114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3534b3b8a74eeca871571ea42da1e7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.358715 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2944/5857] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:09 2022] DELETE /identity/v3/users/5f3534b3b8a74eeca871571ea42da1e7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:09.361656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:09.364651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:09.365260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:09.367767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:09.378820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5d075-c63d-4dac-841e-19777171d6d6 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:09.419989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:09.421543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:09.471506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:09.472504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:09.472804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:09.473450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] PATH_INFO: `/v3/users/55d006fe06664224a55ca66e66092dfa` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:09.474677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d006fe06664224a55ca66e66092dfa)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:09.478168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:09.539945 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2945/5858] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:09.558640 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:09.562929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:09.564948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:09.593998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d006fe06664224a55ca66e66092dfa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.594700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d006fe06664224a55ca66e66092dfa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.595472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d006fe06664224a55ca66e66092dfa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.628218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d006fe06664224a55ca66e66092dfa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.662292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ee04922-655d-4e30-97dc-5e7df3deef19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d006fe06664224a55ca66e66092dfa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:09.705564 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2914/5859] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:09 2022] DELETE /identity/v3/users/55d006fe06664224a55ca66e66092dfa => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:09.710005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:09.710823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:09.712208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:09.734890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43011f55-f0fe-4c59-b808-d8288cb5319f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:09.743073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:09.745292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:09.867302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:09.868241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:09.868542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:09.870309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:09.873827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:09.881417 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2915/5860] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:09.894686 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:09.901629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:09.913031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:09.942491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:09.945233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:09.950251 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2946/5861] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:28:09.977428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fbbe7-4a62-4c5a-8f11-ed39d3375ae4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:09.982886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:09.983732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:09.984637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:09.985161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:09.999770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:10.001536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:10.035107 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2916/5862] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:28:11.234985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:11.236616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:11.254993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882fadf-732a-4589-893b-9d2ff078004c service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:11.260268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:11.261035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:11.261449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:11.261825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] PATH_INFO: `/v3/projects/09f21886b0b8477b9c8aca4ec1652f6c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:11.263124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f21886b0b8477b9c8aca4ec1652f6c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:11.265628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:11.335070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f21886b0b8477b9c8aca4ec1652f6c', 'request_id': 'req-54f094e7-5f6d-44f3-8876-64a85fc2d34b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.340745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f21886b0b8477b9c8aca4ec1652f6c', 'request_id': 'req-54f094e7-5f6d-44f3-8876-64a85fc2d34b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.347540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f21886b0b8477b9c8aca4ec1652f6c', 'request_id': 'req-54f094e7-5f6d-44f3-8876-64a85fc2d34b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.367967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] The token cache is being invalidate because project 09f21886b0b8477b9c8aca4ec1652f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:11.368267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.369462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.371058 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2947/5863] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:11 2022] DELETE /identity/v3/projects/09f21886b0b8477b9c8aca4ec1652f6c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:11.375049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:11.401864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa5311-24ce-4058-ae34-f87ebc34503a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:11.500333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:11.500980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:11.501291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:11.501566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] PATH_INFO: `/v3/users/15604bc770f147829fd85bf55a698687` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:11.502774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15604bc770f147829fd85bf55a698687)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:11.505321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:11.572932 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:11.574274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15604bc770f147829fd85bf55a698687'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.575234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15604bc770f147829fd85bf55a698687'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.576032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15604bc770f147829fd85bf55a698687'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.589000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15604bc770f147829fd85bf55a698687'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.615655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15604bc770f147829fd85bf55a698687'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.648653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2917/5864] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:11 2022] DELETE /identity/v3/users/15604bc770f147829fd85bf55a698687 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:11.752204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:11.758988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:11.759193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:11.760476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:11.785252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f094e7-5f6d-44f3-8876-64a85fc2d34b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:11.882233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc5f-3607-44f4-ad5e-2a7c9a6b5f5f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:11.892012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:11.892736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:11.893012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:11.893357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] PATH_INFO: `/v3/projects/d7aa9b860a3445edb02e3e42d2779695` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:11.894635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7aa9b860a3445edb02e3e42d2779695)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:11.896626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:11.961255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:11.962516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:11.962807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:11.963089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] PATH_INFO: `/v3/projects/1f1001a55f8f4696bd210928d20b433b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:11.967361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1001a55f8f4696bd210928d20b433b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:11.969575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7aa9b860a3445edb02e3e42d2779695', 'request_id': 'req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:11.970556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:11.984658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7aa9b860a3445edb02e3e42d2779695', 'request_id': 'req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.003391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7aa9b860a3445edb02e3e42d2779695', 'request_id': 'req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.037128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] The token cache is being invalidate because project d7aa9b860a3445edb02e3e42d2779695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:12.037434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.038235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-80a24a0f-3032-42b0-84a6-4c9599cf3ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.040005 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2918/5865] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:11 2022] DELETE /identity/v3/projects/d7aa9b860a3445edb02e3e42d2779695 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:12.046584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eae443-cbaf-4261-b9e1-28e67a024219 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.047126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eae443-cbaf-4261-b9e1-28e67a024219 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.047408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eae443-cbaf-4261-b9e1-28e67a024219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.095663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1001a55f8f4696bd210928d20b433b', 'request_id': 'req-6a78c902-691a-4f3b-9298-71a1df45c383'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.097473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-34eae443-cbaf-4261-b9e1-28e67a024219 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:12.100369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-34eae443-cbaf-4261-b9e1-28e67a024219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:12.110633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1001a55f8f4696bd210928d20b433b', 'request_id': 'req-6a78c902-691a-4f3b-9298-71a1df45c383'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.124317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1001a55f8f4696bd210928d20b433b', 'request_id': 'req-6a78c902-691a-4f3b-9298-71a1df45c383'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.154140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] The token cache is being invalidate because project 1f1001a55f8f4696bd210928d20b433b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:12.154383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.155065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6a78c902-691a-4f3b-9298-71a1df45c383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.159740 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2948/5866] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:11 2022] DELETE /identity/v3/projects/1f1001a55f8f4696bd210928d20b433b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:12.165487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50004-903a-4d4e-9de9-0058e2ec3ad2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.165770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50004-903a-4d4e-9de9-0058e2ec3ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.166048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50004-903a-4d4e-9de9-0058e2ec3ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.210189 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:12.238237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6ae50004-903a-4d4e-9de9-0058e2ec3ad2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:12.239518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6ae50004-903a-4d4e-9de9-0058e2ec3ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:12.257272 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:12.291897 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2919/5867] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:12.301318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3b99-171c-4eb6-8033-18bcc1e54a28 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.301761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3b99-171c-4eb6-8033-18bcc1e54a28 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.302176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3b99-171c-4eb6-8033-18bcc1e54a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.351988 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2949/5868] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:12.361091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223961-2820-45f4-84a5-c510c9791a06 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.361534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223961-2820-45f4-84a5-c510c9791a06 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.362340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223961-2820-45f4-84a5-c510c9791a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.378363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-775f3b99-171c-4eb6-8033-18bcc1e54a28 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:12.383477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-775f3b99-171c-4eb6-8033-18bcc1e54a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:12.391096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4e223961-2820-45f4-84a5-c510c9791a06 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:12.393330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4e223961-2820-45f4-84a5-c510c9791a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:12.404239 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2920/5869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:12.406267 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2950/5870] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:12.408477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f3b99-171c-4eb6-8033-18bcc1e54a28 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.409961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e223961-2820-45f4-84a5-c510c9791a06 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.429836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f3b99-171c-4eb6-8033-18bcc1e54a28 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.433576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e223961-2820-45f4-84a5-c510c9791a06 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.447270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:12.448011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.448186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.448445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.449126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:12.449438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:12.451783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:12.456814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:12.457517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.457802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.458078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.458805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:12.459113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:12.461663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:12.480987 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2951/5871] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:12.485128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.499362 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2921/5872] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:12.501180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.529366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4839b4f-5e1c-4438-aea9-c9b5f40634c3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.540232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e55a2-0ad7-44c1-aa4b-4cb9d9cbb5fd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.548814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:12.549534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.550533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.550533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.551126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:12.552336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:12.552809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.553209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.553471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.554781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:12.555016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:12.559757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:12.626545 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2922/5873] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:12.628438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.631203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:12.644840 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2952/5874] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:12.646088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.748179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebe12a-9d31-4660-8ce4-8a9494283994 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.754002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:12.754721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.755004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.755279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.756535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:12.761217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:12.790944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe272638-633b-4480-be18-fe68508d0908 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.801262 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2953/5875] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:12.805026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.810158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:12.810836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.811117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.811388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] PATH_INFO: `/v3/projects/6ebf018095db4dbcae97202edb749ee7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.816755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebf018095db4dbcae97202edb749ee7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:12.824358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:12.837693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e886f4-520d-4b5c-a9c6-d4fad2195cd9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.849215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:12.850196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:12.851610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:12.851895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:12.852599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:12.855253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:12.908289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2954/5876] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:12 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:12.908289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:12.919485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e538-8772-4d4e-863e-6c372c6ccb4e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:12.942575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebf018095db4dbcae97202edb749ee7', 'request_id': 'req-b83d73ec-ef2c-4cad-ad6f-e466953294b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.969866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebf018095db4dbcae97202edb749ee7', 'request_id': 'req-b83d73ec-ef2c-4cad-ad6f-e466953294b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:12.978607 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:12.986612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebf018095db4dbcae97202edb749ee7', 'request_id': 'req-b83d73ec-ef2c-4cad-ad6f-e466953294b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:13.023257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] The token cache is being invalidate because project 6ebf018095db4dbcae97202edb749ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:13.024109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:13.025331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:13.031025 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2923/5877] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:12 2022] DELETE /identity/v3/projects/6ebf018095db4dbcae97202edb749ee7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:13.032334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.035244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:13.041224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbccd9-ccf4-47ea-ac16-747d48d1aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.041912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbccd9-ccf4-47ea-ac16-747d48d1aea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.042197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbccd9-ccf4-47ea-ac16-747d48d1aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.042473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbccd9-ccf4-47ea-ac16-747d48d1aea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.043369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbccd9-ccf4-47ea-ac16-747d48d1aea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.045532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbccd9-ccf4-47ea-ac16-747d48d1aea5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.059041 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2955/5878] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:13.060458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b1da5-3cab-4e51-93e7-56a22f48ccd2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.060753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b1da5-3cab-4e51-93e7-56a22f48ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.061031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b1da5-3cab-4e51-93e7-56a22f48ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.072888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d73ec-ef2c-4cad-ad6f-e466953294b0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.083768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.085783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.086378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.086887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.087830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.089713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.097140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-309b1da5-3cab-4e51-93e7-56a22f48ccd2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:13.100634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-309b1da5-3cab-4e51-93e7-56a22f48ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:13.108253 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2924/5879] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:13.109582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.111556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:13.121248 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2956/5880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:13.127769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b1da5-3cab-4e51-93e7-56a22f48ccd2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.136320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e303fe-01f2-4046-8582-3863ec6fba2d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.148096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b1da5-3cab-4e51-93e7-56a22f48ccd2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.149088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64828a35-3fda-41b1-869e-f255f7f312f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.150259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828a35-3fda-41b1-869e-f255f7f312f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.150772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828a35-3fda-41b1-869e-f255f7f312f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.151247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828a35-3fda-41b1-869e-f255f7f312f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.152431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64828a35-3fda-41b1-869e-f255f7f312f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.155784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64828a35-3fda-41b1-869e-f255f7f312f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.175364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.176451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.176924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.177269 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2925/5881] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:13.177762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.179326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22130e-3b4d-4a3d-ba8a-84e8c5f14cee None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.179750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22130e-3b4d-4a3d-ba8a-84e8c5f14cee None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.180197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22130e-3b4d-4a3d-ba8a-84e8c5f14cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.192180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.197383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.204253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7c22130e-3b4d-4a3d-ba8a-84e8c5f14cee None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:13.205563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7c22130e-3b4d-4a3d-ba8a-84e8c5f14cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:13.227035 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2926/5882] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:13.229460 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2957/5883] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:13.231926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.234283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22130e-3b4d-4a3d-ba8a-84e8c5f14cee None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.249320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadba67-7192-4148-b80d-3d6630b88ae9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.259558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.261299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.261759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.262402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22130e-3b4d-4a3d-ba8a-84e8c5f14cee None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.262720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.263741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:13.264405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.266626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.278728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.279478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.279705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.280013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] PATH_INFO: `/v3/projects/aff4935e546f4f2f83f0e852a6e4618f/users/cacf9f6514124baa8ccb44b1d8b1b5a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.301380 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2958/5884] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:13.302712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.317943 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:13.321250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b90af-2db3-4d8d-8c46-3a788a551bbf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.330330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38223399-fa19-403e-87a1-0662c23d1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.331846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38223399-fa19-403e-87a1-0662c23d1263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.332407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38223399-fa19-403e-87a1-0662c23d1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.334411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38223399-fa19-403e-87a1-0662c23d1263 admin admin] PATH_INFO: `/v3/projects/2fbc2c64e26f4d748b89b539caad094b/users/45895ab973fc46c496f5ac1f86f23907/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.336570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff4935e546f4f2f83f0e852a6e4618f, user_id=cacf9f6514124baa8ccb44b1d8b1b5a8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.341805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.356998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38223399-fa19-403e-87a1-0662c23d1263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbc2c64e26f4d748b89b539caad094b, user_id=45895ab973fc46c496f5ac1f86f23907, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.361837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38223399-fa19-403e-87a1-0662c23d1263 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.380019 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2927/5885] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:13 2022] PUT /identity/v3/projects/aff4935e546f4f2f83f0e852a6e4618f/users/cacf9f6514124baa8ccb44b1d8b1b5a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:13.380925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.409381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2959/5886] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:13 2022] PUT /identity/v3/projects/2fbc2c64e26f4d748b89b539caad094b/users/45895ab973fc46c496f5ac1f86f23907/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:13.412241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780c77-6dad-451a-affd-ac32b968949f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.414056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780c77-6dad-451a-affd-ac32b968949f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.414375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780c77-6dad-451a-affd-ac32b968949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.487761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-00780c77-6dad-451a-affd-ac32b968949f None None] MFA Rules not processed for user `cacf9f6514124baa8ccb44b1d8b1b5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:13.492670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-00780c77-6dad-451a-affd-ac32b968949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:13.536267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76f241-4f20-4cd4-b3d1-38ac8a815233 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.641372 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2960/5887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:13.643451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0be5ec-1bd8-485f-a682-8942ada09223 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.643705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0be5ec-1bd8-485f-a682-8942ada09223 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.643984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0be5ec-1bd8-485f-a682-8942ada09223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.653889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.656506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.657253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.657759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.659197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.665833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.685333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5c0be5ec-1bd8-485f-a682-8942ada09223 None None] MFA Rules not processed for user `45895ab973fc46c496f5ac1f86f23907`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:13.686726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5c0be5ec-1bd8-485f-a682-8942ada09223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:13.740077 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2928/5888] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:13.750121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.785518 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:13.808533 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2961/5889] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:13.811259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0be5ec-1bd8-485f-a682-8942ada09223 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.832126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0be5ec-1bd8-485f-a682-8942ada09223 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.934136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bb284-64e7-4b13-8fa7-c6d8c5c6053c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.943500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.943680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:13.944413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.944695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.944949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:13.945103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.945526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:13.946315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:13.946979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.948005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:13.949106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.950227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:13.983973 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2962/5890] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:13.983973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:13.999696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d366f0-5d65-4240-8db6-aceaac87705f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:13.999935 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2929/5891] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/projects => generated 389 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:14.000775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.002804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.010597 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:14.073895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.074635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.075228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.076005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.076544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.079930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.081432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d5f0-8629-47a6-ac32-b5a71332d833 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.087022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.087661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.088073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.088369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] PATH_INFO: `/v3/users/f2e7bdbfc4994010a5f889b486e4f15b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.089549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e7bdbfc4994010a5f889b486e4f15b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.091477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.113711 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2963/5892] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:13 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:14.118085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.146177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e7bdbfc4994010a5f889b486e4f15b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.147140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e7bdbfc4994010a5f889b486e4f15b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.148769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e7bdbfc4994010a5f889b486e4f15b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.157833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e7bdbfc4994010a5f889b486e4f15b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.172857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e7bdbfc4994010a5f889b486e4f15b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.190303 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2930/5893] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:13 2022] DELETE /identity/v3/users/f2e7bdbfc4994010a5f889b486e4f15b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:14.191118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.192661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.198602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93b7e0-9dce-402c-88c5-cbf7750ec73d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.218294 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:14.282460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5c019-ac8f-4bb0-b158-6768e6a76189 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.285297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.285931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.286215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.286493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.287146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.289760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.296503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.298249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.298939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.299727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.300628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.302255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2964/5894] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:14.303188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.303554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.307974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.332403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce541-ba2e-4a13-b008-c4d4f841591c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.341338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.342108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.342840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.342840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.343439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.346592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.354237 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2931/5895] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:14 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:14.355612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.360657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.383481 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2965/5896] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:14 2022] POST /identity/v3/users => generated 291 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:14.383481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.389374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7e7a-a101-42ab-842c-d8a0b9d0fc26 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.394422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd86e-2aee-4ab9-92c2-7b08de67ed4b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.403389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.404513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.404513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.404725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.405265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.407544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.414323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.414958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.415225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.415506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.416157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.423594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2966/5897] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:14.425207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.426956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.449285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418904e1-49ec-4252-a72a-a30371b8b650 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.461508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.462579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.462869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.463146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.463793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.465193 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2932/5898] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:14.465697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.466456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.484492 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:14.485515 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2967/5899] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:14.487377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.493856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fd452-7b24-4793-adbd-a1202ad62ddb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.502404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.505108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.505697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.507468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] PATH_INFO: `/v3/projects/cfbeb082db3146afa683b661fb0e73a6/users/543384893b4349b2836ffc80ec60f266/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.516099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbdf05-6339-40b5-acc7-14ae8297a8cc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.521899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.523397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.523742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.524029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] PATH_INFO: `/v3/projects/9d7bf2f33f544e70a7f1159695719a67/users/b705c41d25b34b3e8d5bf9a300bf7868/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.534887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbeb082db3146afa683b661fb0e73a6, user_id=543384893b4349b2836ffc80ec60f266, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.541215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.552051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7bf2f33f544e70a7f1159695719a67, user_id=b705c41d25b34b3e8d5bf9a300bf7868, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.564432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.571766 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2933/5900] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:14 2022] PUT /identity/v3/projects/cfbeb082db3146afa683b661fb0e73a6/users/543384893b4349b2836ffc80ec60f266/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:14.574220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.577290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.587685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2968/5901] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:14 2022] PUT /identity/v3/projects/9d7bf2f33f544e70a7f1159695719a67/users/b705c41d25b34b3e8d5bf9a300bf7868/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:14.589675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.665353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed53b7d-9245-4d96-a7d8-cd24d3a831d3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.693100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5c307-26b7-437c-833a-f22dc31964c3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.699223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.699223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.699511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.699791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] PATH_INFO: `/v3/projects/1fbfe73117874083b74fc7dd33baf11c/users/5717a4e10ec943e685c9860f60133b7b/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.719373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbfe73117874083b74fc7dd33baf11c, user_id=5717a4e10ec943e685c9860f60133b7b, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.722158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.733512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.734316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.734585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.734857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] PATH_INFO: `/v3/projects/f5f98622100d44fca07f033864a3e351` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.736075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f98622100d44fca07f033864a3e351)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.738055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.745150 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2969/5902] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:14 2022] PUT /identity/v3/projects/1fbfe73117874083b74fc7dd33baf11c/users/5717a4e10ec943e685c9860f60133b7b/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:14.746062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.794253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f98622100d44fca07f033864a3e351', 'request_id': 'req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.801419 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:14.810102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f98622100d44fca07f033864a3e351', 'request_id': 'req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.827963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f98622100d44fca07f033864a3e351', 'request_id': 'req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.841397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa60a-b7bb-44d3-9b5d-02f57741ef34 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.841762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] The token cache is being invalidate because project f5f98622100d44fca07f033864a3e351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:14.842020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.843093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b778c0a-d8b6-4901-96a9-7cb2ff69ea22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:14.844726 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2934/5903] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:14 2022] DELETE /identity/v3/projects/f5f98622100d44fca07f033864a3e351 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:14.846456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.846456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.846699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.869700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:14.871122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.881539 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:14.932900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.934044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.934428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.934951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.935694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.937586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.950801 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2935/5904] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:14.952964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.954010 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2970/5905] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:14.955137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:14.957017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.961416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:14.972489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdb5cf-8960-4497-9e92-b2918a8ac288 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.974215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4e5d3-fd5c-4a31-ad23-bfedd732bcfd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:14.979033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.979752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:14.979921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.980270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.980408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:14.980704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] PATH_INFO: `/v3/users/9403d05d164f4b00afdf891a113ed12f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.980837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:14.981037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:14.981731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.982760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9403d05d164f4b00afdf891a113ed12f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:14.983325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:14.984503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:15.002437 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2936/5906] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:15.003281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:15.007965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:15.031408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b14998-1b44-4d5c-adac-120ee06248ce admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:15.036114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:15.037612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.038424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.038702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] PATH_INFO: `/v3/projects/cfbeb082db3146afa683b661fb0e73a6/users/543384893b4349b2836ffc80ec60f266/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.040764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbeb082db3146afa683b661fb0e73a6, user_id=543384893b4349b2836ffc80ec60f266, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:15.043676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:15.068367 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2937/5907] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:15 2022] PUT /identity/v3/projects/cfbeb082db3146afa683b661fb0e73a6/users/543384893b4349b2836ffc80ec60f266/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:15.070053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:15.072055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:15.099197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9403d05d164f4b00afdf891a113ed12f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:15.117978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9403d05d164f4b00afdf891a113ed12f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:15.118833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9403d05d164f4b00afdf891a113ed12f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:15.139368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9403d05d164f4b00afdf891a113ed12f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:15.151116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9403d05d164f4b00afdf891a113ed12f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:15.171457 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2971/5908] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:14 2022] DELETE /identity/v3/users/9403d05d164f4b00afdf891a113ed12f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:15.172682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:15.174833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:15.196709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24181375-5d71-4b99-890b-0b7677ce0e85 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:15.305522 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:15.320815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2649-3956-41de-b8e6-50f8432a5de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:15.321981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2649-3956-41de-b8e6-50f8432a5de4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.322309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2649-3956-41de-b8e6-50f8432a5de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.322589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2649-3956-41de-b8e6-50f8432a5de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.326691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5dd2649-3956-41de-b8e6-50f8432a5de4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:15.333602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54448d-f014-43fa-82d2-1d403c21ce93 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:15.340823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955350a8-6d1a-4809-8267-09a09989f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:15.341539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955350a8-6d1a-4809-8267-09a09989f1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.341820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955350a8-6d1a-4809-8267-09a09989f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.342094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955350a8-6d1a-4809-8267-09a09989f1df admin admin] PATH_INFO: `/v3/projects/1fbfe73117874083b74fc7dd33baf11c/users/5717a4e10ec943e685c9860f60133b7b/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.344895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955350a8-6d1a-4809-8267-09a09989f1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbfe73117874083b74fc7dd33baf11c, user_id=5717a4e10ec943e685c9860f60133b7b, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:15.347155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2649-3956-41de-b8e6-50f8432a5de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:15.347820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955350a8-6d1a-4809-8267-09a09989f1df admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:15.348743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2649-3956-41de-b8e6-50f8432a5de4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:15.381290 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2938/5909] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:15.394802 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2972/5910] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:15 2022] PUT /identity/v3/projects/1fbfe73117874083b74fc7dd33baf11c/users/5717a4e10ec943e685c9860f60133b7b/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:15.398530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344863c-11be-44fa-b133-3452ed34249e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.398899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344863c-11be-44fa-b133-3452ed34249e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.399576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344863c-11be-44fa-b133-3452ed34249e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.400278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab3402-0e14-4d37-9985-b2fbe977b558 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.401383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab3402-0e14-4d37-9985-b2fbe977b558 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.401892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab3402-0e14-4d37-9985-b2fbe977b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.477917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5344863c-11be-44fa-b133-3452ed34249e None None] MFA Rules not processed for user `5717a4e10ec943e685c9860f60133b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:15.478148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d6ab3402-0e14-4d37-9985-b2fbe977b558 None None] MFA Rules not processed for user `543384893b4349b2836ffc80ec60f266`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:15.478251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5344863c-11be-44fa-b133-3452ed34249e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:15.479163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d6ab3402-0e14-4d37-9985-b2fbe977b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:15.618106 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:15.640628 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2973/5911] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:15.666255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344863c-11be-44fa-b133-3452ed34249e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:15.668788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5344863c-11be-44fa-b133-3452ed34249e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:15.675015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2939/5912] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:15.682763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab3402-0e14-4d37-9985-b2fbe977b558 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:15.708380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab3402-0e14-4d37-9985-b2fbe977b558 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:15.722734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:15.724145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.724145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.724145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects/aff4935e546f4f2f83f0e852a6e4618f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.727140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:get_project(project_id=aff4935e546f4f2f83f0e852a6e4618f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:15.730914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:15.733160 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2940/5913] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:28:15 2022] GET /identity/v3/projects/aff4935e546f4f2f83f0e852a6e4618f => generated 385 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:15.737458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:15.755342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476cda9-87b2-458a-a1a7-d4f004948e5d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:15.763608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344863c-11be-44fa-b133-3452ed34249e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:15.764359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:15.765017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.765271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.765581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.766543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:15.770940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:15.778285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:15.778984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:15.779264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:15.779531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:15.805469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:15.809678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:15.856127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2974/5914] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:15.868508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2941/5915] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:28:15 2022] POST /identity/v3/projects => generated 339 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:15.868930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:15.894561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fbbf8-03a0-4274-b990-de44c3295242 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.016395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.017025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.017339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.017616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.018268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.020610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.051126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.052035 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2975/5916] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:28:15 2022] GET /identity/v3/projects => generated 7264 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:16.064988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c57deb-e0f4-4685-93bd-faa9e35f7d4d tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.079570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.080719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.081023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.082022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects/aff4935e546f4f2f83f0e852a6e4618f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.091686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:get_project(project_id=aff4935e546f4f2f83f0e852a6e4618f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.094777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.099992 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2942/5917] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects/aff4935e546f4f2f83f0e852a6e4618f => generated 385 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:16.104437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.130474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363113a-d4b8-4a9c-8131-c2ba7f3189df tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.141383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.143573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.144033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.144471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects/74c28086674c4cd9888e3e8710c1b734` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.146883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:get_project(project_id=74c28086674c4cd9888e3e8710c1b734)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.150913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.155718 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2976/5918] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects/74c28086674c4cd9888e3e8710c1b734 => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:28:16.160015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.177546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7790e08-07f5-4a91-b3bc-da4fbcb6fccd tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.183550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.184168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.184450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.184759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.185789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.190956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.216478 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2943/5919] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects => generated 7264 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:16.221093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.226517 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:16.234033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d4ff6-f885-48cd-91cc-dae5e337d7ae tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.240766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.242073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.242458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.242836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.243641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:16.244051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.246078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.280366 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2977/5920] 10.222.0.16 () {58 vars in 1166 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects?domain_id=default => generated 6933 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:28:16.283643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.296203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cc097-461d-477b-9387-a58689f1a233 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.301686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.302473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.302831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.303166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.304905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.306956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.337720 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2944/5921] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects => generated 7264 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:16.342679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.373226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.375355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:16.377930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc6ed-cdc3-4cee-a290-15ae6c6dc2ec tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.388980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.389826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.390205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.390633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.391402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:16.391804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.395020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.422261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2978/5922] 10.222.0.16 () {58 vars in 1166 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects?domain_id=default => generated 6933 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:16.429421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.463518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10f9bf-baa3-4a62-8476-f4a06b6e51a9 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.477861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.478484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.478761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.493230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.493230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.493230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.543566 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2979/5923] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects => generated 7264 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:16.549997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.559395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088251d-4b21-444c-a2e5-b7b153996907 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.567185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.567907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.568183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.571845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3db1b6-6911-40fc-954e-9892ad8c3323 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.572108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] PATH_INFO: `/v3/projects/ad77a6e9822547f5bbc873f4684012d0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.574094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad77a6e9822547f5bbc873f4684012d0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.576208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.585446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.586153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.586435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.586711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.587389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-67558577) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:16.587702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.594311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.623292 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2980/5924] 10.222.0.16 () {58 vars in 1228 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-67558577 => generated 531 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:16.628084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.642483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b46daf-9d0c-40d7-941a-02401b52351e tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.648123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '543384893b4349b2836ffc80ec60f266', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfbeb082db3146afa683b661fb0e73a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.648826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.649146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.649427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] PATH_INFO: `/v3/projects/74c28086674c4cd9888e3e8710c1b734` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.650710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74c28086674c4cd9888e3e8710c1b734)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.653138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.668757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad77a6e9822547f5bbc873f4684012d0', 'request_id': 'req-51242b50-0107-4e2f-a184-702945d1cc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.676967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad77a6e9822547f5bbc873f4684012d0', 'request_id': 'req-51242b50-0107-4e2f-a184-702945d1cc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.688886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad77a6e9822547f5bbc873f4684012d0', 'request_id': 'req-51242b50-0107-4e2f-a184-702945d1cc5c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.708907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] The token cache is being invalidate because project ad77a6e9822547f5bbc873f4684012d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:16.709471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.711696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-51242b50-0107-4e2f-a184-702945d1cc5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.717743 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2945/5925] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:16 2022] DELETE /identity/v3/projects/ad77a6e9822547f5bbc873f4684012d0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:16.719494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334981b-f1fd-47bb-ba59-1b1d93112c1c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.721321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334981b-f1fd-47bb-ba59-1b1d93112c1c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.722465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c28086674c4cd9888e3e8710c1b734', 'request_id': 'req-51d97124-ca14-4966-a508-96a20db39ac4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.723114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334981b-f1fd-47bb-ba59-1b1d93112c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.729598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c28086674c4cd9888e3e8710c1b734', 'request_id': 'req-51d97124-ca14-4966-a508-96a20db39ac4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.737589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c28086674c4cd9888e3e8710c1b734', 'request_id': 'req-51d97124-ca14-4966-a508-96a20db39ac4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.749006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7334981b-f1fd-47bb-ba59-1b1d93112c1c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:16.751001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7334981b-f1fd-47bb-ba59-1b1d93112c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:16.754414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] The token cache is being invalidate because project 74c28086674c4cd9888e3e8710c1b734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:16.754826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.755411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.758480 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:16.761137 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2981/5926] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:16 2022] DELETE /identity/v3/projects/74c28086674c4cd9888e3e8710c1b734 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:16.764075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.766613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:16.860514 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2946/5927] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:16.862255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9e1c-c578-4127-a459-24c5bb14b98b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.862644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9e1c-c578-4127-a459-24c5bb14b98b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.863015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9e1c-c578-4127-a459-24c5bb14b98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.864822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97124-ca14-4966-a508-96a20db39ac4 tempest-ListProjectsStaticTestJSON-1363929905 tempest-ListProjectsStaticTestJSON-1363929905-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.878059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.878652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.878928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.879200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] PATH_INFO: `/v3/users/cacf9f6514124baa8ccb44b1d8b1b5a8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.880469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cacf9f6514124baa8ccb44b1d8b1b5a8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.883623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.891818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79be9e1c-c578-4127-a459-24c5bb14b98b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:16.893424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79be9e1c-c578-4127-a459-24c5bb14b98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:16.906542 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2947/5928] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:16.908148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9e1c-c578-4127-a459-24c5bb14b98b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.921434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9e1c-c578-4127-a459-24c5bb14b98b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.927926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.928634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.929362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.929638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.930291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:16.930602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.932906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.946493 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:16.955820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2948/5929] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:16.956812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:16.961048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cacf9f6514124baa8ccb44b1d8b1b5a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.962070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cacf9f6514124baa8ccb44b1d8b1b5a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.963200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cacf9f6514124baa8ccb44b1d8b1b5a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.972718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454859ac-e778-4741-904c-eb715d13662c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:16.979456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:16.980067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:16.980343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:16.980612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:16.981305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:16.983201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:16.984033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cacf9f6514124baa8ccb44b1d8b1b5a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:16.993078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a14cf0f5-5288-4ab2-bb5a-c81cd85f036b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cacf9f6514124baa8ccb44b1d8b1b5a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:17.013407 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2982/5930] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:16 2022] DELETE /identity/v3/users/cacf9f6514124baa8ccb44b1d8b1b5a8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:17.018025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847dba6-9482-41ad-8c34-e0a27d150fe3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.018403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847dba6-9482-41ad-8c34-e0a27d150fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.018682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847dba6-9482-41ad-8c34-e0a27d150fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.031814 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2949/5931] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:16 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:17.033287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.037678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:17.064352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e847dba6-9482-41ad-8c34-e0a27d150fe3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:17.065597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e847dba6-9482-41ad-8c34-e0a27d150fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:17.155445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c829-4db5-4e42-9756-a81994b6337d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:17.161600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:17.162363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.162718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.163939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.165434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:17.168303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:17.202528 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2983/5932] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:17.207907 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2950/5933] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:17 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:17.212441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847dba6-9482-41ad-8c34-e0a27d150fe3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.225904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847dba6-9482-41ad-8c34-e0a27d150fe3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:17.234849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.237400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:17.244206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:17.247005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.248908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.249341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.251096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:17.255359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:17.277969 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2984/5934] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:17.283323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.307013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478ded-f6ac-4ffb-82c9-99ad802168ce admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:17.326525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:17.328228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.332324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.332803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.333692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:17.339846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:17.349802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4811-3b37-4788-91f5-ed51f153f36e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:17.359911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d4876-23c1-4be4-9f2d-e7fb4d15183d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:17.360451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d4876-23c1-4be4-9f2d-e7fb4d15183d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.360992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d4876-23c1-4be4-9f2d-e7fb4d15183d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.361211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d4876-23c1-4be4-9f2d-e7fb4d15183d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.381274 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2985/5935] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:17.382592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.397452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219268e0-21e0-432c-a600-cccf4f8d34fd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:17.397740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d4876-23c1-4be4-9f2d-e7fb4d15183d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:17.403501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d4876-23c1-4be4-9f2d-e7fb4d15183d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:17.405365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e897e5-b23d-4eb2-a2ed-8b0804b0d452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:17.406456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e897e5-b23d-4eb2-a2ed-8b0804b0d452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.407323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e897e5-b23d-4eb2-a2ed-8b0804b0d452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.407597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e897e5-b23d-4eb2-a2ed-8b0804b0d452 admin admin] PATH_INFO: `/v3/projects/6d18b193ca954c949bc074c81046dc56/users/9b243b662a3141a0900a38fcaed5ddc7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.424019 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:17.433840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e897e5-b23d-4eb2-a2ed-8b0804b0d452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d18b193ca954c949bc074c81046dc56, user_id=9b243b662a3141a0900a38fcaed5ddc7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:17.436733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e897e5-b23d-4eb2-a2ed-8b0804b0d452 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:17.439770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2951/5936] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:17.443351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.444957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.445579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.464327 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2986/5937] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:17 2022] PUT /identity/v3/projects/6d18b193ca954c949bc074c81046dc56/users/9b243b662a3141a0900a38fcaed5ddc7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:17.472615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00753f46-8a3d-4350-b6c0-1d13dd27916b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.472969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00753f46-8a3d-4350-b6c0-1d13dd27916b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.473194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00753f46-8a3d-4350-b6c0-1d13dd27916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.512820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] MFA Rules not processed for user `b705c41d25b34b3e8d5bf9a300bf7868`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:17.514425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:17.518686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-00753f46-8a3d-4350-b6c0-1d13dd27916b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:17.521851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-00753f46-8a3d-4350-b6c0-1d13dd27916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:17.629193 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2952/5938] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:17.633699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.635240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:17.654288 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2987/5939] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:17.720139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3960-7d07-465a-9c98-a7feef9702ff None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.720733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3960-7d07-465a-9c98-a7feef9702ff None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.721106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3960-7d07-465a-9c98-a7feef9702ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.743046 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:17.759624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6dcb3960-7d07-465a-9c98-a7feef9702ff None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:17.761887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6dcb3960-7d07-465a-9c98-a7feef9702ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:17.766886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cac0e-54e3-4973-87d5-cc7af18ddc11 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:17.775338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:17.775961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.776244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.776624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.777703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:17.779922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:17.828422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2953/5940] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:17 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:17.831207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.920099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a010c5e-af75-4684-bb9a-667adcb78d73 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:17.924048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:17.924663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:17.924945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:17.925279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:17.943338 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2988/5941] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:17.945054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3960-7d07-465a-9c98-a7feef9702ff None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:17.961252 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:17.964036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3960-7d07-465a-9c98-a7feef9702ff None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:18.000519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:18.003691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:18.016028 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2954/5942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:18.017015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:18.019135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:18.094610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:18.095436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:18.095749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:18.096037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:18.096858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:18.102425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:18.125930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36c207-2097-42d0-a2c2-112bad60517f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:18.135095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:18.136199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:18.136484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:18.136758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:18.141933 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2989/5943] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:17 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:18.143463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:18.168097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d2b3a-5d1a-4bd5-b78f-6e4a7d150b7d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:18.173119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:18.173711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:18.173991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:18.174262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:18.174905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:18.177354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:18.193103 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2990/5944] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:18.194534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:18.206078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f884-ea8f-4fe5-8d47-97ad5e3da21f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:18.211896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:18.212645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:18.213148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:18.213287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:18.213596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] PATH_INFO: `/v3/projects/53178a22daf04994829b0c2981e5f87c/users/c9f97083b5f1480db2020cab1443f054/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:18.215513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:18.236153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53178a22daf04994829b0c2981e5f87c, user_id=c9f97083b5f1480db2020cab1443f054, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:18.239236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:18.243822 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2955/5945] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:28:18.280672 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2991/5946] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:18 2022] PUT /identity/v3/projects/53178a22daf04994829b0c2981e5f87c/users/c9f97083b5f1480db2020cab1443f054/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:18.284764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:18.303264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de3546-4a7b-4d15-a7ed-f7b98fff6654 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:18.440420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:18.441038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:18.441322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:18.442143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:18.442270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:18.444551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:18.495029 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2956/5947] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:18.499929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:18.522452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6756d8-05b4-4d06-b999-8949a28d81a8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:18.535169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:18.535701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:18.536079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:18.536278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] PATH_INFO: `/v3/projects/53178a22daf04994829b0c2981e5f87c/users/c9f97083b5f1480db2020cab1443f054/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:18.538590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53178a22daf04994829b0c2981e5f87c, user_id=c9f97083b5f1480db2020cab1443f054, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:18.541256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:18.555198 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2992/5948] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:18 2022] PUT /identity/v3/projects/53178a22daf04994829b0c2981e5f87c/users/c9f97083b5f1480db2020cab1443f054/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:19.035659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:19.037845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:19.050969 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:19.083129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2019d-049d-4267-b711-e809c758131d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:19.189512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:19.190534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:19.190534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:19.190898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] PATH_INFO: `/v3/projects/aff4935e546f4f2f83f0e852a6e4618f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:19.192210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff4935e546f4f2f83f0e852a6e4618f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:19.194807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:19.271162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff4935e546f4f2f83f0e852a6e4618f', 'request_id': 'req-f7997ec0-c28d-436d-826d-993047fc3d3b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.283745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff4935e546f4f2f83f0e852a6e4618f', 'request_id': 'req-f7997ec0-c28d-436d-826d-993047fc3d3b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.297146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff4935e546f4f2f83f0e852a6e4618f', 'request_id': 'req-f7997ec0-c28d-436d-826d-993047fc3d3b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.315555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] The token cache is being invalidate because project aff4935e546f4f2f83f0e852a6e4618f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:19.316303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.318011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.321823 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2957/5949] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:19 2022] DELETE /identity/v3/projects/aff4935e546f4f2f83f0e852a6e4618f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:19.326287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:19.328077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:19.352727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a531b0-c48c-4074-b68e-479b17fd53e4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:19.434906 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:19.456398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:19.457341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:19.457748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:19.458101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] PATH_INFO: `/v3/users/543384893b4349b2836ffc80ec60f266` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:19.459365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543384893b4349b2836ffc80ec60f266)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:19.462729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:19.536302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543384893b4349b2836ffc80ec60f266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.537146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543384893b4349b2836ffc80ec60f266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.538400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543384893b4349b2836ffc80ec60f266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.553248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543384893b4349b2836ffc80ec60f266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.565732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04a06654-a44c-4ae0-8756-c38417346b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543384893b4349b2836ffc80ec60f266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:19.580803 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2993/5950] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:19 2022] DELETE /identity/v3/users/543384893b4349b2836ffc80ec60f266 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:20.093261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:20.100992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:20.128278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7997ec0-c28d-436d-826d-993047fc3d3b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:20.245139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:20.245964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:20.247622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:20.248113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] PATH_INFO: `/v3/users/45895ab973fc46c496f5ac1f86f23907` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:20.249728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45895ab973fc46c496f5ac1f86f23907)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:20.252450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:20.356546 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:20.385781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45895ab973fc46c496f5ac1f86f23907'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:20.386688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45895ab973fc46c496f5ac1f86f23907'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:20.387768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45895ab973fc46c496f5ac1f86f23907'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:20.399190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45895ab973fc46c496f5ac1f86f23907'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:20.425664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45895ab973fc46c496f5ac1f86f23907'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:20.455700 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2958/5951] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:20 2022] DELETE /identity/v3/users/45895ab973fc46c496f5ac1f86f23907 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:20.457141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:20.457440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:20.457715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:20.481362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:20.482618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:20.576848 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2994/5952] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:20.638905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:20.640661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:20.711061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fa90-e604-4a83-9d96-46bb5f7d8c70 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:20.715361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d28e5-81a7-4e87-aa56-12faaa5e678e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:20.716244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d28e5-81a7-4e87-aa56-12faaa5e678e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:20.716838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d28e5-81a7-4e87-aa56-12faaa5e678e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:20.717357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d28e5-81a7-4e87-aa56-12faaa5e678e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:20.728108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d28e5-81a7-4e87-aa56-12faaa5e678e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:20.730446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d28e5-81a7-4e87-aa56-12faaa5e678e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:20.743234 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2959/5953] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:21.208595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:21.211584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:21.240385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4ec3-9fde-4b43-b194-597fe1b87314 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:21.269686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:21.271738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:21.272634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:21.273472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] PATH_INFO: `/v3/projects/cfbeb082db3146afa683b661fb0e73a6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:21.275845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfbeb082db3146afa683b661fb0e73a6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:21.281968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:21.295265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb2c3-1956-4645-b75c-870638bc7f54 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:21.302905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb2c3-1956-4645-b75c-870638bc7f54 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:21.304213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376eb2c3-1956-4645-b75c-870638bc7f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:21.435554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfbeb082db3146afa683b661fb0e73a6', 'request_id': 'req-8f07f168-4bd2-4368-8d59-e76c6ff45932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:21.446743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfbeb082db3146afa683b661fb0e73a6', 'request_id': 'req-8f07f168-4bd2-4368-8d59-e76c6ff45932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:21.447317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-376eb2c3-1956-4645-b75c-870638bc7f54 None None] MFA Rules not processed for user `c9f97083b5f1480db2020cab1443f054`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:21.449341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-376eb2c3-1956-4645-b75c-870638bc7f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:21.458370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfbeb082db3146afa683b661fb0e73a6', 'request_id': 'req-8f07f168-4bd2-4368-8d59-e76c6ff45932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:21.463884 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:21.504661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] The token cache is being invalidate because project cfbeb082db3146afa683b661fb0e73a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:21.504962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:21.505615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f07f168-4bd2-4368-8d59-e76c6ff45932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:21.518590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2995/5954] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:21 2022] DELETE /identity/v3/projects/cfbeb082db3146afa683b661fb0e73a6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:21.523591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928679da-4094-4141-8ec6-5f44a9c3c18b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:21.525013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928679da-4094-4141-8ec6-5f44a9c3c18b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:21.525013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928679da-4094-4141-8ec6-5f44a9c3c18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:21.569569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-928679da-4094-4141-8ec6-5f44a9c3c18b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:21.571910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-928679da-4094-4141-8ec6-5f44a9c3c18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:21.666008 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2960/5955] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:21.676438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622416-08f7-457f-8ade-6e1ebec7d536 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:21.676969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622416-08f7-457f-8ade-6e1ebec7d536 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:21.677509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622416-08f7-457f-8ade-6e1ebec7d536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:21.731182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2996/5956] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:21.731704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8d622416-08f7-457f-8ade-6e1ebec7d536 None None] MFA Rules not processed for user `b705c41d25b34b3e8d5bf9a300bf7868`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:21.733840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8d622416-08f7-457f-8ade-6e1ebec7d536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:21.753101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67093-4cb4-41bf-9dbc-9f1296f2d375 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:21.753101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67093-4cb4-41bf-9dbc-9f1296f2d375 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:21.753101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e67093-4cb4-41bf-9dbc-9f1296f2d375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:21.787131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-51e67093-4cb4-41bf-9dbc-9f1296f2d375 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:21.788833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-51e67093-4cb4-41bf-9dbc-9f1296f2d375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:21.800423 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2997/5957] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:21.804911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67093-4cb4-41bf-9dbc-9f1296f2d375 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:21.816526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e67093-4cb4-41bf-9dbc-9f1296f2d375 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:21.827299 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:21.844106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:21.845962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:21.848349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:21.851481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:21.852219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:21.852599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:21.857123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:21.882425 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2998/5958] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:28:21.887393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:21.887996 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2961/5959] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:21.905285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b381fc-9388-4225-b2da-48eedcc47ae4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:21.912315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:21.913464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:21.914508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:21.914790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:21.915841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:21.917492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:21.978954 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 2999/5960] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:21 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:21.980310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d622416-08f7-457f-8ade-6e1ebec7d536 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:21.995067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d622416-08f7-457f-8ade-6e1ebec7d536 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:22.078164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:22.080012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:22.188821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:22.191248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.192373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.192373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.195525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:22.200746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:22.217584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc662a1-e82f-4cd8-beb9-123a3246ee9d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:22.225038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:22.226383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.226668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.227085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.229217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:22.273857 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2962/5961] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:21 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:22.276477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:22.281389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:22.307419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301699ba-4878-4b2b-8fa9-cbf7c725f9bc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:22.311879 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:22.314631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:22.315880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.316275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.316689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] PATH_INFO: `/v3/projects/2fbc2c64e26f4d748b89b539caad094b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.318308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbc2c64e26f4d748b89b539caad094b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:22.321394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:22.329745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:22.331777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:22.361384 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3000/5962] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:22.362367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:22.390553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71dcfd-7e1c-4fa0-85a9-6247cd1778f5 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:22.394993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbc2c64e26f4d748b89b539caad094b', 'request_id': 'req-ae2c16a4-2ee8-4c09-bf29-329f98e11286'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.423485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbc2c64e26f4d748b89b539caad094b', 'request_id': 'req-ae2c16a4-2ee8-4c09-bf29-329f98e11286'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.440321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbc2c64e26f4d748b89b539caad094b', 'request_id': 'req-ae2c16a4-2ee8-4c09-bf29-329f98e11286'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.461017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] The token cache is being invalidate because project 2fbc2c64e26f4d748b89b539caad094b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:22.461558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.462548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.464965 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2963/5963] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:22 2022] DELETE /identity/v3/projects/2fbc2c64e26f4d748b89b539caad094b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:22.469157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:22.471108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:22.494682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:22.495797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.496078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.496395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.497049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:22.498775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:22.514953 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3001/5964] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:22.516173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:22.518050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:22.539915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cfdad-6603-42a9-aefd-70edf81473b8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:22.547069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:22.547809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.548357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.548550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.549347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:22.551506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:22.579281 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3002/5965] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:22.580293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:22.581498 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:22.585986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c16a4-2ee8-4c09-bf29-329f98e11286 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:22.594774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:22.595745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.596529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.596971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] PATH_INFO: `/v3/users/5717a4e10ec943e685c9860f60133b7b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.598704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5717a4e10ec943e685c9860f60133b7b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:22.603488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:22.612598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5856bf-ea75-4959-b231-216382a06a21 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:22.627262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb950f-0a59-4057-862c-debbf0d7675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:22.628687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb950f-0a59-4057-862c-debbf0d7675d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.630610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb950f-0a59-4057-862c-debbf0d7675d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.630909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb950f-0a59-4057-862c-debbf0d7675d admin admin] PATH_INFO: `/v3/projects/ef35a9dd031844ef82c7d1575155bf80/users/8027969596164a5295a2a898bc1df2d5/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.679101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb950f-0a59-4057-862c-debbf0d7675d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35a9dd031844ef82c7d1575155bf80, user_id=8027969596164a5295a2a898bc1df2d5, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:22.685204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb950f-0a59-4057-862c-debbf0d7675d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:22.687040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5717a4e10ec943e685c9860f60133b7b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.689221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5717a4e10ec943e685c9860f60133b7b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.692718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5717a4e10ec943e685c9860f60133b7b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.712526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5717a4e10ec943e685c9860f60133b7b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.723023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3003/5966] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:22 2022] PUT /identity/v3/projects/ef35a9dd031844ef82c7d1575155bf80/users/8027969596164a5295a2a898bc1df2d5/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:22.734329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5717a4e10ec943e685c9860f60133b7b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:22.736449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee437-fa27-4bae-a73c-a2ace3408dbd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:22.737368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee437-fa27-4bae-a73c-a2ace3408dbd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:22.737876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee437-fa27-4bae-a73c-a2ace3408dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:22.755630 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2964/5967] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:22 2022] DELETE /identity/v3/users/5717a4e10ec943e685c9860f60133b7b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:22.792614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-49fee437-fa27-4bae-a73c-a2ace3408dbd None None] MFA Rules not processed for user `8027969596164a5295a2a898bc1df2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:22.794731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-49fee437-fa27-4bae-a73c-a2ace3408dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:22.905449 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3004/5968] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:22.909617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:22.911216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:23.016523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c9f17-520d-4170-b293-c24e38f941be admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.021946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.023088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.023370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.023644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.024290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.033812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.071125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2965/5969] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:22 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:23.074930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee437-fa27-4bae-a73c-a2ace3408dbd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.099571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee437-fa27-4bae-a73c-a2ace3408dbd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.231813 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:23.286011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.287045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.293180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.295410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.296383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.320133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.355003 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3005/5970] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:23 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:23.357901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.371235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0637-24a1-4c8d-8d07-60a680321f09 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.378189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.379003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.379136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.379349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.380023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.382277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.395966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2966/5971] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:23.400699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.419438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447f0c0-9449-4f94-942b-4daf77a707a1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.425388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.426275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.426634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.426916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] PATH_INFO: `/v3/projects/0245df21add144b78a4368b7691f6588/users/0442c0276fad448cace80c0cf3f3d941/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.449046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0245df21add144b78a4368b7691f6588, user_id=0442c0276fad448cace80c0cf3f3d941, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.452189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.473785 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3006/5972] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:23 2022] PUT /identity/v3/projects/0245df21add144b78a4368b7691f6588/users/0442c0276fad448cace80c0cf3f3d941/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:23.478823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.491634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1cacd-1abd-495d-982e-06ca9633bfee admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.556279 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:23.569434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.570167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.570837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.571191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.571921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.574169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.586668 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2967/5973] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:23.592003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.594715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:23.596005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.619353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6e976-8c29-4d7f-be4b-ee5470aec8d9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.626729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cf6fe-5b84-40f7-b261-6730fe13c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.627440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cf6fe-5b84-40f7-b261-6730fe13c6df admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.627693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cf6fe-5b84-40f7-b261-6730fe13c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.628013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cf6fe-5b84-40f7-b261-6730fe13c6df admin admin] PATH_INFO: `/v3/projects/0245df21add144b78a4368b7691f6588/users/0442c0276fad448cace80c0cf3f3d941/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.630120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cf6fe-5b84-40f7-b261-6730fe13c6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0245df21add144b78a4368b7691f6588, user_id=0442c0276fad448cace80c0cf3f3d941, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.633651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cf6fe-5b84-40f7-b261-6730fe13c6df admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.640032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed27f8-1c44-4e11-a6ad-45d2b0927438 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.646886 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2968/5974] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:23 2022] PUT /identity/v3/projects/0245df21add144b78a4368b7691f6588/users/0442c0276fad448cace80c0cf3f3d941/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:23.659244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442d8b-0df8-47dd-83b0-8779eeba35b7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.659653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442d8b-0df8-47dd-83b0-8779eeba35b7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.660061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442d8b-0df8-47dd-83b0-8779eeba35b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.696161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b7442d8b-0df8-47dd-83b0-8779eeba35b7 None None] MFA Rules not processed for user `0442c0276fad448cace80c0cf3f3d941`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:23.699760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b7442d8b-0df8-47dd-83b0-8779eeba35b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:23.753371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.754895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.755418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.755909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] PATH_INFO: `/v3/projects/1fbfe73117874083b74fc7dd33baf11c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.758907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fbfe73117874083b74fc7dd33baf11c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.766497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.818662 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2969/5975] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:23.824608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7442d8b-0df8-47dd-83b0-8779eeba35b7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.838758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7442d8b-0df8-47dd-83b0-8779eeba35b7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:23.845751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:23.846521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.846853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.847575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:23.848316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:23.852124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:23.908761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fbfe73117874083b74fc7dd33baf11c', 'request_id': 'req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:23.910858 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2970/5976] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:23 2022] POST /identity/v3/projects => generated 334 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:23.914842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:23.920930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fbfe73117874083b74fc7dd33baf11c', 'request_id': 'req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:23.929384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fbfe73117874083b74fc7dd33baf11c', 'request_id': 'req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:23.949254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] The token cache is being invalidate because project 1fbfe73117874083b74fc7dd33baf11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:23.951401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:23.953381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a9f3c0af-a5db-4b8b-92e3-0c6fc07a6a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:23.962819 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3007/5977] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:23 2022] DELETE /identity/v3/projects/1fbfe73117874083b74fc7dd33baf11c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:23.964447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625bdc-a200-4aae-8d6a-ccfd24fe3993 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:23.964737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625bdc-a200-4aae-8d6a-ccfd24fe3993 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:23.965014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b625bdc-a200-4aae-8d6a-ccfd24fe3993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.015873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1b625bdc-a200-4aae-8d6a-ccfd24fe3993 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:24.020318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b625bdc-a200-4aae-8d6a-ccfd24fe3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:24.051669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbbb94-1a42-4d9a-8242-3151dd121c02 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.062317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.062929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.064167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.064455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.065241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.067813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.103533 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:24.129800 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2971/5978] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:28:23 2022] POST /identity/v3/projects => generated 332 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:24.134253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.137360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:24.180242 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3008/5979] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:24.188703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f61bc-1a8a-4d23-b73d-dbed6a0a1026 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.188965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f61bc-1a8a-4d23-b73d-dbed6a0a1026 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.189278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f61bc-1a8a-4d23-b73d-dbed6a0a1026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.204629 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:24.251973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d70f61bc-1a8a-4d23-b73d-dbed6a0a1026 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:24.255418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d70f61bc-1a8a-4d23-b73d-dbed6a0a1026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:24.299646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2ac34-d788-4d7f-856a-8e57029e2bb3 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.311319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.313456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.315489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.315886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.316703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.322743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.418458 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2972/5980] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:24 2022] POST /identity/v3/projects => generated 358 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:24.420513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.442838 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3009/5981] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:24.448087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f61bc-1a8a-4d23-b73d-dbed6a0a1026 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.478109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f61bc-1a8a-4d23-b73d-dbed6a0a1026 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.598948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad0963-b6bc-4573-b87c-8b0246ad0140 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.607490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.608326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.608705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.609211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.610445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.612838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.645187 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2973/5982] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:28:24 2022] GET /identity/v3/projects => generated 7546 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:24.654900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.658471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.659109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.659395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.659675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.660674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:24.660980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.663320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.678865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67165-a419-40d5-a0de-491353a1197a tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.689639 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3010/5983] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:24.693710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.695320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.696389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.696921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.697478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.698507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:24.699119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.701423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.728772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0536c-bdb4-4db1-b6a5-6255520aa286 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.735072 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2974/5984] 10.222.0.16 () {58 vars in 1158 bytes} [Sun Sep 11 01:28:24 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:24.741536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.749714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.750284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.750576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.750853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.751495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.753470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.760922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d41fe-bb44-4c1c-9592-63e9e7e34d9e tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.773436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.774083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.774369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.774646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.775336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Adding query filter params (parent_id=358e43a638cd4be7a26f1a68980f3058) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:24.775649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.788414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.825779 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2975/5985] 10.222.0.16 () {58 vars in 1216 bytes} [Sun Sep 11 01:28:24 2022] GET /identity/v3/projects?parent_id=358e43a638cd4be7a26f1a68980f3058 => generated 498 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:28:24.831803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.844655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7fa75-f0a5-4281-86d3-4716391a4a18 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.857827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:24.858483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:24.858773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:24.859050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects/24c48d47d62947c78622c1b4615ea975` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:24.860949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24c48d47d62947c78622c1b4615ea975)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:24.862384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:24.862698 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3011/5986] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:24 2022] POST /identity/v3/projects => generated 355 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:24.867712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:24.961496 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:24.981964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c48d47d62947c78622c1b4615ea975', 'request_id': 'req-7fa682cd-498c-4e3d-895b-1fcc1ee66431'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:24.982922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1604-da56-46bd-874d-02412c53baad admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:24.997430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c48d47d62947c78622c1b4615ea975', 'request_id': 'req-7fa682cd-498c-4e3d-895b-1fcc1ee66431'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.021189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c48d47d62947c78622c1b4615ea975', 'request_id': 'req-7fa682cd-498c-4e3d-895b-1fcc1ee66431'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.024705 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:25.044622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] The token cache is being invalidate because project 24c48d47d62947c78622c1b4615ea975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:25.045364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.047868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.051296 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2976/5987] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:24 2022] DELETE /identity/v3/projects/24c48d47d62947c78622c1b4615ea975 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:25.055215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:25.056828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:25.125474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:25.126112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:25.128382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:25.128687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:25.129482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:25.137711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:25.195677 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3012/5988] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:24 2022] POST /identity/v3/users => generated 278 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:25.199601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:25.202449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:25.244104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53274ff-e1e3-4a98-93a8-c47386956f96 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:25.261403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:25.267375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:25.267660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:25.267936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:25.268613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:25.270297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:25.316036 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3013/5989] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:25.320433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:25.325993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa682cd-498c-4e3d-895b-1fcc1ee66431 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:25.347420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:25.348836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:25.350587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:25.351382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects/358e43a638cd4be7a26f1a68980f3058` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:25.356186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:delete_project(project_id=358e43a638cd4be7a26f1a68980f3058)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:25.372900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627291-e245-436b-9abb-b33cfbda1192 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:25.379586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:25.392912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:25.393610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:25.394055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:25.394332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:25.395887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:25.406309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:25.451864 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3014/5990] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:25.456746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:25.495052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c08e-5926-4eb2-adbc-c77c88550f98 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:25.502210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6590-efb1-4943-9908-eac4187e77ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:25.502926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6590-efb1-4943-9908-eac4187e77ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:25.503327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6590-efb1-4943-9908-eac4187e77ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:25.503655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6590-efb1-4943-9908-eac4187e77ec admin admin] PATH_INFO: `/v3/projects/a7daa68e6cd04dc8bdfb4b059bfed8f7/users/ccd8aab2fce84732829c8d2667f26f9e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:25.556251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358e43a638cd4be7a26f1a68980f3058', 'request_id': 'req-3d0bd704-4028-4742-8993-ef9fc848ecda'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.567456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6590-efb1-4943-9908-eac4187e77ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7daa68e6cd04dc8bdfb4b059bfed8f7, user_id=ccd8aab2fce84732829c8d2667f26f9e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:25.576890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6590-efb1-4943-9908-eac4187e77ec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:25.580914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358e43a638cd4be7a26f1a68980f3058', 'request_id': 'req-3d0bd704-4028-4742-8993-ef9fc848ecda'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.609496 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3015/5991] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:25 2022] PUT /identity/v3/projects/a7daa68e6cd04dc8bdfb4b059bfed8f7/users/ccd8aab2fce84732829c8d2667f26f9e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:25.611347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358e43a638cd4be7a26f1a68980f3058', 'request_id': 'req-3d0bd704-4028-4742-8993-ef9fc848ecda'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.620949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:25.621300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:25.621527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:25.651265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] The token cache is being invalidate because project 358e43a638cd4be7a26f1a68980f3058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:25.651639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.660007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:25.663046 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2977/5992] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:25 2022] DELETE /identity/v3/projects/358e43a638cd4be7a26f1a68980f3058 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:25.669449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:25.674324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:25.684708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] MFA Rules not processed for user `ccd8aab2fce84732829c8d2667f26f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:25.687818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:25.816122 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3016/5993] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:25.820867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:25.823818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:25.844516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd704-4028-4742-8993-ef9fc848ecda tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:25.894684 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:25.921727 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:25.975430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd310f1-b06a-4f67-be95-648890f548ee None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:25.995682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:25.997108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:25.997108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:25.997654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:25.999363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.003812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.023133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0442c0276fad448cace80c0cf3f3d941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0245df21add144b78a4368b7691f6588', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:26.023806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.024139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.024419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] PATH_INFO: `/v3/projects/c501afe26f6d49ddbde2966de3fc4869` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.025726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c501afe26f6d49ddbde2966de3fc4869)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.028170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.072673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3017/5994] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:25 2022] POST /identity/v3/projects => generated 355 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:26.076728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:26.135730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c501afe26f6d49ddbde2966de3fc4869', 'request_id': 'req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.162365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c501afe26f6d49ddbde2966de3fc4869', 'request_id': 'req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.180729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c501afe26f6d49ddbde2966de3fc4869', 'request_id': 'req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.207324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] The token cache is being invalidate because project c501afe26f6d49ddbde2966de3fc4869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:26.207324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.209994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.214901 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2978/5995] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:25 2022] DELETE /identity/v3/projects/c501afe26f6d49ddbde2966de3fc4869 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:26.218595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:26.223361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298929c-332b-4a21-a447-3142aef025b1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:26.247525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:26.352859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:26.353903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.354189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.355238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.355905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.358521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.359775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690fa54-0b05-4f45-b3b0-ad09e95b63a1 tempest-ListProjectsTestJSON-796199351 tempest-ListProjectsTestJSON-796199351-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:26.372899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:26.373130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.373924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.373924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] PATH_INFO: `/v3/users/8027969596164a5295a2a898bc1df2d5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.375228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8027969596164a5295a2a898bc1df2d5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.379487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.397433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3018/5996] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:26 2022] POST /identity/v3/users => generated 284 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:26.401642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:26.404272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:26.429426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b0dd3-ad62-49bc-8799-8f76af275671 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:26.439823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:26.440849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.441260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.441764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.442494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.444725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.458821 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3019/5997] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:28:26.463112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:26.474758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8027969596164a5295a2a898bc1df2d5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.476012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8027969596164a5295a2a898bc1df2d5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.476372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2801f7b-7ee1-48ae-9653-88f6fdd7125b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:26.476684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8027969596164a5295a2a898bc1df2d5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.485017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:26.485299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8027969596164a5295a2a898bc1df2d5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.486992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.487821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.488831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] PATH_INFO: `/v3/projects/ef0eb3f6f81644a497f5e53855327650/users/5b02bd8e7f8245b6a0bf22f79c4d5915/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.491670 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:26.505463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8f1a85af-54d8-4f9f-a1e1-f7f670f7636f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8027969596164a5295a2a898bc1df2d5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:26.514018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0eb3f6f81644a497f5e53855327650, user_id=5b02bd8e7f8245b6a0bf22f79c4d5915, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.517495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.527490 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2979/5998] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:26 2022] DELETE /identity/v3/users/8027969596164a5295a2a898bc1df2d5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:26.540507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac79fe-1fa4-47ea-b3ac-e77c2cd23de9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.540787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac79fe-1fa4-47ea-b3ac-e77c2cd23de9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.541081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac79fe-1fa4-47ea-b3ac-e77c2cd23de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.551563 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3020/5999] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:26 2022] PUT /identity/v3/projects/ef0eb3f6f81644a497f5e53855327650/users/5b02bd8e7f8245b6a0bf22f79c4d5915/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:26.553529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:26.585556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:26.628467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-caac79fe-1fa4-47ea-b3ac-e77c2cd23de9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:26.636715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-caac79fe-1fa4-47ea-b3ac-e77c2cd23de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:26.641012 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:26.754313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c34c-4214-4cfc-9876-27ecc7405d2b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:26.766719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4b50d-d99f-40fd-97ad-993f2f915633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:26.769618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b50d-d99f-40fd-97ad-993f2f915633 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.769941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b50d-d99f-40fd-97ad-993f2f915633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.770409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b50d-d99f-40fd-97ad-993f2f915633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.770887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4b50d-d99f-40fd-97ad-993f2f915633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.780352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4b50d-d99f-40fd-97ad-993f2f915633 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.801143 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2980/6000] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:26.808162 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3021/6001] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:26.813263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac79fe-1fa4-47ea-b3ac-e77c2cd23de9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:26.827350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac79fe-1fa4-47ea-b3ac-e77c2cd23de9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:26.837050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:26.838858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.839965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.839965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] PATH_INFO: `/v3/projects/ef0eb3f6f81644a497f5e53855327650/users/5b02bd8e7f8245b6a0bf22f79c4d5915/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.843668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0eb3f6f81644a497f5e53855327650, user_id=5b02bd8e7f8245b6a0bf22f79c4d5915, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:26.847400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:26.864235 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2981/6002] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:26 2022] PUT /identity/v3/projects/ef0eb3f6f81644a497f5e53855327650/users/5b02bd8e7f8245b6a0bf22f79c4d5915/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:26.875356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bbb2-cee0-4fd3-bce1-c4da93e43902 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:26.875922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bbb2-cee0-4fd3-bce1-c4da93e43902 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:26.875922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bbb2-cee0-4fd3-bce1-c4da93e43902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:26.920799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:26.922807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:26.960409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ddf9bbb2-cee0-4fd3-bce1-c4da93e43902 None None] MFA Rules not processed for user `5b02bd8e7f8245b6a0bf22f79c4d5915`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:26.961686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ddf9bbb2-cee0-4fd3-bce1-c4da93e43902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:27.058025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab99a2-b558-49d2-8640-f49ab02a1bbf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:27.063983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:27.064613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:27.064893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:27.065232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:27.077259 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3022/6003] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:27.081768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9bbb2-cee0-4fd3-bce1-c4da93e43902 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:27.093358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9bbb2-cee0-4fd3-bce1-c4da93e43902 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:27.102773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b02bd8e7f8245b6a0bf22f79c4d5915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef0eb3f6f81644a497f5e53855327650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:27.103597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:27.103860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:27.104133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:27.105093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:27.105406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:27.107264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:27.136769 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3023/6004] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:27.142108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:27.154386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:27.156011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:27.162810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036370e1-b7a5-4ec9-8aa8-4e3f3ed633bf tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:27.172807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b02bd8e7f8245b6a0bf22f79c4d5915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef0eb3f6f81644a497f5e53855327650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:27.173470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:27.174419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:27.174419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:27.174663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:27.176536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:27.180498 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2982/6005] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:27.220637 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3024/6006] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:27 2022] POST /identity/v3/projects => generated 350 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:27.224142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:27.238302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fc135-a049-4695-95d6-22c4fc833517 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:27.254286 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:27.337554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b02bd8e7f8245b6a0bf22f79c4d5915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef0eb3f6f81644a497f5e53855327650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:27.338950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:27.339406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:27.339681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:27.340391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:27.340698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:27.342348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:27.364347 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2983/6007] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:27.371902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:27.373904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:27.484085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277cd9-82c3-42a3-ad63-607e50253760 tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:27.491784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:27.492981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:27.493608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:27.494059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:27.511923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:27.549216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:27.607102 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3025/6008] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:28:28.067970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:28.083362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfaf78-9d96-4e86-94bf-025854e6a34a tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:28.098974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b02bd8e7f8245b6a0bf22f79c4d5915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef0eb3f6f81644a497f5e53855327650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:28.099684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:28.101313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:28.101824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] PATH_INFO: `/v3/projects/9337a1ed58374f8384615f630c52b4e2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:28.103990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9337a1ed58374f8384615f630c52b4e2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:28.108332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:28.205234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9337a1ed58374f8384615f630c52b4e2', 'request_id': 'req-00978b7f-38e5-497a-abfa-325448b41eee'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:28.220620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9337a1ed58374f8384615f630c52b4e2', 'request_id': 'req-00978b7f-38e5-497a-abfa-325448b41eee'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:28.232856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9337a1ed58374f8384615f630c52b4e2', 'request_id': 'req-00978b7f-38e5-497a-abfa-325448b41eee'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:28.246404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] The token cache is being invalidate because project 9337a1ed58374f8384615f630c52b4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:28.246739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:28.247402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-00978b7f-38e5-497a-abfa-325448b41eee tempest-QuotasTest-177441706 tempest-QuotasTest-177441706-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:28.253547 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2984/6009] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:28 2022] DELETE /identity/v3/projects/9337a1ed58374f8384615f630c52b4e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:28.706409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:28.722787 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:28.815019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:28.815500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:28.815753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:28.840559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b424b5f-985a-45d4-a407-6b974690ac65 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:28.880329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] MFA Rules not processed for user `9b243b662a3141a0900a38fcaed5ddc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:28.883917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:28.941027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:28.942603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:28.942879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:28.943150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] PATH_INFO: `/v3/users/ccd8aab2fce84732829c8d2667f26f9e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:28.946763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd8aab2fce84732829c8d2667f26f9e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:28.949901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:29.012728 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2985/6010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:29.014076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:29.019433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:29.038315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98e22-1861-453c-a884-a2c20ae873cb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:29.044704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:29.045465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:29.045751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd8aab2fce84732829c8d2667f26f9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.045889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:29.046041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] PATH_INFO: `/v3/projects/ef35a9dd031844ef82c7d1575155bf80` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:29.047007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd8aab2fce84732829c8d2667f26f9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.047200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef35a9dd031844ef82c7d1575155bf80)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:29.048150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd8aab2fce84732829c8d2667f26f9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.049128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:29.068791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd8aab2fce84732829c8d2667f26f9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.074941 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:29.078038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-37e45d5e-98ef-4b0e-8e49-f7235607d855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd8aab2fce84732829c8d2667f26f9e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.099105 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3026/6011] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:28 2022] DELETE /identity/v3/users/ccd8aab2fce84732829c8d2667f26f9e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:29.099105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:29.099105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:29.099105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:29.122389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] MFA Rules not processed for user `9b243b662a3141a0900a38fcaed5ddc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:29.123667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:29.131085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef35a9dd031844ef82c7d1575155bf80', 'request_id': 'req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.140062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef35a9dd031844ef82c7d1575155bf80', 'request_id': 'req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.153392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef35a9dd031844ef82c7d1575155bf80', 'request_id': 'req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.167199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] The token cache is being invalidate because project ef35a9dd031844ef82c7d1575155bf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:29.167559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.168581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7cd3fb12-dc13-4d4c-9b3f-39fe2a35e3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.170360 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2986/6012] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:29 2022] DELETE /identity/v3/projects/ef35a9dd031844ef82c7d1575155bf80 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:29.171347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:29.171629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:29.173846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:29.179236 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:29.200404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:29.201998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:29.219388 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3027/6013] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:29.220212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:29.225016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:29.315588 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2987/6014] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:29.324843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:29.328676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:29.341434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04453c60-04df-4ec4-b555-b2406beb954f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:29.348089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:29.348737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:29.349030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:29.349385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] PATH_INFO: `/v3/users/0442c0276fad448cace80c0cf3f3d941` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:29.351619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0442c0276fad448cace80c0cf3f3d941)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:29.354183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:29.427644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff15c5-531b-4b46-a7dd-9434e34e1f3a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:29.433347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:29.434379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:29.435122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:29.435934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:29.437388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0442c0276fad448cace80c0cf3f3d941'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.438245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0442c0276fad448cace80c0cf3f3d941'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.439109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0442c0276fad448cace80c0cf3f3d941'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.453009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:29.455811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0442c0276fad448cace80c0cf3f3d941'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.457887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:29.464656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0442c0276fad448cace80c0cf3f3d941'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:29.473962 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2988/6015] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:29.501046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:29.509244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3028/6016] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:29 2022] DELETE /identity/v3/users/0442c0276fad448cace80c0cf3f3d941 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:29.519349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:29.597046 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:29.656923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e66fa3-f33a-479b-92aa-ac9b07a63a9a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:29.766015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:29.766641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:29.766970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:29.767378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:29.769537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:29.909193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:29.911028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:29.931143 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2989/6017] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:30.458153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:30.460899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:30.629187 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:30.645615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2a633-dc54-41dc-b2c7-a9d1adaceb2e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:30.664722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:30.666369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:30.666657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:30.666930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] PATH_INFO: `/v3/projects/a7daa68e6cd04dc8bdfb4b059bfed8f7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:30.668827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7daa68e6cd04dc8bdfb4b059bfed8f7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:30.673001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:30.721247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:30.724432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:30.769927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7daa68e6cd04dc8bdfb4b059bfed8f7', 'request_id': 'req-21713805-e0c8-4008-a4ea-86551c13607f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:30.775017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cd188-f9ca-490d-8810-fc5c3f083f61 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:30.784412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7daa68e6cd04dc8bdfb4b059bfed8f7', 'request_id': 'req-21713805-e0c8-4008-a4ea-86551c13607f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:30.795268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7daa68e6cd04dc8bdfb4b059bfed8f7', 'request_id': 'req-21713805-e0c8-4008-a4ea-86551c13607f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:30.822458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] The token cache is being invalidate because project a7daa68e6cd04dc8bdfb4b059bfed8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:30.822801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:30.823506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:30.825842 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3029/6018] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:30 2022] DELETE /identity/v3/projects/a7daa68e6cd04dc8bdfb4b059bfed8f7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:30.832811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:30.834378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:30.903826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:30.906801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:30.908786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:30.909275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] PATH_INFO: `/v3/projects/0245df21add144b78a4368b7691f6588` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:30.913512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0245df21add144b78a4368b7691f6588)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:30.920217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:30.973484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21713805-e0c8-4008-a4ea-86551c13607f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:30.983399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:30.984062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:30.984353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:30.984613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] PATH_INFO: `/v3/users/5b02bd8e7f8245b6a0bf22f79c4d5915` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:30.985950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b02bd8e7f8245b6a0bf22f79c4d5915)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:30.991261 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:30.991543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:31.022504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0245df21add144b78a4368b7691f6588', 'request_id': 'req-85de7a9c-f34b-41e6-899f-7d895e922fa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.037668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0245df21add144b78a4368b7691f6588', 'request_id': 'req-85de7a9c-f34b-41e6-899f-7d895e922fa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.051927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0245df21add144b78a4368b7691f6588', 'request_id': 'req-85de7a9c-f34b-41e6-899f-7d895e922fa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.065673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] The token cache is being invalidate because project 0245df21add144b78a4368b7691f6588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:31.065966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.066639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85de7a9c-f34b-41e6-899f-7d895e922fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.070168 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2990/6019] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:30 2022] DELETE /identity/v3/projects/0245df21add144b78a4368b7691f6588 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:31.076371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6241-0dd0-431b-9f38-ccb0f9665c51 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:31.077771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6241-0dd0-431b-9f38-ccb0f9665c51 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:31.078244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6241-0dd0-431b-9f38-ccb0f9665c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:31.103572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-243c6241-0dd0-431b-9f38-ccb0f9665c51 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:31.105188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-243c6241-0dd0-431b-9f38-ccb0f9665c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:31.108775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b02bd8e7f8245b6a0bf22f79c4d5915'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.109603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b02bd8e7f8245b6a0bf22f79c4d5915'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.111633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b02bd8e7f8245b6a0bf22f79c4d5915'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.134137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b02bd8e7f8245b6a0bf22f79c4d5915'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.148967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-431fe2b9-7e21-42cc-9910-54798b8a4d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b02bd8e7f8245b6a0bf22f79c4d5915'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:31.182413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3030/6020] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:30 2022] DELETE /identity/v3/users/5b02bd8e7f8245b6a0bf22f79c4d5915 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:31.239515 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2991/6021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:31.247893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944b6e-1bc9-4d06-a40e-3e9b1fb91d9b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:31.248418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944b6e-1bc9-4d06-a40e-3e9b1fb91d9b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:31.248857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944b6e-1bc9-4d06-a40e-3e9b1fb91d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:31.274486 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:31.285322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-36944b6e-1bc9-4d06-a40e-3e9b1fb91d9b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:31.287398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-36944b6e-1bc9-4d06-a40e-3e9b1fb91d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:31.467916 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3031/6022] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:31.472710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6241-0dd0-431b-9f38-ccb0f9665c51 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:31.496700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6241-0dd0-431b-9f38-ccb0f9665c51 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:31.511294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:31.512298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:31.512589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:31.513053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:31.513876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:31.514193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:31.517998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:31.541812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2992/6023] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:31.544553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944b6e-1bc9-4d06-a40e-3e9b1fb91d9b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:31.557674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944b6e-1bc9-4d06-a40e-3e9b1fb91d9b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:31.566006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:31.567275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:31.568243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:31.569285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:31.571828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:31.576643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:31.640689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3032/6024] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:31 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:31.645589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:31.676218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f38aaf-b0cf-4978-9f33-d63563770b76 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:31.815412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:31.816517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:31.816911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:31.817230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:31.817889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:31.823761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:31.874994 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2993/6025] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:31 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:31.880147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:31.907285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be455065-1d59-45a2-a900-7fd1995d7a04 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:31.952869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:31.954675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:31.955830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:31.956417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:31.961729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:31.969994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:31.991782 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3033/6026] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:31.993265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:32.018613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80d925-9f4d-4508-a286-6353ebff3ce9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:32.055955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4144dba-df33-4853-b869-705eb2046665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:32.056654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144dba-df33-4853-b869-705eb2046665 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:32.057263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144dba-df33-4853-b869-705eb2046665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:32.057263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144dba-df33-4853-b869-705eb2046665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:32.057960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4144dba-df33-4853-b869-705eb2046665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:32.060545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4144dba-df33-4853-b869-705eb2046665 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:32.089004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2994/6027] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:32.093930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:32.130109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce88b1-abc6-46fc-9648-6e830bee714a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:32.145818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:32.150435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:32.150986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:32.152852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] PATH_INFO: `/v3/projects/42d9c1ef405c4fed8cb37ff8bf3292bd/users/affb0f87c08d4f1eaab904e99037c102/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:32.201803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d9c1ef405c4fed8cb37ff8bf3292bd, user_id=affb0f87c08d4f1eaab904e99037c102, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:32.208423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:32.245606 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3034/6028] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:32 2022] PUT /identity/v3/projects/42d9c1ef405c4fed8cb37ff8bf3292bd/users/affb0f87c08d4f1eaab904e99037c102/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:32.256840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7369-2ed0-4f2b-a24a-0c1320e8303b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:32.257146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7369-2ed0-4f2b-a24a-0c1320e8303b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:32.258217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7369-2ed0-4f2b-a24a-0c1320e8303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:32.304995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a6bc7369-2ed0-4f2b-a24a-0c1320e8303b None None] MFA Rules not processed for user `affb0f87c08d4f1eaab904e99037c102`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:32.306248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6bc7369-2ed0-4f2b-a24a-0c1320e8303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:32.317480 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:32.421574 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2995/6029] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:32.426174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:32.593847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd9a9-3c3f-40b8-8c0e-7d573981492c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:32.609331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:32.610128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:32.610593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:32.611224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:32.612355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:32.615164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:32.680783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7369-2ed0-4f2b-a24a-0c1320e8303b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:32.683320 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3035/6030] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:32 2022] POST /identity/v3/projects => generated 367 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:32.695692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7369-2ed0-4f2b-a24a-0c1320e8303b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:32.860271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:32.861004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:32.861325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:32.861792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:32.863612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:32.866354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:32.921557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:32.927575 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2996/6031] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:32 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:32.944000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddb62-fbc8-4098-a516-fbdfbc71733f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:32.993317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:32.995108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:32.995108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:32.995344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:32.995903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:33.007820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:33.047176 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3036/6032] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:28:33.048746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:33.066446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb264f38-d9f4-4128-bdbf-ff5982a1196d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:33.076819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:33.077535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.077808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.078080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] PATH_INFO: `/v3/projects/e33238603ace49cfbae0f4f7faed9950/users/31b33b07d6654400911af6d400d72dda/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.106296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33238603ace49cfbae0f4f7faed9950, user_id=31b33b07d6654400911af6d400d72dda, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:33.110013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:33.132935 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2997/6033] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:33 2022] PUT /identity/v3/projects/e33238603ace49cfbae0f4f7faed9950/users/31b33b07d6654400911af6d400d72dda/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:33.137568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:33.149243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c722d69-9044-4bc2-aa7d-6c1612e4674d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:33.198184 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:33.305879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba919f80-5e37-440c-9e85-1d7edc5eebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:33.307088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919f80-5e37-440c-9e85-1d7edc5eebe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.307370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919f80-5e37-440c-9e85-1d7edc5eebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.307688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919f80-5e37-440c-9e85-1d7edc5eebe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.310335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba919f80-5e37-440c-9e85-1d7edc5eebe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:33.312019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba919f80-5e37-440c-9e85-1d7edc5eebe7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:33.337127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3037/6034] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:33.341208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:33.359843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79dd2-b071-4eb3-bd5a-4d3ca2ef2620 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:33.370304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:33.370986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.371263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.372486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] PATH_INFO: `/v3/projects/e33238603ace49cfbae0f4f7faed9950/users/31b33b07d6654400911af6d400d72dda/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.377614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33238603ace49cfbae0f4f7faed9950, user_id=31b33b07d6654400911af6d400d72dda, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:33.380291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:33.410635 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2998/6035] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:33 2022] PUT /identity/v3/projects/e33238603ace49cfbae0f4f7faed9950/users/31b33b07d6654400911af6d400d72dda/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:33.422935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7a75-c11c-4ed1-a082-db1c91fee3ac None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.423381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7a75-c11c-4ed1-a082-db1c91fee3ac None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.423660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7a75-c11c-4ed1-a082-db1c91fee3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.467620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7fde7a75-c11c-4ed1-a082-db1c91fee3ac None None] MFA Rules not processed for user `31b33b07d6654400911af6d400d72dda`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:33.468927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7fde7a75-c11c-4ed1-a082-db1c91fee3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:33.518923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:33.523918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:33.634966 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3038/6036] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:33.639100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde7a75-c11c-4ed1-a082-db1c91fee3ac None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:33.654777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde7a75-c11c-4ed1-a082-db1c91fee3ac None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:33.659173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc6806-b34e-4152-bf8c-15e961d1c126 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:33.671564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:33.672948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:33.673588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.673743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.674097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.674584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.674732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] PATH_INFO: `/v3/projects/ef0eb3f6f81644a497f5e53855327650` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.675829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.676077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0eb3f6f81644a497f5e53855327650)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:33.676916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:33.679683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:33.681833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:33.682551 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:33.727311 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3039/6037] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:33 2022] POST /identity/v3/roles => generated 235 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:33.735944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:33.757741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17b33-ffed-4dd1-b5a8-245bda03e9e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:33.771152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0eb3f6f81644a497f5e53855327650', 'request_id': 'req-4329d087-d788-4027-b75b-2419faadb214'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:33.781280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0eb3f6f81644a497f5e53855327650', 'request_id': 'req-4329d087-d788-4027-b75b-2419faadb214'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:33.798341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0eb3f6f81644a497f5e53855327650', 'request_id': 'req-4329d087-d788-4027-b75b-2419faadb214'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:33.827434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] The token cache is being invalidate because project ef0eb3f6f81644a497f5e53855327650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:33.847962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:33.849694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4329d087-d788-4027-b75b-2419faadb214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:33.861366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 2999/6038] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:33 2022] DELETE /identity/v3/projects/ef0eb3f6f81644a497f5e53855327650 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:33.865923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869071-b516-43b8-a315-ba64e7623248 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.873097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869071-b516-43b8-a315-ba64e7623248 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.873765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869071-b516-43b8-a315-ba64e7623248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.924096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-65869071-b516-43b8-a315-ba64e7623248 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:33.925701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-65869071-b516-43b8-a315-ba64e7623248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:33.927514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:33.928662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:33.929252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:33.929735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:33.931857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:33.936310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:33.982739 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3040/6039] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:33 2022] POST /identity/v3/roles => generated 235 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:33.987897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:33.995040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:34.033038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985b80-3c29-4442-866b-994e3013bda7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.049533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:34.050401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.050860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.051330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.052181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:34.054812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:34.066401 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3000/6040] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:34.068932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166880e8-3308-47fe-8c44-f06d8a5cca73 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.069244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166880e8-3308-47fe-8c44-f06d8a5cca73 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.069519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166880e8-3308-47fe-8c44-f06d8a5cca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.117817 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3041/6041] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:33 2022] POST /identity/v3/roles => generated 235 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:34.121796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:34.136082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-166880e8-3308-47fe-8c44-f06d8a5cca73 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:34.137736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-166880e8-3308-47fe-8c44-f06d8a5cca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:34.140309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794878-121b-4485-ab0e-68d1d1c45acb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.168781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:34.170841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3001/6042] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:34.171522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.172024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.172510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.173417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:34.175525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:34.176077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166880e8-3308-47fe-8c44-f06d8a5cca73 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:34.205282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166880e8-3308-47fe-8c44-f06d8a5cca73 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.209921 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:34.225470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:34.226755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.227053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.227369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.228046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:34.228685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:34.230330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:34.238927 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3042/6043] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:28:34 2022] POST /identity/v3/domains => generated 275 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:34.242750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:34.266332 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3002/6044] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:34.274791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:34.311203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6eb21-5e30-4577-877b-9d547005c824 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.412769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b053c6-e51b-42ae-8ff0-b3615e9af316 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.426762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:34.428596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.429197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.432226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.434515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:34.436727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:34.462677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:34.464839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.465721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.466151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.469165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:34.472207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:34.541638 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:34.546246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3043/6045] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:34 2022] POST /identity/v3/projects => generated 398 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:34.550691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:34.601386 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3003/6046] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:34 2022] POST /identity/v3/projects => generated 373 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:34.602381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:34.808799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bae9b-d2d4-4825-a028-d0384529531b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.811797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616a1a9-0c8c-4c18-8bf4-bd374bdaa0c4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.819705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:34.820351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.820854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.821162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.821817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:34.823856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:34.863579 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3004/6047] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:34 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:34.869073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:34.893161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a783a-8330-4cab-8322-6e88fcf8e1b1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:34.905136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:34.905866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:34.907839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:34.908086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:34.911190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:34.915875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:34.972340 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3005/6048] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:34 2022] GET /identity/v3/roles => generated 2098 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:34.976515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.015675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2eb78-1b0f-4ffc-a586-dec98c7c8077 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.032972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.034324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.035067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.035972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.036262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.036516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.039724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.040063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.040811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.041421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.058051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.059493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.074230 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3006/6049] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:34 2022] GET /identity/v3/roles => generated 2098 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:35.078267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.101338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14664e4-9407-45c3-8795-d65e4342cc8f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.112260 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3044/6050] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:28:34 2022] POST /identity/v3/groups => generated 301 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:35.116432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.117237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a21a3-7b08-4dcf-b9bc-3534807cebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.118716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a21a3-7b08-4dcf-b9bc-3534807cebb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.119955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a21a3-7b08-4dcf-b9bc-3534807cebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.126317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a21a3-7b08-4dcf-b9bc-3534807cebb1 admin admin] PATH_INFO: `/v3/projects/923b203f6c3c44d299faf755c5d7725f/users/10816ad8559847dfb82c6b177fa1fd0f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.150729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa59bb-fdcd-4a93-8656-9c3ddefd11c3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.161591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a21a3-7b08-4dcf-b9bc-3534807cebb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923b203f6c3c44d299faf755c5d7725f, user_id=10816ad8559847dfb82c6b177fa1fd0f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.164859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a21a3-7b08-4dcf-b9bc-3534807cebb1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.167118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.167758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.168039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.168317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.170940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.174751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.194115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3007/6051] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:35 2022] PUT /identity/v3/projects/923b203f6c3c44d299faf755c5d7725f/users/10816ad8559847dfb82c6b177fa1fd0f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:35.207391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8712ce5-3be3-43b5-aeb7-d03ae06d2e49 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.207944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8712ce5-3be3-43b5-aeb7-d03ae06d2e49 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.208401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8712ce5-3be3-43b5-aeb7-d03ae06d2e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.217220 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3045/6052] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:35 2022] POST /identity/v3/roles => generated 234 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:35.221206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.239259 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:35.250642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39ffdb-b0be-42a2-93d5-ec318e83a083 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.273882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c8712ce5-3be3-43b5-aeb7-d03ae06d2e49 None None] MFA Rules not processed for user `10816ad8559847dfb82c6b177fa1fd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:35.274903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8712ce5-3be3-43b5-aeb7-d03ae06d2e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:35.426042 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3008/6053] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:35.427360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8712ce5-3be3-43b5-aeb7-d03ae06d2e49 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.442376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.443192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.444099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.444763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.445279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.448458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.476873 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:35.492467 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3046/6054] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:35 2022] POST /identity/v3/users => generated 442 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:35.496343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.512076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827849b-d2e7-46ff-aac1-b928d0a5d7af tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.516452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8712ce5-3be3-43b5-aeb7-d03ae06d2e49 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.522420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.523812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.524091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.524368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.524999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.525176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.527385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.534675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.534967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.535242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.535932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.536967 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:35.536967 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:35.536967 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:35.538173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.565915 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3047/6055] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:35 2022] POST /identity/v3/roles => generated 269 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:35.572572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.580452 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3009/6056] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:35 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:35.586424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.593252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e8ce-7b64-4cfb-a2de-214f1202a264 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.738801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120eec-c214-44ef-ad3f-4b111ad3d68c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.744295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.746015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.746319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.746599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/127a301a1011486e8d1c1892b999da8f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.751276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:35.753201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:35.753486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:35.754650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:35.755364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.761310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.784479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_grant(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=127a301a1011486e8d1c1892b999da8f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:35.790280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:35.809529 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3048/6057] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:35 2022] PUT /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/127a301a1011486e8d1c1892b999da8f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:35.814684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.815256 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3010/6058] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:35 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:35.818617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:35.830047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742c167-66cb-4cfa-9dc7-f18b65eb4cac admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:35.999362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.000072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.000270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.000544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.003241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.004903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.012142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a27c0-8bcc-4057-99d6-e7c04d337d6c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.023836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.024473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.024759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.025033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.027850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Adding query filter params (scope.project.id=af52e137e72a4737a6125da6ba15d254, user.id=7eb56e3dc4fe4d79b10a23df65dbb269) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:36.028075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.030922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.041595 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3011/6059] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:35 2022] GET /identity/v3/roles => generated 2323 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:28:36.042659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:36.051619 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:36.053953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca6bdd-82fc-4223-9a62-dad3ca3b270b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.063765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.064936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.065668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.066931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] PATH_INFO: `/v3/projects/64d22ab8517a400ab9c028d65637b32d/users/4fd7a7793fb24556b9c0f804cda4dcc9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.110778 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3049/6060] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:28:35 2022] GET /identity/v3/role_assignments?scope.project.id=af52e137e72a4737a6125da6ba15d254&user.id=7eb56e3dc4fe4d79b10a23df65dbb269&effective => generated 228 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:36.112019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:36.121240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d22ab8517a400ab9c028d65637b32d, user_id=4fd7a7793fb24556b9c0f804cda4dcc9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.127798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.135947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aaaa6-753d-4fdc-8130-513fdfc2b9fe tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.141409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.142620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.143010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.143394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/127a301a1011486e8d1c1892b999da8f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.148718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=127a301a1011486e8d1c1892b999da8f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.152496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.168940 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3012/6061] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:36 2022] PUT /identity/v3/projects/64d22ab8517a400ab9c028d65637b32d/users/4fd7a7793fb24556b9c0f804cda4dcc9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:36.173456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:36.177800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 127a301a1011486e8d1c1892b999da8f was removed from user 7eb56e3dc4fe4d79b10a23df65dbb269 on project af52e137e72a4737a6125da6ba15d254. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:36.180229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:36.181439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:36.218139 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3050/6062] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 11 01:28:36 2022] DELETE /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/127a301a1011486e8d1c1892b999da8f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:36.219220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:36.222267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:36.222806 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:36.400191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1c63f-1aa8-4d13-90d5-f76b17f6c0e7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.409714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775118-943a-4351-9b65-3c394fa12da0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.412789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.413712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.414164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.414631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/127a301a1011486e8d1c1892b999da8f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.417372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=127a301a1011486e8d1c1892b999da8f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.421534 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:36.421534 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:36.421534 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:36.422993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.500550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 127a301a1011486e8d1c1892b999da8f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:36.500861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:36.501614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:36.509241 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3051/6063] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:36 2022] DELETE /identity/v3/roles/127a301a1011486e8d1c1892b999da8f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:36.510177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:36.524485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:36.574090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.574988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.575766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.577204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.578550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.581232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.610075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3013/6064] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:36 2022] GET /identity/v3/roles => generated 2323 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:36.611595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:36.614705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:36.636368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e2023-0696-418e-87ed-dd7052d7d164 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.683273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8dea-9b5b-42aa-b08c-63e512b91a47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.715021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.715997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.716588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.717049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/20c99dc7f0a14a9983c775f6ee106a0b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.725117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_grant(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=20c99dc7f0a14a9983c775f6ee106a0b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.728076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.736047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25036d5-31a2-43e0-ba28-0d4edd208a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.738309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25036d5-31a2-43e0-ba28-0d4edd208a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.739726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25036d5-31a2-43e0-ba28-0d4edd208a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.739726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25036d5-31a2-43e0-ba28-0d4edd208a1c admin admin] PATH_INFO: `/v3/projects/64d22ab8517a400ab9c028d65637b32d/users/4fd7a7793fb24556b9c0f804cda4dcc9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.746204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25036d5-31a2-43e0-ba28-0d4edd208a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d22ab8517a400ab9c028d65637b32d, user_id=4fd7a7793fb24556b9c0f804cda4dcc9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.749741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25036d5-31a2-43e0-ba28-0d4edd208a1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.769957 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3052/6065] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:36 2022] PUT /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/20c99dc7f0a14a9983c775f6ee106a0b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:36.773972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:36.777692 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3014/6066] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:36 2022] PUT /identity/v3/projects/64d22ab8517a400ab9c028d65637b32d/users/4fd7a7793fb24556b9c0f804cda4dcc9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:36.791504 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:36.802184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.803943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.805571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.867542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] MFA Rules not processed for user `4fd7a7793fb24556b9c0f804cda4dcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:36.870122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:36.885132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c498bb6-a566-444e-b3ec-e5fc3729f5cb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:36.890357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:36.891805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:36.892084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:36.892489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:36.895562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:36.897516 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:36.897516 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:36.897516 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:36.898464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:36.933813 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:36.937613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3053/6067] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:36 2022] PUT /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 521 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:36.938800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.023661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3015/6068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:37.038226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.040559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:37.058306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dd84f-a76d-45d9-88d6-558602b53847 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.069971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.070255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.070536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.070809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.071550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Adding query filter params (scope.project.id=af52e137e72a4737a6125da6ba15d254, user.id=7eb56e3dc4fe4d79b10a23df65dbb269) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:37.071857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.073810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.162316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf67a-82df-45c1-9be9-cccdb14f7cea None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.183304 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3054/6069] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:28:36 2022] GET /identity/v3/role_assignments?scope.project.id=af52e137e72a4737a6125da6ba15d254&user.id=7eb56e3dc4fe4d79b10a23df65dbb269&effective => generated 1061 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:37.187502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.206785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6ba71-772e-4938-aa17-b75089534439 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.225259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.225939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.226219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.226495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.228327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.229324 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:37.229324 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:37.229324 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:37.230305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.243349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.244896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.245229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.245620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.257762 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3055/6070] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:37 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:37.261719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.326048 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:37.341879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.343397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.358596 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3016/6071] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:28:37.390730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc733c-0ac3-4913-a3a3-34efe9bcc1fa tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.397966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.398723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.399082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.399479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.400458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Adding query filter params (scope.project.id=af52e137e72a4737a6125da6ba15d254, user.id=7eb56e3dc4fe4d79b10a23df65dbb269) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:37.400839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.403331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.489236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3056/6072] 10.222.0.16 () {58 vars in 1356 bytes} [Sun Sep 11 01:28:37 2022] GET /identity/v3/role_assignments?scope.project.id=af52e137e72a4737a6125da6ba15d254&user.id=7eb56e3dc4fe4d79b10a23df65dbb269&effective => generated 577 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:28:37.493667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.507958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05765dc-357d-4da8-bade-e18a5aaf046a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.514106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.514912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.515314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.515691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.517506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.518626 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:37.518626 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:37.518626 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:37.519758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def.: keystone.exception.ImpliedRoleNotFound: 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def. Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = query.one() Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._iter().one() Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._only_one_row( Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:37.532757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 11 01:28:37.534446 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 11 01:28:37.537771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 11 01:28:37.537771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 11 01:28:37.537771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 11 01:28:37.537771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def. Sep 11 01:28:37.537771 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:37.537771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3017/6073] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:37 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 137 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:28:37.539265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.550780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb08ab-9bb7-422c-afb8-9684489a588c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.556817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.557603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.557979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.558345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/20c99dc7f0a14a9983c775f6ee106a0b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.561839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=20c99dc7f0a14a9983c775f6ee106a0b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.565105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.573598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 20c99dc7f0a14a9983c775f6ee106a0b was removed from user 7eb56e3dc4fe4d79b10a23df65dbb269 on project af52e137e72a4737a6125da6ba15d254. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:37.574197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:37.575508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:37.605347 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3057/6074] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 11 01:28:37 2022] DELETE /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/20c99dc7f0a14a9983c775f6ee106a0b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:37.611786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.613771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:37.630066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaae0a-07bd-4779-a968-d38927073d13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.682312 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:37.719168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.719771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.720134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.720510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.721309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.722478 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:37.722478 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:37.722478 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:37.723383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.744925 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3018/6075] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:37 2022] POST /identity/v3/roles => generated 272 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:37.748764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.760710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f527-c476-4dc2-b8ee-e1c46762d4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.766127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.766847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.767197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.767557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.768422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Adding query filter params (domain_id=131cc0de0e994d36bec60f028e3c54eb) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:37.768598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.769955 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:37.769955 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:37.769955 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:37.771270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.780590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3058/6076] 10.222.0.16 () {58 vars in 1207 bytes} [Sun Sep 11 01:28:37 2022] GET /identity/v3/roles?domain_id=131cc0de0e994d36bec60f028e3c54eb => generated 409 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:37.785161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.797092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952662dd-f8b5-40dd-8fed-ada5927385b5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:37.810404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:37.811160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:37.811497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:37.813021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/224ecdcf9ec44dc3ac649f1e336997c3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:37.814875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=224ecdcf9ec44dc3ac649f1e336997c3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:37.815898 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:37.815898 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:37.815898 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:37.816867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:37.908039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 224ecdcf9ec44dc3ac649f1e336997c3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:37.908390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:37.909432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:37.918007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:37.918543 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3019/6077] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:37 2022] DELETE /identity/v3/roles/224ecdcf9ec44dc3ac649f1e336997c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:37.920583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:37.940999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fb8f-e86a-40b4-81f8-b4f68d87cf0a tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.037263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.038483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.039129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.039634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.040543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Adding query filter params (domain_id=131cc0de0e994d36bec60f028e3c54eb) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:38.041136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.042926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.058487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.083609 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3059/6078] 10.222.0.16 () {58 vars in 1207 bytes} [Sun Sep 11 01:28:37 2022] GET /identity/v3/roles?domain_id=131cc0de0e994d36bec60f028e3c54eb => generated 148 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:38.084721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e729-8c54-4035-81dd-3fc6ffea5c9c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.094609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.095275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.095565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.095998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/224ecdcf9ec44dc3ac649f1e336997c3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.121937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Could not find role: 224ecdcf9ec44dc3ac649f1e336997c3.: keystone.exception.RoleNotFound: Could not find role: 224ecdcf9ec44dc3ac649f1e336997c3. Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Sep 11 01:28:38.128299 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:28:38.129448 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 224ecdcf9ec44dc3ac649f1e336997c3. Sep 11 01:28:38.130602 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:38.134223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3020/6079] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:38 2022] DELETE /identity/v3/roles/224ecdcf9ec44dc3ac649f1e336997c3 => generated 110 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:28:38.140092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.153379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20947be-2aaa-48bd-806f-e98ca76ef409 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.159344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.160094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.160388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.160671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.169494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=131cc0de0e994d36bec60f028e3c54eb, group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.172284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.188136 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3060/6080] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:38 2022] PUT /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:38.192487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.206956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72d44-e8cf-4aff-81fd-e9b99231562b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.298735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.300766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.301087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.301451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.305982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=131cc0de0e994d36bec60f028e3c54eb, group_id=bab15243a4604583b9354d66287de1ed)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.307099 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:38.307099 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:38.307099 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:38.309853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.330969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3021/6081] 10.222.0.16 () {58 vars in 1365 bytes} [Sun Sep 11 01:28:38 2022] GET /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles => generated 409 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:38.335637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.347619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d97a76-b680-4776-a0c2-f7e63f99bad4 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.359312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.360298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.360778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.361337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.364379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=131cc0de0e994d36bec60f028e3c54eb, group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.368088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.377569 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3061/6082] 10.222.0.16 () {58 vars in 1465 bytes} [Sun Sep 11 01:28:38 2022] HEAD /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:38.380292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.397519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63225530-15b6-4ec3-96c2-39f1dd03a99b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.402743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.403578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.404462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.404462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.406792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=131cc0de0e994d36bec60f028e3c54eb, group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.409337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.417300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role d6fc3ee12d704137be8c8bfcdb2bee6d was removed from group bab15243a4604583b9354d66287de1ed on domain 131cc0de0e994d36bec60f028e3c54eb. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:38.417650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:38.422416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:38.446599 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3022/6083] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 11 01:28:38 2022] DELETE /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:38.451608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.454157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:38.477008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db8d5a-1e64-48ef-baa6-f658dcd45529 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.537953 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:38.584370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.585730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.586265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.586792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.590291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_grant(project_id=af52e137e72a4737a6125da6ba15d254, group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.593633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.610934 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3062/6084] 10.222.0.16 () {60 vars in 1486 bytes} [Sun Sep 11 01:28:38 2022] PUT /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:38.615381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.629191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919040e-76f0-4b5e-b50f-a75d6e99d36c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.716317 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:38.734206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798469c7-f1c2-4f34-a6bc-375e9cb86386 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.736406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798469c7-f1c2-4f34-a6bc-375e9cb86386 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.736852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798469c7-f1c2-4f34-a6bc-375e9cb86386 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.737260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798469c7-f1c2-4f34-a6bc-375e9cb86386 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.739504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798469c7-f1c2-4f34-a6bc-375e9cb86386 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_grants(project_id=af52e137e72a4737a6125da6ba15d254, group_id=bab15243a4604583b9354d66287de1ed)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.742306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798469c7-f1c2-4f34-a6bc-375e9cb86386 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.759962 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3023/6085] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 11 01:28:38 2022] GET /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles => generated 410 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:38.761550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:38.774566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f424-d1d0-410b-aafc-7c99556ab6bc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:38.781327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:38.782073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.782428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.782809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/groups/bab15243a4604583b9354d66287de1ed/users/7eb56e3dc4fe4d79b10a23df65dbb269` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.784658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bab15243a4604583b9354d66287de1ed, user_id=7eb56e3dc4fe4d79b10a23df65dbb269)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:38.786840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:38.824634 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3063/6086] 10.222.0.16 () {60 vars in 1360 bytes} [Sun Sep 11 01:28:38 2022] PUT /identity/v3/groups/bab15243a4604583b9354d66287de1ed/users/7eb56e3dc4fe4d79b10a23df65dbb269 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:38.826639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72af9-4b01-495c-a95b-11081302f79c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:38.827138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72af9-4b01-495c-a95b-11081302f79c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:38.827597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72af9-4b01-495c-a95b-11081302f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:38.886236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a5f72af9-4b01-495c-a95b-11081302f79c None None] MFA Rules not processed for user `7eb56e3dc4fe4d79b10a23df65dbb269`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:38.893826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a5f72af9-4b01-495c-a95b-11081302f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:39.038349 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3024/6087] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:39.038457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.198488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d68da8-a6ed-4c2d-b9b8-8688225cd5ad tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.213745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.214448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.214711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.215099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.217245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:check_grant(project_id=af52e137e72a4737a6125da6ba15d254, group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.220567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.234754 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3064/6088] 10.222.0.16 () {58 vars in 1468 bytes} [Sun Sep 11 01:28:39 2022] HEAD /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:39.239153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72af9-4b01-495c-a95b-11081302f79c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.262886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72af9-4b01-495c-a95b-11081302f79c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.268431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.269158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.269443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.269717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.272321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=af52e137e72a4737a6125da6ba15d254, group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.277453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.285312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role d6fc3ee12d704137be8c8bfcdb2bee6d was removed from group bab15243a4604583b9354d66287de1ed on project af52e137e72a4737a6125da6ba15d254. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:39.285734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:39.286557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:39.311994 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3025/6089] 10.222.0.16 () {58 vars in 1470 bytes} [Sun Sep 11 01:28:39 2022] DELETE /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:39.315813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.319342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:39.339826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f48a0-d2c2-4cee-a5ff-8c3921d82e27 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.346355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.348987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:39.467863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.468828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.469357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.469802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/groups/bab15243a4604583b9354d66287de1ed/users/7eb56e3dc4fe4d79b10a23df65dbb269` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.471752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=bab15243a4604583b9354d66287de1ed, user_id=7eb56e3dc4fe4d79b10a23df65dbb269)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.473956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.482558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ce5a-8870-4f2b-8107-734bf91471d5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.487811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.488629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.488911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.489267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.489847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7eb56e3dc4fe4d79b10a23df65dbb269'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:39.493206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:39.520043 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3065/6090] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:28:39 2022] DELETE /identity/v3/groups/bab15243a4604583b9354d66287de1ed/users/7eb56e3dc4fe4d79b10a23df65dbb269 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:39.523946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.524393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.525309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.539169 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3026/6091] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:39.573649 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:39.617700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fce4-9e88-4452-9ef0-21ac0458b2a8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.624613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.625410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.625748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.626117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.628669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.629812 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:39.629812 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:39.629812 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:39.630924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.640022 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3066/6092] 10.222.0.16 () {60 vars in 1381 bytes} [Sun Sep 11 01:28:39 2022] PUT /identity/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:39.645044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.663587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3f04-702b-4e3f-910a-22d785d63e3e service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.685274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.685274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.685274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.685709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.685709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=bab15243a4604583b9354d66287de1ed)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.685709 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:39.685709 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:39.685709 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:39.685709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.699315 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3027/6093] 10.222.0.16 () {58 vars in 1263 bytes} [Sun Sep 11 01:28:39 2022] GET /identity/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles => generated 375 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:39.703053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.714205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3380d-e54b-4731-9f9e-802bd370d3a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.719046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.719683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.720054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.720246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.722496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.723612 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:39.723612 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:39.723612 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:39.725320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.733117 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3067/6094] 10.222.0.16 () {58 vars in 1363 bytes} [Sun Sep 11 01:28:39 2022] HEAD /identity/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:39.737140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.747755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f01efc-74e1-49f2-ad92-7bbb2b9e2f1c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.771250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.771250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.771250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.772105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.772105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=bab15243a4604583b9354d66287de1ed, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.772105 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:39.772105 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:39.772105 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:39.772105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.772636 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:39.782100 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3028/6095] 10.222.0.16 () {58 vars in 1365 bytes} [Sun Sep 11 01:28:39 2022] DELETE /identity/v3/system/groups/bab15243a4604583b9354d66287de1ed/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:39.783309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.799633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276917e8-a21e-476c-9eb0-17aea25750e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.806483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.807270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.807557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.807832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.811274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=131cc0de0e994d36bec60f028e3c54eb, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.813969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.830161 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3068/6096] 10.222.0.16 () {60 vars in 1480 bytes} [Sun Sep 11 01:28:39 2022] PUT /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:39.837519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.851190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed2f2-d4b0-4fa3-8e9e-263abde3a1ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.935345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.936584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.936584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.936822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.939547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=131cc0de0e994d36bec60f028e3c54eb, user_id=7eb56e3dc4fe4d79b10a23df65dbb269)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.942238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:39.962471 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3029/6097] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 11 01:28:39 2022] GET /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles => generated 408 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:28:39.966843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:39.982963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bff6e-8561-4454-b76b-2db7b3ad71c8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:39.989277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:39.990609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:39.991258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:39.991401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:39.994006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=131cc0de0e994d36bec60f028e3c54eb, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:39.996855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.009187 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3069/6098] 10.222.0.16 () {58 vars in 1462 bytes} [Sun Sep 11 01:28:39 2022] HEAD /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:40.013254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.029305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4286-e14b-4edd-a5b4-cd179f80be52 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.035407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.036092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.036374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.036652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.040162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=131cc0de0e994d36bec60f028e3c54eb, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.044482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.055222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role d6fc3ee12d704137be8c8bfcdb2bee6d was removed from user 7eb56e3dc4fe4d79b10a23df65dbb269 on domain 131cc0de0e994d36bec60f028e3c54eb. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:40.055222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:40.055990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:40.081364 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3030/6099] 10.222.0.16 () {58 vars in 1464 bytes} [Sun Sep 11 01:28:40 2022] DELETE /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:40.086235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.088543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:40.106600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ad127-c353-4744-8798-9af590764eeb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.204780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.205910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.206396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.207197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.210078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_grant(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.212791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.243333 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3070/6100] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:40 2022] PUT /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:40.246031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.259362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f88d4-89ab-4c1a-bf27-8a72fb76ff79 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.339546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.340597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.340867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.341262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.344237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_grants(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.347091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.371993 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3031/6101] 10.222.0.16 () {58 vars in 1365 bytes} [Sun Sep 11 01:28:40 2022] GET /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles => generated 409 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:40.373567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.404177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46e3e-14d6-4658-93c3-fe3a93c66f73 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.412183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.419236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.419236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.419236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.419236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:check_grant(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.420525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.434706 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3071/6102] 10.222.0.16 () {58 vars in 1465 bytes} [Sun Sep 11 01:28:40 2022] HEAD /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:40.438842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.461232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f26a9-4c54-417b-ba1a-d991392a68a1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.476347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.477971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.478502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.479239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.483632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=af52e137e72a4737a6125da6ba15d254, user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.486999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.496206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role d6fc3ee12d704137be8c8bfcdb2bee6d was removed from user 7eb56e3dc4fe4d79b10a23df65dbb269 on project af52e137e72a4737a6125da6ba15d254. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:40.496900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:40.500041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:40.536607 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3032/6103] 10.222.0.16 () {58 vars in 1467 bytes} [Sun Sep 11 01:28:40 2022] DELETE /identity/v3/projects/af52e137e72a4737a6125da6ba15d254/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:40.542111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.544222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:40.565559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d8b25-76b6-4069-8e75-478f80fbf5dc tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.664153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.664720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.665002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.665331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.671208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.671208 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:40.671208 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:40.671208 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:40.671208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.685241 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3072/6104] 10.222.0.16 () {60 vars in 1378 bytes} [Sun Sep 11 01:28:40 2022] PUT /identity/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:40.685661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.708298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba96cdb-65b1-408c-857f-a59dc2bf1555 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.716595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.726747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.726747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.726747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.726747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=7eb56e3dc4fe4d79b10a23df65dbb269)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.727967 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:40.727967 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:40.727967 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:40.727967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.752728 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3033/6105] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 11 01:28:40 2022] GET /identity/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles => generated 374 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:40.753180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.773678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b47bc1-becb-42e3-8683-e5c3851ef4a7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.782839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.783506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.783785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.784059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.790119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.793336 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:40.793336 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:40.793336 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:40.794233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.801119 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3073/6106] 10.222.0.16 () {58 vars in 1360 bytes} [Sun Sep 11 01:28:40 2022] HEAD /identity/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:40.805791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.816784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3854736-c9bc-4912-a7d8-638f07e252db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.822210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.823088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.823451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.823931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.826519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=7eb56e3dc4fe4d79b10a23df65dbb269, role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.827584 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:40.827584 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:40.827584 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:40.828585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.837201 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3034/6107] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 11 01:28:40 2022] DELETE /identity/v3/system/users/7eb56e3dc4fe4d79b10a23df65dbb269/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:40.842120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.856048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8f7c8-3de7-4516-ba43-e1f1a504e40d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.864494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.865708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.866062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.866412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.867167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.868854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.873644 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:40.899054 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3074/6108] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:40 2022] POST /identity/v3/roles => generated 269 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:40.900109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.913862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7233-4466-4130-8574-8af60d75aac5 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.919107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.919725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.920677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.921642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.921775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.923754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:40.948677 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3035/6109] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:40 2022] POST /identity/v3/roles => generated 270 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:40.950015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:40.963024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6660f2-2b2f-4f91-bb68-6a720a05d3bb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:40.970734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:40.971664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:40.972016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:40.972423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/fef14b12721b4f9b93a8e2d5c5d9276c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:40.974891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6c849a4c5bc844008f1b264741c2594c, implied_role_id=fef14b12721b4f9b93a8e2d5c5d9276c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:40.979452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.017899 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3075/6110] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:40 2022] PUT /identity/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/fef14b12721b4f9b93a8e2d5c5d9276c => generated 530 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:41.023277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.035331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968dabd-aa6e-4dbb-b391-1985c75f17f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.047629 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:41.111750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.112368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.112646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.113414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.113611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.116644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.136487 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3036/6111] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:28:41 2022] POST /identity/v3/domains => generated 277 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:41.141124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.184736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0efbe2-8e0d-406e-bf65-628d36cc118f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.292087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.292875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.293291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.293667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.295076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.296859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.315919 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3076/6112] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:41 2022] POST /identity/v3/roles => generated 270 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:41.321325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.333381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96b47-6c84-4caf-ad93-555e577b0449 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.339349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.340115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.340417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.340692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/15ef9348cceb453eb5731b1ea7ef312c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.342475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6c849a4c5bc844008f1b264741c2594c, implied_role_id=15ef9348cceb453eb5731b1ea7ef312c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.343555 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:41.343555 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:41.343555 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:41.344454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.377332 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3037/6113] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:41 2022] PUT /identity/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/15ef9348cceb453eb5731b1ea7ef312c => generated 530 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:41.381627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.392407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b09fa6-dfc3-40f1-88b0-2d3a6b490605 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.463684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.464376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.464656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.464931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.466800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6c849a4c5bc844008f1b264741c2594c, implied_role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.468473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.499732 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3077/6114] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:41 2022] PUT /identity/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 524 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:41.503993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.525337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776e11-116f-4e81-b639-dde8b96215dd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.604083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.604744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.605028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.605339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/d6fc3ee12d704137be8c8bfcdb2bee6d/implies/6c849a4c5bc844008f1b264741c2594c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.607028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d6fc3ee12d704137be8c8bfcdb2bee6d, implied_role_id=6c849a4c5bc844008f1b264741c2594c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.608615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] 6c849a4c5bc844008f1b264741c2594c cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 6c849a4c5bc844008f1b264741c2594c cannot be an implied roles. Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Sep 11 01:28:41.630036 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Sep 11 01:28:41.631744 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:28:41.631744 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:28:41.631744 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Sep 11 01:28:41.631744 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Sep 11 01:28:41.631744 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 6c849a4c5bc844008f1b264741c2594c cannot be an implied roles. Sep 11 01:28:41.631744 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:41.632217 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3038/6115] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:41 2022] PUT /identity/v3/roles/d6fc3ee12d704137be8c8bfcdb2bee6d/implies/6c849a4c5bc844008f1b264741c2594c => generated 116 bytes in 128 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:28:41.636451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.658726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dba2e-e3fd-45e4-b692-b6161e3bf117 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.666656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.668262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.668739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.670135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.672393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6c849a4c5bc844008f1b264741c2594c, implied_role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.675856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.691707 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3078/6116] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:41 2022] DELETE /identity/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:41.697105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.713974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240c1bc-2897-4b83-a445-7a663a6beadb tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.789028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.790202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.790732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.791158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/15ef9348cceb453eb5731b1ea7ef312c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.793241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6c849a4c5bc844008f1b264741c2594c, implied_role_id=15ef9348cceb453eb5731b1ea7ef312c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.795038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.806098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3039/6117] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:41 2022] DELETE /identity/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/15ef9348cceb453eb5731b1ea7ef312c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:41.810276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.821902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86314cef-4cde-431a-b4d9-10ac9a2d0401 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:41.862900 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:41.902623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:41.903360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:41.903741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:41.904089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/15ef9348cceb453eb5731b1ea7ef312c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:41.905938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=15ef9348cceb453eb5731b1ea7ef312c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:41.907627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:41.965098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 15ef9348cceb453eb5731b1ea7ef312c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:41.965887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:41.977234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:41.977234 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3079/6118] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:41 2022] DELETE /identity/v3/roles/15ef9348cceb453eb5731b1ea7ef312c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:41.979594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:41.984404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:41.997251 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:42.003379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218c8f7-beeb-4c43-988e-cf0a0b2e94e2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:42.129361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:42.130292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:42.131294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:42.131738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/7d79aba2f5184a52a31bf4df618794f9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:42.147680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7d79aba2f5184a52a31bf4df618794f9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:42.155589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:42.188303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.189327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.228293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.229880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.233419 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3040/6119] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:28:41 2022] PATCH /identity/v3/domains/7d79aba2f5184a52a31bf4df618794f9 => generated 278 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:42.237158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:42.254715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6958d61-b20a-49cf-ae4b-b7d08635dfb2 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:42.371323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:42.372545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:42.372997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:42.373465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/7d79aba2f5184a52a31bf4df618794f9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:42.394167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7d79aba2f5184a52a31bf4df618794f9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:42.397207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:42.430861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.443517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.509964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9', 'request_id': 'req-0a48d6d4-1073-418b-b9ae-0d9faf137266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.519615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9', 'request_id': 'req-0a48d6d4-1073-418b-b9ae-0d9faf137266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.530037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9', 'request_id': 'req-0a48d6d4-1073-418b-b9ae-0d9faf137266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.536545 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:42.554654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] The token cache is being invalidate because project 7d79aba2f5184a52a31bf4df618794f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:42.558937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.559952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.575143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9', 'request_id': 'req-0a48d6d4-1073-418b-b9ae-0d9faf137266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.576737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9', 'request_id': 'req-0a48d6d4-1073-418b-b9ae-0d9faf137266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.578601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7d79aba2f5184a52a31bf4df618794f9', 'request_id': 'req-0a48d6d4-1073-418b-b9ae-0d9faf137266'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:42.596770 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3080/6120] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:28:42 2022] DELETE /identity/v3/domains/7d79aba2f5184a52a31bf4df618794f9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:42.602011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:42.604663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:42.621301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72aecd-c3a1-41b5-a55b-e46f520435b3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:42.708727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:42.709601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:42.710328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:42.710328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/fef14b12721b4f9b93a8e2d5c5d9276c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:42.712170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6c849a4c5bc844008f1b264741c2594c, implied_role_id=fef14b12721b4f9b93a8e2d5c5d9276c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:42.713969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:42.725459 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3041/6121] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:42 2022] DELETE /identity/v3/roles/6c849a4c5bc844008f1b264741c2594c/implies/fef14b12721b4f9b93a8e2d5c5d9276c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:42.729456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:42.731060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:42.748748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d6d4-1073-418b-b9ae-0d9faf137266 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:42.919262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:42.920969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:42.921461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:42.923051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/fef14b12721b4f9b93a8e2d5c5d9276c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:42.925095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=fef14b12721b4f9b93a8e2d5c5d9276c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:42.929852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.019140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role fef14b12721b4f9b93a8e2d5c5d9276c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:43.019542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:43.020756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:43.024317 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3081/6122] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:42 2022] DELETE /identity/v3/roles/fef14b12721b4f9b93a8e2d5c5d9276c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:43.028067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.029851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:43.043612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8312c4-28d6-48c1-8226-3c4ae29584d6 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.112277 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:43.120698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.122307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.122861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.123452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/6c849a4c5bc844008f1b264741c2594c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.125614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6c849a4c5bc844008f1b264741c2594c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.127485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.175585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 6c849a4c5bc844008f1b264741c2594c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:43.175878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:43.176646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:43.179805 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3042/6123] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:43 2022] DELETE /identity/v3/roles/6c849a4c5bc844008f1b264741c2594c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:43.185149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.219708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e48b-132d-4cc7-ad8a-6679fa413aed tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.331313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.332068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.332907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.332907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.335460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.337296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.404856 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3082/6124] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:43 2022] PUT /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 521 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:43.408742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.410205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:43.427417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0b812-c6be-4752-b705-8c103de573b9 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.505132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.506359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.506726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.507085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.508795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.510106 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:43.510106 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:43.510106 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:43.516555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.516555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.516555 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:43.516555 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:43.516555 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:43.516555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.527746 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3043/6125] 10.222.0.16 () {58 vars in 1345 bytes} [Sun Sep 11 01:28:43 2022] HEAD /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:43.529107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.545417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5a772-36ad-4411-9eff-1066423d3c47 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.550866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.553788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.553788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.554378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.556262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.557549 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:43.557549 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:43.557549 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:43.558797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.569490 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3083/6126] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:28:43 2022] GET /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 521 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:43.571586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.583800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa4276-4526-4134-9f89-dc7bbf4408ec tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.590273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.590979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.591445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.591765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.594960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.596882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.625092 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3044/6127] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:43 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:43.625771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.645277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7247fd0-e53b-4dd0-b597-ad39a81a1b38 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.662482 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:43.756390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.757592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.758108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.758997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.761470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.763856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def.: keystone.exception.ImpliedRoleNotFound: 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def. Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = query.one() Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._iter().one() Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._only_one_row( Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:43.778945 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 11 01:28:43.780409 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 11 01:28:43.781636 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 11 01:28:43.781636 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def. Sep 11 01:28:43.781636 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:28:43.788405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.805395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edae60-8c51-42e8-8e6f-71706ec03189 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.811751 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3084/6128] 10.222.0.16 () {58 vars in 1344 bytes} [Sun Sep 11 01:28:43 2022] GET /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 137 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:28:43.821806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.822488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.822774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.823047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.824792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.826416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def.: keystone.exception.ImpliedRoleNotFound: 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def. Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = query.one() Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._iter().one() Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._only_one_row( Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:43.847842 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 11 01:28:43.849395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 11 01:28:43.850997 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 11 01:28:43.850997 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 11 01:28:43.850997 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 11 01:28:43.850997 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 20c99dc7f0a14a9983c775f6ee106a0b does not imply 12c65c2b07ca48d2987a8c8e0ccc1def. Sep 11 01:28:43.850997 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:43.856172 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3045/6129] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:43 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 137 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:28:43.857839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.875434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e307a3-d07f-4582-9528-3869d171309b tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:43.889221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:43.889995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:43.890161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:43.890504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:43.892222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:43.893891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:43.925243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3085/6130] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:43 2022] PUT /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 521 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:43.930125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:43.941030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfe348-a90f-452e-8085-e449eb7a3ac7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.010998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.011659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.011938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.012273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.014222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=00b7080b680d4a0a8dcadeab909c1a2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.015974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.050059 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3046/6131] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:43 2022] PUT /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b => generated 521 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:44.055636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.066833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dce976-88fe-4fd6-9dab-5be25f79b305 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.159000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.159693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.160023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.160624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.163356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=00b7080b680d4a0a8dcadeab909c1a2b, implied_role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.165294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.212100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3086/6132] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:44 2022] PUT /identity/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 520 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:44.215992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.231566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d8f7-5e9b-44c2-80a9-574430e47538 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.279826 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:44.342987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.343706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.344183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.344531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.345441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.348342 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:44.348342 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:44.348342 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:44.348342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.371874 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3047/6133] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 11 01:28:44 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:44.375821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.388237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d74fc1-57bd-451c-9dcf-c0eee7b36574 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.394234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.394901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.395189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.395467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.398100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=00b7080b680d4a0a8dcadeab909c1a2b, implied_role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.400316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.412932 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3087/6134] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:44 2022] DELETE /identity/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:44.417098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.430246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd5d6-7444-4add-8ee2-146e763158f1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.530121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.531074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.531538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.531997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.534825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=00b7080b680d4a0a8dcadeab909c1a2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.537532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.553886 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3048/6135] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:44 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:44.558434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.603101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5603fc-435c-4cc1-aafd-f88467ab8ba1 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.697179 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:44.697179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.697179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.697854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.697854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.697854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.698700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.723069 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3088/6136] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:44 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:44.728615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.749220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78637d45-b84d-4bef-be8e-9b10d561c021 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.855345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.856408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.856916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.858626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.860064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.862210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.883195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3049/6137] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:44 2022] GET /identity/v3/roles => generated 2323 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:44.887876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.902381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707eae0-79ac-4528-976c-194043e32055 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.907896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.908833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.910268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.910876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.912280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.914884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:44.939800 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3089/6138] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:28:44 2022] POST /identity/v3/roles => generated 235 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:44.945610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:44.963858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781725f-3358-4cee-a6e2-71b403cc846e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:44.969964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:44.970952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:44.971517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:44.971986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/c0df0a592f264b758c4ff86247ea2e0a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:44.973927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:update_role(role_id=c0df0a592f264b758c4ff86247ea2e0a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:44.975541 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:44.975541 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:44.975541 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:44.976978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.031505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3050/6139] 10.222.0.16 () {60 vars in 1243 bytes} [Sun Sep 11 01:28:44 2022] PATCH /identity/v3/roles/c0df0a592f264b758c4ff86247ea2e0a => generated 237 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:45.038504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.057387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a3890-a0fd-4ccf-9ca0-e36fcb4792f3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.067166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.068740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.069271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.069722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/c0df0a592f264b758c4ff86247ea2e0a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.084873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:get_role(role_id=c0df0a592f264b758c4ff86247ea2e0a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.086440 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:45.086440 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:28:45.086440 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:28:45.087436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.089205 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3090/6140] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:28:45 2022] GET /identity/v3/roles/c0df0a592f264b758c4ff86247ea2e0a => generated 237 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:45.093488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.111610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2935f-f915-426e-bd03-a7cdf08eb4d8 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.120149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.120974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.121365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.121714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.122628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.124473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.142443 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3051/6141] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:45 2022] GET /identity/v3/roles => generated 2551 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:45.146736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.158046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc627854-002c-42e4-9d9d-6c93da8a6247 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.171265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.172037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.172325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.172603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/c0df0a592f264b758c4ff86247ea2e0a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.180225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c0df0a592f264b758c4ff86247ea2e0a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.181899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.283330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role c0df0a592f264b758c4ff86247ea2e0a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:45.283761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:45.284524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:45.288047 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3091/6142] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:45 2022] DELETE /identity/v3/roles/c0df0a592f264b758c4ff86247ea2e0a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:45.293226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.295091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:45.319632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21288a-d937-4e3e-8afd-b7d19be65b14 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.337888 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:45.424346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.425292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.425654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.426006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.429618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.431475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.473403 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3052/6143] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:45 2022] PUT /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 521 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:45.476209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.487766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f744-c8b1-40aa-b228-1f1aeadc63db tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.570942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.571669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.572082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.572369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.575183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=00b7080b680d4a0a8dcadeab909c1a2b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.577706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.625508 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3092/6144] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:45 2022] PUT /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b => generated 521 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:45.629426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.644307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46514d8-4bbf-48d0-a6b0-d768e83215ea tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.667094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.669661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:45.739698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.742063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.742572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.743088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.745405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=00b7080b680d4a0a8dcadeab909c1a2b, implied_role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.747387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.777672 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3053/6145] 10.222.0.16 () {60 vars in 1363 bytes} [Sun Sep 11 01:28:45 2022] PUT /identity/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 520 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:45.781556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.789602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af827-ab93-4383-8bb1-4e49ca9c1016 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.798133 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:45.880254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565ce5-837d-4f91-b4de-2aedf5741513 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.902876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.903551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.909487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.910095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.913292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=00b7080b680d4a0a8dcadeab909c1a2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.914977 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:28:45.914977 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:28:45.914977 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:28:45.917027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.930971 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3054/6146] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 11 01:28:45 2022] GET /identity/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies => generated 489 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:28:45.941370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:45.947151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.947784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.948074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.948348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.960953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:45.962553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf2e0-0f07-47cd-8680-6b8014696c0e tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:45.977907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:45.978567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:45.978854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:45.979137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:45.980388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:45.981985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:45.994052 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3055/6147] 10.222.0.16 () {58 vars in 1245 bytes} [Sun Sep 11 01:28:45 2022] GET /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies => generated 661 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:45.997784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:46.001901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:46.003020 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:46.013561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:46.019153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb0de-a705-4b27-addb-c91e44836497 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:46.032119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:46.033874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:46.034636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:46.035295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:46.037943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=00b7080b680d4a0a8dcadeab909c1a2b, implied_role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:46.043664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:46.057579 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3056/6148] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:45 2022] DELETE /identity/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b/implies/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:46.062579 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3093/6149] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:46.067694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:46.165440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f55a9-b6a7-4c1b-b21b-cfab8dd611fd tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:46.172001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:46.172719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:46.173227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:46.173510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:46.175429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=00b7080b680d4a0a8dcadeab909c1a2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:46.177421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:46.189188 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3057/6150] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:46 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/00b7080b680d4a0a8dcadeab909c1a2b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:46.193507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:46.205367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdedab-1bb9-4d50-8af1-995e14c62606 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:46.283934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:46.284604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:46.284888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:46.285219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:46.288057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=20c99dc7f0a14a9983c775f6ee106a0b, implied_role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:46.288997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:46.307674 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3094/6151] 10.222.0.16 () {58 vars in 1347 bytes} [Sun Sep 11 01:28:46 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b/implies/12c65c2b07ca48d2987a8c8e0ccc1def => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:46.315075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:46.329185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed380bb7-3d19-4a6d-bc4f-5e500d8eb168 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:46.455619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:46.456237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:46.456445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:46.456728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/7d79aba2f5184a52a31bf4df618794f9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:46.472467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Could not find domain: 7d79aba2f5184a52a31bf4df618794f9.: keystone.exception.DomainNotFound: Could not find domain: 7d79aba2f5184a52a31bf4df618794f9. Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7d79aba2f5184a52a31bf4df618794f9. Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:28:46.478233 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:28:46.480546 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7d79aba2f5184a52a31bf4df618794f9. Sep 11 01:28:46.481951 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:28:46.484008 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3058/6152] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:28:46 2022] PATCH /identity/v3/domains/7d79aba2f5184a52a31bf4df618794f9 => generated 112 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:28:46.487740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:46.503778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc1074-5bda-4c00-aded-9f2999d280ba tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:46.520673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:46.522097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:46.522386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:46.522659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/users/7eb56e3dc4fe4d79b10a23df65dbb269` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:46.525508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7eb56e3dc4fe4d79b10a23df65dbb269)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:46.532732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:46.612814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb56e3dc4fe4d79b10a23df65dbb269'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:46.613554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb56e3dc4fe4d79b10a23df65dbb269'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:46.614715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb56e3dc4fe4d79b10a23df65dbb269'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:46.634322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb56e3dc4fe4d79b10a23df65dbb269'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:46.642678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb56e3dc4fe4d79b10a23df65dbb269'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:46.658744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3095/6153] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:46 2022] DELETE /identity/v3/users/7eb56e3dc4fe4d79b10a23df65dbb269 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:46.663788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:46.665885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:46.680017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99944-04ba-4039-a949-b8e95e423812 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:46.746437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:46.747341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:46.747722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:46.748188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/d6fc3ee12d704137be8c8bfcdb2bee6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:46.749781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d6fc3ee12d704137be8c8bfcdb2bee6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:46.751469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:46.776583 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:46.796113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role d6fc3ee12d704137be8c8bfcdb2bee6d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:46.796557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:46.797328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:46.799470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3059/6154] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:46 2022] DELETE /identity/v3/roles/d6fc3ee12d704137be8c8bfcdb2bee6d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:46.804593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:46.815841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95ad7-b4a5-47bc-964e-2ca675aca8a3 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:46.820512 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:46.898142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:46.898941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:46.899362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:46.899640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/groups/bab15243a4604583b9354d66287de1ed` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:46.900860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bab15243a4604583b9354d66287de1ed)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:46.903358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:47.016917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:47.020541 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3096/6155] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:28:46 2022] DELETE /identity/v3/groups/bab15243a4604583b9354d66287de1ed => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:47.022221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:47.045926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de062ff-f353-4b0f-aeac-39a7aa3e122d tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:47.130694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:47.130694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:47.132405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:47.132673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/projects/af52e137e72a4737a6125da6ba15d254` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:47.134006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af52e137e72a4737a6125da6ba15d254)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:47.136420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:47.225691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:47.227899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:47.233819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af52e137e72a4737a6125da6ba15d254', 'request_id': 'req-0452accc-4884-4eaf-8631-c93170afec75'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.249621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af52e137e72a4737a6125da6ba15d254', 'request_id': 'req-0452accc-4884-4eaf-8631-c93170afec75'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.264230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af52e137e72a4737a6125da6ba15d254', 'request_id': 'req-0452accc-4884-4eaf-8631-c93170afec75'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.285972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] The token cache is being invalidate because project af52e137e72a4737a6125da6ba15d254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:47.286567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.287946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.292483 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3060/6156] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:47 2022] DELETE /identity/v3/projects/af52e137e72a4737a6125da6ba15d254 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:47.293526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:47.295885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:47.347305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b27618-135f-4dee-9230-15da36a56ee7 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:47.406662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452accc-4884-4eaf-8631-c93170afec75 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:47.417721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:47.418391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:47.418695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:47.419042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:47.421132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=131cc0de0e994d36bec60f028e3c54eb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:47.426202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:47.437823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd7a7793fb24556b9c0f804cda4dcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d22ab8517a400ab9c028d65637b32d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:47.438447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:47.438918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:47.439170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:47.440169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:47.440421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:47.442232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:47.462031 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3097/6157] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:47.463341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:47.465477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:47.485840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26215a-807c-4b2e-99cb-a5627422ebc3 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:47.487948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.490454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.494264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd7a7793fb24556b9c0f804cda4dcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d22ab8517a400ab9c028d65637b32d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:47.496406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:47.497238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:47.498769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:47.501418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:47.512177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:47.520349 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:47.530916 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:47.571277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.573052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:47.578794 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3098/6158] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:47 2022] POST /identity/v3/projects => generated 348 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:47.583557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:47.585661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:47.591496 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3061/6159] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:28:47 2022] PATCH /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb => generated 276 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:47.592702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:47.594786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:47.727987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830c68-5015-4749-802d-147c2e3d8567 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:47.749573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd7a7793fb24556b9c0f804cda4dcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d22ab8517a400ab9c028d65637b32d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:47.750206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:47.750492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:47.750771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:47.751424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:47.751734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:47.753360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:47.756876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575de8d-971a-45aa-b92b-af6dd7c13a3c tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:47.782112 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3099/6160] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:47.783094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:47.785820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:47.945545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:47.946475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:47.947015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:47.947459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/domains/131cc0de0e994d36bec60f028e3c54eb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:47.947740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484237-3336-4c3f-8ec9-17bbc178f9d9 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:47.958572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:47.959753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:47.960025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:47.960296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] PATH_INFO: `/v3/users/acc4109ff34b49029ba4b893fc74f9bb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:47.962461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=131cc0de0e994d36bec60f028e3c54eb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:47.965361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:47.968105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc4109ff34b49029ba4b893fc74f9bb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:47.970321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:48.000530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.007243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.076087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc4109ff34b49029ba4b893fc74f9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.076950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc4109ff34b49029ba4b893fc74f9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.077940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc4109ff34b49029ba4b893fc74f9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.105897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc4109ff34b49029ba4b893fc74f9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.109557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb', 'request_id': 'req-4b75358b-c58e-4f1a-b88b-236e51723f13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.120532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb', 'request_id': 'req-4b75358b-c58e-4f1a-b88b-236e51723f13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.123237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc4109ff34b49029ba4b893fc74f9bb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.137871 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:48.150393 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3100/6161] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:47 2022] DELETE /identity/v3/users/acc4109ff34b49029ba4b893fc74f9bb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:48.151568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:48.156122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:48.157697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb', 'request_id': 'req-4b75358b-c58e-4f1a-b88b-236e51723f13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.161142 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:48.190193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] The token cache is being invalidate because project 131cc0de0e994d36bec60f028e3c54eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:48.191140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.195261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.212146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb', 'request_id': 'req-4b75358b-c58e-4f1a-b88b-236e51723f13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.212908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb', 'request_id': 'req-4b75358b-c58e-4f1a-b88b-236e51723f13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.218849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '131cc0de0e994d36bec60f028e3c54eb', 'request_id': 'req-4b75358b-c58e-4f1a-b88b-236e51723f13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.234727 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3062/6162] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:28:47 2022] DELETE /identity/v3/domains/131cc0de0e994d36bec60f028e3c54eb => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:48.237678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:48.239568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:48.350023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c011-76ae-4059-b791-738d18a8ab0e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:48.366758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:48.367394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:48.367670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:48.367943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:48.375491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75358b-c58e-4f1a-b88b-236e51723f13 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:48.377428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:48.405105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:48.407720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:48.441669 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3101/6163] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:48.599222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:48.604668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:48.604668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:48.604950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:48.613409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_role(role_id=00b7080b680d4a0a8dcadeab909c1a2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:48.615858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:48.715652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:48.717244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:48.750356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 00b7080b680d4a0a8dcadeab909c1a2b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:48.751221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.752912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:48.777541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3063/6164] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:48 2022] DELETE /identity/v3/roles/00b7080b680d4a0a8dcadeab909c1a2b => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:48.777541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:48.788377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:48.874679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb45e2-d0f8-4924-a734-ff145b0a945d service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:48.894765 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:48.931910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c73f-64e1-4e1e-bf27-7e59720dc793 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:48.948059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:48.948815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:48.949171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:48.950032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/12c65c2b07ca48d2987a8c8e0ccc1def` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:48.951105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12c65c2b07ca48d2987a8c8e0ccc1def)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:48.952778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:48.955258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:48.956320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:48.956654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:48.956934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] PATH_INFO: `/v3/projects/65f8398f8bd544e3b2386b930ea48d68` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:48.959143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f8398f8bd544e3b2386b930ea48d68)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:48.962828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:49.016873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 12c65c2b07ca48d2987a8c8e0ccc1def has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:49.017262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.018040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.029862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3064/6165] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:48 2022] DELETE /identity/v3/roles/12c65c2b07ca48d2987a8c8e0ccc1def => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:49.029862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:49.031264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:49.049499 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:49.071935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f8398f8bd544e3b2386b930ea48d68', 'request_id': 'req-bd4f95b1-31d2-4bce-949f-b887da5da174'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.083950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f8398f8bd544e3b2386b930ea48d68', 'request_id': 'req-bd4f95b1-31d2-4bce-949f-b887da5da174'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.108303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f8398f8bd544e3b2386b930ea48d68', 'request_id': 'req-bd4f95b1-31d2-4bce-949f-b887da5da174'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.132584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] The token cache is being invalidate because project 65f8398f8bd544e3b2386b930ea48d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:49.133071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.133958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.137394 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3102/6166] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:48 2022] DELETE /identity/v3/projects/65f8398f8bd544e3b2386b930ea48d68 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:28:49.138338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:49.140356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:49.165363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03a33-1f54-440a-bb16-f8009dc9f52f tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:49.242677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f95b1-31d2-4bce-949f-b887da5da174 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:49.249641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b33b07d6654400911af6d400d72dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33238603ace49cfbae0f4f7faed9950', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:49.250653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:49.251613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:49.252285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] PATH_INFO: `/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:49.254271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorizing `identity:delete_role(role_id=20c99dc7f0a14a9983c775f6ee106a0b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:49.257433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:49.275109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd7a7793fb24556b9c0f804cda4dcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d22ab8517a400ab9c028d65637b32d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:49.275876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:49.276273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:49.276631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] PATH_INFO: `/v3/projects/774ca37113b04dfd91ccd1346ba02638` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:49.289992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorizing `identity:delete_project(project_id=774ca37113b04dfd91ccd1346ba02638)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:49.292065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:49.308790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invalidating the token cache because role 20c99dc7f0a14a9983c775f6ee106a0b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:49.309900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.310690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.313842 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3103/6167] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:49 2022] DELETE /identity/v3/roles/20c99dc7f0a14a9983c775f6ee106a0b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:49.314846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:49.317390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:49.363399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774ca37113b04dfd91ccd1346ba02638', 'request_id': 'req-57efe0c3-27c8-44c2-ab56-ffe68a086b91'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.371890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774ca37113b04dfd91ccd1346ba02638', 'request_id': 'req-57efe0c3-27c8-44c2-ab56-ffe68a086b91'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.386269 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:49.399070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774ca37113b04dfd91ccd1346ba02638', 'request_id': 'req-57efe0c3-27c8-44c2-ab56-ffe68a086b91'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.418962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] The token cache is being invalidate because project 774ca37113b04dfd91ccd1346ba02638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:49.419398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.420468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.422421 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3065/6168] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:49 2022] DELETE /identity/v3/projects/774ca37113b04dfd91ccd1346ba02638 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:49.423279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:49.428214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:49.445282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c6225-cf1e-430f-8fd7-154ccba55f60 tempest-RolesV3TestJSON-1709373001 tempest-RolesV3TestJSON-1709373001-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:49.525380 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:49.613038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:49.613851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:49.614237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:49.614617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] PATH_INFO: `/v3/users/8e65b86393ce43cc8c69be3ad2f91f93` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:49.619396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e65b86393ce43cc8c69be3ad2f91f93)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:49.622460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:49.630247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efe0c3-27c8-44c2-ab56-ffe68a086b91 tempest-RoutersIpV6AdminTest-219449897 tempest-RoutersIpV6AdminTest-219449897-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:49.666364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:49.670101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:49.670737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:49.671226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] PATH_INFO: `/v3/users/affb0f87c08d4f1eaab904e99037c102` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:49.673863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=affb0f87c08d4f1eaab904e99037c102)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:49.685192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:49.710634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e65b86393ce43cc8c69be3ad2f91f93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.711366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e65b86393ce43cc8c69be3ad2f91f93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.713307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e65b86393ce43cc8c69be3ad2f91f93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.752793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e65b86393ce43cc8c69be3ad2f91f93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.772107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e65b86393ce43cc8c69be3ad2f91f93'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.811832 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3104/6169] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:49 2022] DELETE /identity/v3/users/8e65b86393ce43cc8c69be3ad2f91f93 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:49.813195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:49.814631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:49.907371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affb0f87c08d4f1eaab904e99037c102'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.908188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affb0f87c08d4f1eaab904e99037c102'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.908760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affb0f87c08d4f1eaab904e99037c102'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.925285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affb0f87c08d4f1eaab904e99037c102'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:49.965871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-188631d6-fdb3-421f-9ae1-4bc8641559f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affb0f87c08d4f1eaab904e99037c102'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:50.002188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74264-373e-4394-8e18-ca278cc45046 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:50.004088 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3066/6170] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:49 2022] DELETE /identity/v3/users/affb0f87c08d4f1eaab904e99037c102 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:50.010384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:50.010675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:50.010950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:50.078499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:50.080048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:50.102270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:50.103112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:50.103393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:50.103669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:50.109011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:50.154728 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:50.199208 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3067/6171] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:50.215865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:50.216913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:50.218111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:50.218510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:50.229873 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3105/6172] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:50.240552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be28cc-b62b-49b4-acea-330541d8117a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:50.246991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dafb3-423c-4086-ab83-517b97ca9ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:50.248285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dafb3-423c-4086-ab83-517b97ca9ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:50.248926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dafb3-423c-4086-ab83-517b97ca9ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:50.249450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dafb3-423c-4086-ab83-517b97ca9ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:50.258188 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:50.264322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dafb3-423c-4086-ab83-517b97ca9ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:50.266425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dafb3-423c-4086-ab83-517b97ca9ed4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:50.292117 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3068/6173] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:50.533007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:50.534715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:50.563371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21058e-ab6d-4901-87a3-4a07e01950a9 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:50.572159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:50.572850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:50.573150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:50.575059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] PATH_INFO: `/v3/projects/a8f9ab6368894cbfa20305df37c9476f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:50.577344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f9ab6368894cbfa20305df37c9476f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:50.584074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:50.684091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f9ab6368894cbfa20305df37c9476f', 'request_id': 'req-c7b99b22-1947-468b-aec2-a66ca89ede19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:50.692686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f9ab6368894cbfa20305df37c9476f', 'request_id': 'req-c7b99b22-1947-468b-aec2-a66ca89ede19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:50.716347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f9ab6368894cbfa20305df37c9476f', 'request_id': 'req-c7b99b22-1947-468b-aec2-a66ca89ede19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:50.743999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] The token cache is being invalidate because project a8f9ab6368894cbfa20305df37c9476f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:50.745353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:50.749160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7b99b22-1947-468b-aec2-a66ca89ede19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:50.754701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3106/6174] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:50 2022] DELETE /identity/v3/projects/a8f9ab6368894cbfa20305df37c9476f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:50.757390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04347f6-2a2f-41b2-aa5b-b9ed18f112e4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:50.757882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04347f6-2a2f-41b2-aa5b-b9ed18f112e4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:50.758351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04347f6-2a2f-41b2-aa5b-b9ed18f112e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:50.783322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e04347f6-2a2f-41b2-aa5b-b9ed18f112e4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:50.785259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e04347f6-2a2f-41b2-aa5b-b9ed18f112e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:50.952462 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3069/6175] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:50.961910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f56d7-4285-4a87-b0de-6133cfdb32be None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:50.961910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f56d7-4285-4a87-b0de-6133cfdb32be None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:50.962186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f56d7-4285-4a87-b0de-6133cfdb32be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.005976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-903f56d7-4285-4a87-b0de-6133cfdb32be None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:51.008515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-903f56d7-4285-4a87-b0de-6133cfdb32be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:51.051605 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3107/6176] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:51.054194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04347f6-2a2f-41b2-aa5b-b9ed18f112e4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.068572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04347f6-2a2f-41b2-aa5b-b9ed18f112e4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.075193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.076221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.076746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.077377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.079147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:51.079745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.082231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.108364 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3070/6177] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:51.112339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f56d7-4285-4a87-b0de-6133cfdb32be None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.127731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f56d7-4285-4a87-b0de-6133cfdb32be None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.139684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.140309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.140576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.140843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.141513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.143404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.239182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3108/6178] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:51 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:51.244852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.262550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34090930-4082-418e-9b1a-bc8b6d5bd491 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.393721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.403303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.406106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.406661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.408077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.413483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.472547 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3071/6179] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:51 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:51.479311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.496118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11701bdc-1157-478e-a750-1e03fc5b75a9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.510425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.510925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.517999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.517999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.517999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.518408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:51.518517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.518517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.537120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941368-5304-474a-beda-86c7ed84f112 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.545890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.546488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.546769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.547047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] PATH_INFO: `/v3/projects/42d9c1ef405c4fed8cb37ff8bf3292bd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.548404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d9c1ef405c4fed8cb37ff8bf3292bd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.550368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.555139 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3109/6180] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:51.566677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.588208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218793-c393-4922-9282-699e9f348a30 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.594150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.594959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.595245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.595518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.596693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.598494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.623166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3110/6181] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:51.624066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.627654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:51.643398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d9c1ef405c4fed8cb37ff8bf3292bd', 'request_id': 'req-0b6ccd21-1442-40c3-b00e-1ef6f65df546'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.647510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78155195-1869-4269-b28b-aed3c52ea561 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.653946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d9c1ef405c4fed8cb37ff8bf3292bd', 'request_id': 'req-0b6ccd21-1442-40c3-b00e-1ef6f65df546'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.706012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d9c1ef405c4fed8cb37ff8bf3292bd', 'request_id': 'req-0b6ccd21-1442-40c3-b00e-1ef6f65df546'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.715452 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:51.744820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] The token cache is being invalidate because project 42d9c1ef405c4fed8cb37ff8bf3292bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:51.745207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.746082 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:51.746913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.750760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3072/6182] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:51 2022] DELETE /identity/v3/projects/42d9c1ef405c4fed8cb37ff8bf3292bd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:51.753488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.757122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:51.764542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.765454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.765739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.768131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] PATH_INFO: `/v3/users/6d907e5f4a3049cfafd76b4e0b38e7ed` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.769674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d907e5f4a3049cfafd76b4e0b38e7ed)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.775345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.785911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ccd21-1442-40c3-b00e-1ef6f65df546 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:51.798996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:51.798996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:51.799348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:51.799464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] PATH_INFO: `/v3/projects/e58cba4a61144e20a72bcb6f7e90b727/users/435d50630b1844408f0150077087877d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:51.837612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58cba4a61144e20a72bcb6f7e90b727, user_id=435d50630b1844408f0150077087877d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:51.841489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:51.868077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d907e5f4a3049cfafd76b4e0b38e7ed'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.868613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d907e5f4a3049cfafd76b4e0b38e7ed'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.874578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d907e5f4a3049cfafd76b4e0b38e7ed'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.883324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3073/6183] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:51 2022] PUT /identity/v3/projects/e58cba4a61144e20a72bcb6f7e90b727/users/435d50630b1844408f0150077087877d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:51.886945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.888448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:51.907518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d907e5f4a3049cfafd76b4e0b38e7ed'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.923704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d907e5f4a3049cfafd76b4e0b38e7ed'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:51.949922 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3111/6184] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:51 2022] DELETE /identity/v3/users/6d907e5f4a3049cfafd76b4e0b38e7ed => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:51.950828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:51.953824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:51.978332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d28d-49da-4e4c-978e-4b4e725b180d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:52.043604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daafa9-3f00-4c84-af04-bc5a8e3deb9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:52.044244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daafa9-3f00-4c84-af04-bc5a8e3deb9f service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:52.044881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daafa9-3f00-4c84-af04-bc5a8e3deb9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:52.045079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daafa9-3f00-4c84-af04-bc5a8e3deb9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:52.047091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67daafa9-3f00-4c84-af04-bc5a8e3deb9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:52.103210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df65996-7eb7-4bfa-a1a4-f08b4681c856 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:52.109473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:52.111316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:52.111610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:52.111956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] PATH_INFO: `/v3/users/31b33b07d6654400911af6d400d72dda` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:52.113520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b33b07d6654400911af6d400d72dda)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:52.116865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:52.149825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daafa9-3f00-4c84-af04-bc5a8e3deb9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:52.152599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daafa9-3f00-4c84-af04-bc5a8e3deb9f service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:52.166316 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3074/6185] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:52.169168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11b87-a53a-4580-8df3-d9bdc85f2f35 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:52.169692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11b87-a53a-4580-8df3-d9bdc85f2f35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:52.170196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11b87-a53a-4580-8df3-d9bdc85f2f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:52.196877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-24e11b87-a53a-4580-8df3-d9bdc85f2f35 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:52.198637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-24e11b87-a53a-4580-8df3-d9bdc85f2f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:52.207494 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3075/6186] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:52.209772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:52.210371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:52.210876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:52.220987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b33b07d6654400911af6d400d72dda'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:52.223925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b33b07d6654400911af6d400d72dda'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:52.224790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b33b07d6654400911af6d400d72dda'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:52.235149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:52.237037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:52.248445 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3076/6187] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:52.249907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:52.253390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:52.268087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b33b07d6654400911af6d400d72dda'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:52.279480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b33b07d6654400911af6d400d72dda'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:52.284674 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:52.303369 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3112/6188] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:51 2022] DELETE /identity/v3/users/31b33b07d6654400911af6d400d72dda => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:52.303578 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:52.304290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:52.326922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:52.393311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7b880-d56c-4451-aa2d-1816063b6b97 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:52.440873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09ed78-0b38-46ae-930b-67feaf41c2ce admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:52.447024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:52.447649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:52.447932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:52.448388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:52.470053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:52.471146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:52.471537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:52.471967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:52.474187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:52.563059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:52.564912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:52.595019 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3113/6189] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:52.622569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:52.624055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:52.636447 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3077/6190] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:54.262324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:54.266071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:54.289709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e43ca0-c5ae-4ab4-bc63-603f50ff2c01 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:54.294607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:54.295254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:54.295534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:54.295810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] PATH_INFO: `/v3/projects/e33238603ace49cfbae0f4f7faed9950` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:54.296964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33238603ace49cfbae0f4f7faed9950)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:54.298914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:54.381550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33238603ace49cfbae0f4f7faed9950', 'request_id': 'req-391296f2-8704-42b2-a32e-bab4f8013c65'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.401246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33238603ace49cfbae0f4f7faed9950', 'request_id': 'req-391296f2-8704-42b2-a32e-bab4f8013c65'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.410411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33238603ace49cfbae0f4f7faed9950', 'request_id': 'req-391296f2-8704-42b2-a32e-bab4f8013c65'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.438277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] The token cache is being invalidate because project e33238603ace49cfbae0f4f7faed9950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:54.438277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.438277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-391296f2-8704-42b2-a32e-bab4f8013c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.439348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:54.440088 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3114/6191] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:54 2022] DELETE /identity/v3/projects/e33238603ace49cfbae0f4f7faed9950 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:54.441013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:54.445773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d8f6-1b53-40b5-94df-0bed187e2a7c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:54.446180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d8f6-1b53-40b5-94df-0bed187e2a7c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:54.447222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d8f6-1b53-40b5-94df-0bed187e2a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:54.461885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97170929-93e3-4229-8471-eea834d5b959 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:54.479482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5945d8f6-1b53-40b5-94df-0bed187e2a7c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:54.498078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5945d8f6-1b53-40b5-94df-0bed187e2a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:54.555203 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:54.609011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:54.609702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:54.610154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:54.610483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] PATH_INFO: `/v3/projects/c4b06c38593e4b3f96e65c197afce50d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:54.612272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b06c38593e4b3f96e65c197afce50d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:54.619489 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3115/6192] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:54.619715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:54.621234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db111-060c-43a7-a532-5103fd1945ed None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:54.621684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db111-060c-43a7-a532-5103fd1945ed None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:54.622077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db111-060c-43a7-a532-5103fd1945ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:54.667391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4d8db111-060c-43a7-a532-5103fd1945ed None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:54.669932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4d8db111-060c-43a7-a532-5103fd1945ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:54.693735 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3116/6193] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:54.697249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8db111-060c-43a7-a532-5103fd1945ed None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:54.706378 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:54.716586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8db111-060c-43a7-a532-5103fd1945ed None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:54.733867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b06c38593e4b3f96e65c197afce50d', 'request_id': 'req-4319ccb2-4ead-41c7-9e81-1018a75b510c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.749680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b06c38593e4b3f96e65c197afce50d', 'request_id': 'req-4319ccb2-4ead-41c7-9e81-1018a75b510c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.770041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b06c38593e4b3f96e65c197afce50d', 'request_id': 'req-4319ccb2-4ead-41c7-9e81-1018a75b510c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.795309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] The token cache is being invalidate because project c4b06c38593e4b3f96e65c197afce50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:54.796599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.799326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:54.801880 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3078/6194] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:54 2022] DELETE /identity/v3/projects/c4b06c38593e4b3f96e65c197afce50d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:54.808778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:54.815470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:54.832221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:54.832900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:54.833407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:54.834075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:54.835389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:54.835765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:54.837560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:54.860557 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3117/6195] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:54.862904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:54.864126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:54.882835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14d5c-0e63-4b1d-98a8-c72036f4ec7b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:54.912929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:54.912929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:54.913453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:54.913545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:54.916604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:54.922372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:54.962197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319ccb2-4ead-41c7-9e81-1018a75b510c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:54.973964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:54.977423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:54.977708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:54.977985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] PATH_INFO: `/v3/users/8831a930e3da4071b22f8b5b4e3578d3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:54.983255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8831a930e3da4071b22f8b5b4e3578d3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:54.985314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:55.010744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3118/6196] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:54 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:55.012075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:55.104731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8831a930e3da4071b22f8b5b4e3578d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:55.106256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8831a930e3da4071b22f8b5b4e3578d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:55.107799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8831a930e3da4071b22f8b5b4e3578d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:55.127365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8831a930e3da4071b22f8b5b4e3578d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:55.143712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4a76c-b3a6-42f5-8f32-c24a01d56fb9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:55.151350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8831a930e3da4071b22f8b5b4e3578d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:55.158773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:55.161107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:55.163092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:55.163312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:55.165480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:55.170725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:55.179253 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3079/6197] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:54 2022] DELETE /identity/v3/users/8831a930e3da4071b22f8b5b4e3578d3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:55.274668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3119/6198] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:55 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:55.289133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:55.290898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:55.378129 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:55.426042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92941b3-1ef2-46b6-8d20-2a319ec6281d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:55.432637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:55.435222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:55.435687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:55.436295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:55.437560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:55.440537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:55.459618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:55.470205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3080/6199] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:55.471716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58292d62-e913-4694-acc9-ec8da7c19260 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:55.478715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:55.479445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:55.479719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:55.479993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:55.480822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:55.482481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:55.495781 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3120/6200] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:55.502205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:55.518585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c5a6e-f867-479d-8859-1bac76ff9d0a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:55.527421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e2e03-aa3d-480e-a6ca-f382c2654791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:55.527421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2e03-aa3d-480e-a6ca-f382c2654791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:55.527421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2e03-aa3d-480e-a6ca-f382c2654791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:55.527421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e2e03-aa3d-480e-a6ca-f382c2654791 admin admin] PATH_INFO: `/v3/projects/eb1f85aa8f4449668010678d14fb8af8/users/59ab74addc114e2c8b916a57cbe60a6c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:55.556113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e2e03-aa3d-480e-a6ca-f382c2654791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1f85aa8f4449668010678d14fb8af8, user_id=59ab74addc114e2c8b916a57cbe60a6c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:55.559140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e2e03-aa3d-480e-a6ca-f382c2654791 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:55.584477 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3081/6201] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:55 2022] PUT /identity/v3/projects/eb1f85aa8f4449668010678d14fb8af8/users/59ab74addc114e2c8b916a57cbe60a6c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:55.618425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d1d2-7f11-489f-9a4b-459b9a3de46b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:55.618714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:55.618858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d1d2-7f11-489f-9a4b-459b9a3de46b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:55.619069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d1d2-7f11-489f-9a4b-459b9a3de46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:55.621569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:55.645867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72581-976d-4ba6-a5d9-b85edb2d4cf3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:55.659097 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:55.704764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-44a3d1d2-7f11-489f-9a4b-459b9a3de46b None None] MFA Rules not processed for user `59ab74addc114e2c8b916a57cbe60a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:55.706043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-44a3d1d2-7f11-489f-9a4b-459b9a3de46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:55.778080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:55.778812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:55.781607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:55.781607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] PATH_INFO: `/v3/projects/1e0b2c04b5d3496dad9aa7d58addc24f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:55.785143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0b2c04b5d3496dad9aa7d58addc24f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:55.789547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:55.869042 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3082/6202] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:55.873470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d1d2-7f11-489f-9a4b-459b9a3de46b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:55.899986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d1d2-7f11-489f-9a4b-459b9a3de46b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:55.957232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0b2c04b5d3496dad9aa7d58addc24f', 'request_id': 'req-02163be3-5508-4f2a-948e-723d54a29c9b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:55.979743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0b2c04b5d3496dad9aa7d58addc24f', 'request_id': 'req-02163be3-5508-4f2a-948e-723d54a29c9b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:56.009318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0b2c04b5d3496dad9aa7d58addc24f', 'request_id': 'req-02163be3-5508-4f2a-948e-723d54a29c9b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:56.024998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.025652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.026599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.031470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.032442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.035694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.042418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] The token cache is being invalidate because project 1e0b2c04b5d3496dad9aa7d58addc24f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:28:56.042708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:56.046031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-02163be3-5508-4f2a-948e-723d54a29c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:56.053487 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3121/6203] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:28:55 2022] DELETE /identity/v3/projects/1e0b2c04b5d3496dad9aa7d58addc24f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:56.058409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c4a5-8972-4a93-bbc5-dcf641f76df1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.058694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c4a5-8972-4a93-bbc5-dcf641f76df1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.058969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c4a5-8972-4a93-bbc5-dcf641f76df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.086951 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3083/6204] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:55 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:56.087899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.090047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:56.102873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-75d7c4a5-8972-4a93-bbc5-dcf641f76df1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:56.104110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-75d7c4a5-8972-4a93-bbc5-dcf641f76df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:56.127466 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:56.203847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7784-2a0f-4822-9f95-87ec1a221543 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:56.217428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.218265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.218648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.219039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.219916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.222085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.252452 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3122/6205] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:56.259509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9b06-3f6f-477a-9993-31032c0ec44e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.259872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9b06-3f6f-477a-9993-31032c0ec44e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.260122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9b06-3f6f-477a-9993-31032c0ec44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.288802 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3084/6206] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:56 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:56.291849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.325313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddae688-d24b-4bba-b35c-3476406646e7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:56.339045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3cef9b06-3f6f-477a-9993-31032c0ec44e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:56.342460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3cef9b06-3f6f-477a-9993-31032c0ec44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:56.343059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.344126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.344530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.344804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.345504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.350648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.360025 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3123/6207] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:56.364619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9b06-3f6f-477a-9993-31032c0ec44e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.368956 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3085/6208] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:28:56.373812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.377045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9b06-3f6f-477a-9993-31032c0ec44e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:56.383933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.385097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.386030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.386475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.387334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:28:56.387818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.390975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f76d2-31f1-4476-8b4c-a31586a85585 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:56.397994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.408620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.409438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.409749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.410102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.411314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.415785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.417105 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3124/6209] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:56.421531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.438629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e306bed-6d20-4f7d-9dde-518fe3fe40ec admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:56.445175 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3086/6210] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:56.446079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.446725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.447039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.447458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.448181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.450548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.453328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.467842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c6d8-ab10-496d-94c2-b9968fbc3daf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:56.473329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68963-dc78-4927-9341-872084150b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.475640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68963-dc78-4927-9341-872084150b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.476278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68963-dc78-4927-9341-872084150b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.477042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68963-dc78-4927-9341-872084150b76 admin admin] PATH_INFO: `/v3/projects/57e01041b92b482a8624ebdebeadb344/users/44f0ed26b43f4f449495131f1abee024/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.507712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c68963-dc78-4927-9341-872084150b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e01041b92b482a8624ebdebeadb344, user_id=44f0ed26b43f4f449495131f1abee024, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.509856 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:56.522946 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3125/6211] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:28:56 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:28:56.529681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.534064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c68963-dc78-4927-9341-872084150b76 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.555997 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3087/6212] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:56 2022] PUT /identity/v3/projects/57e01041b92b482a8624ebdebeadb344/users/44f0ed26b43f4f449495131f1abee024/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:56.570138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.570717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.571125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.694907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] MFA Rules not processed for user `44f0ed26b43f4f449495131f1abee024`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:56.700661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:56.735627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1dcdc-562c-4081-aedb-3eae4f8ea6d5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:56.854907 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3088/6213] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:28:56.856018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:56.857955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:56.911504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:56.912425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:56.912707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:56.912984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:56.915598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:56.920470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:56.975043 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3126/6214] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:28:56 2022] POST /identity/v3/users => generated 291 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:28:56.977875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:57.002088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452807-e1f3-4959-b0ee-df94d6ad4fe4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:57.003790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68e71-926a-479c-bf78-23c5d7a71617 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:57.011378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd25d-e544-41b1-b7cf-93d84bc3128b tempest-IdentityV3ProjectsTest-782778694 tempest-IdentityV3ProjectsTest-782778694-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ab74addc114e2c8b916a57cbe60a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb1f85aa8f4449668010678d14fb8af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:57.012043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd25d-e544-41b1-b7cf-93d84bc3128b tempest-IdentityV3ProjectsTest-782778694 tempest-IdentityV3ProjectsTest-782778694-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.012326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd25d-e544-41b1-b7cf-93d84bc3128b tempest-IdentityV3ProjectsTest-782778694 tempest-IdentityV3ProjectsTest-782778694-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.012608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd25d-e544-41b1-b7cf-93d84bc3128b tempest-IdentityV3ProjectsTest-782778694 tempest-IdentityV3ProjectsTest-782778694-project] PATH_INFO: `/v3/users/59ab74addc114e2c8b916a57cbe60a6c/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.014043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbd25d-e544-41b1-b7cf-93d84bc3128b tempest-IdentityV3ProjectsTest-782778694 tempest-IdentityV3ProjectsTest-782778694-project] RBAC: Authorizing `identity:list_user_projects(user_id=59ab74addc114e2c8b916a57cbe60a6c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:57.015841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbd25d-e544-41b1-b7cf-93d84bc3128b tempest-IdentityV3ProjectsTest-782778694 tempest-IdentityV3ProjectsTest-782778694-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:57.018956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:57.019673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.020128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.020404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.021892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:57.023521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:57.030195 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:57.050486 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3127/6215] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:57.053719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:57.082154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a656-6982-4124-92a4-98602276df0d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:57.094786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:57.096417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.096704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.096967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.110589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:57.122678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:57.140406 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3089/6216] 10.222.0.16 () {58 vars in 1248 bytes} [Sun Sep 11 01:28:56 2022] GET /identity/v3/users/59ab74addc114e2c8b916a57cbe60a6c/projects => generated 515 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:28:57.141887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013f3f-8782-4db2-8cf3-ecfa54ea462a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.145788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013f3f-8782-4db2-8cf3-ecfa54ea462a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.146288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013f3f-8782-4db2-8cf3-ecfa54ea462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.154345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3128/6217] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:28:57.159217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:57.182483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93608203-d214-4ab2-9a63-63a7711f87f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:57.198080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf089c-90b8-4f7b-99df-9316d9b491fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:57.198779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf089c-90b8-4f7b-99df-9316d9b491fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.199058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf089c-90b8-4f7b-99df-9316d9b491fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.199336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf089c-90b8-4f7b-99df-9316d9b491fb admin admin] PATH_INFO: `/v3/projects/9fef5c8b7f5b48e0a06e25116133fcde/users/70bae67c6c2e4c1f9e07dbd8bf2464fe/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.226263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf089c-90b8-4f7b-99df-9316d9b491fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fef5c8b7f5b48e0a06e25116133fcde, user_id=70bae67c6c2e4c1f9e07dbd8bf2464fe, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:57.230528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf089c-90b8-4f7b-99df-9316d9b491fb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:57.243030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-45013f3f-8782-4db2-8cf3-ecfa54ea462a None None] MFA Rules not processed for user `59ab74addc114e2c8b916a57cbe60a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:57.251978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45013f3f-8782-4db2-8cf3-ecfa54ea462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:57.255867 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3129/6218] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:28:57 2022] PUT /identity/v3/projects/9fef5c8b7f5b48e0a06e25116133fcde/users/70bae67c6c2e4c1f9e07dbd8bf2464fe/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:57.275979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.276705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.277533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.381780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] MFA Rules not processed for user `70bae67c6c2e4c1f9e07dbd8bf2464fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:57.385371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:57.427108 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3090/6219] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:57.431222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.431589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.432256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.460109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] MFA Rules not processed for user `59ab74addc114e2c8b916a57cbe60a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:57.463790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:57.503261 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:57.550786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.models.token_model [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] User 59ab74addc114e2c8b916a57cbe60a6c has no access to project 57e01041b92b482a8624ebdebeadb344 {{(pid=81860) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Sep 11 01:28:57.617887 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.server.flask.application [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 11 01:28:57.617887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3091/6220] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:57 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 152 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Sep 11 01:28:57.617887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:57.618860 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3130/6221] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:57.647769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:57.647769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:57.755101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe8429-9db3-425f-9cf0-a41b447d4d0c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:57.763071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:57.763916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.764369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.764651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] PATH_INFO: `/v3/users/59ab74addc114e2c8b916a57cbe60a6c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.766059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ab74addc114e2c8b916a57cbe60a6c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:57.769519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:57.774882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d2c58-9425-461f-8e45-d66904ff684c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:57.780574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db432c7-47f2-4d0a-978f-d47328054875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:57.781366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db432c7-47f2-4d0a-978f-d47328054875 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.781749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db432c7-47f2-4d0a-978f-d47328054875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.782283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db432c7-47f2-4d0a-978f-d47328054875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.798443 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:28:57.803734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db432c7-47f2-4d0a-978f-d47328054875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:57.805355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db432c7-47f2-4d0a-978f-d47328054875 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:57.829836 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3131/6222] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:28:57.842739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ab74addc114e2c8b916a57cbe60a6c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:57.843467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ab74addc114e2c8b916a57cbe60a6c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:57.844833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ab74addc114e2c8b916a57cbe60a6c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:57.854007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ab74addc114e2c8b916a57cbe60a6c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:57.905568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ab74addc114e2c8b916a57cbe60a6c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:28:57.936145 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3092/6223] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:28:57 2022] DELETE /identity/v3/users/59ab74addc114e2c8b916a57cbe60a6c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:28:57.942378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:57.942734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:57.943484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:57.994387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:28:57.995698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:58.165869 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3132/6224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:28:58.187940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:28:58.190405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:28:58.359011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81584eb-68aa-4425-b130-58543d390c0f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:28:58.368861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:28:58.369511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:28:58.369793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:28:58.370063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:28:58.392801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:28:58.394250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:28:58.418663 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3093/6225] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:00.433950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:00.435410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:00.458949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5601560-07b6-41b2-be15-f2b5bb489c6b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:00.472961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:00.475836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:00.476158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:00.476431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] PATH_INFO: `/v3/projects/eb1f85aa8f4449668010678d14fb8af8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:00.480128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1f85aa8f4449668010678d14fb8af8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:00.485557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:00.589957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1f85aa8f4449668010678d14fb8af8', 'request_id': 'req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:00.623739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1f85aa8f4449668010678d14fb8af8', 'request_id': 'req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:00.643383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1f85aa8f4449668010678d14fb8af8', 'request_id': 'req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:00.674129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] The token cache is being invalidate because project eb1f85aa8f4449668010678d14fb8af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:00.674909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:00.676850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:00.679693 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3133/6226] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:00 2022] DELETE /identity/v3/projects/eb1f85aa8f4449668010678d14fb8af8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:00.683526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:00.701786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66354-f747-4784-9e16-5fd51fe5020c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:00.855991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:00.870776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:00.871069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:00.871433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] PATH_INFO: `/v3/users/44f0ed26b43f4f449495131f1abee024` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:00.876730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f0ed26b43f4f449495131f1abee024)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:00.879106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:01.044168 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:01.051305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f0ed26b43f4f449495131f1abee024'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:01.054018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f0ed26b43f4f449495131f1abee024'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:01.055662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f0ed26b43f4f449495131f1abee024'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:01.079083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f0ed26b43f4f449495131f1abee024'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:01.118817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a5772b09-e977-436d-8099-7336470da931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f0ed26b43f4f449495131f1abee024'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:01.162234 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3094/6227] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:00 2022] DELETE /identity/v3/users/44f0ed26b43f4f449495131f1abee024 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:03.150181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:03.152028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:03.183248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a6add-d346-4036-a2ce-38b7cb9e6f6a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:03.205726 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:03.334317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:03.334992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:03.335267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:03.335536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] PATH_INFO: `/v3/projects/57e01041b92b482a8624ebdebeadb344` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:03.336906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e01041b92b482a8624ebdebeadb344)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:03.339003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:03.424867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e01041b92b482a8624ebdebeadb344', 'request_id': 'req-7403a00a-0fcf-4756-896b-61a03c455013'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:03.432384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e01041b92b482a8624ebdebeadb344', 'request_id': 'req-7403a00a-0fcf-4756-896b-61a03c455013'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:03.459517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e01041b92b482a8624ebdebeadb344', 'request_id': 'req-7403a00a-0fcf-4756-896b-61a03c455013'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:03.486638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] The token cache is being invalidate because project 57e01041b92b482a8624ebdebeadb344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:03.486937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:03.488837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7403a00a-0fcf-4756-896b-61a03c455013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:03.492135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3134/6228] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:03 2022] DELETE /identity/v3/projects/57e01041b92b482a8624ebdebeadb344 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:03.496459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50499a2-c775-4b65-b442-1fcad744a8bf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:03.496959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50499a2-c775-4b65-b442-1fcad744a8bf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:03.497102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50499a2-c775-4b65-b442-1fcad744a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:03.550220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c50499a2-c775-4b65-b442-1fcad744a8bf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:03.551671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c50499a2-c775-4b65-b442-1fcad744a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:03.730768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda97e-d934-4d47-8a89-5a507ac931f3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:03.731004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3095/6229] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:03.731430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda97e-d934-4d47-8a89-5a507ac931f3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:03.731884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda97e-d934-4d47-8a89-5a507ac931f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:03.765585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e5fda97e-d934-4d47-8a89-5a507ac931f3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:03.767118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5fda97e-d934-4d47-8a89-5a507ac931f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:03.791709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3135/6230] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:03.795962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50499a2-c775-4b65-b442-1fcad744a8bf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:03.819860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50499a2-c775-4b65-b442-1fcad744a8bf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:03.826975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:03.827620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:03.827961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:03.828237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:03.829000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:03.829368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:03.832010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:03.854042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda97e-d934-4d47-8a89-5a507ac931f3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:03.860057 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3096/6231] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:29:03.868254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda97e-d934-4d47-8a89-5a507ac931f3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:03.874744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:03.875946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:03.876655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:03.877183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:03.878054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:03.880905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:03.933393 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3136/6232] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:03 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:03.939609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:03.956088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cde482-a064-4636-b800-e6ca0245686e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:04.116217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:04.116772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:04.117143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:04.117428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:04.118079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:04.123144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:04.181043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:04.181625 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3097/6233] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:03 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:04.196279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047298aa-4842-4691-8098-ce0c0c05e4da admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:04.210129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:04.211360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:04.212648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:04.212648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:04.214679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:04.218101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:04.247372 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3137/6234] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:29:04.251268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:04.267956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f3548-bc06-47bf-a898-270c95b9e9c0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:04.285392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:04.286092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:04.286421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:04.287003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] PATH_INFO: `/v3/projects/3fea372171764dcf8895e2a2c57e8c91/users/ff83a113031e46d1b190089307ded4db/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:04.342040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fea372171764dcf8895e2a2c57e8c91, user_id=ff83a113031e46d1b190089307ded4db, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:04.345761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:04.380575 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3098/6235] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:04 2022] PUT /identity/v3/projects/3fea372171764dcf8895e2a2c57e8c91/users/ff83a113031e46d1b190089307ded4db/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:04.384663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:04.405276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fde189-3013-4a7b-9cf4-532b287ba464 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:04.574126 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:04.587348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0d44e-f380-4123-8a87-4bf79ca3d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:04.587987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d44e-f380-4123-8a87-4bf79ca3d71d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:04.588280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d44e-f380-4123-8a87-4bf79ca3d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:04.588849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d44e-f380-4123-8a87-4bf79ca3d71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:04.590085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0d44e-f380-4123-8a87-4bf79ca3d71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:04.592521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0d44e-f380-4123-8a87-4bf79ca3d71d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:04.636789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:04.649361 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3138/6236] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:29:04.660006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a836-1063-42a5-bd74-6be54ac07951 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:04.673347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:04.674256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:04.675344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:04.675992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] PATH_INFO: `/v3/projects/3fea372171764dcf8895e2a2c57e8c91/users/ff83a113031e46d1b190089307ded4db/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:04.682699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fea372171764dcf8895e2a2c57e8c91, user_id=ff83a113031e46d1b190089307ded4db, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:04.690951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:04.712623 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:04.763963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3099/6237] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:04 2022] PUT /identity/v3/projects/3fea372171764dcf8895e2a2c57e8c91/users/ff83a113031e46d1b190089307ded4db/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:04.765136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99b82-9d47-4553-8235-f7eebc3ad201 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:04.765596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99b82-9d47-4553-8235-f7eebc3ad201 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:04.765973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e99b82-9d47-4553-8235-f7eebc3ad201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:04.845650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d4e99b82-9d47-4553-8235-f7eebc3ad201 None None] MFA Rules not processed for user `ff83a113031e46d1b190089307ded4db`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:04.846867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d4e99b82-9d47-4553-8235-f7eebc3ad201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:05.037623 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3139/6238] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:05.041779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:05.179172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a5189-4370-46c8-9c88-f06d72672ff3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:05.193862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:05.194498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:05.194778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:05.195229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:05.196045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:05.203237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:05.274905 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3100/6239] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:05 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:05.279308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e99b82-9d47-4553-8235-f7eebc3ad201 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:05.298481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e99b82-9d47-4553-8235-f7eebc3ad201 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:05.421598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:05.422275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:05.422613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:05.422935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:05.423621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:05.425699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:05.466153 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3140/6240] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:05 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:05.470323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:05.489669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940149-f55b-4dda-bcb4-9db4c9f28b98 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:05.501675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:05.503557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:05.503902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:05.504240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:05.505863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:05.507615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:05.523763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3101/6241] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:05.527807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:05.550295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbe65a-c14d-456a-bdce-ae998c566c57 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:05.563086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343afd6c-c094-4520-a8b0-55fc0bb7ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:05.564002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afd6c-c094-4520-a8b0-55fc0bb7ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:05.564283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afd6c-c094-4520-a8b0-55fc0bb7ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:05.564552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343afd6c-c094-4520-a8b0-55fc0bb7ac4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:05.565263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343afd6c-c094-4520-a8b0-55fc0bb7ac4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:05.568313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343afd6c-c094-4520-a8b0-55fc0bb7ac4c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:05.592634 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3141/6242] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:05.600112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:05.624182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe9d07-a11d-4d00-a1e6-c5e4a3399096 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:05.635000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:05.636069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:05.636581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:05.637395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] PATH_INFO: `/v3/projects/a3710e8d6b484c15b6bf111f29e67695/users/afeed0e93b0c447696463886df69ef1f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:05.696307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3710e8d6b484c15b6bf111f29e67695, user_id=afeed0e93b0c447696463886df69ef1f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:05.699330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:05.741104 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3102/6243] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:05 2022] PUT /identity/v3/projects/a3710e8d6b484c15b6bf111f29e67695/users/afeed0e93b0c447696463886df69ef1f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:05.751599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb88bd-4ce4-43f6-9b94-fac365dcd4db None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:05.752137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb88bd-4ce4-43f6-9b94-fac365dcd4db None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:05.752511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb88bd-4ce4-43f6-9b94-fac365dcd4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:05.819537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8acb88bd-4ce4-43f6-9b94-fac365dcd4db None None] MFA Rules not processed for user `afeed0e93b0c447696463886df69ef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:05.823281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8acb88bd-4ce4-43f6-9b94-fac365dcd4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:05.906222 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:05.951580 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3142/6244] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:05.964258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:05.967650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:06.123052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bfff-744c-42ad-910e-20007d5bcd5a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:06.128889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:06.131597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:06.135923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:06.136461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:06.194215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80daa8-64ba-4f33-b457-3772f375004d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:06.194215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80daa8-64ba-4f33-b457-3772f375004d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:06.195555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80daa8-64ba-4f33-b457-3772f375004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:06.326887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4a80daa8-64ba-4f33-b457-3772f375004d None None] MFA Rules not processed for user `435d50630b1844408f0150077087877d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:06.328688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4a80daa8-64ba-4f33-b457-3772f375004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:06.371235 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:06.394043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:06.397754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:06.410516 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3103/6245] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:06.506300 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3143/6246] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:06.512075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:06.523047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:06.837026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d16a6-e26e-41d6-a22f-a0d0d4feb7ae service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:06.846845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:06.847515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:06.847800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:06.848137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:06.848817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:06.851829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:06.912988 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3104/6247] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:06 2022] POST /identity/v3/projects => generated 375 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:06.914421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80daa8-64ba-4f33-b457-3772f375004d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:06.934592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80daa8-64ba-4f33-b457-3772f375004d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:07.065987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:07.066640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:07.066915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:07.067182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:07.068579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:07.070705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:07.125096 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3144/6248] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:06 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:07.129125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:07.151462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34181347-2a6d-42f7-8c7d-dd914990258f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:07.159063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:07.163473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:07.164048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:07.165215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:07.166076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:07.170861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:07.208760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3105/6249] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:29:07.213381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:07.231112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b51df-4cd7-44db-8ece-0fd22097c253 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:07.244025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:07.245212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:07.245498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:07.245775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] PATH_INFO: `/v3/projects/00ea505e433c4f92947b5748d0f5ef83/users/1464d40f7c3f48a29cd90b7882c2afac/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:07.300704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ea505e433c4f92947b5748d0f5ef83, user_id=1464d40f7c3f48a29cd90b7882c2afac, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:07.306145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:07.365989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3145/6250] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:07 2022] PUT /identity/v3/projects/00ea505e433c4f92947b5748d0f5ef83/users/1464d40f7c3f48a29cd90b7882c2afac/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:07.369212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:07.384247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adda83f-b27b-4ee8-9336-5bb74b561c26 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:07.611119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:07.611867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:07.612274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:07.612766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:07.613617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:07.615780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:07.649789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3106/6251] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:07.654338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:07.687619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d336-68c8-48dd-a6ac-49924dd6103d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:07.713421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f055509-acb0-4078-8ee3-1a7dd1393517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:07.714106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f055509-acb0-4078-8ee3-1a7dd1393517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:07.714384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f055509-acb0-4078-8ee3-1a7dd1393517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:07.714658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f055509-acb0-4078-8ee3-1a7dd1393517 admin admin] PATH_INFO: `/v3/projects/00ea505e433c4f92947b5748d0f5ef83/users/1464d40f7c3f48a29cd90b7882c2afac/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:07.722440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f055509-acb0-4078-8ee3-1a7dd1393517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ea505e433c4f92947b5748d0f5ef83, user_id=1464d40f7c3f48a29cd90b7882c2afac, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:07.726474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f055509-acb0-4078-8ee3-1a7dd1393517 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:07.740952 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3146/6252] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:07 2022] PUT /identity/v3/projects/00ea505e433c4f92947b5748d0f5ef83/users/1464d40f7c3f48a29cd90b7882c2afac/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:08.096076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:08.111205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe35888-302c-4c48-ba50-0f437bf6b292 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:08.254060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:08.254822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:08.255290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:08.255956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] PATH_INFO: `/v3/users/ff83a113031e46d1b190089307ded4db` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:08.257410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff83a113031e46d1b190089307ded4db)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:08.259572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:08.261583 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:08.352725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff83a113031e46d1b190089307ded4db'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:08.353709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff83a113031e46d1b190089307ded4db'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:08.355577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff83a113031e46d1b190089307ded4db'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:08.370578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff83a113031e46d1b190089307ded4db'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:08.389261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff83a113031e46d1b190089307ded4db'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:08.425402 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3107/6253] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:08 2022] DELETE /identity/v3/users/ff83a113031e46d1b190089307ded4db => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:08.430077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:08.430960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:08.431384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:08.468220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:08.470188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:08.532312 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:08.631585 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3147/6254] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:29:08.664439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:08.666225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:08.844075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d2cd-6250-45af-86db-91925a4fdacf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:08.851106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:08.855947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:08.856351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:08.856499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:08.876602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:08.878166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:08.910194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3108/6255] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:11.380723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:11.384343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:11.400255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b54a13-9310-49c1-9fde-c441b73c2216 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:11.406960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:11.408118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:11.408640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:11.409204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] PATH_INFO: `/v3/projects/3fea372171764dcf8895e2a2c57e8c91` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:11.410828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fea372171764dcf8895e2a2c57e8c91)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:11.414076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:11.523742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fea372171764dcf8895e2a2c57e8c91', 'request_id': 'req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.542204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fea372171764dcf8895e2a2c57e8c91', 'request_id': 'req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.554403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fea372171764dcf8895e2a2c57e8c91', 'request_id': 'req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.590216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] The token cache is being invalidate because project 3fea372171764dcf8895e2a2c57e8c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:11.592367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.593299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.596942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3148/6256] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:11 2022] DELETE /identity/v3/projects/3fea372171764dcf8895e2a2c57e8c91 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:11.602431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:11.616779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00073-1a9b-43e5-922d-d4b373726396 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:11.759130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:11.759983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:11.760269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:11.764928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] PATH_INFO: `/v3/users/afeed0e93b0c447696463886df69ef1f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:11.766429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afeed0e93b0c447696463886df69ef1f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:11.768554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:11.822056 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:11.875327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afeed0e93b0c447696463886df69ef1f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.876022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afeed0e93b0c447696463886df69ef1f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.877535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afeed0e93b0c447696463886df69ef1f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.898868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afeed0e93b0c447696463886df69ef1f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.930840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afeed0e93b0c447696463886df69ef1f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:11.961853 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3109/6257] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:11 2022] DELETE /identity/v3/users/afeed0e93b0c447696463886df69ef1f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:12.539571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:12.541039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:12.588466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d02c-c5f2-4017-ac8a-6519992ac5b6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:12.756528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:12.758339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:12.758917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:12.759420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] PATH_INFO: `/v3/users/8b1dfbbafa304ec6958dcbdd6e847ac9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:12.761130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1dfbbafa304ec6958dcbdd6e847ac9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:12.763648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:12.843935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1dfbbafa304ec6958dcbdd6e847ac9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:12.844810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1dfbbafa304ec6958dcbdd6e847ac9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:12.845558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1dfbbafa304ec6958dcbdd6e847ac9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:12.859849 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:12.894061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1dfbbafa304ec6958dcbdd6e847ac9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:12.915468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c4dae344-cce9-46c6-9d0e-b7dac8062338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1dfbbafa304ec6958dcbdd6e847ac9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:12.942239 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3149/6258] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:12 2022] DELETE /identity/v3/users/8b1dfbbafa304ec6958dcbdd6e847ac9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:13.807571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:13.811189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:13.843600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22a00-eafc-4990-bbe7-eccd07904c65 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:14.083450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:14.084120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:14.084684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:14.084684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] PATH_INFO: `/v3/projects/a3710e8d6b484c15b6bf111f29e67695` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:14.109274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3710e8d6b484c15b6bf111f29e67695)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:14.111372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:14.450081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3710e8d6b484c15b6bf111f29e67695', 'request_id': 'req-efea189c-9737-4f54-ba32-b6e4eaf5ae49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:14.465757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3710e8d6b484c15b6bf111f29e67695', 'request_id': 'req-efea189c-9737-4f54-ba32-b6e4eaf5ae49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:14.491894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3710e8d6b484c15b6bf111f29e67695', 'request_id': 'req-efea189c-9737-4f54-ba32-b6e4eaf5ae49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:14.573645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] The token cache is being invalidate because project a3710e8d6b484c15b6bf111f29e67695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:14.574434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:14.576557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-efea189c-9737-4f54-ba32-b6e4eaf5ae49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:14.608963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3110/6259] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:13 2022] DELETE /identity/v3/projects/a3710e8d6b484c15b6bf111f29e67695 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:14.614781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22c63-2df7-4489-8f2a-1c0c3b4768c5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:14.616390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22c63-2df7-4489-8f2a-1c0c3b4768c5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:14.616974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22c63-2df7-4489-8f2a-1c0c3b4768c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:14.648555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-adb22c63-2df7-4489-8f2a-1c0c3b4768c5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:14.650244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-adb22c63-2df7-4489-8f2a-1c0c3b4768c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:14.762678 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3150/6260] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:14.774424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:14.775144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:14.775885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:14.821020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:14.825491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:14.857881 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3111/6261] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:14.863681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb22c63-2df7-4489-8f2a-1c0c3b4768c5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:14.880668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb22c63-2df7-4489-8f2a-1c0c3b4768c5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:14.898050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:14.899597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:14.904462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:14.904880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:14.906011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:14.906567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:14.910556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:14.928885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:14.930630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:14.977280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfba00-1b61-48c6-a408-82c52fd26b6a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:14.984624 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3151/6262] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:29:14.987230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:15.001706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:15.003629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.003629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.003629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] PATH_INFO: `/v3/projects/d2d5a61641514a45b567202ad2bc75f7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.011491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d5a61641514a45b567202ad2bc75f7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:15.013608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:15.032074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f27d3-a26e-4bf4-b916-1791ea3feb46 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:15.061674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:15.061674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.061674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.061674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.062233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:15.084765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:15.131150 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:15.205205 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3152/6263] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:14 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:15.209982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:15.251914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d5a61641514a45b567202ad2bc75f7', 'request_id': 'req-4a67e1af-864d-49e7-886e-73bf4583688c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:15.281814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d5a61641514a45b567202ad2bc75f7', 'request_id': 'req-4a67e1af-864d-49e7-886e-73bf4583688c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:15.313692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d5a61641514a45b567202ad2bc75f7', 'request_id': 'req-4a67e1af-864d-49e7-886e-73bf4583688c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:15.354803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] The token cache is being invalidate because project d2d5a61641514a45b567202ad2bc75f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:15.355117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:15.358943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a67e1af-864d-49e7-886e-73bf4583688c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:15.360803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3112/6264] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:14 2022] DELETE /identity/v3/projects/d2d5a61641514a45b567202ad2bc75f7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:15.379325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b2d1-ea4b-4126-ad74-b170159ea01d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.379638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b2d1-ea4b-4126-ad74-b170159ea01d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.380453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b2d1-ea4b-4126-ad74-b170159ea01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.461532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f753b2d1-ea4b-4126-ad74-b170159ea01d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:15.463181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f753b2d1-ea4b-4126-ad74-b170159ea01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:15.549161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d3259-5683-4fd3-a573-4bb679f03097 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:15.578967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:15.579851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.580377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.581828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.582906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:15.586662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:15.665434 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3153/6265] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:15 2022] POST /identity/v3/users => generated 287 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:15.675214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:15.682529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:15.727071 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3113/6266] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:15.736799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b40c-3b28-4762-9097-bde71fdc6c2c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.737835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ac17e-eee7-441d-a7f2-c34c9d8d5beb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:15.738328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b40c-3b28-4762-9097-bde71fdc6c2c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.738708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526b40c-3b28-4762-9097-bde71fdc6c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.756961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:15.765297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.765970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.766355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.771767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:15.773614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:15.814039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4526b40c-3b28-4762-9097-bde71fdc6c2c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:15.826644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4526b40c-3b28-4762-9097-bde71fdc6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:15.828782 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3154/6267] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:29:15.830302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:15.861249 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3114/6268] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:15.868394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526b40c-3b28-4762-9097-bde71fdc6c2c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:15.873485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18628c1-f80d-4fb8-80bd-dc9dcadcfb13 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:15.894675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526b40c-3b28-4762-9097-bde71fdc6c2c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:15.898897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:15.899662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.901164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.901552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.903336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:15.907530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:15.925796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:15.926945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:15.929498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:15.931399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:15.932399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:15.937256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:15.940081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:15.954709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3155/6269] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:15.963921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:15.984444 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:15.986864 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3115/6270] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:29:15.993835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:15.996963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ae3e-8087-44c4-9364-2cb5f041e561 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:16.025633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b72f54-fff5-4888-873b-e8e00dbf9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:16.026424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72f54-fff5-4888-873b-e8e00dbf9f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:16.026806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72f54-fff5-4888-873b-e8e00dbf9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:16.027449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72f54-fff5-4888-873b-e8e00dbf9f2f admin admin] PATH_INFO: `/v3/projects/b68eae8de6a246c1955c1e3629a5b728/users/c871d49322d7476a8983c8539ba51868/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:16.037722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fdfe9-f3ce-49a4-862c-4a7f02a72840 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:16.069654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:16.070600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:16.071319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:16.075416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:16.077921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:16.080130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:16.088656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b72f54-fff5-4888-873b-e8e00dbf9f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68eae8de6a246c1955c1e3629a5b728, user_id=c871d49322d7476a8983c8539ba51868, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:16.111046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b72f54-fff5-4888-873b-e8e00dbf9f2f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:16.188047 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3156/6271] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:15 2022] PUT /identity/v3/projects/b68eae8de6a246c1955c1e3629a5b728/users/c871d49322d7476a8983c8539ba51868/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:16.202592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690232-11df-4215-ba90-bae2a5c23ff7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:16.203261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690232-11df-4215-ba90-bae2a5c23ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:16.203760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690232-11df-4215-ba90-bae2a5c23ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:16.260785 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3116/6272] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:15 2022] POST /identity/v3/projects => generated 405 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:16.262153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:16.373677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4b690232-11df-4215-ba90-bae2a5c23ff7 None None] MFA Rules not processed for user `c871d49322d7476a8983c8539ba51868`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:16.377808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4b690232-11df-4215-ba90-bae2a5c23ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:16.718344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f6d58-43aa-4d6e-b6c9-ec46baad268b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:16.745567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:16.746212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:16.746497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:16.746777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:16.747429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:16.749427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:16.792346 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3157/6273] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:16.795591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690232-11df-4215-ba90-bae2a5c23ff7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:16.818105 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:16.824668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690232-11df-4215-ba90-bae2a5c23ff7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:16.842702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:16.843265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:16.843550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:16.843810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:16.844449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:16.846376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:16.861942 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3117/6274] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:16 2022] POST /identity/v3/users => generated 303 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:16.864643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:16.916177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1933b-b0ac-4329-8a8d-d7a40be2d55a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:16.941396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:16.944232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:16.944524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:16.948124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:16.951803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:16.963711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:17.002016 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3158/6275] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:16 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:17.004439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.008898 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3118/6276] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:17.010553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.030912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851ac8a-d18b-49a0-94e6-babef1f75d17 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:17.281046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2a70-0a28-48ed-b002-727863418d61 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:17.297272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:17.297912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:17.298193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:17.298466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:17.299953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:17.306912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:17.356977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:17.359758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:17.360155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:17.360528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:17.361479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:17.374645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:17.400330 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3159/6277] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:17 2022] POST /identity/v3/users => generated 289 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:17.405225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.409115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3119/6278] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:17.420210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.439563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a0422-9d72-432d-93f7-766733a389d1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:17.451124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf126-63e4-452f-a870-c4f86599b7ba admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:17.462054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:17.462693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:17.462974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:17.463233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:17.463886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:17.467171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:17.482217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab9f43-1404-468a-9b73-9aa688e16463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:17.483491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9f43-1404-468a-9b73-9aa688e16463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:17.483491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9f43-1404-468a-9b73-9aa688e16463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:17.483491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9f43-1404-468a-9b73-9aa688e16463 admin admin] PATH_INFO: `/v3/projects/9f32577bf1654f22a81c18cc1ed8b1f2/users/e4d263e82c604e3b8838b7d2754f5f6d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:17.501821 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3160/6279] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:17.506074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.529515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab9f43-1404-468a-9b73-9aa688e16463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f32577bf1654f22a81c18cc1ed8b1f2, user_id=e4d263e82c604e3b8838b7d2754f5f6d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:17.532716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab9f43-1404-468a-9b73-9aa688e16463 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:17.537884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108f5c3-b622-4234-a042-e4630721468d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:17.550512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:17.551145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:17.551422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:17.552342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:17.552938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:17.563302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:17.569416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3120/6280] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:17 2022] PUT /identity/v3/projects/9f32577bf1654f22a81c18cc1ed8b1f2/users/e4d263e82c604e3b8838b7d2754f5f6d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:17.576732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:17.577014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:17.577373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:17.595170 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3161/6281] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:17.596448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.625538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:17.628074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaf08f-a87d-4bbb-9777-42f97fbd7822 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:17.629678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:17.673760 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:17.859457 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3121/6282] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:17.860683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.872957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:17.873682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:17.873963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:17.874240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] PATH_INFO: `/v3/projects/c6dfc0737f344f96927ab8d9b6c8e7b3/users/f2ed847c55df45b7bec542e9c4829ceb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:17.882907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:17.893035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6dfc0737f344f96927ab8d9b6c8e7b3, user_id=f2ed847c55df45b7bec542e9c4829ceb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:17.897053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:17.917799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c5ee4-617b-488f-b89e-57bd7536f1f8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:17.924531 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3162/6283] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:17 2022] PUT /identity/v3/projects/c6dfc0737f344f96927ab8d9b6c8e7b3/users/f2ed847c55df45b7bec542e9c4829ceb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:17.937009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:17.938954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:18.053274 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:18.071600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:18.072360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:18.072650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:18.072949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] PATH_INFO: `/v3/users/9b243b662a3141a0900a38fcaed5ddc7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:18.074740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b243b662a3141a0900a38fcaed5ddc7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:18.080010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:18.093840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c39e6-3db0-4d19-9f3f-e0300cb0f41b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:18.112314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb0845-16db-4882-a3b9-ba92ec13ed3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:18.115680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0845-16db-4882-a3b9-ba92ec13ed3e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:18.115680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0845-16db-4882-a3b9-ba92ec13ed3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:18.115680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb0845-16db-4882-a3b9-ba92ec13ed3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:18.170199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb0845-16db-4882-a3b9-ba92ec13ed3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:18.171944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb0845-16db-4882-a3b9-ba92ec13ed3e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:18.195644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3163/6284] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:18.206476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909efb5-f197-41bf-8055-d0d755196b99 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:18.206770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909efb5-f197-41bf-8055-d0d755196b99 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:18.207080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909efb5-f197-41bf-8055-d0d755196b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:18.207735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b243b662a3141a0900a38fcaed5ddc7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:18.209948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b243b662a3141a0900a38fcaed5ddc7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:18.211003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b243b662a3141a0900a38fcaed5ddc7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:18.227109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b243b662a3141a0900a38fcaed5ddc7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:18.263385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b243b662a3141a0900a38fcaed5ddc7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:18.299450 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3122/6285] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:17 2022] DELETE /identity/v3/users/9b243b662a3141a0900a38fcaed5ddc7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:18.306321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d909efb5-f197-41bf-8055-d0d755196b99 None None] MFA Rules not processed for user `f2ed847c55df45b7bec542e9c4829ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:18.307619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d909efb5-f197-41bf-8055-d0d755196b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:18.439901 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3164/6286] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:18.459166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:18.461653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:18.618794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78df5-e1f8-40c1-9add-8a2ebddf4a7f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:18.623133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:18.623967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:18.624311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:18.624746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:18.628141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:18.740594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:18.742486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:18.772772 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3123/6287] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:19.084305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:19.084893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:19.084893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:19.153437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:19.154917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:19.246463 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:19.333050 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3165/6288] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:29:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:19.401676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:19.403485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:19.473366 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:19.582196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9585b2-e0ac-400d-b728-4e78fcbdc101 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:19.590636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:19.591269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:19.591617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:19.592205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:19.613541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:19.615666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:19.632719 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3124/6289] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:29:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:29:19.793373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:19.795311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:19.971765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f0774-a35c-4a4e-a4e8-eb5473ba53f9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:19.989102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:19.993477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:19.993952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:19.994232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] PATH_INFO: `/v3/projects/6d18b193ca954c949bc074c81046dc56` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:19.999008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d18b193ca954c949bc074c81046dc56)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:20.005878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:20.149097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:20.150521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:20.171870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45773c6c-f0cd-4ac1-ba2c-ccc778c79f80 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:20.201809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7005d-5c12-4a67-8a40-18b606c0cc4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:20.202443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7005d-5c12-4a67-8a40-18b606c0cc4e service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:20.202779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7005d-5c12-4a67-8a40-18b606c0cc4e service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:20.203065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7005d-5c12-4a67-8a40-18b606c0cc4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:20.217750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d18b193ca954c949bc074c81046dc56', 'request_id': 'req-8603f45b-452b-4eed-aaba-83f03f879078'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:20.228761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7005d-5c12-4a67-8a40-18b606c0cc4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:20.230665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7005d-5c12-4a67-8a40-18b606c0cc4e service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:20.232829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d18b193ca954c949bc074c81046dc56', 'request_id': 'req-8603f45b-452b-4eed-aaba-83f03f879078'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:20.247772 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3125/6290] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:29:20.248811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d18b193ca954c949bc074c81046dc56', 'request_id': 'req-8603f45b-452b-4eed-aaba-83f03f879078'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:20.281233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] The token cache is being invalidate because project 6d18b193ca954c949bc074c81046dc56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:20.281979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:20.282957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8603f45b-452b-4eed-aaba-83f03f879078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:20.284811 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3166/6291] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:19 2022] DELETE /identity/v3/projects/6d18b193ca954c949bc074c81046dc56 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:20.290134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c42b-e4c7-4e4d-be8a-47c643f33272 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:20.290426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c42b-e4c7-4e4d-be8a-47c643f33272 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:20.290700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c42b-e4c7-4e4d-be8a-47c643f33272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:20.325391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-04b6c42b-e4c7-4e4d-be8a-47c643f33272 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:20.327379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-04b6c42b-e4c7-4e4d-be8a-47c643f33272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:20.376682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:20.376973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:20.377336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:20.421071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:20.432622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:20.486237 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3126/6292] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:20.496831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc4ef-7ff8-462f-a22a-42505764931e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:20.497869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc4ef-7ff8-462f-a22a-42505764931e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:20.498182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc4ef-7ff8-462f-a22a-42505764931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:20.566643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-746cc4ef-7ff8-462f-a22a-42505764931e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:20.568851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-746cc4ef-7ff8-462f-a22a-42505764931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:20.576715 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3167/6293] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:29:20.610515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:20.614440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:20.637589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3127/6294] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:20.641532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cc4ef-7ff8-462f-a22a-42505764931e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:20.645481 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:20.672401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cc4ef-7ff8-462f-a22a-42505764931e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:20.699826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:20.700464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:20.701581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:20.702493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:20.702928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:20.704830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:20.712840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:20.756643 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3128/6295] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:29:20.759391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:20.778656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634aea2-2cd6-4e80-a15b-824cdc010148 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:20.785932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:20.787499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:20.788050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:20.788552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:20.796781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49cddf-4936-43f3-9a31-f41b0501de08 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:20.801227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:20.804744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:20.828212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:20.828846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:20.829156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:20.830245 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3168/6296] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:29:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:29:20.830376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:20.831003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:20.838705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:20.925639 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3129/6297] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:20 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:20.930058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:20.952007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90986-f525-4c7d-b695-e37877ab2604 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:21.047587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:21.051169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:21.119234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:21.120058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.123020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.123429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.127392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:21.132023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:21.191197 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3169/6298] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:20 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:29:21.193619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:21.216934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adec8e-3a4d-4698-b9f1-ae79d12f9d5e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:21.221814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c1f25-4c28-46f7-b2e9-5d326778d7f5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:21.230796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:21.232561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.233641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.234839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.235831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:21.237438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:21.239108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.239900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:21.240250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.240599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] PATH_INFO: `/v3/users/c871d49322d7476a8983c8539ba51868` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.243682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c871d49322d7476a8983c8539ba51868)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:21.249454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:21.270100 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:21.271661 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3170/6299] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:21.272719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:21.295082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1c04c-44f4-4e6b-8548-56e576c16502 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:21.311480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:21.312228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.313175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.313617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.315281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:21.321084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:21.342444 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3171/6300] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:21.354567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:21.369933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c871d49322d7476a8983c8539ba51868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:21.370553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c871d49322d7476a8983c8539ba51868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:21.371617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c871d49322d7476a8983c8539ba51868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:21.382407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c871d49322d7476a8983c8539ba51868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:21.386415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bb28a-cebc-4a38-8266-ff26220a0efa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:21.397999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea17e34-dfc1-4f6e-b8ec-dc24fb4c56df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:21.399782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea17e34-dfc1-4f6e-b8ec-dc24fb4c56df admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.400839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-905a3217-1bfe-469e-bd0b-1a48d8b66ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c871d49322d7476a8983c8539ba51868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:21.401426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea17e34-dfc1-4f6e-b8ec-dc24fb4c56df admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.402988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea17e34-dfc1-4f6e-b8ec-dc24fb4c56df admin admin] PATH_INFO: `/v3/projects/c258328650ba471fa589e32968c85bf0/users/07d17df90a3e4cd6a0cce3e3d44d3ceb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.429097 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3130/6301] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:21 2022] DELETE /identity/v3/users/c871d49322d7476a8983c8539ba51868 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:21.432331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.432999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.434494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.436518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea17e34-dfc1-4f6e-b8ec-dc24fb4c56df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c258328650ba471fa589e32968c85bf0, user_id=07d17df90a3e4cd6a0cce3e3d44d3ceb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:21.439241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea17e34-dfc1-4f6e-b8ec-dc24fb4c56df admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:21.462692 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3172/6302] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:21 2022] PUT /identity/v3/projects/c258328650ba471fa589e32968c85bf0/users/07d17df90a3e4cd6a0cce3e3d44d3ceb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:21.464115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.464469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.465053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.487729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:21.489527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:21.490053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:21.492152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:21.578722 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3131/6303] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:21.604757 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:21.609917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:21.611923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:21.634125 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3173/6304] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:21.678015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:21.679913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:21.768116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c2f4-03b6-43db-976c-23bac0631acf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:21.781783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:21.782736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.783140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.785543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.809784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:21.812374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:21.813912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a466-1e31-4fc4-80ff-b0efe7120331 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:21.828227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:21.828951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:21.830322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:21.830605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:21.856272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:21.857047 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3132/6305] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:29:21.860773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:21.892578 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3174/6306] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:23.170649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:23.172230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:23.200208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb6ff3-cff5-4667-95d3-b1f060f25cb9 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:23.224875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:23.225654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:23.225924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:23.227157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] PATH_INFO: `/v3/projects/b68eae8de6a246c1955c1e3629a5b728` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:23.229510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68eae8de6a246c1955c1e3629a5b728)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:23.231466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:23.289647 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:23.400822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68eae8de6a246c1955c1e3629a5b728', 'request_id': 'req-ea9ad9ee-2972-4597-9255-08b580d8066b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.433333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68eae8de6a246c1955c1e3629a5b728', 'request_id': 'req-ea9ad9ee-2972-4597-9255-08b580d8066b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.455923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68eae8de6a246c1955c1e3629a5b728', 'request_id': 'req-ea9ad9ee-2972-4597-9255-08b580d8066b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.491610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] The token cache is being invalidate because project b68eae8de6a246c1955c1e3629a5b728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:23.493399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.496627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.499652 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3133/6307] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:23 2022] DELETE /identity/v3/projects/b68eae8de6a246c1955c1e3629a5b728 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:23.503720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:23.535750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdb8f3-fc48-4c48-a0e2-0d9efa881694 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:23.679526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:23.680206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:23.680492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:23.680763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] PATH_INFO: `/v3/users/f2ed847c55df45b7bec542e9c4829ceb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:23.683848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ed847c55df45b7bec542e9c4829ceb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:23.692631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:23.813284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ed847c55df45b7bec542e9c4829ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.814501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ed847c55df45b7bec542e9c4829ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.816050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ed847c55df45b7bec542e9c4829ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.857828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ed847c55df45b7bec542e9c4829ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.873711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-26e4077c-3730-4592-a38e-1114125b4324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ed847c55df45b7bec542e9c4829ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:23.914642 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3175/6308] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:23 2022] DELETE /identity/v3/users/f2ed847c55df45b7bec542e9c4829ceb => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:25.627563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:25.636436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:25.724953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ad9ee-2972-4597-9255-08b580d8066b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:25.856921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:25.859232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:25.859619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:25.860001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] PATH_INFO: `/v3/projects/c6dfc0737f344f96927ab8d9b6c8e7b3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:25.866347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6dfc0737f344f96927ab8d9b6c8e7b3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:25.874702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:26.065276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6dfc0737f344f96927ab8d9b6c8e7b3', 'request_id': 'req-7c54d151-fef1-4b60-88a7-d0b90e7fd736'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:26.080736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6dfc0737f344f96927ab8d9b6c8e7b3', 'request_id': 'req-7c54d151-fef1-4b60-88a7-d0b90e7fd736'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:26.101704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6dfc0737f344f96927ab8d9b6c8e7b3', 'request_id': 'req-7c54d151-fef1-4b60-88a7-d0b90e7fd736'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:26.118784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] The token cache is being invalidate because project c6dfc0737f344f96927ab8d9b6c8e7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:26.119545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:26.121329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c54d151-fef1-4b60-88a7-d0b90e7fd736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:26.131074 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3134/6309] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:25 2022] DELETE /identity/v3/projects/c6dfc0737f344f96927ab8d9b6c8e7b3 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:26.133205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856ac9f-1ce1-41d7-a426-9bc84061b6e7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:26.133635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856ac9f-1ce1-41d7-a426-9bc84061b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:26.133860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856ac9f-1ce1-41d7-a426-9bc84061b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:26.164592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:26.168488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:26.168887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:26.226387 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:26.250898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] MFA Rules not processed for user `1464d40f7c3f48a29cd90b7882c2afac`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:26.251954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4856ac9f-1ce1-41d7-a426-9bc84061b6e7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:26.265031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:26.267596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4856ac9f-1ce1-41d7-a426-9bc84061b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:26.356869 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:26.414244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3176/6310] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:26.418275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3135/6311] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:29:26.429909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf5fc-a33f-4bb6-be5e-446ef5bd5202 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:26.430290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf5fc-a33f-4bb6-be5e-446ef5bd5202 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:26.430510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faf5fc-a33f-4bb6-be5e-446ef5bd5202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:26.439017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:26.440909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:26.494107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d4faf5fc-a33f-4bb6-be5e-446ef5bd5202 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:26.495845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d4faf5fc-a33f-4bb6-be5e-446ef5bd5202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:26.530851 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3177/6312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:26.534649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faf5fc-a33f-4bb6-be5e-446ef5bd5202 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:26.560585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faf5fc-a33f-4bb6-be5e-446ef5bd5202 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:26.578028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:26.578818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:26.579205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:26.579593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:26.580370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:26.580935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:26.583335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:26.642399 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3178/6313] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:29:26.643497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881df4-ce28-46e5-8dcd-18d782e966a5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:26.649768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:26.658637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664888-485e-4d63-95d3-771f5c8a4865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:26.659277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664888-485e-4d63-95d3-771f5c8a4865 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:26.659556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664888-485e-4d63-95d3-771f5c8a4865 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:26.659828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664888-485e-4d63-95d3-771f5c8a4865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:26.685009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664888-485e-4d63-95d3-771f5c8a4865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:26.694894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664888-485e-4d63-95d3-771f5c8a4865 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:26.705544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c45c0-cd33-4429-9ac4-e061f28e3608 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:26.727153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:26.730935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:26.731859 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3136/6314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:26.732893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:26.735549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:26.738001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:26.746677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:26.835375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8aa88-5bc7-460e-a811-bbfd6087e117 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:26.835667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8aa88-5bc7-460e-a811-bbfd6087e117 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:26.835945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8aa88-5bc7-460e-a811-bbfd6087e117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:26.889708 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3179/6315] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:26 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:26.892854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-76f8aa88-5bc7-460e-a811-bbfd6087e117 None None] MFA Rules not processed for user `435d50630b1844408f0150077087877d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:26.893963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:26.897870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-76f8aa88-5bc7-460e-a811-bbfd6087e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:27.074012 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3137/6316] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:29:27.132619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fef29-1eaf-4810-94cb-26f4342a0c5c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:27.155061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:27.156624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:27.156904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:27.159496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:27.162509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:27.168101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:27.226546 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3180/6317] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:26 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:27.227467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8aa88-5bc7-460e-a811-bbfd6087e117 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:27.255729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8aa88-5bc7-460e-a811-bbfd6087e117 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:27.281279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:27.282207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:27.282702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:27.283158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:27.284005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:27.303887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:27.328921 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3138/6318] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:27.333566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:27.353762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461444-fa18-4b92-a3ea-bd39997f5449 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:27.365688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527729c-ecd6-4ec8-bb1a-9d33fb67fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:27.369507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527729c-ecd6-4ec8-bb1a-9d33fb67fc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:27.370445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527729c-ecd6-4ec8-bb1a-9d33fb67fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:27.371110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527729c-ecd6-4ec8-bb1a-9d33fb67fc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:27.372899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527729c-ecd6-4ec8-bb1a-9d33fb67fc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:27.375040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527729c-ecd6-4ec8-bb1a-9d33fb67fc50 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:27.421950 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3181/6319] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:27.423077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:27.439354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026443-7316-46e0-bd06-77c7794c5f91 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:27.460389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:27.461081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:27.461379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:27.461649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] PATH_INFO: `/v3/projects/70f0f141cdb143afb3e07c67224fead3/users/5a523164836441d183f60713e10305f9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:27.493529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f0f141cdb143afb3e07c67224fead3, user_id=5a523164836441d183f60713e10305f9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:27.496654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:27.563096 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3139/6320] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:27 2022] PUT /identity/v3/projects/70f0f141cdb143afb3e07c67224fead3/users/5a523164836441d183f60713e10305f9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:27.569120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fec1f-b3be-4795-80ad-4a178c086859 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:27.569410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fec1f-b3be-4795-80ad-4a178c086859 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:27.569795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fec1f-b3be-4795-80ad-4a178c086859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:27.613699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e56fec1f-b3be-4795-80ad-4a178c086859 None None] MFA Rules not processed for user `5a523164836441d183f60713e10305f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:27.616639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e56fec1f-b3be-4795-80ad-4a178c086859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:27.663199 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:27.750680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:27.754127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3182/6321] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:27.809522 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:27.900690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776cdce-70bf-4616-bef0-8073ddbb62b1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:27.915982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:27.916218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:27.916401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:27.916675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:27.917345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:27.919790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:27.970782 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3140/6322] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:27 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:27.979454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fec1f-b3be-4795-80ad-4a178c086859 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:28.001449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fec1f-b3be-4795-80ad-4a178c086859 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:28.106499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:28.107398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:28.107726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:28.108003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:28.109684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:28.114592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:28.149203 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3183/6323] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:27 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:28.150205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:28.167220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f170c-87a1-4f3a-b3da-9df98267dfcb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:28.173646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:28.174539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:28.175280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:28.175740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:28.176919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:28.179715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:28.199156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3141/6324] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:29:28.200738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:28.217154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606755-996f-4061-813c-9bac16324bf1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:28.235042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:28.236353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:28.237206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:28.240405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] PATH_INFO: `/v3/projects/8e5f91d0396141a9b0a3bf653d717ff5/users/3a675b969a0c48e9ae1b08579ee2b3d8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:28.281009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5f91d0396141a9b0a3bf653d717ff5, user_id=3a675b969a0c48e9ae1b08579ee2b3d8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:28.286284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:28.316082 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3184/6325] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:28 2022] PUT /identity/v3/projects/8e5f91d0396141a9b0a3bf653d717ff5/users/3a675b969a0c48e9ae1b08579ee2b3d8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:28.317550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:28.331318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c43f7-01cc-4bbe-a3f3-fb252216acda admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:28.481663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270b76e-c39d-4605-a33f-f5541009e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:28.484182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b76e-c39d-4605-a33f-f5541009e473 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:28.484913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b76e-c39d-4605-a33f-f5541009e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:28.486333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270b76e-c39d-4605-a33f-f5541009e473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:28.487046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b76e-c39d-4605-a33f-f5541009e473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:28.493407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270b76e-c39d-4605-a33f-f5541009e473 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:28.553779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:28.582089 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3142/6326] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:29:28.586622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7e1b9-e3e3-4f01-ae86-4e4e45de8943 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:28.613557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:28.614902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:28.615435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:28.615904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] PATH_INFO: `/v3/projects/8e5f91d0396141a9b0a3bf653d717ff5/users/3a675b969a0c48e9ae1b08579ee2b3d8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:28.619581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5f91d0396141a9b0a3bf653d717ff5, user_id=3a675b969a0c48e9ae1b08579ee2b3d8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:28.626702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:28.667381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3185/6327] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:28 2022] PUT /identity/v3/projects/8e5f91d0396141a9b0a3bf653d717ff5/users/3a675b969a0c48e9ae1b08579ee2b3d8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:28.679488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:28.679488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:28.679844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:28.737143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] MFA Rules not processed for user `3a675b969a0c48e9ae1b08579ee2b3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:28.738621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:28.955043 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3143/6328] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:29.000216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:29.003800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:29.166979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47323b6-7b9e-4a81-a48a-430ba22f83c0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:29.177466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:29.178745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:29.180763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:29.181254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:29.205838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:29.208881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:29.235484 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3186/6329] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:31.325757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:31.327784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:31.378791 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:31.537951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69134b82-ed91-47d5-ad8c-cbd77b5a2aea None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:31.557054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:31.558351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:31.558351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:31.558351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:31.563968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:31.620822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:31.629448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:31.663517 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3144/6330] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:37.984864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:38.052679 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:38.072118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:38.073946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:38.168436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60337-f984-42b3-95fc-876d8a36f96f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:38.178692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:38.179361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:38.179643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:38.179918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] PATH_INFO: `/v3/users/5a523164836441d183f60713e10305f9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:38.185375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a523164836441d183f60713e10305f9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:38.189009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:38.277903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815ae7-9261-4c34-b13d-b34b42cdbfe6 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:38.295543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:38.296227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:38.296510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:38.296793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] PATH_INFO: `/v3/users/70bae67c6c2e4c1f9e07dbd8bf2464fe` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:38.306580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bae67c6c2e4c1f9e07dbd8bf2464fe)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:38.311978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:38.313457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a523164836441d183f60713e10305f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.314637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a523164836441d183f60713e10305f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.315522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a523164836441d183f60713e10305f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.352320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a523164836441d183f60713e10305f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.374667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a7febc7-ee2e-438a-a1db-381b39a04cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a523164836441d183f60713e10305f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.419507 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3187/6331] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:37 2022] DELETE /identity/v3/users/5a523164836441d183f60713e10305f9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:38.425672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:38.426471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:38.426609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:38.445610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bae67c6c2e4c1f9e07dbd8bf2464fe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.447011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bae67c6c2e4c1f9e07dbd8bf2464fe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.447656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bae67c6c2e4c1f9e07dbd8bf2464fe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.461028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bae67c6c2e4c1f9e07dbd8bf2464fe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.482249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:38.485574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:38.501709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-351d14d3-b9dd-47ae-ba7c-67b6efe9d496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bae67c6c2e4c1f9e07dbd8bf2464fe'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:38.572943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3145/6332] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:38 2022] DELETE /identity/v3/users/70bae67c6c2e4c1f9e07dbd8bf2464fe => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:38.576284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:38.576572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:38.576838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:38.673146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:38.677777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:38.770310 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:38.790978 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3188/6333] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:38.873623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:38.875625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:38.876083 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3146/6334] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:38.909384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:38.911337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:39.006482 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:39.022367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabec1d-f7f9-4f99-b892-3b19b87a3e29 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:39.056057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb8c8e-daed-4d1f-82f5-a90cf12c082f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:39.063380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:39.064022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:39.064304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:39.064582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:39.100958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:39.102736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:39.126317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3147/6335] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:29:39.140618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:39.141272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:39.141761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:39.142204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:39.166606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:39.168399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:39.181487 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3189/6336] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:29:39.701471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:39.703658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:39.705621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:39.705799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:39.731944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326f8c1-abe4-4ca2-b143-de6c3d1367f7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:39.747063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765051-c052-4c69-ad04-b24967619173 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:39.747669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:39.748325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:39.748602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:39.748872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] PATH_INFO: `/v3/projects/9fef5c8b7f5b48e0a06e25116133fcde` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:39.750102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fef5c8b7f5b48e0a06e25116133fcde)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:39.752212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:39.782277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4f1c-3f22-4dc8-b05a-82a6e064e7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:39.788443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4f1c-3f22-4dc8-b05a-82a6e064e7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:39.793345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4f1c-3f22-4dc8-b05a-82a6e064e7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:39.793864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4f1c-3f22-4dc8-b05a-82a6e064e7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:39.802732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-255e4f1c-3f22-4dc8-b05a-82a6e064e7c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:39.860737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fef5c8b7f5b48e0a06e25116133fcde', 'request_id': 'req-946434af-8e0e-44ba-be61-f28e57b25b6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:39.868595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fef5c8b7f5b48e0a06e25116133fcde', 'request_id': 'req-946434af-8e0e-44ba-be61-f28e57b25b6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:39.881746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fef5c8b7f5b48e0a06e25116133fcde', 'request_id': 'req-946434af-8e0e-44ba-be61-f28e57b25b6d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:39.884806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4f1c-3f22-4dc8-b05a-82a6e064e7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:39.896823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4f1c-3f22-4dc8-b05a-82a6e064e7c3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:39.911041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] The token cache is being invalidate because project 9fef5c8b7f5b48e0a06e25116133fcde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:39.911320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:39.913219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-946434af-8e0e-44ba-be61-f28e57b25b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:39.922310 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3190/6337] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:39 2022] DELETE /identity/v3/projects/9fef5c8b7f5b48e0a06e25116133fcde => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:39.925503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6540aa-0fe0-4d1f-b0fb-6b1b8f4184fd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:39.925753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6540aa-0fe0-4d1f-b0fb-6b1b8f4184fd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:39.926011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6540aa-0fe0-4d1f-b0fb-6b1b8f4184fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:39.969290 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3148/6338] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:40.026532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ec6540aa-0fe0-4d1f-b0fb-6b1b8f4184fd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:40.028780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ec6540aa-0fe0-4d1f-b0fb-6b1b8f4184fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:40.217392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3191/6339] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:40.225819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff8e86-6006-4508-babe-e1f3b6337de8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:40.226397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff8e86-6006-4508-babe-e1f3b6337de8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:40.226569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff8e86-6006-4508-babe-e1f3b6337de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:40.279599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-51ff8e86-6006-4508-babe-e1f3b6337de8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:40.280957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-51ff8e86-6006-4508-babe-e1f3b6337de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:40.326524 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3149/6340] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:40.327346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6540aa-0fe0-4d1f-b0fb-6b1b8f4184fd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:40.343092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6540aa-0fe0-4d1f-b0fb-6b1b8f4184fd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:40.353847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:40.354488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:40.354770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:40.355045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:40.357377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:40.357711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:40.361594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:40.406169 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3192/6341] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:29:40.411243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff8e86-6006-4508-babe-e1f3b6337de8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:40.425759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff8e86-6006-4508-babe-e1f3b6337de8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:40.451948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:40.452700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:40.453198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:40.453583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:40.454425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:40.461862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:40.583037 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3150/6342] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:40 2022] POST /identity/v3/projects => generated 353 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:40.586951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:40.603037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4521-98bd-498a-a558-06340097f0cb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:40.634763 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:40.744732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:40.745607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:40.745894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:40.746172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:40.746803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:40.748812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:40.796747 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3193/6343] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:40 2022] POST /identity/v3/users => generated 277 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:40.797945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:40.812547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f131-ac2c-4b2b-91a5-6eec3e3e6348 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:40.830804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:40.834228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:40.834519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:40.837793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:40.838694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:40.840487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:40.878146 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3151/6344] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:40.880006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:40.897149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da44fc-304f-4ec5-b1ee-cb01a6c09712 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:40.917894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b9ff0-879e-4c9e-a65a-57cac34cd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:40.918596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9ff0-879e-4c9e-a65a-57cac34cd76f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:40.918968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9ff0-879e-4c9e-a65a-57cac34cd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:40.919271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9ff0-879e-4c9e-a65a-57cac34cd76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:40.919933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b9ff0-879e-4c9e-a65a-57cac34cd76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:40.922177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b9ff0-879e-4c9e-a65a-57cac34cd76f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:40.951797 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3194/6345] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:40.956663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:40.978013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e8bf2-6124-4511-8d1f-7bee6578b457 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:40.991016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:40.992856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:40.993172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:40.994855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] PATH_INFO: `/v3/projects/8520e782608e490d996ad5427fb7f468/users/705e454f1c8a49f690438d7946042daf/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:41.047889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8520e782608e490d996ad5427fb7f468, user_id=705e454f1c8a49f690438d7946042daf, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:41.056054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:41.092884 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3152/6346] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:40 2022] PUT /identity/v3/projects/8520e782608e490d996ad5427fb7f468/users/705e454f1c8a49f690438d7946042daf/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:41.103930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:41.104465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:41.104465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:41.262177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] MFA Rules not processed for user `705e454f1c8a49f690438d7946042daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:41.280986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:41.455528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:41.459758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:41.512345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3195/6347] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:41.512345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:41.546816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:41.591084 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:41.657313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120a54-4a27-4bcf-9c5c-d43645cbc398 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:41.674526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:41.677730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:41.679392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:41.679788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:41.686803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:41.729174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:41.733728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:41.741032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3474-5344-4753-8377-d53b5bf3a1bd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:41.747656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:41.748730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:41.749237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:41.749860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] PATH_INFO: `/v3/projects/70f0f141cdb143afb3e07c67224fead3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:41.751955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f0f141cdb143afb3e07c67224fead3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:41.757681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:41.781661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3153/6348] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:41.783735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:41.788524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:41.917429 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:41.961885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f0f141cdb143afb3e07c67224fead3', 'request_id': 'req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:41.963956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436a320-1f9b-480c-9b5b-b27d00897a7b service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:41.976715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f0f141cdb143afb3e07c67224fead3', 'request_id': 'req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:41.993603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f0f141cdb143afb3e07c67224fead3', 'request_id': 'req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.022097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] The token cache is being invalidate because project 70f0f141cdb143afb3e07c67224fead3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:42.022458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.023166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.030944 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3196/6349] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:41 2022] DELETE /identity/v3/projects/70f0f141cdb143afb3e07c67224fead3 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:42.031918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:42.036005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:42.164075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39aa84-fb47-45a4-8890-495394a442bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:42.166989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39aa84-fb47-45a4-8890-495394a442bd service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:42.166989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39aa84-fb47-45a4-8890-495394a442bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:42.166989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39aa84-fb47-45a4-8890-495394a442bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:42.174853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb39aa84-fb47-45a4-8890-495394a442bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:42.257391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d1e6-a3c9-4d89-99a7-5242f5b31181 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:42.274628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:42.275565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:42.276011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:42.276448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] PATH_INFO: `/v3/users/3a675b969a0c48e9ae1b08579ee2b3d8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:42.286345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a675b969a0c48e9ae1b08579ee2b3d8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:42.288546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:42.407522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39aa84-fb47-45a4-8890-495394a442bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:42.425486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a675b969a0c48e9ae1b08579ee2b3d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.426759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a675b969a0c48e9ae1b08579ee2b3d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.429024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a675b969a0c48e9ae1b08579ee2b3d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.431573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39aa84-fb47-45a4-8890-495394a442bd service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:42.464794 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3154/6350] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:42.472647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a675b969a0c48e9ae1b08579ee2b3d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.495607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a675b969a0c48e9ae1b08579ee2b3d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:42.537887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3197/6351] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:42 2022] DELETE /identity/v3/users/3a675b969a0c48e9ae1b08579ee2b3d8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:44.105753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537fa0f-113d-45cf-b8bc-e8e24761881b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:44.106586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537fa0f-113d-45cf-b8bc-e8e24761881b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:44.107052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537fa0f-113d-45cf-b8bc-e8e24761881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:44.166929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a537fa0f-113d-45cf-b8bc-e8e24761881b None None] MFA Rules not processed for user `e4d263e82c604e3b8838b7d2754f5f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:44.168138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a537fa0f-113d-45cf-b8bc-e8e24761881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:44.284170 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:44.356231 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3155/6352] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:44.360711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:44.362666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:44.466368 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:44.522197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d133-53f5-449d-a2e8-1ba1254c5c52 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:44.537339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:44.537979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:44.538258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:44.538530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:44.539172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:44.541556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:44.594480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3198/6353] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:44 2022] POST /identity/v3/projects => generated 405 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:44.598931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537fa0f-113d-45cf-b8bc-e8e24761881b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:44.631392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537fa0f-113d-45cf-b8bc-e8e24761881b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:44.764741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b05d-1d30-45dd-bc15-869ed4597b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:44.765339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b05d-1d30-45dd-bc15-869ed4597b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:44.765688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b05d-1d30-45dd-bc15-869ed4597b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:44.766047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b05d-1d30-45dd-bc15-869ed4597b77 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:44.766791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b05d-1d30-45dd-bc15-869ed4597b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:44.770887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b05d-1d30-45dd-bc15-869ed4597b77 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:44.813176 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3156/6354] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:44 2022] POST /identity/v3/users => generated 303 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:44.817860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:44.835833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17400c-f9ba-4031-8700-683372b8dc19 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:44.856119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:44.856845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:44.857154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:44.857431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:44.859923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e448f-8ec6-4e01-a35d-f4c0596b93f5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:44.860200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e448f-8ec6-4e01-a35d-f4c0596b93f5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:44.860473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e448f-8ec6-4e01-a35d-f4c0596b93f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:44.880469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:44.882188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:44.947648 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3199/6355] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:44.956939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:44.966981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:44.991710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-063e448f-8ec6-4e01-a35d-f4c0596b93f5 None None] MFA Rules not processed for user `07d17df90a3e4cd6a0cce3e3d44d3ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:44.992984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-063e448f-8ec6-4e01-a35d-f4c0596b93f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:45.008434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c3fc-434e-43dc-8726-1e1bef3a1d83 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:45.022551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:45.023665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:45.023665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:45.023915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] PATH_INFO: `/v3/projects/8e5f91d0396141a9b0a3bf653d717ff5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:45.030343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5f91d0396141a9b0a3bf653d717ff5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:45.032679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:45.135110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5f91d0396141a9b0a3bf653d717ff5', 'request_id': 'req-d5a2551a-65a2-40db-89c2-54fc7ead9c06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:45.150611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5f91d0396141a9b0a3bf653d717ff5', 'request_id': 'req-d5a2551a-65a2-40db-89c2-54fc7ead9c06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:45.158005 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3157/6356] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:45.159043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e448f-8ec6-4e01-a35d-f4c0596b93f5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:45.166637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5f91d0396141a9b0a3bf653d717ff5', 'request_id': 'req-d5a2551a-65a2-40db-89c2-54fc7ead9c06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:45.180570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e448f-8ec6-4e01-a35d-f4c0596b93f5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:45.195562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] The token cache is being invalidate because project 8e5f91d0396141a9b0a3bf653d717ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:45.196521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:45.201359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d5a2551a-65a2-40db-89c2-54fc7ead9c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:45.207306 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3200/6357] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:44 2022] DELETE /identity/v3/projects/8e5f91d0396141a9b0a3bf653d717ff5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:45.209155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:45.211119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:45.212871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:45.282955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] MFA Rules not processed for user `07d17df90a3e4cd6a0cce3e3d44d3ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:45.287692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:45.355703 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:45.372914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c4c7e-13ea-4b62-90e4-d3bb568a4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:45.375724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4c7e-13ea-4b62-90e4-d3bb568a4980 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:45.375724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4c7e-13ea-4b62-90e4-d3bb568a4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:45.376018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c4c7e-13ea-4b62-90e4-d3bb568a4980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:45.376641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c4c7e-13ea-4b62-90e4-d3bb568a4980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:45.378302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c4c7e-13ea-4b62-90e4-d3bb568a4980 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:45.407736 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3158/6358] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:45.413603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:45.413896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:45.414169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:45.440701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3201/6359] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:45.441731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:45.446712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:45.465993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:45.468203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:45.489477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff421d-313c-4c4b-abce-800b91da0e95 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:45.505677 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3159/6360] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:45.509610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:45.513478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f8bd9-9516-4234-bc78-9e970809bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:45.513478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8bd9-9516-4234-bc78-9e970809bee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:45.513478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8bd9-9516-4234-bc78-9e970809bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:45.513478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f8bd9-9516-4234-bc78-9e970809bee4 admin admin] PATH_INFO: `/v3/projects/bfb6fa49d00f40d39239f55694a53b45/users/4700ecda006b4db2b6e1c7a8b8470a47/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:45.521385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:45.580246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f8bd9-9516-4234-bc78-9e970809bee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb6fa49d00f40d39239f55694a53b45, user_id=4700ecda006b4db2b6e1c7a8b8470a47, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:45.586028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f8bd9-9516-4234-bc78-9e970809bee4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:45.642679 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3202/6361] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:45 2022] PUT /identity/v3/projects/bfb6fa49d00f40d39239f55694a53b45/users/4700ecda006b4db2b6e1c7a8b8470a47/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:45.652895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334052ed-924c-4c27-aa8b-01abd9dedbd9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:45.658170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334052ed-924c-4c27-aa8b-01abd9dedbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:45.658515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334052ed-924c-4c27-aa8b-01abd9dedbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:45.727202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-334052ed-924c-4c27-aa8b-01abd9dedbd9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:45.735838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-334052ed-924c-4c27-aa8b-01abd9dedbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:45.751689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588deb04-82ab-4565-8970-effbfdd8f0a8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:45.766452 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:45.923773 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3203/6362] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:45.928527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334052ed-924c-4c27-aa8b-01abd9dedbd9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:45.943203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334052ed-924c-4c27-aa8b-01abd9dedbd9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:45.956629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:45.958243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:45.958748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:45.959230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:45.960097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:45.960607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:45.964858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:45.994485 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3204/6363] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:29:45.998432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:46.026831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbceb36-e7f2-4877-a330-c2c5c74140a9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:46.034734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:46.037615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.037905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.038184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.042761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:46.043906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:46.044634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.045347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.046832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.047590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:46.052760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:46.115638 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3205/6364] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:45 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:29:46.120330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:46.210704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:46.212346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:46.243649 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3160/6365] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:46.301782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48b3e-24f1-41e0-93f5-6d0c0f67dbab admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:46.317918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:46.319670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.319951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.320226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.323251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:46.337091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:46.393946 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3206/6366] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:46 2022] POST /identity/v3/users => generated 295 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:46.395430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:46.413409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b041-fd07-453d-9aa7-633bcd657bef service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:46.424444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:46.427752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.428074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.428360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.429460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:46.433259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:46.466646 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3161/6367] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:46.470463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:46.487072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2108-aa40-4626-bbdb-1f8df5bc028a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:46.499798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151dd7-fb3e-4e83-ac90-803cfca76668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:46.500438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151dd7-fb3e-4e83-ac90-803cfca76668 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.500718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151dd7-fb3e-4e83-ac90-803cfca76668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.500992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151dd7-fb3e-4e83-ac90-803cfca76668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.503920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151dd7-fb3e-4e83-ac90-803cfca76668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:46.513238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151dd7-fb3e-4e83-ac90-803cfca76668 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:46.545003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:46.545843 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3207/6368] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:46.560739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ed95-3e69-44c3-a582-4356c9ef5ab9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:46.576846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:46.577600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.577887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.578167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] PATH_INFO: `/v3/projects/e5f0bb286f0e4b32b84b9e8a048f9d48/users/25c39a77437348079ede97d73c8dde70/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.593965 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:46.620014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f0bb286f0e4b32b84b9e8a048f9d48, user_id=25c39a77437348079ede97d73c8dde70, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:46.622761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:46.654667 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3162/6369] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:46 2022] PUT /identity/v3/projects/e5f0bb286f0e4b32b84b9e8a048f9d48/users/25c39a77437348079ede97d73c8dde70/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:46.668925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:46.669283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:46.669541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:46.764046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] MFA Rules not processed for user `25c39a77437348079ede97d73c8dde70`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:46.765442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:46.921353 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:46.987196 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3208/6370] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:47.109124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:47.115158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:47.270693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f269f6-8dd3-4488-8fd4-7d43ad1ea4ab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:47.295832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1363-8383-4388-aa1e-6f1afc8adedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:47.296548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1363-8383-4388-aa1e-6f1afc8adedb service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:47.297038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1363-8383-4388-aa1e-6f1afc8adedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:47.297443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1363-8383-4388-aa1e-6f1afc8adedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:47.338243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1363-8383-4388-aa1e-6f1afc8adedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:47.346908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1363-8383-4388-aa1e-6f1afc8adedb service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:47.379863 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3163/6371] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:48.490767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:48.493370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:48.735968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad932bee-e2ef-4c6f-82fb-4eea019a5412 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:48.745243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:48.746401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:48.746921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:48.747417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] PATH_INFO: `/v3/users/705e454f1c8a49f690438d7946042daf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:48.748990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] RBAC: Authorizing `identity:delete_user(user_id=705e454f1c8a49f690438d7946042daf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:48.751758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:48.874835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705e454f1c8a49f690438d7946042daf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:48.875804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705e454f1c8a49f690438d7946042daf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:48.876739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705e454f1c8a49f690438d7946042daf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:48.899394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705e454f1c8a49f690438d7946042daf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:48.916192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705e454f1c8a49f690438d7946042daf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:48.945802 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3209/6372] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:48 2022] DELETE /identity/v3/users/705e454f1c8a49f690438d7946042daf => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:48.950219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:48.950760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:48.950760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:48.977863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:48.979098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:49.084580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3164/6373] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:49.095016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:49.096723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:49.245435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bebb4-f26b-4d77-9783-24eadbc0167d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:49.250465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:49.251104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:49.251387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:49.251667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:49.262939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:49.264701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:49.286990 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3210/6374] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:49.514524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:49.519542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:49.539652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ded1-fc8b-4c70-81b8-ce3b9e3531db None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:49.544851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:49.545534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:49.545812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:49.546102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] PATH_INFO: `/v3/users/b705c41d25b34b3e8d5bf9a300bf7868` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:49.547259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b705c41d25b34b3e8d5bf9a300bf7868)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:49.549218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:49.607789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b705c41d25b34b3e8d5bf9a300bf7868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.608697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b705c41d25b34b3e8d5bf9a300bf7868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.609388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b705c41d25b34b3e8d5bf9a300bf7868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.618889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b705c41d25b34b3e8d5bf9a300bf7868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.629108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:49.630402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:49.654899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d3b63-0d5d-4256-978f-2c25969fb967 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:49.658671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4f2a802-c3c2-44e9-89f2-20c034301e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b705c41d25b34b3e8d5bf9a300bf7868'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.661754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:49.662704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:49.662980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:49.663272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] PATH_INFO: `/v3/projects/8520e782608e490d996ad5427fb7f468` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:49.665160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8520e782608e490d996ad5427fb7f468)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:49.669623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:49.672765 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:49.697411 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3165/6375] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:49 2022] DELETE /identity/v3/users/b705c41d25b34b3e8d5bf9a300bf7868 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:49.797215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8520e782608e490d996ad5427fb7f468', 'request_id': 'req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.809995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8520e782608e490d996ad5427fb7f468', 'request_id': 'req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.817879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8520e782608e490d996ad5427fb7f468', 'request_id': 'req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.853801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] The token cache is being invalidate because project 8520e782608e490d996ad5427fb7f468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:49.854434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.857705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:49.859755 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3211/6376] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:49 2022] DELETE /identity/v3/projects/8520e782608e490d996ad5427fb7f468 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:49.865040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e23a6d-187d-403c-ac13-3a2ff19a20ec None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:49.865358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e23a6d-187d-403c-ac13-3a2ff19a20ec None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:49.865691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e23a6d-187d-403c-ac13-3a2ff19a20ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:49.883872 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:49.912830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c2e23a6d-187d-403c-ac13-3a2ff19a20ec None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:49.914564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c2e23a6d-187d-403c-ac13-3a2ff19a20ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:49.988795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:49.990800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:50.038143 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3166/6377] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:50.047170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1ebaf-3237-4813-857a-5ea551bc9b7f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.047511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1ebaf-3237-4813-857a-5ea551bc9b7f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.047935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1ebaf-3237-4813-857a-5ea551bc9b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.100528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0fd1ebaf-3237-4813-857a-5ea551bc9b7f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:50.105851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0fd1ebaf-3237-4813-857a-5ea551bc9b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:50.158269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9572d2-c5e4-40b8-99a0-6e60769a1c22 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.158502 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3167/6378] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:50.162613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1ebaf-3237-4813-857a-5ea551bc9b7f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:50.175488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.176684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.180770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.181094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] PATH_INFO: `/v3/projects/9d7bf2f33f544e70a7f1159695719a67` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.181494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1ebaf-3237-4813-857a-5ea551bc9b7f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.182661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7bf2f33f544e70a7f1159695719a67)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.184685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.193824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.194457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.194737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.195009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.195660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:50.195954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.197574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.229363 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3168/6379] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:29:50.233414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:50.249578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38662985-a1f0-4339-a9e7-9b26d922646e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.333251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.333599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7bf2f33f544e70a7f1159695719a67', 'request_id': 'req-8c37ec59-83ad-4090-a093-1bb1b3a15f64'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.334062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.334062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.334062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.334062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.334062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.334911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7bf2f33f544e70a7f1159695719a67', 'request_id': 'req-8c37ec59-83ad-4090-a093-1bb1b3a15f64'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.338811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7bf2f33f544e70a7f1159695719a67', 'request_id': 'req-8c37ec59-83ad-4090-a093-1bb1b3a15f64'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.359464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3169/6380] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:50 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:29:50.363383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:50.368588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] The token cache is being invalidate because project 9d7bf2f33f544e70a7f1159695719a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:50.368992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.370596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.372668 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3212/6381] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:49 2022] DELETE /identity/v3/projects/9d7bf2f33f544e70a7f1159695719a67 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:50.378237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:50.386834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:50.504890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070dcb-05ed-4e50-8c34-2faa5dacba2d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.521864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.522194 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:50.522342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.522624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.522892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.523556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.525596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.585569 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3170/6382] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:50 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:29:50.590275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:50.594567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:50.634211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621ac8-633b-4469-86fc-e71afbd4569f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.646383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37ec59-83ad-4090-a093-1bb1b3a15f64 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.648085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.648720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.648996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.654066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.654786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.662479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.663159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.663438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.663707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] PATH_INFO: `/v3/users/c9f97083b5f1480db2020cab1443f054` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.670712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f97083b5f1480db2020cab1443f054)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.672658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.674333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.715422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3171/6383] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:29:50.717772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:50.743945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d496629-7bf7-49b0-b892-f35503624e74 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.755029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.757249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.758519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.759530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.760584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.763649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.782932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f97083b5f1480db2020cab1443f054'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.783609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f97083b5f1480db2020cab1443f054'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.784221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f97083b5f1480db2020cab1443f054'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.804823 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3172/6384] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:50.813977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:50.818087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f97083b5f1480db2020cab1443f054'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.819832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:50.837122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5119ad62-066b-4672-887a-35fad2848a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f97083b5f1480db2020cab1443f054'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:50.859448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ad242-643c-4280-a30a-4776cb46e0d0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:50.861523 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3213/6385] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:29:50 2022] DELETE /identity/v3/users/c9f97083b5f1480db2020cab1443f054 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:50.867626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:50.868319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.868602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.868880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] PATH_INFO: `/v3/projects/4aa5ce912630403081aaa736a22c6cd9/users/2e88c30cf4c44fe4b278764d7d38497e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.905528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa5ce912630403081aaa736a22c6cd9, user_id=2e88c30cf4c44fe4b278764d7d38497e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:50.910226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:50.976789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8707-f0fb-4a48-8948-108b1fb10263 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:50.977116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8707-f0fb-4a48-8948-108b1fb10263 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:50.977371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8707-f0fb-4a48-8948-108b1fb10263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:50.980430 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3173/6386] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:50 2022] PUT /identity/v3/projects/4aa5ce912630403081aaa736a22c6cd9/users/2e88c30cf4c44fe4b278764d7d38497e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:51.050444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-37ca8707-f0fb-4a48-8948-108b1fb10263 None None] MFA Rules not processed for user `2e88c30cf4c44fe4b278764d7d38497e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:51.051877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-37ca8707-f0fb-4a48-8948-108b1fb10263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:51.200897 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3214/6387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:51.209149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:51.219085 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:51.392653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683875d5-6f86-4607-a6a3-8f1f6b84ba52 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:51.414846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:51.415542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:51.415845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:51.416549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:51.417301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:51.419266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:51.490359 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3174/6388] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:51 2022] POST /identity/v3/projects => generated 363 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:51.494266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8707-f0fb-4a48-8948-108b1fb10263 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:51.523642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8707-f0fb-4a48-8948-108b1fb10263 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:51.586096 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:51.655037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:51.655653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:51.656080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:51.656512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:51.657318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:51.659359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:51.711887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3215/6389] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:51 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:51.716975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:51.763953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b5e42-5dcb-4c62-a3da-dd3752352685 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:51.786819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:51.787617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:51.790197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:51.790612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:51.791693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:51.800769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:51.892258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3175/6390] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:51.892924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:51.917100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648a76c-c4d4-449a-b32f-b50165cc95ea admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:51.929936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:51.930619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:51.930897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:51.931164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] PATH_INFO: `/v3/projects/f3bf73f4a62342ed8bae6e011ee7fc7f/users/97c7950226cb4677b8d17a842ca72aa8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:51.983889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf73f4a62342ed8bae6e011ee7fc7f, user_id=97c7950226cb4677b8d17a842ca72aa8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:51.993936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:52.032942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3216/6391] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:51 2022] PUT /identity/v3/projects/f3bf73f4a62342ed8bae6e011ee7fc7f/users/97c7950226cb4677b8d17a842ca72aa8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:52.038432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:52.056427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f53b24-cd33-4c11-a265-01b60d5d3230 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:52.230003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4419-b9f8-4344-99c8-c88cebf0acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:52.235835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4419-b9f8-4344-99c8-c88cebf0acaa admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:52.236318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4419-b9f8-4344-99c8-c88cebf0acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:52.236739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4419-b9f8-4344-99c8-c88cebf0acaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:52.238446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f4419-b9f8-4344-99c8-c88cebf0acaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:52.245004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f4419-b9f8-4344-99c8-c88cebf0acaa admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:52.277383 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3176/6392] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:52.278216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:52.334293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65216a-2168-48e8-976d-f77785932b7a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:52.349842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:52.355759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:52.358830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:52.359496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] PATH_INFO: `/v3/projects/f3bf73f4a62342ed8bae6e011ee7fc7f/users/97c7950226cb4677b8d17a842ca72aa8/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:52.366107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bf73f4a62342ed8bae6e011ee7fc7f, user_id=97c7950226cb4677b8d17a842ca72aa8, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:52.372140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:52.399652 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3217/6393] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:52 2022] PUT /identity/v3/projects/f3bf73f4a62342ed8bae6e011ee7fc7f/users/97c7950226cb4677b8d17a842ca72aa8/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:29:52.413530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f00dc-b96a-4646-854c-3b64ac7cf9f6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:52.413814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f00dc-b96a-4646-854c-3b64ac7cf9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:52.414095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f00dc-b96a-4646-854c-3b64ac7cf9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:52.533198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f17f00dc-b96a-4646-854c-3b64ac7cf9f6 None None] MFA Rules not processed for user `97c7950226cb4677b8d17a842ca72aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:52.535423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f17f00dc-b96a-4646-854c-3b64ac7cf9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:52.685411 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:52.692374 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3177/6394] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:52.705394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:52.707953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:52.855006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341e3d9-b0fa-4240-890f-fc6f8ffe2af5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:52.859747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:52.860373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:52.860649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:52.860917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:52.874025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:52.875472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:52.887573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3218/6395] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:29:52.987670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f00dc-b96a-4646-854c-3b64ac7cf9f6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:53.005630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f00dc-b96a-4646-854c-3b64ac7cf9f6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:53.022284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6249c-3dfd-46d2-8453-fc88cfbbfaa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:53.022991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6249c-3dfd-46d2-8453-fc88cfbbfaa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:53.023775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6249c-3dfd-46d2-8453-fc88cfbbfaa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:53.023775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6249c-3dfd-46d2-8453-fc88cfbbfaa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:53.127051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:53.129581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:53.167655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6249c-3dfd-46d2-8453-fc88cfbbfaa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:53.169765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6249c-3dfd-46d2-8453-fc88cfbbfaa0 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:53.189449 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3178/6396] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:53.317007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bfa4f-eea0-41fd-8d2b-61798c75401e service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:53.332861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:53.334619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:53.336325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:53.336325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] PATH_INFO: `/v3/projects/53178a22daf04994829b0c2981e5f87c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:53.339942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53178a22daf04994829b0c2981e5f87c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:53.344427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:53.460091 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:53.507481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53178a22daf04994829b0c2981e5f87c', 'request_id': 'req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:53.537174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53178a22daf04994829b0c2981e5f87c', 'request_id': 'req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:53.557035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53178a22daf04994829b0c2981e5f87c', 'request_id': 'req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:53.613797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] The token cache is being invalidate because project 53178a22daf04994829b0c2981e5f87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:29:53.614365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:53.618520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34a4d322-e4c9-4af2-9a27-48af9d27e5c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:29:53.632621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c26ab-ec68-4dfa-b2b1-6d144754222e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:53.633495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c26ab-ec68-4dfa-b2b1-6d144754222e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:53.633951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c26ab-ec68-4dfa-b2b1-6d144754222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:53.648413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3219/6397] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:29:53 2022] DELETE /identity/v3/projects/53178a22daf04994829b0c2981e5f87c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:53.729410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4e4c26ab-ec68-4dfa-b2b1-6d144754222e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:53.733825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4e4c26ab-ec68-4dfa-b2b1-6d144754222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:54.067626 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3179/6398] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:54.075561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9399db-7c28-4b39-9cbe-7fa9a04e3a8e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.075928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9399db-7c28-4b39-9cbe-7fa9a04e3a8e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.076098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9399db-7c28-4b39-9cbe-7fa9a04e3a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.114314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ee9399db-7c28-4b39-9cbe-7fa9a04e3a8e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:54.118168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ee9399db-7c28-4b39-9cbe-7fa9a04e3a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:54.157600 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3220/6399] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:54.162663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c26ab-ec68-4dfa-b2b1-6d144754222e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:54.176423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c26ab-ec68-4dfa-b2b1-6d144754222e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:54.196091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:54.196722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.196988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.197376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.198010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:29:54.198520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:54.205949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:54.267897 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3180/6400] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:29:54.274569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9399db-7c28-4b39-9cbe-7fa9a04e3a8e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:54.298291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9399db-7c28-4b39-9cbe-7fa9a04e3a8e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:54.318992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:54.322278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.322783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.323705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.326604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:54.333867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:54.427359 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3221/6401] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:29:54 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:54.427694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:54.447433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344fe68-a83f-4306-a2e5-88dbd2c9cc8e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:54.697298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:54.699956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.699956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.700996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.703585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:54.711225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:54.765922 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3181/6402] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:29:54 2022] POST /identity/v3/users => generated 288 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:29:54.766460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:54.785678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13272a-5f95-475d-902f-1dce48bcb113 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:54.803176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:54.805612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.806036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.806130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.807077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:54.808400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:54.848344 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3222/6403] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:54.852630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:54.869606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9610cd-97a1-4c45-839f-d768c1a52d43 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:54.880388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d92f4-377e-4926-b11d-d4af66d0b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:54.881138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d92f4-377e-4926-b11d-d4af66d0b1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.882187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d92f4-377e-4926-b11d-d4af66d0b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.882545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d92f4-377e-4926-b11d-d4af66d0b1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.883293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d92f4-377e-4926-b11d-d4af66d0b1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:54.885014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d92f4-377e-4926-b11d-d4af66d0b1f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:54.903178 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3182/6404] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:29:54.906878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:54.922479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c3189-35a6-4d70-abee-5012c8e974fc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:54.936124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:54.937123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:54.938325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:54.938720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] PATH_INFO: `/v3/projects/361c685493404536a6b9131eee2e3adb/users/d0b0f377f1f7465bbf9020c2f1cfcb33/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:54.973276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361c685493404536a6b9131eee2e3adb, user_id=d0b0f377f1f7465bbf9020c2f1cfcb33, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:54.981767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:55.013929 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3223/6405] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:29:54 2022] PUT /identity/v3/projects/361c685493404536a6b9131eee2e3adb/users/d0b0f377f1f7465bbf9020c2f1cfcb33/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:29:55.027612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ef39-9bbb-44a9-b79f-6780f48b4e19 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:55.028477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ef39-9bbb-44a9-b79f-6780f48b4e19 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:55.028878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20ef39-9bbb-44a9-b79f-6780f48b4e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:55.066748 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:29:55.098084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cb20ef39-9bbb-44a9-b79f-6780f48b4e19 None None] MFA Rules not processed for user `d0b0f377f1f7465bbf9020c2f1cfcb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:55.099775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb20ef39-9bbb-44a9-b79f-6780f48b4e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:55.252518 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3183/6406] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:29:55.283302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:29:55.288388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:55.407179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828cff-fe3e-4340-953b-2335619d4960 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:29:55.419340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:29:55.420372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:55.420846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:55.423969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:55.446294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:29:55.448037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:29:55.469612 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3224/6407] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:29:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:29:56.649408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4f8f-cda6-4bc1-ac05-5b95b05393d0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:29:56.649914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4f8f-cda6-4bc1-ac05-5b95b05393d0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:29:56.650015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4f8f-cda6-4bc1-ac05-5b95b05393d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:29:56.718216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7fcb4f8f-cda6-4bc1-ac05-5b95b05393d0 None None] MFA Rules not processed for user `435d50630b1844408f0150077087877d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:29:56.719796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7fcb4f8f-cda6-4bc1-ac05-5b95b05393d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:29:56.894712 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3184/6408] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:03.660225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:03.662289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:03.842593 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:03.933763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b21e4-0f9e-4aa4-9f15-fec7babdf64a service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:03.963919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b69a1-1415-4702-a5d1-79a0393de7d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:03.964532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b69a1-1415-4702-a5d1-79a0393de7d2 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:03.964857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b69a1-1415-4702-a5d1-79a0393de7d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:03.965403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b69a1-1415-4702-a5d1-79a0393de7d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:03.971477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9e4b69a1-1415-4702-a5d1-79a0393de7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:04.002935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b69a1-1415-4702-a5d1-79a0393de7d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:04.004980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b69a1-1415-4702-a5d1-79a0393de7d2 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:04.042768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3225/6409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:06.502393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d7a7-08d2-4d33-8d81-c1577e3ad689 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:06.502838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d7a7-08d2-4d33-8d81-c1577e3ad689 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:06.502944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d7a7-08d2-4d33-8d81-c1577e3ad689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:06.605220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9dc6d7a7-08d2-4d33-8d81-c1577e3ad689 None None] MFA Rules not processed for user `4700ecda006b4db2b6e1c7a8b8470a47`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:06.607233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9dc6d7a7-08d2-4d33-8d81-c1577e3ad689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:06.771831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3185/6410] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:06.782659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:06.783186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:06.783908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:06.820206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] MFA Rules not processed for user `e4d263e82c604e3b8838b7d2754f5f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:06.825619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:06.924292 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3226/6411] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:07.999107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d7a7-08d2-4d33-8d81-c1577e3ad689 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:08.033419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d7a7-08d2-4d33-8d81-c1577e3ad689 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:08.045236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e04d9-7137-410e-8625-1f3be2b94dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:08.045909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e04d9-7137-410e-8625-1f3be2b94dd0 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:08.046693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e04d9-7137-410e-8625-1f3be2b94dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:08.046693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e04d9-7137-410e-8625-1f3be2b94dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:08.053650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6f3e04d9-7137-410e-8625-1f3be2b94dd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:08.073994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e04d9-7137-410e-8625-1f3be2b94dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:08.075797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e04d9-7137-410e-8625-1f3be2b94dd0 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:08.121184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3186/6412] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:07 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:09.937586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:09.941702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:10.129090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0712c-110e-4344-a22c-956d2a4088c1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:10.142977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:10.144000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:10.144380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:10.145418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:10.147423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:10.186335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:10.187893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:10.207522 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3227/6413] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:18.088265 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:20.198366 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=60 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:23.012808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ffd0-0322-4946-b2b9-ee1eeb9eb6bc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:23.014346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ffd0-0322-4946-b2b9-ee1eeb9eb6bc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:23.014928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ffd0-0322-4946-b2b9-ee1eeb9eb6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:23.055856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1f87ffd0-0322-4946-b2b9-ee1eeb9eb6bc None None] MFA Rules not processed for user `07d17df90a3e4cd6a0cce3e3d44d3ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:23.058172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1f87ffd0-0322-4946-b2b9-ee1eeb9eb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:23.201429 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3187/6414] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:31.048701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:31.052075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:31.594462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6476893-687a-4061-881c-d06771c2d43a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:31.632448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:31.635937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:31.637389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:31.638096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] PATH_INFO: `/v3/users/2e88c30cf4c44fe4b278764d7d38497e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:31.645378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e88c30cf4c44fe4b278764d7d38497e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:31.656464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:31.865014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e88c30cf4c44fe4b278764d7d38497e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:31.865785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e88c30cf4c44fe4b278764d7d38497e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:31.866413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e88c30cf4c44fe4b278764d7d38497e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:31.910441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e88c30cf4c44fe4b278764d7d38497e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:31.932907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e88c30cf4c44fe4b278764d7d38497e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:31.972784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:31.974149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:31.974659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:31.997029 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3228/6415] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:31 2022] DELETE /identity/v3/users/2e88c30cf4c44fe4b278764d7d38497e => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:32.048015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:32.055405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:32.277998 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3188/6416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:32.525225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:32.528145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:32.809368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b3114-2215-4799-9d5f-398a4fd1422e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:32.818830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:32.821759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:32.822161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:32.822545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:32.851366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:32.856977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:32.899947 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3229/6417] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:35.073973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:35.077702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:35.346968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad173d-ee2f-476d-964b-6c1963ca39bb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:35.360143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:35.360791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:35.361090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:35.367882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:35.378305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:35.676108 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:35.769969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:35.775865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:35.833208 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3189/6418] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:37.449086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:37.449086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:37.469981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb3c2-930f-40d7-99af-f15eac0efd77 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:37.480267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:37.482540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:37.482540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:37.482540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] PATH_INFO: `/v3/users/25c39a77437348079ede97d73c8dde70` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:37.486342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c39a77437348079ede97d73c8dde70)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:37.491449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:37.540297 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:37.589775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:37.593001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:37.618429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd230d36-da17-45d5-89fb-26eacf2f3801 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:37.633914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:37.634586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c39a77437348079ede97d73c8dde70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.636065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c39a77437348079ede97d73c8dde70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.636287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:37.637834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:37.638287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c39a77437348079ede97d73c8dde70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.638725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] PATH_INFO: `/v3/projects/4aa5ce912630403081aaa736a22c6cd9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:37.642472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa5ce912630403081aaa736a22c6cd9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:37.649238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:37.672817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c39a77437348079ede97d73c8dde70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.691775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-610c74c3-50d6-45aa-9073-38aed834cbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c39a77437348079ede97d73c8dde70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.722129 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3230/6419] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:37 2022] DELETE /identity/v3/users/25c39a77437348079ede97d73c8dde70 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:37.727570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:37.727570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:37.728781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:37.771784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa5ce912630403081aaa736a22c6cd9', 'request_id': 'req-e8a663b8-6ec6-4709-a732-b3fcebc06f15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.788719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:37.791960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:37.792873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa5ce912630403081aaa736a22c6cd9', 'request_id': 'req-e8a663b8-6ec6-4709-a732-b3fcebc06f15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.823686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa5ce912630403081aaa736a22c6cd9', 'request_id': 'req-e8a663b8-6ec6-4709-a732-b3fcebc06f15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.845117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] The token cache is being invalidate because project 4aa5ce912630403081aaa736a22c6cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:37.845485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.848307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:37.855541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3190/6420] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:37 2022] DELETE /identity/v3/projects/4aa5ce912630403081aaa736a22c6cd9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:37.858346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:37.860694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:37.962173 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3231/6421] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:30:38.035886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:38.038310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:38.054663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a663b8-6ec6-4709-a732-b3fcebc06f15 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:38.082390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:38.083983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:38.084278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:38.084560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] PATH_INFO: `/v3/users/97c7950226cb4677b8d17a842ca72aa8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:38.093730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c7950226cb4677b8d17a842ca72aa8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:38.098646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:38.225860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c7950226cb4677b8d17a842ca72aa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:38.227187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c7950226cb4677b8d17a842ca72aa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:38.243649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c7950226cb4677b8d17a842ca72aa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:38.257826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f167532-b323-4e7a-8eb2-dc9448a87efc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:38.276015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c7950226cb4677b8d17a842ca72aa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:38.289267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4b624-2f89-4ae0-b7ea-4490b669296a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:38.289884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4b624-2f89-4ae0-b7ea-4490b669296a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:38.290177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4b624-2f89-4ae0-b7ea-4490b669296a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:38.290441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4b624-2f89-4ae0-b7ea-4490b669296a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:38.296787 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:38.297881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-30b4b624-2f89-4ae0-b7ea-4490b669296a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:38.318077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c7950226cb4677b8d17a842ca72aa8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:38.357194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3191/6422] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:37 2022] DELETE /identity/v3/users/97c7950226cb4677b8d17a842ca72aa8 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:38.360056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4b624-2f89-4ae0-b7ea-4490b669296a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:38.363976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4b624-2f89-4ae0-b7ea-4490b669296a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:38.395494 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3232/6423] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:30:39.220109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:39.223009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:39.496900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c198c-ce74-40ef-96a5-1ae62905bae2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:39.525021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:39.526120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:39.526400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:39.526671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] PATH_INFO: `/v3/projects/e5f0bb286f0e4b32b84b9e8a048f9d48` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:39.531206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f0bb286f0e4b32b84b9e8a048f9d48)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:39.537867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:39.662292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f0bb286f0e4b32b84b9e8a048f9d48', 'request_id': 'req-5e638448-9e42-4c0e-aad7-ed6e072bb781'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:39.682272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f0bb286f0e4b32b84b9e8a048f9d48', 'request_id': 'req-5e638448-9e42-4c0e-aad7-ed6e072bb781'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:39.697596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f0bb286f0e4b32b84b9e8a048f9d48', 'request_id': 'req-5e638448-9e42-4c0e-aad7-ed6e072bb781'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:39.740353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] The token cache is being invalidate because project e5f0bb286f0e4b32b84b9e8a048f9d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:39.741314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:39.743489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5e638448-9e42-4c0e-aad7-ed6e072bb781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:39.747228 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3192/6424] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:39 2022] DELETE /identity/v3/projects/e5f0bb286f0e4b32b84b9e8a048f9d48 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:39.753354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49daa-961b-4521-8e7f-0ec6945016ad None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:39.753874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49daa-961b-4521-8e7f-0ec6945016ad None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:39.753966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a49daa-961b-4521-8e7f-0ec6945016ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:39.798673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-39a49daa-961b-4521-8e7f-0ec6945016ad None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:39.800422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-39a49daa-961b-4521-8e7f-0ec6945016ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:39.974825 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:40.102223 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3233/6425] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:30:40.105981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082c25c-674e-4ef8-963c-42ed6a8b9f98 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:40.106524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082c25c-674e-4ef8-963c-42ed6a8b9f98 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:40.107122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082c25c-674e-4ef8-963c-42ed6a8b9f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:40.146259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2082c25c-674e-4ef8-963c-42ed6a8b9f98 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:40.152407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2082c25c-674e-4ef8-963c-42ed6a8b9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:40.180821 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3193/6426] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:40.186199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a49daa-961b-4521-8e7f-0ec6945016ad None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:40.202632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a49daa-961b-4521-8e7f-0ec6945016ad None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:40.226063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:40.230108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:40.232322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:40.232780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:40.235984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:30:40.244282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:40.251579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:40.295820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082c25c-674e-4ef8-963c-42ed6a8b9f98 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:40.301990 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3234/6427] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:30:40.336959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:40.338485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:40.344533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082c25c-674e-4ef8-963c-42ed6a8b9f98 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:40.371555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94678e-d751-41ce-a87e-83380063c3d2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:40.372915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:40.373867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:40.374351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:40.374907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:40.375810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:40.386858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:40.395088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:40.395809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:40.395809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:40.395809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] PATH_INFO: `/v3/projects/f3bf73f4a62342ed8bae6e011ee7fc7f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:40.398043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bf73f4a62342ed8bae6e011ee7fc7f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:40.399962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:40.555793 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3194/6428] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:30:40 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:30:40.560556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:40.658269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bf73f4a62342ed8bae6e011ee7fc7f', 'request_id': 'req-141d7979-e662-44a6-95ac-947c2e19c1cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:40.688298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bf73f4a62342ed8bae6e011ee7fc7f', 'request_id': 'req-141d7979-e662-44a6-95ac-947c2e19c1cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:40.726133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bf73f4a62342ed8bae6e011ee7fc7f', 'request_id': 'req-141d7979-e662-44a6-95ac-947c2e19c1cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:40.779916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] The token cache is being invalidate because project f3bf73f4a62342ed8bae6e011ee7fc7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:40.785817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:40.788056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-141d7979-e662-44a6-95ac-947c2e19c1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:40.795137 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3235/6429] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:40 2022] DELETE /identity/v3/projects/f3bf73f4a62342ed8bae6e011ee7fc7f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:40.803566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59ac78-c3a6-41a6-93ae-2dc42998a10d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:40.803566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59ac78-c3a6-41a6-93ae-2dc42998a10d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:40.803566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59ac78-c3a6-41a6-93ae-2dc42998a10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:40.854933 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:40.911536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5e59ac78-c3a6-41a6-93ae-2dc42998a10d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:40.918394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5e59ac78-c3a6-41a6-93ae-2dc42998a10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:40.929737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74bfe4-6398-4086-9c2f-88e45bca6917 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:41.216544 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3236/6430] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:41.220342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311ad8-1da6-476f-9f4a-3b64435ef923 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.220835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311ad8-1da6-476f-9f4a-3b64435ef923 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.221568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311ad8-1da6-476f-9f4a-3b64435ef923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.245932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:41.254567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.256277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.259081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.260327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:41.270723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:41.328748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ca311ad8-1da6-476f-9f4a-3b64435ef923 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:41.330044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ca311ad8-1da6-476f-9f4a-3b64435ef923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:41.352097 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3237/6431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:41.358904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca311ad8-1da6-476f-9f4a-3b64435ef923 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:41.373983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca311ad8-1da6-476f-9f4a-3b64435ef923 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:41.375413 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3195/6432] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:30:40 2022] POST /identity/v3/users => generated 286 bytes in 809 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:41.377157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:41.387058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:41.387626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:41.388253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.388546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.388804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.389486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:30:41.389776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:41.391384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:41.426132 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3238/6433] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:30:41.427738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:41.451379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e57d86-1e6d-4ab9-b693-49f4489e6af6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:41.470520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:41.471779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.472151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.472404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.473095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:41.474998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:41.479614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f92fb-6c33-42ff-877e-2e9600aaba31 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:41.555257 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:41.572761 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3239/6434] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:30:41 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:41.573797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:41.711512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:41.717697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.717990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.718992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.719700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:41.732907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:41.796297 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3196/6435] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:41.801743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:41.838067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc0cea-4d0b-46c5-aff3-d6743401ca52 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:41.861249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffec66-24a6-4e44-9f94-dc1a0d935a72 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:41.873409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:41.873633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.873873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.874143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.874792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:41.876407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:41.899430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:41.899774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.900053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.900327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.904451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:41.915344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:41.925382 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3197/6436] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:41.926373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:41.958348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa04af-b886-4c3d-8df4-de70ac67ce3d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:41.976265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:41.976951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:41.977258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:41.977535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] PATH_INFO: `/v3/projects/007b2b4d03cc4afda526b20785424403/users/a8da49a363304ce6a6540b52a41ac866/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:41.991661 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3240/6437] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:30:41 2022] POST /identity/v3/users => generated 294 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:41.996541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:42.015624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] RBAC: Authorizing `identity:create_grant(project_id=007b2b4d03cc4afda526b20785424403, user_id=a8da49a363304ce6a6540b52a41ac866, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:42.019383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:42.069291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca0dd7-a4d3-49eb-971a-a247034adc3f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:42.149829 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3198/6438] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:30:41 2022] PUT /identity/v3/projects/007b2b4d03cc4afda526b20785424403/users/a8da49a363304ce6a6540b52a41ac866/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:42.149829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:42.160831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:42.304946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0bf9-ae45-4f31-bb55-91eeb3351d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:42.306141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0bf9-ae45-4f31-bb55-91eeb3351d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:42.306141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0bf9-ae45-4f31-bb55-91eeb3351d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:42.306141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0bf9-ae45-4f31-bb55-91eeb3351d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:42.306996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a0bf9-ae45-4f31-bb55-91eeb3351d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:42.308802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a0bf9-ae45-4f31-bb55-91eeb3351d66 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:42.353736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3241/6439] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:30:42.358642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:42.362388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:42.363985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:42.420664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ccd57-6c66-4b70-8269-18a786c9771a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:42.439474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:42.441636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:42.444003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:42.444305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] PATH_INFO: `/v3/users/10816ad8559847dfb82c6b177fa1fd0f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:42.446047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10816ad8559847dfb82c6b177fa1fd0f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:42.448000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:42.478588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] MFA Rules not processed for user `a8da49a363304ce6a6540b52a41ac866`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:42.478758 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:42.481452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:42.610441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10816ad8559847dfb82c6b177fa1fd0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:42.613910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10816ad8559847dfb82c6b177fa1fd0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:42.615189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10816ad8559847dfb82c6b177fa1fd0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:42.639813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10816ad8559847dfb82c6b177fa1fd0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:42.647684 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:42.670089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3242/6440] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:42.671690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:42.673855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:42.684404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10816ad8559847dfb82c6b177fa1fd0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:42.724063 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3199/6441] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:42 2022] DELETE /identity/v3/users/10816ad8559847dfb82c6b177fa1fd0f => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:42.725356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:42.727475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:42.921319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb7940-5bbe-4070-95e7-4b8406913b2a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:43.046897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f6287-8c6c-400a-848b-b8906918e332 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:43.082231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:43.082878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:43.091902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:43.092187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:43.097468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:43.104781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:43.163225 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3200/6442] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:43.177089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:43.182994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:43.211182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e199e-01bf-4892-b133-3f752c5616a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:43.212082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e199e-01bf-4892-b133-3f752c5616a0 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:43.212562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e199e-01bf-4892-b133-3f752c5616a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:43.213034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e199e-01bf-4892-b133-3f752c5616a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:43.217249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a19e199e-01bf-4892-b133-3f752c5616a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:43.361360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e199e-01bf-4892-b133-3f752c5616a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:43.363268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e199e-01bf-4892-b133-3f752c5616a0 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:43.383819 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3243/6443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:42 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:43.385264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2a79a-5e2b-4631-9e18-5bb7bfd0bb5e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:43.385661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2a79a-5e2b-4631-9e18-5bb7bfd0bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:43.386035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2a79a-5e2b-4631-9e18-5bb7bfd0bb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:43.436015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d956-56e3-4775-b3df-d73d9c5e9261 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:43.436564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3da2a79a-5e2b-4631-9e18-5bb7bfd0bb5e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:43.437718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3da2a79a-5e2b-4631-9e18-5bb7bfd0bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:43.468645 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3244/6444] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:43.469517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2a79a-5e2b-4631-9e18-5bb7bfd0bb5e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:43.480212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e662-339a-4388-a4f1-3b87c450fc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:43.482087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e662-339a-4388-a4f1-3b87c450fc90 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:43.484783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e662-339a-4388-a4f1-3b87c450fc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:43.485051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e662-339a-4388-a4f1-3b87c450fc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:43.491911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1be3e662-339a-4388-a4f1-3b87c450fc90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:43.506165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2a79a-5e2b-4631-9e18-5bb7bfd0bb5e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:43.522543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:43.523379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:43.523666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:43.523943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] PATH_INFO: `/v3/projects/68239e535c0d4e36a8b120efab410324/users/c83e4488f5b543f5a48acbde683eea46/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:43.561264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68239e535c0d4e36a8b120efab410324, user_id=c83e4488f5b543f5a48acbde683eea46, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:43.564257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:43.616539 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:43.619177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3245/6445] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:30:43 2022] PUT /identity/v3/projects/68239e535c0d4e36a8b120efab410324/users/c83e4488f5b543f5a48acbde683eea46/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:43.621367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:43.691976 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:43.744063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e662-339a-4388-a4f1-3b87c450fc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:43.746613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e662-339a-4388-a4f1-3b87c450fc90 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:43.780577 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3201/6446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:43.787612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544a3c-5bce-416b-a14a-50f456ed7239 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:43.788102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544a3c-5bce-416b-a14a-50f456ed7239 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:43.788521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544a3c-5bce-416b-a14a-50f456ed7239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:43.822218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3596123-43cb-4ae4-9b68-0b90c4659c77 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:43.834626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:43.835758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:43.836141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:43.836545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:44.028474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-01544a3c-5bce-416b-a14a-50f456ed7239 None None] MFA Rules not processed for user `c83e4488f5b543f5a48acbde683eea46`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:44.063301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-01544a3c-5bce-416b-a14a-50f456ed7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:44.188168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:44.199421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:44.316604 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3246/6447] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:44.419857 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3202/6448] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 638 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:44.420593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:44.432278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0c1a-8e34-4b72-9d9b-7ad5d3b9a372 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:44.443347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:44.444209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:44.444660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:44.445221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:44.446192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:44.449806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:44.501743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544a3c-5bce-416b-a14a-50f456ed7239 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:44.502882 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3247/6449] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:30:44 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:44.547070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544a3c-5bce-416b-a14a-50f456ed7239 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:44.718903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:44.719706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:44.720619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:44.720619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:44.721651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:44.723630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:44.801027 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3203/6450] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:30:44 2022] POST /identity/v3/users => generated 300 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:44.806353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:44.824866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c61c-6fad-4321-ac75-9504aef1234a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:44.836877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:44.839058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:44.839350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:44.839630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:44.841604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:44.844561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:44.881611 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3248/6451] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:44.885212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:44.931770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c0025-48db-4ea1-a272-354c7ef81380 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:44.968420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:44.970044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:44.970319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:44.970704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] PATH_INFO: `/v3/projects/a07d555295f64521a2d44ca6909fe119/users/4234b088e35a46bca77115f55f168d06/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:45.049914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07d555295f64521a2d44ca6909fe119, user_id=4234b088e35a46bca77115f55f168d06, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:45.052838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:45.094811 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3204/6452] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:30:44 2022] PUT /identity/v3/projects/a07d555295f64521a2d44ca6909fe119/users/4234b088e35a46bca77115f55f168d06/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:45.098643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:45.114734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c60ed2-9968-4628-80ae-4ff8a3d922b5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:45.287108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f0408-4841-4851-bf82-2dbdda90945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:45.287855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0408-4841-4851-bf82-2dbdda90945c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:45.288088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0408-4841-4851-bf82-2dbdda90945c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:45.288364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0408-4841-4851-bf82-2dbdda90945c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:45.289021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f0408-4841-4851-bf82-2dbdda90945c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:45.295684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f0408-4841-4851-bf82-2dbdda90945c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:45.332708 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3249/6453] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:45.336761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:45.353930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4913085-fc96-4a8f-be8c-755b2665b82c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:45.382792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:45.384437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:45.384894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:45.386317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] PATH_INFO: `/v3/projects/a07d555295f64521a2d44ca6909fe119/users/4234b088e35a46bca77115f55f168d06/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:45.397343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07d555295f64521a2d44ca6909fe119, user_id=4234b088e35a46bca77115f55f168d06, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:45.410164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:45.476031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e973-adb9-4746-b827-3e3eab69ddbb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:45.476472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e973-adb9-4746-b827-3e3eab69ddbb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:45.476580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e973-adb9-4746-b827-3e3eab69ddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:45.485741 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3205/6454] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:30:45 2022] PUT /identity/v3/projects/a07d555295f64521a2d44ca6909fe119/users/4234b088e35a46bca77115f55f168d06/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:45.590124 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:45.604824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9be3e973-adb9-4746-b827-3e3eab69ddbb None None] MFA Rules not processed for user `4234b088e35a46bca77115f55f168d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:45.606488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9be3e973-adb9-4746-b827-3e3eab69ddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:45.786861 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3250/6455] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:45.806629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:45.809294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:45.880968 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:46.047799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f4936-5886-4c45-858c-741e6f4cbf59 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:46.083781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78ecf5-88c9-4c5f-a945-6ca6d7a6d0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:46.085717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ecf5-88c9-4c5f-a945-6ca6d7a6d0dc service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:46.087795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ecf5-88c9-4c5f-a945-6ca6d7a6d0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:46.090000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ecf5-88c9-4c5f-a945-6ca6d7a6d0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:46.113875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ecf5-88c9-4c5f-a945-6ca6d7a6d0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:46.115852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ecf5-88c9-4c5f-a945-6ca6d7a6d0dc service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:46.137503 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3206/6456] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:46.409284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e973-adb9-4746-b827-3e3eab69ddbb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:46.510092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e973-adb9-4746-b827-3e3eab69ddbb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:46.527382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:46.528055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:46.528327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:46.528593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] PATH_INFO: `/v3/users/c83e4488f5b543f5a48acbde683eea46` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:46.536537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83e4488f5b543f5a48acbde683eea46)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:46.538742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:46.605279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83e4488f5b543f5a48acbde683eea46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:46.607037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83e4488f5b543f5a48acbde683eea46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:46.609342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83e4488f5b543f5a48acbde683eea46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:46.629443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83e4488f5b543f5a48acbde683eea46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:46.641795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83e4488f5b543f5a48acbde683eea46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:46.680862 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3251/6457] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:46 2022] DELETE /identity/v3/users/c83e4488f5b543f5a48acbde683eea46 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:46.681883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:46.682185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:46.682485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:46.734573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:46.736275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:46.890444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3207/6458] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:46.891953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:46.894418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:46.913894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:46.915642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:46.930738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ac70a-fc6f-4787-95f0-a3f68dd0b326 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:46.956567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:46.957327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:46.957614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:46.957902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] PATH_INFO: `/v3/projects/923b203f6c3c44d299faf755c5d7725f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:46.969122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] RBAC: Authorizing `identity:delete_project(project_id=923b203f6c3c44d299faf755c5d7725f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:46.974362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:47.030874 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:47.051828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aae300-690f-43a5-930a-3f74068182b4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:47.064504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:47.065463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:47.065753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:47.066028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:47.088663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:47.090679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:47.103125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3208/6459] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:47.125855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923b203f6c3c44d299faf755c5d7725f', 'request_id': 'req-2227a790-c0f3-4b45-8bcb-0f037e5f683a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.138351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923b203f6c3c44d299faf755c5d7725f', 'request_id': 'req-2227a790-c0f3-4b45-8bcb-0f037e5f683a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.159883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923b203f6c3c44d299faf755c5d7725f', 'request_id': 'req-2227a790-c0f3-4b45-8bcb-0f037e5f683a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.195233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] The token cache is being invalidate because project 923b203f6c3c44d299faf755c5d7725f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:47.195539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.196381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.202878 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3252/6460] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:46 2022] DELETE /identity/v3/projects/923b203f6c3c44d299faf755c5d7725f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:47.204129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:47.219736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebe1a6-a319-48ad-b01a-70dd8ec4e708 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:47.334791 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:47.352482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:47.353945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:47.355411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:47.355733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] PATH_INFO: `/v3/users/4fd7a7793fb24556b9c0f804cda4dcc9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:47.359045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd7a7793fb24556b9c0f804cda4dcc9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:47.362599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:47.474240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd7a7793fb24556b9c0f804cda4dcc9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.477488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd7a7793fb24556b9c0f804cda4dcc9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.478162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd7a7793fb24556b9c0f804cda4dcc9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.492476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd7a7793fb24556b9c0f804cda4dcc9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.536139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd7a7793fb24556b9c0f804cda4dcc9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:47.579797 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3209/6461] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:47 2022] DELETE /identity/v3/users/4fd7a7793fb24556b9c0f804cda4dcc9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:47.598571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:47.601019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:47.738007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227a790-c0f3-4b45-8bcb-0f037e5f683a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:47.843402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:47.843892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:47.844171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:47.844443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:47.846585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:47.944476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:47.946342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:47.959966 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3253/6462] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:48.150533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:48.151417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:48.167305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31da6f-d778-4bd0-9ae1-d566ae4a3c7e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:48.176048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:48.177666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:48.178146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:48.178572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] PATH_INFO: `/v3/projects/68239e535c0d4e36a8b120efab410324` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:48.180031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68239e535c0d4e36a8b120efab410324)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:48.184052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:48.256750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68239e535c0d4e36a8b120efab410324', 'request_id': 'req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.268732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68239e535c0d4e36a8b120efab410324', 'request_id': 'req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.281582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68239e535c0d4e36a8b120efab410324', 'request_id': 'req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.299971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] The token cache is being invalidate because project 68239e535c0d4e36a8b120efab410324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:48.301179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.302181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.308415 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3210/6463] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:48 2022] DELETE /identity/v3/projects/68239e535c0d4e36a8b120efab410324 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:48.308725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:48.322515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799385c5-ad0b-436c-9c80-fe366d2cc7f8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:48.330835 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:48.472512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:48.473459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:48.473918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:48.474380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] PATH_INFO: `/v3/users/4234b088e35a46bca77115f55f168d06` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:48.478481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4234b088e35a46bca77115f55f168d06)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:48.480648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:48.532044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:48.532044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:48.564391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04764-0cec-42e5-89da-2e2b5c1c3a1e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:48.584554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:48.585225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:48.585497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:48.585794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] PATH_INFO: `/v3/projects/64d22ab8517a400ab9c028d65637b32d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:48.594043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d22ab8517a400ab9c028d65637b32d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:48.598045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:48.599692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4234b088e35a46bca77115f55f168d06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.600386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4234b088e35a46bca77115f55f168d06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.601336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4234b088e35a46bca77115f55f168d06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.623822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4234b088e35a46bca77115f55f168d06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.659091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1939adb8-c8a5-40e1-aee6-81a7dad1e2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4234b088e35a46bca77115f55f168d06'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.686280 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3254/6464] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:48 2022] DELETE /identity/v3/users/4234b088e35a46bca77115f55f168d06 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:48.723792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d22ab8517a400ab9c028d65637b32d', 'request_id': 'req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.725088 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:48.740598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d22ab8517a400ab9c028d65637b32d', 'request_id': 'req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.760459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d22ab8517a400ab9c028d65637b32d', 'request_id': 'req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.785438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] The token cache is being invalidate because project 64d22ab8517a400ab9c028d65637b32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:48.785743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.788231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d37f2e5e-0bec-4f9b-99fe-b36276f1689f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:48.790771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3211/6465] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:48 2022] DELETE /identity/v3/projects/64d22ab8517a400ab9c028d65637b32d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:48.795611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce20a4-15cf-4af1-b1f4-4eaad36f94a4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:48.795900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce20a4-15cf-4af1-b1f4-4eaad36f94a4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:48.796174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce20a4-15cf-4af1-b1f4-4eaad36f94a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:48.831514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-07ce20a4-15cf-4af1-b1f4-4eaad36f94a4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:48.833288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-07ce20a4-15cf-4af1-b1f4-4eaad36f94a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:48.924907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3255/6466] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:48.932421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0e785-a6d1-47f0-9b1e-f560d009b0f4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:48.932711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0e785-a6d1-47f0-9b1e-f560d009b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:48.932991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0e785-a6d1-47f0-9b1e-f560d009b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:48.961735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ead0e785-a6d1-47f0-9b1e-f560d009b0f4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:48.963632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ead0e785-a6d1-47f0-9b1e-f560d009b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:48.975264 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3212/6467] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:48.979885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce20a4-15cf-4af1-b1f4-4eaad36f94a4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:48.995553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce20a4-15cf-4af1-b1f4-4eaad36f94a4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:49.009316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:49.010982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:49.011333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:49.011799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:49.012476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:30:49.015505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:49.019169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:49.050397 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3256/6468] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:30:49.055188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0e785-a6d1-47f0-9b1e-f560d009b0f4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:49.069188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0e785-a6d1-47f0-9b1e-f560d009b0f4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:49.078211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:49.079022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:49.079499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:49.079910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:49.080650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:49.083074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:49.140478 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3213/6469] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:30:49 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:49.144621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:49.161865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fcab0-5431-482a-bafb-e12bfd6fb9e7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:49.189493 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:49.280613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:49.281329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:49.282182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:49.282182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:49.282957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:49.286999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:49.330832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:49.334858 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3257/6470] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:30:49 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:49.348840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d21a36-b4ac-478f-9042-719142de55d1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:49.363622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:49.365733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:49.365916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:49.367208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:49.369169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:49.371227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:49.403510 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3214/6471] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:49.405606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:49.449734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb9300-9691-4b97-a332-522718d22fd8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:49.476506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a577-82c0-47fb-8bb8-f51e1de78e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:49.478184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a577-82c0-47fb-8bb8-f51e1de78e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:49.479722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a577-82c0-47fb-8bb8-f51e1de78e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:49.480245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a577-82c0-47fb-8bb8-f51e1de78e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:49.482521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a577-82c0-47fb-8bb8-f51e1de78e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:49.483981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a577-82c0-47fb-8bb8-f51e1de78e60 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:49.541243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:49.550337 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3258/6472] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:49.561370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849db7b-2e1c-4046-929a-457d18ccdaea admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:49.577828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:49.579902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:49.582909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:49.583796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] PATH_INFO: `/v3/projects/04d251fede3d492f962aaa0ea2de10c5/users/d3c2c29f78f7448087bb72779a6f1371/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:49.624279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d251fede3d492f962aaa0ea2de10c5, user_id=d3c2c29f78f7448087bb72779a6f1371, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:49.631305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:49.665712 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3215/6473] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:30:49 2022] PUT /identity/v3/projects/04d251fede3d492f962aaa0ea2de10c5/users/d3c2c29f78f7448087bb72779a6f1371/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:49.679756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:49.680169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:49.680782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:49.737686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] MFA Rules not processed for user `d3c2c29f78f7448087bb72779a6f1371`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:49.739246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:49.903289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3259/6474] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:49.942059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:49.944677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:50.047647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6956d6-ebf4-41aa-9ba6-7ff2d73631c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:50.052420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04a0d7-960a-4d67-8cba-d4c616252aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:50.053215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04a0d7-960a-4d67-8cba-d4c616252aaf service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:50.053806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04a0d7-960a-4d67-8cba-d4c616252aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:50.054097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04a0d7-960a-4d67-8cba-d4c616252aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:50.071084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04a0d7-960a-4d67-8cba-d4c616252aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:50.072539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04a0d7-960a-4d67-8cba-d4c616252aaf service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:50.107401 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3216/6475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:51.924992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:51.926469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:52.085770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33944-fb40-4987-873e-6005a7a10374 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:52.094967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:52.095684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:52.096649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:52.096916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] PATH_INFO: `/v3/projects/a07d555295f64521a2d44ca6909fe119` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:52.110817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07d555295f64521a2d44ca6909fe119)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:52.127006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:52.190821 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:52.247137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07d555295f64521a2d44ca6909fe119', 'request_id': 'req-a3fceee8-a146-4cae-b62c-fc95f18a7f67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:52.254937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07d555295f64521a2d44ca6909fe119', 'request_id': 'req-a3fceee8-a146-4cae-b62c-fc95f18a7f67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:52.282928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07d555295f64521a2d44ca6909fe119', 'request_id': 'req-a3fceee8-a146-4cae-b62c-fc95f18a7f67'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:52.313372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] The token cache is being invalidate because project a07d555295f64521a2d44ca6909fe119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:52.313718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:52.320664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3fceee8-a146-4cae-b62c-fc95f18a7f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:52.325577 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3260/6476] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:51 2022] DELETE /identity/v3/projects/a07d555295f64521a2d44ca6909fe119 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:52.327976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2968d8-3bd9-44e3-8ed1-817ae71dc2dc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:52.328551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2968d8-3bd9-44e3-8ed1-817ae71dc2dc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:52.328551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2968d8-3bd9-44e3-8ed1-817ae71dc2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:52.370726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ea2968d8-3bd9-44e3-8ed1-817ae71dc2dc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:52.371950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ea2968d8-3bd9-44e3-8ed1-817ae71dc2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:52.519466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f2d93-f79e-402f-a75e-6d609aab36da None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:52.519980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f2d93-f79e-402f-a75e-6d609aab36da None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:52.520396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f2d93-f79e-402f-a75e-6d609aab36da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:52.524404 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3217/6477] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:52.564646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cc9f2d93-f79e-402f-a75e-6d609aab36da None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:52.566233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc9f2d93-f79e-402f-a75e-6d609aab36da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:52.579094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2968d8-3bd9-44e3-8ed1-817ae71dc2dc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:52.579839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3261/6478] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:52.590525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2968d8-3bd9-44e3-8ed1-817ae71dc2dc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:52.597105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:52.598079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:52.598499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:52.598909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:52.599697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:30:52.600272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:52.602040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:52.621832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f2d93-f79e-402f-a75e-6d609aab36da None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:52.630265 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3218/6479] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:30:52.637971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f2d93-f79e-402f-a75e-6d609aab36da None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:52.644611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:52.645589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:52.646276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:52.646704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:52.647529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:52.649693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:52.727354 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3262/6480] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:30:52 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:52.729016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:52.737979 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:52.748946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bf276-f47a-4d2f-a530-c7b7d5c4fe49 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:52.937489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:52.938076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:52.938360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:52.938744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:52.939305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:52.944251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:53.011784 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3219/6481] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:30:52 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:53.015674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:53.040215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759b9c0-9093-4215-9113-f79496dee9ca admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:53.049407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:53.050763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:53.051263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:53.051748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:53.053116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:53.061112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:53.086561 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3263/6482] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:30:53.091129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:53.106244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca68ad-8ece-4b3d-8d6f-155b045be924 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:53.115504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29490191-13e8-41dd-8e99-228859bbce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:53.117012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490191-13e8-41dd-8e99-228859bbce70 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:53.117620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490191-13e8-41dd-8e99-228859bbce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:53.118009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490191-13e8-41dd-8e99-228859bbce70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:53.118948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29490191-13e8-41dd-8e99-228859bbce70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:53.121460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29490191-13e8-41dd-8e99-228859bbce70 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:53.142915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3220/6483] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:30:53.144424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:53.160825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605d1c-4c8e-4e41-95d1-56d341bc7919 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:53.166422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:53.167240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:53.168204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:53.168600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] PATH_INFO: `/v3/projects/58a6fc04248340cfba6f20d9526568b3/users/9f69368604c54c27bee090a6e0bd512e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:53.213854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a6fc04248340cfba6f20d9526568b3, user_id=9f69368604c54c27bee090a6e0bd512e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:53.223051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:53.277829 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3264/6484] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:30:53 2022] PUT /identity/v3/projects/58a6fc04248340cfba6f20d9526568b3/users/9f69368604c54c27bee090a6e0bd512e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:53.395928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2cba-2cbd-495d-9eec-b785a72200ce None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:53.396511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2cba-2cbd-495d-9eec-b785a72200ce None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:53.396511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df2cba-2cbd-495d-9eec-b785a72200ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:53.456359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-32df2cba-2cbd-495d-9eec-b785a72200ce None None] MFA Rules not processed for user `9f69368604c54c27bee090a6e0bd512e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:53.457624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-32df2cba-2cbd-495d-9eec-b785a72200ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:53.641999 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3221/6485] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:53.655630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:53.665016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:53.911325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc3539-2f95-4844-88ef-72b6aa28769f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:53.920849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37832d-8a83-407c-a3c1-ceac047511d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:53.921562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37832d-8a83-407c-a3c1-ceac047511d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:53.921850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37832d-8a83-407c-a3c1-ceac047511d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:53.922127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37832d-8a83-407c-a3c1-ceac047511d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:53.942859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37832d-8a83-407c-a3c1-ceac047511d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:53.944463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37832d-8a83-407c-a3c1-ceac047511d2 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:53.966920 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3265/6486] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:30:53.999048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2cba-2cbd-495d-9eec-b785a72200ce None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:54.154222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df2cba-2cbd-495d-9eec-b785a72200ce None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:54.163654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:54.165434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:54.167350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:54.167765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] PATH_INFO: `/v3/users/9f69368604c54c27bee090a6e0bd512e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:54.170470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f69368604c54c27bee090a6e0bd512e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:54.176869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:54.232745 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:54.329812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f69368604c54c27bee090a6e0bd512e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:54.330765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f69368604c54c27bee090a6e0bd512e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:54.331709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f69368604c54c27bee090a6e0bd512e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:54.361467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f69368604c54c27bee090a6e0bd512e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:54.408876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f69368604c54c27bee090a6e0bd512e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:54.453404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:54.454273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:54.454757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:54.460565 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3222/6487] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:53 2022] DELETE /identity/v3/users/9f69368604c54c27bee090a6e0bd512e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:54.494540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:54.494540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:54.609520 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:54.652509 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3266/6488] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:54.669490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:54.672335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:54.800213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd00e-7eca-4d98-84af-9740a3bcc028 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:54.810872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc1ed-1525-4b54-a3f8-9dcb7732c3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:54.811512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc1ed-1525-4b54-a3f8-9dcb7732c3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:54.811806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc1ed-1525-4b54-a3f8-9dcb7732c3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:54.812066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc1ed-1525-4b54-a3f8-9dcb7732c3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:54.841566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc1ed-1525-4b54-a3f8-9dcb7732c3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:54.845000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc1ed-1525-4b54-a3f8-9dcb7732c3b3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:54.870087 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3223/6489] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:56.960302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:56.962817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:56.991757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406dd84-a986-496b-a0b4-7a736c84a5ba None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:56.999787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:57.000675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:57.001139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:57.001562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] PATH_INFO: `/v3/projects/58a6fc04248340cfba6f20d9526568b3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:57.003342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a6fc04248340cfba6f20d9526568b3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:57.006231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:57.166714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a6fc04248340cfba6f20d9526568b3', 'request_id': 'req-6f0c1072-1f60-45c3-8d44-1489cb3e4059'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:57.188428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a6fc04248340cfba6f20d9526568b3', 'request_id': 'req-6f0c1072-1f60-45c3-8d44-1489cb3e4059'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:57.206019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a6fc04248340cfba6f20d9526568b3', 'request_id': 'req-6f0c1072-1f60-45c3-8d44-1489cb3e4059'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:57.240110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] The token cache is being invalidate because project 58a6fc04248340cfba6f20d9526568b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:30:57.240619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:57.241538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6f0c1072-1f60-45c3-8d44-1489cb3e4059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:57.249345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3267/6490] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:30:56 2022] DELETE /identity/v3/projects/58a6fc04248340cfba6f20d9526568b3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:57.251021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24c7d-0bab-414f-b85c-ff6cc0455189 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:57.251473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24c7d-0bab-414f-b85c-ff6cc0455189 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:57.252379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24c7d-0bab-414f-b85c-ff6cc0455189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:57.405646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bda24c7d-0bab-414f-b85c-ff6cc0455189 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:57.411071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bda24c7d-0bab-414f-b85c-ff6cc0455189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:57.599171 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3224/6491] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:57.599498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbf51-8841-45f9-808a-2276e9529ffe None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:57.599893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbf51-8841-45f9-808a-2276e9529ffe None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:57.600276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbf51-8841-45f9-808a-2276e9529ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:57.632748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-295cbf51-8841-45f9-808a-2276e9529ffe None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:57.634081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-295cbf51-8841-45f9-808a-2276e9529ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:57.645141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3268/6492] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:57.647143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda24c7d-0bab-414f-b85c-ff6cc0455189 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:57.667241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda24c7d-0bab-414f-b85c-ff6cc0455189 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:57.684212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:57.684847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:57.685153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:57.685425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:57.686086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:30:57.686386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:57.688085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:57.719236 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3225/6493] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:30:57.726811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbf51-8841-45f9-808a-2276e9529ffe None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:57.740233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbf51-8841-45f9-808a-2276e9529ffe None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:57.747174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:57.747806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:57.748088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:57.748357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:57.749003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:57.750947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:57.823056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3269/6494] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:30:57 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:57.827825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:57.848289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fecda-5522-4db2-98cf-fd9763dca75b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:57.933937 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:58.047686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:58.048229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:58.049468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:58.049759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:58.052813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:58.060581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:58.126412 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3226/6495] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:30:57 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:30:58.132207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:58.150606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af48db0-2e86-42f3-84b8-d76663c125d7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:58.159094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:58.161105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:58.162463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:58.164002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:58.165428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:58.170500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:58.210337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:58.221278 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3270/6496] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:58.232249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5716-dffb-4e26-8067-317831cf860d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:58.252247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84e3bf-913d-4008-be6c-25e39601bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:58.254930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e3bf-913d-4008-be6c-25e39601bcdf admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:58.255748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e3bf-913d-4008-be6c-25e39601bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:58.255941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e3bf-913d-4008-be6c-25e39601bcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:58.256912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84e3bf-913d-4008-be6c-25e39601bcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:58.259568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84e3bf-913d-4008-be6c-25e39601bcdf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:58.292082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:58.317415 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3227/6497] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:30:58.322190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c0ef1-6f45-465c-a89f-8daf32a6d581 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:58.331730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:58.334233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:58.334685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:58.335111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] PATH_INFO: `/v3/projects/a6677331581943e48b571a5377d83f93/users/1b184f278e2447c1bc710914329d2e80/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:58.385088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6677331581943e48b571a5377d83f93, user_id=1b184f278e2447c1bc710914329d2e80, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:58.387942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:58.434161 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3271/6498] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:30:58 2022] PUT /identity/v3/projects/a6677331581943e48b571a5377d83f93/users/1b184f278e2447c1bc710914329d2e80/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:58.444316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:58.445678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:58.447579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:58.534436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] MFA Rules not processed for user `1b184f278e2447c1bc710914329d2e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:58.547879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:58.767739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:58.769955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:58.797818 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3228/6499] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:58.808584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:58.812892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:59.080413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b2c31-d1ea-4b52-b36b-ade0fba70d41 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:59.107197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810504e9-e531-4e9c-8560-475095e4eb55 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:59.116367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:59.117621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:59.121257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:59.122143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] PATH_INFO: `/v3/users/d0b0f377f1f7465bbf9020c2f1cfcb33` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:59.126355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a3176-43ab-483f-b7ed-b89de81f8d90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:59.128668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b0f377f1f7465bbf9020c2f1cfcb33)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:59.129705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3176-43ab-483f-b7ed-b89de81f8d90 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:59.130287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3176-43ab-483f-b7ed-b89de81f8d90 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:59.131120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:59.132762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3176-43ab-483f-b7ed-b89de81f8d90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:59.134235 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:59.148175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a3176-43ab-483f-b7ed-b89de81f8d90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:59.166082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a3176-43ab-483f-b7ed-b89de81f8d90 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:59.185267 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3229/6500] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:30:59.216697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b0f377f1f7465bbf9020c2f1cfcb33'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:59.217796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b0f377f1f7465bbf9020c2f1cfcb33'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:59.218650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b0f377f1f7465bbf9020c2f1cfcb33'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:59.238817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b0f377f1f7465bbf9020c2f1cfcb33'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:59.253773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b0f377f1f7465bbf9020c2f1cfcb33'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:30:59.329860 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3272/6501] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:30:58 2022] DELETE /identity/v3/users/d0b0f377f1f7465bbf9020c2f1cfcb33 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:30:59.335480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:59.336006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:59.336129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:59.408577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:30:59.411650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:59.529503 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:30:59.663717 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3230/6502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:30:59.694185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:30:59.695648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:30:59.858277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb1860-d91e-49b3-9642-8ff85cdb2a6c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:30:59.873589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aed34-6ef0-4827-aa0e-a6c576abb803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:30:59.874519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aed34-6ef0-4827-aa0e-a6c576abb803 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:30:59.875117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aed34-6ef0-4827-aa0e-a6c576abb803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:30:59.875637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aed34-6ef0-4827-aa0e-a6c576abb803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:30:59.891190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aed34-6ef0-4827-aa0e-a6c576abb803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:30:59.894274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aed34-6ef0-4827-aa0e-a6c576abb803 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:30:59.915930 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3273/6503] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:31:00.715395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:00.717510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:00.738804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e6338-cacf-4aa0-b1ac-da2d03d635a5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:00.754013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:00.754843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:00.755310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:00.755728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] PATH_INFO: `/v3/projects/361c685493404536a6b9131eee2e3adb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:00.761962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361c685493404536a6b9131eee2e3adb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:00.763908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:00.874651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361c685493404536a6b9131eee2e3adb', 'request_id': 'req-45619849-1f54-4834-a87b-1c1267457925'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:00.894310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361c685493404536a6b9131eee2e3adb', 'request_id': 'req-45619849-1f54-4834-a87b-1c1267457925'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:00.912643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361c685493404536a6b9131eee2e3adb', 'request_id': 'req-45619849-1f54-4834-a87b-1c1267457925'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:00.932591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] The token cache is being invalidate because project 361c685493404536a6b9131eee2e3adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:00.933375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:00.934216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45619849-1f54-4834-a87b-1c1267457925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:00.937780 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3231/6504] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:00 2022] DELETE /identity/v3/projects/361c685493404536a6b9131eee2e3adb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:00.943270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e667-0ce0-495a-a3d9-65b01d7848d5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:00.944063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e667-0ce0-495a-a3d9-65b01d7848d5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:00.944503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e667-0ce0-495a-a3d9-65b01d7848d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:00.989898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d184e667-0ce0-495a-a3d9-65b01d7848d5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:00.991148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d184e667-0ce0-495a-a3d9-65b01d7848d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:01.175499 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3274/6505] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:01.183826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb317a-f474-4174-95ee-ad879abde9f9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:01.185752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb317a-f474-4174-95ee-ad879abde9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:01.186171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb317a-f474-4174-95ee-ad879abde9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:01.247703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1ceb317a-f474-4174-95ee-ad879abde9f9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:01.249526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1ceb317a-f474-4174-95ee-ad879abde9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:01.269281 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3232/6506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:01.273814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e667-0ce0-495a-a3d9-65b01d7848d5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:01.288918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e667-0ce0-495a-a3d9-65b01d7848d5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:01.315388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:01.315781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:01.324583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:01.324955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:01.325717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:01.326296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:01.327986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:01.384907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3275/6507] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:01.388907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb317a-f474-4174-95ee-ad879abde9f9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:01.403765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb317a-f474-4174-95ee-ad879abde9f9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:01.423113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:01.424405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:01.424792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:01.425208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:01.425960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:01.427961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:01.511973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:01.520137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3233/6508] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:01 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:01.526633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ab29-c780-4dfb-b1a5-2eaa3a397183 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:01.542549 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:01.687589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:01.688340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:01.688508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:01.688786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:01.690096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:01.692072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:01.738786 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3276/6509] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:01 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:31:01.742563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:01.762947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111ae5-3985-4b69-b1e9-0f8914b8241a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:01.778880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:01.781335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:01.781669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:01.784940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:01.786757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:01.796967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:01.855774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:01.857996 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3234/6510] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:01.889992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50c02c-4f1d-4fc7-a0e4-f5eebf7a4117 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:01.903917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b2e48-ed7a-4c61-bce4-6dd3415dd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:01.904552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2e48-ed7a-4c61-bce4-6dd3415dd7ca admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:01.904836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2e48-ed7a-4c61-bce4-6dd3415dd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:01.905148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2e48-ed7a-4c61-bce4-6dd3415dd7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:01.905812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b2e48-ed7a-4c61-bce4-6dd3415dd7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:01.912141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b2e48-ed7a-4c61-bce4-6dd3415dd7ca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:01.950594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3277/6511] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:31:01.951479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:01.971691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc28746-c20d-4f69-ba81-7b9752653c28 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:02.000272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:02.000967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:02.001274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:02.001548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] PATH_INFO: `/v3/projects/98cae0ff69b24b24b3dca3708d04c53f/users/5551cca8143b455b822d283fb00d1932/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:02.039238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cae0ff69b24b24b3dca3708d04c53f, user_id=5551cca8143b455b822d283fb00d1932, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:02.042200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:02.091394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:02.091679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:02.092214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:02.105585 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3235/6512] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:01 2022] PUT /identity/v3/projects/98cae0ff69b24b24b3dca3708d04c53f/users/5551cca8143b455b822d283fb00d1932/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:02.133380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:02.135456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:02.293187 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3278/6513] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:02.442406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:02.447258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:02.613888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0072ce-c122-4ec2-9777-b43c2577bdc6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:02.633846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213b131-a602-47c4-9250-fee3896dd5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:02.635109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213b131-a602-47c4-9250-fee3896dd5ed service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:02.635781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213b131-a602-47c4-9250-fee3896dd5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:02.636255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213b131-a602-47c4-9250-fee3896dd5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:02.647741 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:02.656666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213b131-a602-47c4-9250-fee3896dd5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:02.662320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213b131-a602-47c4-9250-fee3896dd5ed service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:02.704023 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3236/6514] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:03.358549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:03.360123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:03.492900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a27cc-65fd-41b4-afd8-cfaf1912b8ff None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:03.498938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:03.499833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:03.500273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:03.500700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:03.503328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:03.520059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:03.522878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:03.550598 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3279/6515] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:08.725748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:08.726227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:08.726304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:08.779886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] MFA Rules not processed for user `5551cca8143b455b822d283fb00d1932`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:08.781409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:08.935003 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3237/6516] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:08.945963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:08.949858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:08.968233 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:09.135000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fae4a-8f0d-48f3-98b5-ebebf1b9a3ee service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:09.146275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:09.147185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:09.147473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:09.147748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:09.162340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:09.164090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:09.176313 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3280/6517] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:09.591703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:09.594073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:09.653208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a49e46-7545-488d-b8ea-e2cc58f94679 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:09.696283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:09.696747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:09.697028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:09.697505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] PATH_INFO: `/v3/users/f01b6459a5c54bafba0ddf73cfd1e399` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:09.701646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01b6459a5c54bafba0ddf73cfd1e399)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:09.706402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:09.874710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01b6459a5c54bafba0ddf73cfd1e399'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:09.905288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01b6459a5c54bafba0ddf73cfd1e399'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:09.906874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01b6459a5c54bafba0ddf73cfd1e399'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:09.949453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01b6459a5c54bafba0ddf73cfd1e399'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:09.987873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83016b62-6ce0-4862-932a-1289adde6736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01b6459a5c54bafba0ddf73cfd1e399'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:10.022841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3238/6518] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:09 2022] DELETE /identity/v3/users/f01b6459a5c54bafba0ddf73cfd1e399 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:11.054322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:11.077590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f32a5d-02ba-43e6-b7f2-f45280f52496 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:11.274607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:11.275639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:11.276103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:11.276754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] PATH_INFO: `/v3/projects/65ff144533fb4a11b46dbe883625116b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:11.278457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ff144533fb4a11b46dbe883625116b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:11.281399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:11.355146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ff144533fb4a11b46dbe883625116b', 'request_id': 'req-321eb282-8cf4-49a2-b2c3-f55bf00516ad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:11.362600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ff144533fb4a11b46dbe883625116b', 'request_id': 'req-321eb282-8cf4-49a2-b2c3-f55bf00516ad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:11.375556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ff144533fb4a11b46dbe883625116b', 'request_id': 'req-321eb282-8cf4-49a2-b2c3-f55bf00516ad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:11.444410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] The token cache is being invalidate because project 65ff144533fb4a11b46dbe883625116b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:11.444900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:11.445890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-321eb282-8cf4-49a2-b2c3-f55bf00516ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:11.449552 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3281/6519] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:11 2022] DELETE /identity/v3/projects/65ff144533fb4a11b46dbe883625116b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:11.454306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4812c-77dc-46f8-8548-a60dd43c98ba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:11.454899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4812c-77dc-46f8-8548-a60dd43c98ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:11.455418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4812c-77dc-46f8-8548-a60dd43c98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:11.549786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d6a4812c-77dc-46f8-8548-a60dd43c98ba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:11.559362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d6a4812c-77dc-46f8-8548-a60dd43c98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:11.823330 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:11.859098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3239/6520] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:11.868270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b7f1-1c69-42f8-a22c-8dd055a21232 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:11.868576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b7f1-1c69-42f8-a22c-8dd055a21232 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:11.868819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b7f1-1c69-42f8-a22c-8dd055a21232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:11.904232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2a21b7f1-1c69-42f8-a22c-8dd055a21232 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:11.905507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a21b7f1-1c69-42f8-a22c-8dd055a21232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:11.932368 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3282/6521] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:11.936620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4812c-77dc-46f8-8548-a60dd43c98ba None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:11.954382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4812c-77dc-46f8-8548-a60dd43c98ba None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:11.962404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:11.963062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:11.964076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:11.964370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:11.965048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:11.965048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:11.980969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:12.012904 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3240/6522] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:12.017012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b7f1-1c69-42f8-a22c-8dd055a21232 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:12.031405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b7f1-1c69-42f8-a22c-8dd055a21232 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:12.070898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:12.072514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:12.072992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:12.082236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:12.083387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:12.087745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:12.121516 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:12.172583 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3283/6523] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:12 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:12.178039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:12.203857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1ba95-3912-4445-895e-99101d4a414c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:12.421313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:12.422096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:12.422380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:12.422649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:12.424593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:12.427464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:12.481538 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3241/6524] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:12 2022] POST /identity/v3/users => generated 283 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:12.482849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:12.515105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115287a-d596-4076-962f-fc0b4e1ad5b8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:12.561681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:12.563035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:12.569123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:12.572231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:12.573293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:12.582871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:12.622650 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3284/6525] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:12.624377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:12.644972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a514deb-d7df-4b1c-ad94-59f03d747bb3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:12.652506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dd6fb-bd9d-4241-925d-032fb34bbed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:12.653662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd6fb-bd9d-4241-925d-032fb34bbed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:12.654190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd6fb-bd9d-4241-925d-032fb34bbed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:12.654739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd6fb-bd9d-4241-925d-032fb34bbed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:12.655657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dd6fb-bd9d-4241-925d-032fb34bbed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:12.667824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dd6fb-bd9d-4241-925d-032fb34bbed6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:12.715713 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3242/6526] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:12.716566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:12.735383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee468ed-f8f5-469c-8424-4bf821af41ba admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:12.764917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:12.765648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:12.765924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:12.770838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] PATH_INFO: `/v3/projects/70dba58147c343c2b668a68634698612/users/cdd0e158e15c43bf8353ae4dfa43951d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:12.831462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dba58147c343c2b668a68634698612, user_id=cdd0e158e15c43bf8353ae4dfa43951d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:12.836262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:12.874941 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3285/6527] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:12 2022] PUT /identity/v3/projects/70dba58147c343c2b668a68634698612/users/cdd0e158e15c43bf8353ae4dfa43951d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:12.886602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457fcd-2726-4616-a0e7-88d009346347 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:12.886896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457fcd-2726-4616-a0e7-88d009346347 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:12.887176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457fcd-2726-4616-a0e7-88d009346347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:13.021191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-26457fcd-2726-4616-a0e7-88d009346347 None None] MFA Rules not processed for user `cdd0e158e15c43bf8353ae4dfa43951d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:13.022508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-26457fcd-2726-4616-a0e7-88d009346347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:13.212297 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3243/6528] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:13.215204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:13.389892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b22d-28c7-41ec-ae52-0359c6d4a7ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:13.398836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:13.399479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:13.399761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:13.400043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:13.400687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:13.408517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:13.491088 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3286/6529] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:13 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:13.494857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26457fcd-2726-4616-a0e7-88d009346347 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:13.514465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26457fcd-2726-4616-a0e7-88d009346347 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:13.693638 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:13.732500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:13.733226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:13.733543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:13.733814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:13.734528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:13.742265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:13.856216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:13.862507 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3244/6530] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:13 2022] POST /identity/v3/users => generated 290 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:13.877394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f696-2817-4e1c-b105-dc51cc119d81 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:13.896742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:13.897436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:13.897723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:13.897999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:13.898670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:13.900331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:13.931804 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3287/6531] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:13.935986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:13.957653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa50fc-bfc6-42f4-8d9f-6b9f7d0801dc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:13.972879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:13.974481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:13.975540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:13.975817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] PATH_INFO: `/v3/projects/339ccfd2d87f4d789415b7dd0c2ee9f1/users/d254b53d2d764c0d9df592be6b132ea1/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:14.043456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=339ccfd2d87f4d789415b7dd0c2ee9f1, user_id=d254b53d2d764c0d9df592be6b132ea1, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:14.046398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:14.073625 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3245/6532] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:13 2022] PUT /identity/v3/projects/339ccfd2d87f4d789415b7dd0c2ee9f1/users/d254b53d2d764c0d9df592be6b132ea1/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:14.077459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:14.089662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43605676-8aff-4534-9c16-49b08dda16e3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:14.287805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9c27-eec0-4934-b2bd-2cbed5e70a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:14.288453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9c27-eec0-4934-b2bd-2cbed5e70a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:14.288714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9c27-eec0-4934-b2bd-2cbed5e70a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:14.291662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9c27-eec0-4934-b2bd-2cbed5e70a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:14.292521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c9c27-eec0-4934-b2bd-2cbed5e70a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:14.298856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c9c27-eec0-4934-b2bd-2cbed5e70a19 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:14.332333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:14.332707 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3288/6533] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:31:14.351638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43575c-d6d2-4a10-8646-230f75c841bc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:14.376864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:14.378375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:14.378652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:14.378924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] PATH_INFO: `/v3/projects/339ccfd2d87f4d789415b7dd0c2ee9f1/users/d254b53d2d764c0d9df592be6b132ea1/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:14.386598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] RBAC: Authorizing `identity:create_grant(project_id=339ccfd2d87f4d789415b7dd0c2ee9f1, user_id=d254b53d2d764c0d9df592be6b132ea1, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:14.389325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:14.424783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3246/6534] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:14 2022] PUT /identity/v3/projects/339ccfd2d87f4d789415b7dd0c2ee9f1/users/d254b53d2d764c0d9df592be6b132ea1/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:14.430915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ca8a-7685-469e-b7f7-a92ae7225879 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:14.432032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ca8a-7685-469e-b7f7-a92ae7225879 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:14.432471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ca8a-7685-469e-b7f7-a92ae7225879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:14.502601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3fe6ca8a-7685-469e-b7f7-a92ae7225879 None None] MFA Rules not processed for user `d254b53d2d764c0d9df592be6b132ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:14.504161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3fe6ca8a-7685-469e-b7f7-a92ae7225879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:14.539342 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:14.679127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3289/6535] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:14.683525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:14.708216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ffda-4649-44f1-b672-9b5f8638353b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:14.720967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:14.721897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:14.722178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:14.722458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:14.724009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:14.725659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:14.772844 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3247/6536] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 11 01:31:14 2022] POST /identity/v3/domains => generated 276 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:14.774025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6ca8a-7685-469e-b7f7-a92ae7225879 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:14.789664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6ca8a-7685-469e-b7f7-a92ae7225879 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:15.076063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:15.076994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:15.077456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:15.077941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:15.080636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:15.084107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:15.128120 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3290/6537] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 11 01:31:14 2022] POST /identity/v3/domains => generated 277 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:15.131186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:15.165522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd3c8-da85-45d2-b030-868bf8231755 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:15.352379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:15.353022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:15.353331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:15.353654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:15.354350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:15.355973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:15.417768 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3248/6538] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 11 01:31:15 2022] POST /identity/v3/domains => generated 276 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:31:15.422282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:15.448668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e479-0150-4f05-97fb-9b51b7f16439 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:15.568689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:15.569419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:15.569720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:15.569992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:15.570663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:15.573936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:15.606486 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3291/6539] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 11 01:31:15 2022] POST /identity/v3/domains => generated 278 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:15.611392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:15.627496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5021-9e84-448f-a019-c180be45b444 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:15.826078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:15.826736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:15.826838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:15.827107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/0b5ef6c8fc774addbd436c5841f4f2f9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:15.856324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b5ef6c8fc774addbd436c5841f4f2f9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:15.858170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:15.894505 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:15.922998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:15.947290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.142372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9', 'request_id': 'req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.153098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9', 'request_id': 'req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.164007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9', 'request_id': 'req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.182377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] The token cache is being invalidate because project 0b5ef6c8fc774addbd436c5841f4f2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:16.183716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.184843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.202631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9', 'request_id': 'req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.203842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9', 'request_id': 'req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.209766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b5ef6c8fc774addbd436c5841f4f2f9', 'request_id': 'req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.222552 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3249/6540] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:15 2022] DELETE /identity/v3/domains/0b5ef6c8fc774addbd436c5841f4f2f9 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:16.223908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:16.225753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:16.265169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6eaf3-7546-471f-a5fb-142740803d5b tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:16.403630 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:16.464070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:16.464766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:16.469344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:16.469645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:16.471773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:16.475347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:16.545601 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3292/6541] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:31:16 2022] POST /identity/v3/domains => generated 249 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:16.550109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:16.567848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1c5c8-2f7a-4288-8c58-15ea65fc09d9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:16.724247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:16.725255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:16.725590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:16.731161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/4b4a254f529544db8ff24b20f72110cc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:16.782119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4b4a254f529544db8ff24b20f72110cc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:16.786661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:16.871099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4b4a254f529544db8ff24b20f72110cc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.871862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4b4a254f529544db8ff24b20f72110cc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.963757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4b4a254f529544db8ff24b20f72110cc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.965221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4b4a254f529544db8ff24b20f72110cc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:16.972592 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3250/6542] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:16 2022] PATCH /identity/v3/domains/4b4a254f529544db8ff24b20f72110cc => generated 250 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:16.976416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:16.980432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:17.005337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d05de6-c66c-4c5b-95dc-3521e0543771 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:17.165774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:17.166615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:17.167788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:17.168162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/4b4a254f529544db8ff24b20f72110cc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:17.180212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:17.182373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:17.237644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4b4a254f529544db8ff24b20f72110cc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:17.240944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:17.250659 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:17.327976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4b4a254f529544db8ff24b20f72110cc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.365622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4b4a254f529544db8ff24b20f72110cc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.462222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4a254f529544db8ff24b20f72110cc', 'request_id': 'req-1b983df0-0ab5-429a-8985-bd892f3e4288'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.477683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4a254f529544db8ff24b20f72110cc', 'request_id': 'req-1b983df0-0ab5-429a-8985-bd892f3e4288'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.499989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4a254f529544db8ff24b20f72110cc', 'request_id': 'req-1b983df0-0ab5-429a-8985-bd892f3e4288'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.507905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460168fe-3b5e-457f-b63b-f8cf62a73efd tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:17.553529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] The token cache is being invalidate because project 4b4a254f529544db8ff24b20f72110cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:17.554078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.556107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.585010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4b4a254f529544db8ff24b20f72110cc', 'request_id': 'req-1b983df0-0ab5-429a-8985-bd892f3e4288'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.587878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4b4a254f529544db8ff24b20f72110cc', 'request_id': 'req-1b983df0-0ab5-429a-8985-bd892f3e4288'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.588825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4b4a254f529544db8ff24b20f72110cc', 'request_id': 'req-1b983df0-0ab5-429a-8985-bd892f3e4288'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.611830 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3293/6543] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:16 2022] DELETE /identity/v3/domains/4b4a254f529544db8ff24b20f72110cc => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:17.615781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:17.621043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:17.659307 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:17.775705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:17.776292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:17.776557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:17.776829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:17.787841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:17.797119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983df0-0ab5-429a-8985-bd892f3e4288 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:17.810151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:17.811126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:17.811893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:17.812282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] PATH_INFO: `/v3/users/d3c2c29f78f7448087bb72779a6f1371` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:17.813823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c2c29f78f7448087bb72779a6f1371)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:17.818046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:17.869260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:17.872756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:17.911473 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3251/6544] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:31:17.913159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:17.917781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:17.972523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c2c29f78f7448087bb72779a6f1371'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.975046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c2c29f78f7448087bb72779a6f1371'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:17.977544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c2c29f78f7448087bb72779a6f1371'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:18.038295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c2c29f78f7448087bb72779a6f1371'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:18.068156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a31d20b9-934e-40e4-9e77-e357afe97701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c2c29f78f7448087bb72779a6f1371'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:18.104180 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3294/6545] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:17 2022] DELETE /identity/v3/users/d3c2c29f78f7448087bb72779a6f1371 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:18.105591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:18.105979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:18.106629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:18.135288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:18.136851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:18.139540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0ae6-e371-4c55-971e-10834fe3c1b2 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:18.299708 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:18.320533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:18.321196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:18.321489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:18.321758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:18.322439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:18.329374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:18.399599 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3252/6546] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:31:17 2022] POST /identity/v3/domains => generated 278 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:18.400502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:18.411509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:18.429312 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3295/6547] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:18.573275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:18.575570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:18.656293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0ca35-558a-430b-8444-0f3b8273d35a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:18.667216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:18.667985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:18.668337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:18.668632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ec0766f69004d7684105c30aee774b9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:18.693557 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:18.709795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9ec0766f69004d7684105c30aee774b9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:18.711671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:18.783753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9ec0766f69004d7684105c30aee774b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:18.785568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9ec0766f69004d7684105c30aee774b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:18.847539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f3b08-7c8d-483e-a4cf-469980e83166 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:18.862736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9ec0766f69004d7684105c30aee774b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:18.865788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9ec0766f69004d7684105c30aee774b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:18.881241 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3253/6548] 10.222.0.16 () {60 vars in 1250 bytes} [Sun Sep 11 01:31:18 2022] PATCH /identity/v3/domains/9ec0766f69004d7684105c30aee774b9 => generated 278 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:18.885245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:18.886689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:19.030620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:19.031295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:19.036316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:19.036874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:19.043457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:19.083136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edefd58-8b82-4022-8b48-1b921c6cdea4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:19.100215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:19.100887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:19.101194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:19.101470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ec0766f69004d7684105c30aee774b9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:19.150923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=9ec0766f69004d7684105c30aee774b9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:19.154285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:19.160742 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3254/6549] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:31:18 2022] GET /identity/v3/domains/9ec0766f69004d7684105c30aee774b9 => generated 278 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:19.162704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:19.187424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926260b3-1fde-4d2b-a23d-8cdc5930a530 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:19.199578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:19.202751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:19.203030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:19.203311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ec0766f69004d7684105c30aee774b9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:19.206250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9ec0766f69004d7684105c30aee774b9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:19.207921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:19.231814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:19.234387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:19.259488 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3296/6550] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:31:19.261561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9ec0766f69004d7684105c30aee774b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.274799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9ec0766f69004d7684105c30aee774b9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.284817 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:19.399884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec0766f69004d7684105c30aee774b9', 'request_id': 'req-edf17779-a1cf-422d-a513-d6acb75db7f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.424894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec0766f69004d7684105c30aee774b9', 'request_id': 'req-edf17779-a1cf-422d-a513-d6acb75db7f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.451446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec0766f69004d7684105c30aee774b9', 'request_id': 'req-edf17779-a1cf-422d-a513-d6acb75db7f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.478816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] The token cache is being invalidate because project 9ec0766f69004d7684105c30aee774b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:19.479168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.480628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.506631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:19.508074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:19.508705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9ec0766f69004d7684105c30aee774b9', 'request_id': 'req-edf17779-a1cf-422d-a513-d6acb75db7f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.513398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9ec0766f69004d7684105c30aee774b9', 'request_id': 'req-edf17779-a1cf-422d-a513-d6acb75db7f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.518394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9ec0766f69004d7684105c30aee774b9', 'request_id': 'req-edf17779-a1cf-422d-a513-d6acb75db7f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:19.533626 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3255/6551] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:19 2022] DELETE /identity/v3/domains/9ec0766f69004d7684105c30aee774b9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:19.535390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:19.537992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:19.729918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0795bb-55f4-4e3e-80c5-9585526134f8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:19.730513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf17779-a1cf-422d-a513-d6acb75db7f9 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:19.744674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:19.746227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:19.746726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:19.747198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:19.748333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:19.753289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:19.801705 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3256/6552] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 11 01:31:19 2022] GET /identity/v3/domains => generated 1347 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:31:19.804276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:19.833634 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:19.838757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea6da6-e0e4-4842-be2e-406e17301267 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:19.857308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:19.858667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:19.858667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:19.858667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ec0766f69004d7684105c30aee774b9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:19.879208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find domain: 9ec0766f69004d7684105c30aee774b9.: keystone.exception.DomainNotFound: Could not find domain: 9ec0766f69004d7684105c30aee774b9. Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9ec0766f69004d7684105c30aee774b9. Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:19.887757 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:19.894715 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9ec0766f69004d7684105c30aee774b9. Sep 11 01:31:19.898763 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:19.899856 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3257/6553] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:19 2022] PATCH /identity/v3/domains/9ec0766f69004d7684105c30aee774b9 => generated 112 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:19.904529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:19.940144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:19.941444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15128b92-bb1c-4769-89fc-f23267145d51 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:19.945391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:19.946320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:19.946832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:19.951955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:19.964071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:19.964726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:19.965011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:19.965575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:19.968981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:19.974498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:19.983484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:19.990599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:20.027751 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3297/6554] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:31:20.044773 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3258/6555] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:31:19 2022] POST /identity/v3/domains => generated 277 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:20.049659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:20.068317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5222b2-d9a7-4caa-ba37-ffc88a3dbece service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:20.228140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:20.228779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:20.229084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:20.229373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:20.230023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:20.237983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:20.341762 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3298/6556] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:20 2022] POST /identity/v3/users => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:31:20.342204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:20.361559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a4c59-6676-418f-92fa-7c7fdcb314d2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:20.380871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:20.387870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:20.388296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:20.388769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:20.389752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:20.406233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:20.471381 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3259/6557] 10.222.0.16 () {60 vars in 1147 bytes} [Sun Sep 11 01:31:20 2022] POST /identity/v3/groups => generated 324 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:20.480272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:20.504680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8a4e-a135-442d-a29e-f3d846a02db0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:20.523491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:20.524160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:20.524440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:20.524712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:20.530423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9ae676ceb4894046b7c7b8d1901ce8b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:20.533226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:20.596967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:20.598093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:20.661267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:20.662403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:20.668307 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3299/6558] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:20 2022] PATCH /identity/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1 => generated 278 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:20.672231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:20.674283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:20.696113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb836a75-afd0-460f-b88f-56d186e31ae0 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:20.834581 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:20.932869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:20.935474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:20.935757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:20.936031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:20.941097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:20.942773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:20.967985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9ae676ceb4894046b7c7b8d1901ce8b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:20.974747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:21.039573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.048366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.085841 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:21.097557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed928439-43e4-40b8-b6e7-9cfe33692a91 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:21.114576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:21.116267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:21.117460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:21.118628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] PATH_INFO: `/v3/users/435d50630b1844408f0150077087877d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:21.122048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=435d50630b1844408f0150077087877d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:21.125333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:21.259295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435d50630b1844408f0150077087877d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.261513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435d50630b1844408f0150077087877d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.262283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435d50630b1844408f0150077087877d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.303270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435d50630b1844408f0150077087877d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.323034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435d50630b1844408f0150077087877d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.366166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3300/6559] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:20 2022] DELETE /identity/v3/users/435d50630b1844408f0150077087877d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:21.369558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:21.373285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:21.426204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebe4b908c1b34d7d9c6044bac0bf8ed6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.427833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebe4b908c1b34d7d9c6044bac0bf8ed6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.430829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebe4b908c1b34d7d9c6044bac0bf8ed6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.450730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebe4b908c1b34d7d9c6044bac0bf8ed6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.478747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebe4b908c1b34d7d9c6044bac0bf8ed6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.540191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a508d-6331-4cfb-a712-3192a236ca5a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:21.544567 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:21.605645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1', 'request_id': 'req-5478343e-033a-4948-a546-11af853981ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.630633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1', 'request_id': 'req-5478343e-033a-4948-a546-11af853981ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.675296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1', 'request_id': 'req-5478343e-033a-4948-a546-11af853981ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.697496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] The token cache is being invalidate because project 9ae676ceb4894046b7c7b8d1901ce8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:21.697700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.698275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.723680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1', 'request_id': 'req-5478343e-033a-4948-a546-11af853981ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.724702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1', 'request_id': 'req-5478343e-033a-4948-a546-11af853981ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.728724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9ae676ceb4894046b7c7b8d1901ce8b1', 'request_id': 'req-5478343e-033a-4948-a546-11af853981ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.740314 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3260/6560] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:20 2022] DELETE /identity/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1 => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:21.744017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:21.745558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:21.784429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:21.785192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:21.785474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:21.785762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] PATH_INFO: `/v3/projects/04d251fede3d492f962aaa0ea2de10c5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:21.796371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d251fede3d492f962aaa0ea2de10c5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:21.807739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:21.878947 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:21.954794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d251fede3d492f962aaa0ea2de10c5', 'request_id': 'req-0edec343-151c-45e0-84b6-baf5c0def814'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.976362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d251fede3d492f962aaa0ea2de10c5', 'request_id': 'req-0edec343-151c-45e0-84b6-baf5c0def814'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:21.983328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478343e-033a-4948-a546-11af853981ad tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:21.996376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d251fede3d492f962aaa0ea2de10c5', 'request_id': 'req-0edec343-151c-45e0-84b6-baf5c0def814'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.029857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] The token cache is being invalidate because project 04d251fede3d492f962aaa0ea2de10c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:22.030152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.031021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.037975 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3301/6561] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:21 2022] DELETE /identity/v3/projects/04d251fede3d492f962aaa0ea2de10c5 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:22.038916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:22.040401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:22.206255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de76fe-3c07-4473-8d2b-00c594630227 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:22.207196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de76fe-3c07-4473-8d2b-00c594630227 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:22.207543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de76fe-3c07-4473-8d2b-00c594630227 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:22.207830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de76fe-3c07-4473-8d2b-00c594630227 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:22.241682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de76fe-3c07-4473-8d2b-00c594630227 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=9ae676ceb4894046b7c7b8d1901ce8b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:22.245274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de76fe-3c07-4473-8d2b-00c594630227 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:22.281233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edec343-151c-45e0-84b6-baf5c0def814 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:22.305810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:22.310462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:22.310954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:22.311473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] PATH_INFO: `/v3/users/07d17df90a3e4cd6a0cce3e3d44d3ceb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-09de76fe-3c07-4473-8d2b-00c594630227 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1.: keystone.exception.DomainNotFound: Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:22.314663 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:22.315634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:22.316588 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:22.319632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d17df90a3e4cd6a0cce3e3d44d3ceb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:22.323920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:22.324190 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3261/6562] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:31:21 2022] GET /identity/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1 => generated 112 bytes in 580 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:31:22.326066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:22.326571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:22.327357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:22.429849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:22.431288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:22.441853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d17df90a3e4cd6a0cce3e3d44d3ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.442564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d17df90a3e4cd6a0cce3e3d44d3ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.443691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d17df90a3e4cd6a0cce3e3d44d3ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.448413 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3262/6563] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:22.450293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:22.452243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:22.462609 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:22.478415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d17df90a3e4cd6a0cce3e3d44d3ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.482190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267dd84-7105-4b1f-b255-5e18c4ce2a8c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:22.493612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:22.494481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:22.494826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:22.495167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] PATH_INFO: `/v3/projects/e58cba4a61144e20a72bcb6f7e90b727` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:22.496770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58cba4a61144e20a72bcb6f7e90b727)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:22.499143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:22.503932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d17df90a3e4cd6a0cce3e3d44d3ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.562138 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3302/6564] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:22 2022] DELETE /identity/v3/users/07d17df90a3e4cd6a0cce3e3d44d3ceb => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:22.563122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:22.565371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:22.629695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58cba4a61144e20a72bcb6f7e90b727', 'request_id': 'req-1d2f838f-2984-49bc-bc8a-d1887b036fee'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.654869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58cba4a61144e20a72bcb6f7e90b727', 'request_id': 'req-1d2f838f-2984-49bc-bc8a-d1887b036fee'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.694875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58cba4a61144e20a72bcb6f7e90b727', 'request_id': 'req-1d2f838f-2984-49bc-bc8a-d1887b036fee'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.730790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] The token cache is being invalidate because project e58cba4a61144e20a72bcb6f7e90b727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:22.731063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.732736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1d2f838f-2984-49bc-bc8a-d1887b036fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:22.737890 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3263/6565] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:22 2022] DELETE /identity/v3/projects/e58cba4a61144e20a72bcb6f7e90b727 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:22.742920 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:22.744954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:22.747384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:22.747687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:22.834517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2bff3-57d1-40a7-b3da-ed528342486a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:22.835922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:22.839451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:22.856194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:22.857426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:22.859663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:22.860155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/users/ebe4b908c1b34d7d9c6044bac0bf8ed6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:22.897926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:get_user(user_id=ebe4b908c1b34d7d9c6044bac0bf8ed6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:22.907233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find user: ebe4b908c1b34d7d9c6044bac0bf8ed6.: keystone.exception.UserNotFound: Could not find user: ebe4b908c1b34d7d9c6044bac0bf8ed6. Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 01:31:22.943032 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:22.944115 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ebe4b908c1b34d7d9c6044bac0bf8ed6. Sep 11 01:31:22.945258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:22.948639 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3303/6566] 10.222.0.16 () {58 vars in 1221 bytes} [Sun Sep 11 01:31:22 2022] GET /identity/v3/users/ebe4b908c1b34d7d9c6044bac0bf8ed6 => generated 110 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:22.949978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:22.953909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:23.067227 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3264/6567] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:23.070509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:23.079036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:23.132714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01990-8ffa-4eb3-af31-259ee86e485a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:23.155017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:23.155904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:23.156379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:23.156840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/groups/8298d30a28dd458faeddf181a5da118a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:23.170864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:get_group(group_id=8298d30a28dd458faeddf181a5da118a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:23.172716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:23.198301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890ace6-9075-445d-acd2-47a7c2f282de tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find group: 8298d30a28dd458faeddf181a5da118a.: keystone.exception.GroupNotFound: Could not find group: 8298d30a28dd458faeddf181a5da118a. Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_group(group_id) Sep 11 01:31:23.208601 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:23.209857 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 8298d30a28dd458faeddf181a5da118a. Sep 11 01:31:23.210746 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:23.211409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:23.211504 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3265/6568] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:23 2022] GET /identity/v3/groups/8298d30a28dd458faeddf181a5da118a => generated 111 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:23.211575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:23.211575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:23.211575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] PATH_INFO: `/v3/users/1464d40f7c3f48a29cd90b7882c2afac` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:23.216192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1464d40f7c3f48a29cd90b7882c2afac)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:23.218279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:23.220562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:23.246335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f412c-068b-4ffa-928e-d995b9334d04 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:23.253990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:23.254623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:23.254956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:23.255403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:23.256709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:23.257098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:23.258721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:23.284111 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3266/6569] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:23.285156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:23.293651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:23.328102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1464d40f7c3f48a29cd90b7882c2afac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.329333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1464d40f7c3f48a29cd90b7882c2afac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.330450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1464d40f7c3f48a29cd90b7882c2afac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.331615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8a3db-a223-4adb-932b-2c4e681b2e52 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:23.339560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:23.340240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:23.340523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:23.340799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] PATH_INFO: `/v3/projects/c258328650ba471fa589e32968c85bf0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:23.347214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c258328650ba471fa589e32968c85bf0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:23.349195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:23.368327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1464d40f7c3f48a29cd90b7882c2afac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.385137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1464d40f7c3f48a29cd90b7882c2afac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.414345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3304/6570] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:22 2022] DELETE /identity/v3/users/1464d40f7c3f48a29cd90b7882c2afac => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:23.418679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:23.423719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:23.468787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c258328650ba471fa589e32968c85bf0', 'request_id': 'req-a28f829b-8f54-4888-8404-57538c936e77'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.483843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c258328650ba471fa589e32968c85bf0', 'request_id': 'req-a28f829b-8f54-4888-8404-57538c936e77'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.486125 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:23.509406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c258328650ba471fa589e32968c85bf0', 'request_id': 'req-a28f829b-8f54-4888-8404-57538c936e77'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.528613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] The token cache is being invalidate because project c258328650ba471fa589e32968c85bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:23.528613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.529458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:23.532004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3267/6571] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:23 2022] DELETE /identity/v3/projects/c258328650ba471fa589e32968c85bf0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:23.538017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:23.541812 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:23.542435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:23.596444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ff9bc-35e7-472b-a614-cf54455b19a8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:23.746985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b00e-4b9e-4d04-b544-0bec5b2d0552 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:23.747744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b00e-4b9e-4d04-b544-0bec5b2d0552 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:23.748128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b00e-4b9e-4d04-b544-0bec5b2d0552 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:23.748470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b00e-4b9e-4d04-b544-0bec5b2d0552 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/groups/8298d30a28dd458faeddf181a5da118a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:23.749012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f829b-8f54-4888-8404-57538c936e77 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:23.761670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:23.762652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:23.763153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:23.763643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:23.764496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:23.770420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b00e-4b9e-4d04-b544-0bec5b2d0552 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:31:23.771260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-6fa8b00e-4b9e-4d04-b544-0bec5b2d0552 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find group: 8298d30a28dd458faeddf181a5da118a.: keystone.exception.GroupNotFound: Could not find group: 8298d30a28dd458faeddf181a5da118a. Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Sep 11 01:31:23.778764 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:23.779664 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 8298d30a28dd458faeddf181a5da118a. Sep 11 01:31:23.780583 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:23.808623 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3305/6572] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:31:23 2022] DELETE /identity/v3/groups/8298d30a28dd458faeddf181a5da118a => generated 111 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:23.836823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a916df-395a-4be2-b3da-b54fc70fe1e0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:23.837137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a916df-395a-4be2-b3da-b54fc70fe1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:23.838411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a916df-395a-4be2-b3da-b54fc70fe1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:23.856005 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3268/6573] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:23 2022] POST /identity/v3/projects => generated 359 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:23.857023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:23.861930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:23.897593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-04a916df-395a-4be2-b3da-b54fc70fe1e0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:23.899441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-04a916df-395a-4be2-b3da-b54fc70fe1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:24.055630 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3306/6574] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:24.056895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a916df-395a-4be2-b3da-b54fc70fe1e0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:24.072072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26df33-6ceb-4de0-98ad-d619e3c63f00 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.083157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a916df-395a-4be2-b3da-b54fc70fe1e0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.096079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.096712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.096989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.097303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.098558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:24.099848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:24.107506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba0539-92f7-4cc9-925b-e418ef1d55d5 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.109017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba0539-92f7-4cc9-925b-e418ef1d55d5 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.109564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba0539-92f7-4cc9-925b-e418ef1d55d5 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.110053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba0539-92f7-4cc9-925b-e418ef1d55d5 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/users/ebe4b908c1b34d7d9c6044bac0bf8ed6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.139315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba0539-92f7-4cc9-925b-e418ef1d55d5 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ebe4b908c1b34d7d9c6044bac0bf8ed6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:24.146368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba0539-92f7-4cc9-925b-e418ef1d55d5 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:24.150310 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3307/6575] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:24 2022] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:24.150310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:24.153836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1bba0539-92f7-4cc9-925b-e418ef1d55d5 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find user: ebe4b908c1b34d7d9c6044bac0bf8ed6.: keystone.exception.UserNotFound: Could not find user: ebe4b908c1b34d7d9c6044bac0bf8ed6. Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Sep 11 01:31:24.187395 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:24.188259 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ebe4b908c1b34d7d9c6044bac0bf8ed6. Sep 11 01:31:24.189802 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:24.194688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3269/6576] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:23 2022] DELETE /identity/v3/users/ebe4b908c1b34d7d9c6044bac0bf8ed6 => generated 110 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:24.196512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafaf5f-a0c0-41f2-bc9c-4867a0f4aeb9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.196791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafaf5f-a0c0-41f2-bc9c-4867a0f4aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.197089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafaf5f-a0c0-41f2-bc9c-4867a0f4aeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.199941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b78cd-6d17-4a2e-8811-b4107701b4d9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.216079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.217015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.217539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.218028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] PATH_INFO: `/v3/projects/00ea505e433c4f92947b5748d0f5ef83` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.219579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ea505e433c4f92947b5748d0f5ef83)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:24.222576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:24.270796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3eafaf5f-a0c0-41f2-bc9c-4867a0f4aeb9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:24.272757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3eafaf5f-a0c0-41f2-bc9c-4867a0f4aeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:24.307621 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3270/6577] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:24.308805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafaf5f-a0c0-41f2-bc9c-4867a0f4aeb9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:24.367984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ea505e433c4f92947b5748d0f5ef83', 'request_id': 'req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:24.377013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafaf5f-a0c0-41f2-bc9c-4867a0f4aeb9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.391109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ea505e433c4f92947b5748d0f5ef83', 'request_id': 'req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:24.442427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ea505e433c4f92947b5748d0f5ef83', 'request_id': 'req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:24.468941 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:24.483216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] The token cache is being invalidate because project 00ea505e433c4f92947b5748d0f5ef83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:24.483975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:24.488065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:24.511596 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3308/6578] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:24 2022] DELETE /identity/v3/projects/00ea505e433c4f92947b5748d0f5ef83 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:24.511596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:24.511596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:24.679962 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:24.724255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.729563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.730037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.730481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.736201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:24.742976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:24.758028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40523f-9f11-4017-ac2d-cfd0b2fa0492 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.775387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.775963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.776314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.776593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.788784 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3271/6579] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:24.793718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:24.803103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:24.812891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:31:24.842657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90266500-266a-49c1-9e99-8b7026975487 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1.: keystone.exception.DomainNotFound: Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:24.842991 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:24.843929 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:24.844841 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:24.848108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3309/6580] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:24 2022] PATCH /identity/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1 => generated 112 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:24.849182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:24.851363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:24.875801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.877269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.877552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.877826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.878513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:24.878816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:24.880484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:24.919181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39499c67-610f-4533-b6f4-76186004e82a tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.925253 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3272/6581] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:24.926340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:24.954945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.959094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.959569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.962774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.963495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:24.963925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f51095-84e7-47dd-8518-eb0d2c1cdf0f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:24.966055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:24.990513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:24.991163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:24.991444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:24.991717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:24.993154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:24.998640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:25.011520 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3310/6582] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:25.037035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:25.051239 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3273/6583] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 11 01:31:24 2022] GET /identity/v3/domains => generated 1347 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:25.058471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:25.061202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd572961-67e1-4675-81a2-99607379b468 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:25.069178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:25.070098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:25.070603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:25.071049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:25.073914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:25.081746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a595-0c64-4db0-beae-60c65eacbdf4 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:25.090858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:25.098186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:25.099636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:25.101968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:25.102253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] PATH_INFO: `/v3/projects/f49f9460e3924c399bba6e684f72dba0/users/05f56b1ad3bd44c4b9db2c4daa797898/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:25.145490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49f9460e3924c399bba6e684f72dba0, user_id=05f56b1ad3bd44c4b9db2c4daa797898, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:25.157443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:25.213114 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3311/6584] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:25 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:25.214082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:25.217873 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3274/6585] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:25 2022] PUT /identity/v3/projects/f49f9460e3924c399bba6e684f72dba0/users/05f56b1ad3bd44c4b9db2c4daa797898/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:25.220240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:25.390744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403800c0-633c-4b94-838a-fa2f8793771c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:25.428404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a096d0-1e07-4bf8-b297-df902f709e0d tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:25.436904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a096d0-1e07-4bf8-b297-df902f709e0d tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:25.438218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a096d0-1e07-4bf8-b297-df902f709e0d tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:25.438218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a096d0-1e07-4bf8-b297-df902f709e0d tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:25.440138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a096d0-1e07-4bf8-b297-df902f709e0d tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:25.441229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a096d0-1e07-4bf8-b297-df902f709e0d tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:25.442118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a096d0-1e07-4bf8-b297-df902f709e0d tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:25.470846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe702056-eccd-4da8-b18c-dc7631c8a0a2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:25.505535 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3312/6586] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:25 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:25.505535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a212f1-cb4a-47e3-bd8e-e463779b7c36 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:25.505535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a212f1-cb4a-47e3-bd8e-e463779b7c36 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:25.505535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a212f1-cb4a-47e3-bd8e-e463779b7c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:25.602118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d0a212f1-cb4a-47e3-bd8e-e463779b7c36 None None] MFA Rules not processed for user `05f56b1ad3bd44c4b9db2c4daa797898`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:25.603377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d0a212f1-cb4a-47e3-bd8e-e463779b7c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:25.752539 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:25.770634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:25.780213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:25.784898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:25.785242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:25.790560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:25.805132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:25.812759 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3313/6587] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:25.818905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a212f1-cb4a-47e3-bd8e-e463779b7c36 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:25.864982 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3275/6588] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:25 2022] POST /identity/v3/users => generated 289 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:25.866294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:25.867032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a212f1-cb4a-47e3-bd8e-e463779b7c36 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:25.874039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:25.894605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:25.899181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:25.899181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:25.899402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:25.900034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1421832334) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:25.900209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:25.901878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:25.952732 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3314/6589] 10.222.0.16 () {58 vars in 1199 bytes} [Sun Sep 11 01:31:25 2022] GET /identity/v3/domains?name=tempest-test_domain-1421832334 => generated 408 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:25.959116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:25.999700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77490ee-2b8b-42ba-9cdc-f1534300cd36 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:26.013770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:26.014928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.016823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.021874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.022849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:26.024730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:26.050754 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:26.071203 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3315/6590] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:26.073101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:26.117743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf0a15-3c84-43c8-b8ea-b57a67a6ed3e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:26.119503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686aae8-2e28-40b5-9d9f-3f17cb004b47 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:26.131806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:26.132450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.132735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.133012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.138177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:26.138733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.139006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.139286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.164882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:26.166384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:26.169760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1.: keystone.exception.DomainNotFound: Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:26.177258 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:26.178209 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9ae676ceb4894046b7c7b8d1901ce8b1. Sep 11 01:31:26.179118 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:26.187960 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3316/6591] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:26 2022] PATCH /identity/v3/domains/9ae676ceb4894046b7c7b8d1901ce8b1 => generated 112 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:26.190523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:26.200732 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3276/6592] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:26.201904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:26.216794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf1dfa-f1a4-4a69-a0d3-dcd6e10a29f6 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:26.224668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091007-7294-415a-be0d-dd4b688904ae service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:26.225987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:26.226601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.227392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.227661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.229400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:26.231043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:26.239380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:26.240029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.240316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.240592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/8675a355e9be41d8bac8eed35c6f9dd1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.274133 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3317/6593] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:26.279007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:26.290386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8675a355e9be41d8bac8eed35c6f9dd1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:26.292258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:26.323004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de2bb2-d925-4ee1-80ef-7bb3d9ee7117 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:26.349979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d33cd-177d-434e-9a02-5a178ba27837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:26.350701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d33cd-177d-434e-9a02-5a178ba27837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.350984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d33cd-177d-434e-9a02-5a178ba27837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.353518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d33cd-177d-434e-9a02-5a178ba27837 admin admin] PATH_INFO: `/v3/projects/18531961a43f499fbc80225398a26996/users/ea477d27693440a9a41d0aa12db57a9b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.408458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d33cd-177d-434e-9a02-5a178ba27837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18531961a43f499fbc80225398a26996, user_id=ea477d27693440a9a41d0aa12db57a9b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:26.411868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d33cd-177d-434e-9a02-5a178ba27837 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:26.468489 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3318/6594] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:26 2022] PUT /identity/v3/projects/18531961a43f499fbc80225398a26996/users/ea477d27693440a9a41d0aa12db57a9b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:26.471881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f078c2-e1b8-40b3-a68a-4bf6a1676669 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.472174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f078c2-e1b8-40b3-a68a-4bf6a1676669 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.472457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f078c2-e1b8-40b3-a68a-4bf6a1676669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.493884 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3277/6595] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:26 2022] PATCH /identity/v3/domains/8675a355e9be41d8bac8eed35c6f9dd1 => generated 276 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:26.495151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:26.538816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1426a-97c2-4105-9bc9-e1d525758fc2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:26.562539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-72f078c2-e1b8-40b3-a68a-4bf6a1676669 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:26.564414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-72f078c2-e1b8-40b3-a68a-4bf6a1676669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:26.740841 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3319/6596] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:26.749424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:26.753290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:26.756274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:26.757668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/8675a355e9be41d8bac8eed35c6f9dd1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:26.789935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8675a355e9be41d8bac8eed35c6f9dd1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:26.795710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:26.887712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:26.894898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:26.936740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f078c2-e1b8-40b3-a68a-4bf6a1676669 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:27.000909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1', 'request_id': 'req-3d04a17b-1373-4c03-913f-4ec62e9cbd96'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.017693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1', 'request_id': 'req-3d04a17b-1373-4c03-913f-4ec62e9cbd96'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.039325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1', 'request_id': 'req-3d04a17b-1373-4c03-913f-4ec62e9cbd96'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.045659 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:27.064543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] The token cache is being invalidate because project 8675a355e9be41d8bac8eed35c6f9dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:27.064744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.065831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.096510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f078c2-e1b8-40b3-a68a-4bf6a1676669 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:27.099091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1', 'request_id': 'req-3d04a17b-1373-4c03-913f-4ec62e9cbd96'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.101074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1', 'request_id': 'req-3d04a17b-1373-4c03-913f-4ec62e9cbd96'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.110716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8675a355e9be41d8bac8eed35c6f9dd1', 'request_id': 'req-3d04a17b-1373-4c03-913f-4ec62e9cbd96'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.129276 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3278/6597] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:26 2022] DELETE /identity/v3/domains/8675a355e9be41d8bac8eed35c6f9dd1 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:27.130203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:27.132921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:27.230193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:27.269467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:27.270187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:27.270748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:27.272284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:27.274538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:27.288588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04a17b-1373-4c03-913f-4ec62e9cbd96 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:27.317988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:27.318658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:27.321268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:27.321635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/f5345ceb789e42879776c2a81241b64c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:27.349870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f5345ceb789e42879776c2a81241b64c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:27.354476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:27.418028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f5345ceb789e42879776c2a81241b64c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.419397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f5345ceb789e42879776c2a81241b64c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.443818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:27.449784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:27.477005 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3320/6598] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:27.479582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f5345ceb789e42879776c2a81241b64c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.481323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f5345ceb789e42879776c2a81241b64c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:27.484429 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3279/6599] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:27 2022] PATCH /identity/v3/domains/f5345ceb789e42879776c2a81241b64c => generated 278 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:27.488626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:27.523799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824ec2-6cd3-45de-b27b-d10e5eaf0d13 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:27.894450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:27.895124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:27.909295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:27.910059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/f5345ceb789e42879776c2a81241b64c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:27.950715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f5345ceb789e42879776c2a81241b64c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:27.973578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:28.013523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f5345ceb789e42879776c2a81241b64c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.033015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f5345ceb789e42879776c2a81241b64c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.218439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5345ceb789e42879776c2a81241b64c', 'request_id': 'req-15e76a07-dd0a-4904-a2c0-a22a79e288af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.229962 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:28.234568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5345ceb789e42879776c2a81241b64c', 'request_id': 'req-15e76a07-dd0a-4904-a2c0-a22a79e288af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.247149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5345ceb789e42879776c2a81241b64c', 'request_id': 'req-15e76a07-dd0a-4904-a2c0-a22a79e288af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.278430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] The token cache is being invalidate because project f5345ceb789e42879776c2a81241b64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:28.278921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.286500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.301053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f5345ceb789e42879776c2a81241b64c', 'request_id': 'req-15e76a07-dd0a-4904-a2c0-a22a79e288af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.301638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f5345ceb789e42879776c2a81241b64c', 'request_id': 'req-15e76a07-dd0a-4904-a2c0-a22a79e288af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.303048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f5345ceb789e42879776c2a81241b64c', 'request_id': 'req-15e76a07-dd0a-4904-a2c0-a22a79e288af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.321324 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3321/6600] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:27 2022] DELETE /identity/v3/domains/f5345ceb789e42879776c2a81241b64c => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:28.325713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:28.328859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:28.366597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45041790-7ccf-4292-9f8c-c2893bb9ecab tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:28.580506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:28.581365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:28.581470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:28.581707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/877bec616ba94c40aae87ab119b39315` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:28.619091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=877bec616ba94c40aae87ab119b39315)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:28.620626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:28.673373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '877bec616ba94c40aae87ab119b39315'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.675818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '877bec616ba94c40aae87ab119b39315'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.684920 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:28.761309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '877bec616ba94c40aae87ab119b39315'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.763917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '877bec616ba94c40aae87ab119b39315'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:28.767914 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3280/6601] 10.222.0.16 () {60 vars in 1249 bytes} [Sun Sep 11 01:31:28 2022] PATCH /identity/v3/domains/877bec616ba94c40aae87ab119b39315 => generated 277 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:28.772036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:28.773753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:28.796123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e76a07-dd0a-4904-a2c0-a22a79e288af tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:28.998760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd254b53d2d764c0d9df592be6b132ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:28.999421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:28.999708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:29.002189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] PATH_INFO: `/v3/domains/877bec616ba94c40aae87ab119b39315` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:29.073606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=877bec616ba94c40aae87ab119b39315)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:29.075908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:29.126471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:29.128288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:29.151993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '877bec616ba94c40aae87ab119b39315'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.189199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '877bec616ba94c40aae87ab119b39315'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.317817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877bec616ba94c40aae87ab119b39315', 'request_id': 'req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.333015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877bec616ba94c40aae87ab119b39315', 'request_id': 'req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.350660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522c0f4-47ed-4654-9796-201e34dccae2 tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:29.354210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877bec616ba94c40aae87ab119b39315', 'request_id': 'req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.405913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] The token cache is being invalidate because project 877bec616ba94c40aae87ab119b39315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:29.406401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.411392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.426341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '877bec616ba94c40aae87ab119b39315', 'request_id': 'req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.428363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '877bec616ba94c40aae87ab119b39315', 'request_id': 'req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.430568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '877bec616ba94c40aae87ab119b39315', 'request_id': 'req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.454652 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:29.470905 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3322/6602] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:28 2022] DELETE /identity/v3/domains/877bec616ba94c40aae87ab119b39315 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:29.490698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:29.494367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:29.623061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:29.624104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:29.624466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:29.624741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] PATH_INFO: `/v3/users/e4d263e82c604e3b8838b7d2754f5f6d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:29.630736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d263e82c604e3b8838b7d2754f5f6d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:29.636612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:29.831072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4e24-cc5e-4a2e-b1d0-4acb264571eb tempest-DomainsTestJSON-1556267566 tempest-DomainsTestJSON-1556267566-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:29.864541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:29.865853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:29.871829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:29.873770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] PATH_INFO: `/v3/users/cdd0e158e15c43bf8353ae4dfa43951d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:29.880507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd0e158e15c43bf8353ae4dfa43951d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:29.894625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d263e82c604e3b8838b7d2754f5f6d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.895742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:29.899721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d263e82c604e3b8838b7d2754f5f6d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.900429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d263e82c604e3b8838b7d2754f5f6d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:29.955084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d263e82c604e3b8838b7d2754f5f6d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:30.055929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e3916fcd-eb33-4397-a367-0c155ba66134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d263e82c604e3b8838b7d2754f5f6d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:30.063965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd0e158e15c43bf8353ae4dfa43951d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:30.066685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd0e158e15c43bf8353ae4dfa43951d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:30.069870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd0e158e15c43bf8353ae4dfa43951d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:30.107353 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3281/6603] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:29 2022] DELETE /identity/v3/users/e4d263e82c604e3b8838b7d2754f5f6d => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:30.116044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd0e158e15c43bf8353ae4dfa43951d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:30.131057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd0e158e15c43bf8353ae4dfa43951d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:30.155121 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3323/6604] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:29 2022] DELETE /identity/v3/users/cdd0e158e15c43bf8353ae4dfa43951d => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:30.159925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:30.160209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:30.160732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:30.192076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:30.192635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:30.197055 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:30.411679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3282/6605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:30.437340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:30.440490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:30.611679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fcc11-ebe3-4094-bba8-4b7bb53605bb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:30.616238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:30.617051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:30.617690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:30.618057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:30.641032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:30.643564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:30.675454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3324/6606] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:31:31.269900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:31.271395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:31.300329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88fd2-e9a8-4853-bf0d-31e4531b3610 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:31.305410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:31.306145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:31.306421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:31.306697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] PATH_INFO: `/v3/projects/9f32577bf1654f22a81c18cc1ed8b1f2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:31.307922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f32577bf1654f22a81c18cc1ed8b1f2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:31.320540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:31.441534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f32577bf1654f22a81c18cc1ed8b1f2', 'request_id': 'req-284af701-30a2-4e5a-817e-33a9315b6314'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.460444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f32577bf1654f22a81c18cc1ed8b1f2', 'request_id': 'req-284af701-30a2-4e5a-817e-33a9315b6314'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.504249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f32577bf1654f22a81c18cc1ed8b1f2', 'request_id': 'req-284af701-30a2-4e5a-817e-33a9315b6314'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.557533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] The token cache is being invalidate because project 9f32577bf1654f22a81c18cc1ed8b1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:31.562391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.566048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.570435 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3283/6607] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:31 2022] DELETE /identity/v3/projects/9f32577bf1654f22a81c18cc1ed8b1f2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:31.574435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:31.598023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e6566-ea59-49ad-bde5-a7cf0019e555 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:31.659184 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:31.750593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:31.751309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:31.751600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:31.751874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] PATH_INFO: `/v3/users/4700ecda006b4db2b6e1c7a8b8470a47` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:31.753096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4700ecda006b4db2b6e1c7a8b8470a47)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:31.755085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:31.870758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4700ecda006b4db2b6e1c7a8b8470a47'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.871771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4700ecda006b4db2b6e1c7a8b8470a47'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.872577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4700ecda006b4db2b6e1c7a8b8470a47'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.931262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4700ecda006b4db2b6e1c7a8b8470a47'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.946190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0c8b35f8-e8fb-4eab-8317-e71ac18afcf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4700ecda006b4db2b6e1c7a8b8470a47'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:31.984072 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3325/6608] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:31 2022] DELETE /identity/v3/users/4700ecda006b4db2b6e1c7a8b8470a47 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:32.457106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:32.459429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:32.484026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284af701-30a2-4e5a-817e-33a9315b6314 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:32.646049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:32.648001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:32.648750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:32.650848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] PATH_INFO: `/v3/projects/bfb6fa49d00f40d39239f55694a53b45` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:32.656544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb6fa49d00f40d39239f55694a53b45)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:32.666368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:32.854012 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:32.950924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb6fa49d00f40d39239f55694a53b45', 'request_id': 'req-e79b3a78-be59-408f-b685-3a1820f236da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:32.977878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb6fa49d00f40d39239f55694a53b45', 'request_id': 'req-e79b3a78-be59-408f-b685-3a1820f236da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:32.995657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb6fa49d00f40d39239f55694a53b45', 'request_id': 'req-e79b3a78-be59-408f-b685-3a1820f236da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.016663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] The token cache is being invalidate because project bfb6fa49d00f40d39239f55694a53b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:33.016980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.018478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e79b3a78-be59-408f-b685-3a1820f236da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.020763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3284/6609] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:32 2022] DELETE /identity/v3/projects/bfb6fa49d00f40d39239f55694a53b45 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:33.025683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.026172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.026277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.060444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:33.064767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:33.213110 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3326/6610] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:33.218463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea70d4-f2b5-469a-8bae-66a76fa4b6a3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.218742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea70d4-f2b5-469a-8bae-66a76fa4b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.219012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea70d4-f2b5-469a-8bae-66a76fa4b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.249305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.251424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:33.256070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a3ea70d4-f2b5-469a-8bae-66a76fa4b6a3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:33.258456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a3ea70d4-f2b5-469a-8bae-66a76fa4b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:33.273366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7ce9c-b61e-4ec9-afdb-e109f2748a2f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.281343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.282801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.283293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.284499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] PATH_INFO: `/v3/projects/70dba58147c343c2b668a68634698612` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.285478 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3285/6611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:33.286549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea70d4-f2b5-469a-8bae-66a76fa4b6a3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.287203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70dba58147c343c2b668a68634698612)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.292816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.311939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea70d4-f2b5-469a-8bae-66a76fa4b6a3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.317591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.327946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.328618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.329226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.330130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:33.330587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.332565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.379964 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3286/6612] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:33.380927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.408851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43dda-71fc-45eb-a6d8-a25adf34029f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.418838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.430562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.430857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.431133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.431812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.434380 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:33.437593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.462554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70dba58147c343c2b668a68634698612', 'request_id': 'req-bee5220f-0024-4d92-9fdf-634957240a0b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.477356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70dba58147c343c2b668a68634698612', 'request_id': 'req-bee5220f-0024-4d92-9fdf-634957240a0b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.491922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70dba58147c343c2b668a68634698612', 'request_id': 'req-bee5220f-0024-4d92-9fdf-634957240a0b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.526651 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3287/6613] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:33 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:33.528535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.533335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] The token cache is being invalidate because project 70dba58147c343c2b668a68634698612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:33.533916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.535034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.542393 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3327/6614] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:33 2022] DELETE /identity/v3/projects/70dba58147c343c2b668a68634698612 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:33.548270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.552800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:33.706075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46a29-69f8-4a81-b0d8-8083c5de841d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.719258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5220f-0024-4d92-9fdf-634957240a0b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.725049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.726677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.727809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.728894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.730281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.756764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.756764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.756764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.757166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] PATH_INFO: `/v3/users/d254b53d2d764c0d9df592be6b132ea1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.758343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.761909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d254b53d2d764c0d9df592be6b132ea1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.777363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.824726 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3288/6615] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:33 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:33.832776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.838494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:33.880280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d72c01-d478-4367-8d59-3c22a1f529be admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:33.902397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:33.903041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:33.903328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:33.903646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:33.904413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:33.904578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd254b53d2d764c0d9df592be6b132ea1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.905460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd254b53d2d764c0d9df592be6b132ea1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.906315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:33.906422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd254b53d2d764c0d9df592be6b132ea1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.939319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd254b53d2d764c0d9df592be6b132ea1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.948893 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3289/6616] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:33.952926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:33.955186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:33.960619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd254b53d2d764c0d9df592be6b132ea1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:33.999793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea683c-93ae-466c-a317-efe1eaf446b7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:34.029459 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3328/6617] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:33 2022] DELETE /identity/v3/users/d254b53d2d764c0d9df592be6b132ea1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:34.191896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda634db-9129-42ee-8846-ece4a6d9a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:34.191896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda634db-9129-42ee-8846-ece4a6d9a73b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:34.191896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda634db-9129-42ee-8846-ece4a6d9a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:34.193798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda634db-9129-42ee-8846-ece4a6d9a73b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:34.194541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda634db-9129-42ee-8846-ece4a6d9a73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:34.196197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda634db-9129-42ee-8846-ece4a6d9a73b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:34.205983 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:34.247083 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3290/6618] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:31:34.254490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:34.272743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1468-8c18-410c-b928-9fab4655c64e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:34.287903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:34.289602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:34.289897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:34.290334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] PATH_INFO: `/v3/projects/e896bdebe5054594a74206d1e88fef0f/users/00182b4e371c476f9e1085d90615d4af/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:34.354944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e896bdebe5054594a74206d1e88fef0f, user_id=00182b4e371c476f9e1085d90615d4af, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:34.367864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:34.453413 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3329/6619] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:34 2022] PUT /identity/v3/projects/e896bdebe5054594a74206d1e88fef0f/users/00182b4e371c476f9e1085d90615d4af/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:34.458863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:34.459151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:34.459431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:34.547290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:34.549967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:34.705627 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3291/6620] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:34.737537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:34.739540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:34.798330 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:34.886006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e754ba-8d08-4e62-9aca-1b2a800866d0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:34.906150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8bcc8-8590-48ac-8c17-a8424486d6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:34.906894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8bcc8-8590-48ac-8c17-a8424486d6cb service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:34.921526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8bcc8-8590-48ac-8c17-a8424486d6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:34.921992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8bcc8-8590-48ac-8c17-a8424486d6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:34.958291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8bcc8-8590-48ac-8c17-a8424486d6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:34.959857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8bcc8-8590-48ac-8c17-a8424486d6cb service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:34.994551 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3330/6621] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:35.959837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:35.961773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:35.988565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94639f-1200-454b-ac53-ad93099dcb37 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:36.007467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:36.009281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:36.009863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:36.010330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] PATH_INFO: `/v3/projects/339ccfd2d87f4d789415b7dd0c2ee9f1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:36.013627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339ccfd2d87f4d789415b7dd0c2ee9f1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:36.018151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:36.124027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'request_id': 'req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:36.152873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'request_id': 'req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:36.177752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339ccfd2d87f4d789415b7dd0c2ee9f1', 'request_id': 'req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:36.225920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] The token cache is being invalidate because project 339ccfd2d87f4d789415b7dd0c2ee9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:36.226121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:36.226807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b8437c89-a4b3-4bc9-bdd6-9c536e11ac62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:36.240647 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3292/6622] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:35 2022] DELETE /identity/v3/projects/339ccfd2d87f4d789415b7dd0c2ee9f1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:36.242207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590756cc-b895-42be-aac6-5e6f1a268a9a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:36.242673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590756cc-b895-42be-aac6-5e6f1a268a9a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:36.242774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590756cc-b895-42be-aac6-5e6f1a268a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:36.314319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-590756cc-b895-42be-aac6-5e6f1a268a9a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:36.319018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-590756cc-b895-42be-aac6-5e6f1a268a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:36.540180 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3331/6623] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:31:36.548871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c32ffb-93b4-45e6-afb2-986c12e44a00 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:36.549182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c32ffb-93b4-45e6-afb2-986c12e44a00 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:36.549454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c32ffb-93b4-45e6-afb2-986c12e44a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:36.598974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c0c32ffb-93b4-45e6-afb2-986c12e44a00 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:36.600628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c0c32ffb-93b4-45e6-afb2-986c12e44a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:36.625508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3293/6624] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:36.627623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590756cc-b895-42be-aac6-5e6f1a268a9a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:36.651355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590756cc-b895-42be-aac6-5e6f1a268a9a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:36.670372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827b4a7-2c8c-472d-b303-ed031c8b1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:36.686880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b4a7-2c8c-472d-b303-ed031c8b1350 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:36.690347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b4a7-2c8c-472d-b303-ed031c8b1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:36.693029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b4a7-2c8c-472d-b303-ed031c8b1350 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:36.694006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b4a7-2c8c-472d-b303-ed031c8b1350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:36.694545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b4a7-2c8c-472d-b303-ed031c8b1350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:36.709133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b4a7-2c8c-472d-b303-ed031c8b1350 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:36.761535 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3332/6625] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:36.764071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c32ffb-93b4-45e6-afb2-986c12e44a00 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:36.779915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c32ffb-93b4-45e6-afb2-986c12e44a00 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:36.814810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:36.815196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:36.815477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:36.815744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:36.816743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:36.818880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:36.932327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6430ba-47a7-41ee-b4c7-e6706cd9af02 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:36.932778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6430ba-47a7-41ee-b4c7-e6706cd9af02 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:36.933189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6430ba-47a7-41ee-b4c7-e6706cd9af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:36.965749 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3294/6626] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:36 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:36.967115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:37.024967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7e6430ba-47a7-41ee-b4c7-e6706cd9af02 None None] MFA Rules not processed for user `00182b4e371c476f9e1085d90615d4af`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:37.028108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7e6430ba-47a7-41ee-b4c7-e6706cd9af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:37.197009 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:37.248026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4adb-4804-4322-b19c-5164152ba7dd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:37.274853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:37.279814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:37.282476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:37.291305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:37.295307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:37.297371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:37.396086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3333/6627] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:37.400002 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3295/6628] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:36 2022] POST /identity/v3/users => generated 284 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:37.405764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6430ba-47a7-41ee-b4c7-e6706cd9af02 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:37.433204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6430ba-47a7-41ee-b4c7-e6706cd9af02 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:37.446823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895d310-6059-4856-a91f-898bb7c07ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:37.447582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895d310-6059-4856-a91f-898bb7c07ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:37.447863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895d310-6059-4856-a91f-898bb7c07ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:37.448137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895d310-6059-4856-a91f-898bb7c07ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:37.448811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895d310-6059-4856-a91f-898bb7c07ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:37.450674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895d310-6059-4856-a91f-898bb7c07ff9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:37.496492 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3334/6629] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:37.500752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:37.508274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:37.508919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:37.509560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:37.548427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47964b86-450b-4677-a39b-8838578aa875 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:37.564491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:37.567187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:37.571221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:37.571518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:37.573230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:37.579539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:37.619994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] MFA Rules not processed for user `00182b4e371c476f9e1085d90615d4af`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:37.623189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:37.651444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3296/6630] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:37.653925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:37.657550 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3335/6631] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:37.672609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:37.675502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:37.710687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52741b34-af74-4842-96d8-eac952e25d4d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:37.718114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e2b71-a758-4623-af68-25ef984d8e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:37.719961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e2b71-a758-4623-af68-25ef984d8e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:37.720519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e2b71-a758-4623-af68-25ef984d8e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:37.721270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e2b71-a758-4623-af68-25ef984d8e19 admin admin] PATH_INFO: `/v3/projects/5050fd4cbaa849aeb3997893c2ccc405/users/fc49e65d0ff14ed58c5760a9093fcef6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:37.772449 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:37.791990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e2b71-a758-4623-af68-25ef984d8e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5050fd4cbaa849aeb3997893c2ccc405, user_id=fc49e65d0ff14ed58c5760a9093fcef6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:37.796325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e2b71-a758-4623-af68-25ef984d8e19 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:37.842882 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3297/6632] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:37 2022] PUT /identity/v3/projects/5050fd4cbaa849aeb3997893c2ccc405/users/fc49e65d0ff14ed58c5760a9093fcef6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:37.845181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd21d-bc5c-4c6c-88a6-c81ac638d166 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:37.845517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd21d-bc5c-4c6c-88a6-c81ac638d166 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:37.845726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd21d-bc5c-4c6c-88a6-c81ac638d166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:37.911766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6e5dd21d-bc5c-4c6c-88a6-c81ac638d166 None None] MFA Rules not processed for user `fc49e65d0ff14ed58c5760a9093fcef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:37.913463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6e5dd21d-bc5c-4c6c-88a6-c81ac638d166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:37.993205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8e15-7002-45bd-8f9b-133f10bd6440 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:38.061785 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3298/6633] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:31:38.070024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd21d-bc5c-4c6c-88a6-c81ac638d166 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:38.127546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:38.128679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.129019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.129269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:38.205526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd21d-bc5c-4c6c-88a6-c81ac638d166 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:38.224836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:38.225748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.226204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.226606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:38.227251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:38.229279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:38.249512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:38.251721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:38.269973 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3336/6634] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:38.302310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3299/6635] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:38 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:38.303487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:38.320344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72715-1f10-4b35-b193-30b8822d7d65 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:38.396518 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:38.444598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:38.445223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.445506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.445779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:38.446430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:38.448372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:38.497538 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3337/6636] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:38 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:38.501733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:38.523192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f4d61-de92-41db-826d-706c650555a2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:38.531670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:38.532585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.532864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.533193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:38.533917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:38.539115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:38.562739 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3300/6637] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:38.567405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:38.585898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c54b-7cd8-4e8e-a94f-2136a0de307d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:38.605748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:38.606442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.606722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.607513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] PATH_INFO: `/v3/projects/20478da2cd804882b5e611f2f28fe70c/users/8514a47f28e34e96ad926c3d67acd081/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:38.638036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20478da2cd804882b5e611f2f28fe70c, user_id=8514a47f28e34e96ad926c3d67acd081, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:38.640842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:38.672346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:38.673792 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3338/6638] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:38 2022] PUT /identity/v3/projects/20478da2cd804882b5e611f2f28fe70c/users/8514a47f28e34e96ad926c3d67acd081/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:38.687012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83dfbc-5fa9-408f-b1a6-ceddaf73acc3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:38.698629 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:38.820535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41e287-0110-4168-950b-41b1727776d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:38.821216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e287-0110-4168-950b-41b1727776d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.821500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e287-0110-4168-950b-41b1727776d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.821775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e287-0110-4168-950b-41b1727776d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:38.822437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41e287-0110-4168-950b-41b1727776d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:38.824065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41e287-0110-4168-950b-41b1727776d4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:38.846570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3301/6639] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:38.853892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:38.879968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d90e6-94ba-415b-973a-3eff6fb57718 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:38.894790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:38.896399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.896680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.898153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] PATH_INFO: `/v3/projects/20478da2cd804882b5e611f2f28fe70c/users/8514a47f28e34e96ad926c3d67acd081/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:38.912860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20478da2cd804882b5e611f2f28fe70c, user_id=8514a47f28e34e96ad926c3d67acd081, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:38.916017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:38.951288 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3339/6640] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:38 2022] PUT /identity/v3/projects/20478da2cd804882b5e611f2f28fe70c/users/8514a47f28e34e96ad926c3d67acd081/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:38.963956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3df777-895c-4ce9-a23f-9cbf5a969219 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:38.964235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3df777-895c-4ce9-a23f-9cbf5a969219 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:38.964514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3df777-895c-4ce9-a23f-9cbf5a969219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.029358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ef3df777-895c-4ce9-a23f-9cbf5a969219 None None] MFA Rules not processed for user `8514a47f28e34e96ad926c3d67acd081`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:39.030763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef3df777-895c-4ce9-a23f-9cbf5a969219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:39.248499 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3302/6641] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:39.254787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.282681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87c17d-0bd3-4a31-bd1f-b1cd06408376 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.292374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.292999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.293430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.293704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.294665 n-d-master-1 devstack@keystone.service[81859]: WARNING oslo_log.versionutils [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 11 01:31:39.295162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.296397 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:39.296397 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:31:39.296397 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:31:39.297305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.359406 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3340/6642] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:31:39 2022] POST /identity/v3/policies => generated 229 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:39.364331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3df777-895c-4ce9-a23f-9cbf5a969219 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.380789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3df777-895c-4ce9-a23f-9cbf5a969219 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.391248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.392378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.392893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.393395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies/1778316444bc43db96ec520ef8898487` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.394674 n-d-master-1 devstack@keystone.service[81860]: WARNING oslo_log.versionutils [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 11 01:31:39.395486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=1778316444bc43db96ec520ef8898487)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.401325 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:39.401325 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:31:39.401325 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:31:39.403008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.458177 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3303/6643] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 11 01:31:39 2022] PATCH /identity/v3/policies/1778316444bc43db96ec520ef8898487 => generated 237 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:39.462044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.474957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb5dae-16c6-433b-b695-bb580f745bdc tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.494757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.495503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.495848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.496191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies/1778316444bc43db96ec520ef8898487` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.497115 n-d-master-1 devstack@keystone.service[81859]: WARNING oslo_log.versionutils [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 11 01:31:39.497724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=1778316444bc43db96ec520ef8898487)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.499050 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:39.499050 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:31:39.499050 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:31:39.500039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.523145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3341/6644] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:39 2022] GET /identity/v3/policies/1778316444bc43db96ec520ef8898487 => generated 237 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:39.533136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.542543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eb6ed-1b9e-4021-80b5-6895f2b6100e tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.556174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.556918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.557865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.557865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies/1778316444bc43db96ec520ef8898487` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.558456 n-d-master-1 devstack@keystone.service[81860]: WARNING oslo_log.versionutils [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 11 01:31:39.559082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1778316444bc43db96ec520ef8898487)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.562428 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:39.562428 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:31:39.562428 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:31:39.563742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.613508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3304/6645] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:39 2022] DELETE /identity/v3/policies/1778316444bc43db96ec520ef8898487 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:39.618841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.635856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759591c-3f86-4e5b-af2a-4ef0b32719a4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.649936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.650583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.650864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.651143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.652721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.657529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.693414 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3342/6646] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:31:39 2022] POST /identity/v3/policies => generated 230 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:39.696252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.713911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05656f-e1f5-4637-9e9d-e122c5ac13c9 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.727861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.728501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.728785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.729099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.730109 n-d-master-1 devstack@keystone.service[81860]: WARNING oslo_log.versionutils [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 11 01:31:39.730603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.734169 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:39.734169 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:31:39.734169 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:31:39.735314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.782968 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3305/6647] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:31:39 2022] POST /identity/v3/policies => generated 229 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:39.788685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.805326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0129c4d-a988-4524-82cf-15454b95db8d tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.826426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.831295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.831648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.831925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.833366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.839533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.886302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.887477 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3343/6648] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:31:39 2022] POST /identity/v3/policies => generated 229 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:39.911139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a030fc9-d952-43d3-9670-460b38f494b8 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.921299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.922017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.922303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.922653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.923605 n-d-master-1 devstack@keystone.service[81860]: WARNING oslo_log.versionutils [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 11 01:31:39.926450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:39.927718 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:39.927718 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:31:39.927718 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:31:39.930959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:39.954117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:39.962739 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3306/6649] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:31:39 2022] GET /identity/v3/policies => generated 764 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:39.969897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe33f5-a890-4c5d-96af-3b7ab6055213 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:39.997194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:39.997867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:39.998143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:39.998411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies/60d19280b2984e60975168d03e1ecaa2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:39.999207 n-d-master-1 devstack@keystone.service[81859]: WARNING oslo_log.versionutils [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 11 01:31:39.999767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=60d19280b2984e60975168d03e1ecaa2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:40.001572 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:40.001572 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:31:40.001572 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:31:40.002459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.044295 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3344/6650] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:39 2022] DELETE /identity/v3/policies/60d19280b2984e60975168d03e1ecaa2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.048740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:40.074244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23550225-5184-4d6b-9f79-d5e8bd579476 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:40.095417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:40.097260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.099514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.099955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies/03b618f836cc4d31a026baa39d58448a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.101254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=03b618f836cc4d31a026baa39d58448a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:40.107713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.164226 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3307/6651] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:40 2022] DELETE /identity/v3/policies/03b618f836cc4d31a026baa39d58448a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.168762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:40.184809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9f8a-be57-41dd-b4d0-d39438ab46d4 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:40.202651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6b98d-354c-473c-a7b4-fed1a3806586 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8514a47f28e34e96ad926c3d67acd081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20478da2cd804882b5e611f2f28fe70c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:40.204349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b98d-354c-473c-a7b4-fed1a3806586 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.204899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b98d-354c-473c-a7b4-fed1a3806586 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.205345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b98d-354c-473c-a7b4-fed1a3806586 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] PATH_INFO: `/v3/policies/cc1d1a29873d480694fa4ee81df6bc8b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.206790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b98d-354c-473c-a7b4-fed1a3806586 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=cc1d1a29873d480694fa4ee81df6bc8b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:40.211189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b98d-354c-473c-a7b4-fed1a3806586 tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.244891 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3345/6652] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:40 2022] DELETE /identity/v3/policies/cc1d1a29873d480694fa4ee81df6bc8b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.250406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:40.381978 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:40.553379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4908a36-f2a4-448c-b0eb-ee4ae5c07efe tempest-PoliciesTestJSON-1488112698 tempest-PoliciesTestJSON-1488112698-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:40.568252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:40.569151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.569151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.571177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] PATH_INFO: `/v3/users/fc49e65d0ff14ed58c5760a9093fcef6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.573840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc49e65d0ff14ed58c5760a9093fcef6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:40.575806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:40.688868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc49e65d0ff14ed58c5760a9093fcef6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.691109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc49e65d0ff14ed58c5760a9093fcef6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.691994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc49e65d0ff14ed58c5760a9093fcef6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.705106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc49e65d0ff14ed58c5760a9093fcef6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.736126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc49e65d0ff14ed58c5760a9093fcef6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:40.765867 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3308/6653] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:40 2022] DELETE /identity/v3/users/fc49e65d0ff14ed58c5760a9093fcef6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:40.770793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:40.771301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:40.771393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:40.818796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:40.820646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:40.976473 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3346/6654] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:41.175818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.178085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:41.376781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f8b3-c20a-4592-9029-f40f469a7316 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.390543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.391489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.391722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.392018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.426774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.428232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.454985 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3309/6655] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:41.609334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:41.611124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:41.636816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282760-0348-4974-be89-f4180e3ef6fd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:41.682274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:41.683199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:41.683653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:41.684072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] PATH_INFO: `/v3/users/00182b4e371c476f9e1085d90615d4af` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:41.685913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] RBAC: Authorizing `identity:delete_user(user_id=00182b4e371c476f9e1085d90615d4af)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:41.700784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:41.725624 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:41.859333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00182b4e371c476f9e1085d90615d4af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:41.862153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00182b4e371c476f9e1085d90615d4af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:41.869487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00182b4e371c476f9e1085d90615d4af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:41.929804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00182b4e371c476f9e1085d90615d4af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:41.949600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00182b4e371c476f9e1085d90615d4af'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:41.982154 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3347/6656] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:41 2022] DELETE /identity/v3/users/00182b4e371c476f9e1085d90615d4af => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:42.949274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:42.950815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:42.983705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba558dc9-95c3-4f86-a54d-530530319343 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:43.081585 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:43.114454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:43.115210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:43.115553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:43.116067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] PATH_INFO: `/v3/projects/5050fd4cbaa849aeb3997893c2ccc405` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:43.118679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5050fd4cbaa849aeb3997893c2ccc405)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:43.124202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:43.273532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5050fd4cbaa849aeb3997893c2ccc405', 'request_id': 'req-8191073e-ea71-490e-a748-fc1a7c1e0ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.295621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:43.296113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5050fd4cbaa849aeb3997893c2ccc405', 'request_id': 'req-8191073e-ea71-490e-a748-fc1a7c1e0ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.297840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:43.312662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5050fd4cbaa849aeb3997893c2ccc405', 'request_id': 'req-8191073e-ea71-490e-a748-fc1a7c1e0ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.318792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989663d1-d1be-4a58-898b-162e61be42de admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:43.330317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] The token cache is being invalidate because project 5050fd4cbaa849aeb3997893c2ccc405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:43.330521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.331279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.335606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3310/6657] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:42 2022] DELETE /identity/v3/projects/5050fd4cbaa849aeb3997893c2ccc405 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:43.336728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:43.338483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:43.451077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:43.451742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:43.452021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:43.452293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] PATH_INFO: `/v3/users/1b184f278e2447c1bc710914329d2e80` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:43.454129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b184f278e2447c1bc710914329d2e80)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:43.458068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:43.480325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191073e-ea71-490e-a748-fc1a7c1e0ce4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:43.489641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:43.490534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:43.491612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:43.492070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] PATH_INFO: `/v3/users/8514a47f28e34e96ad926c3d67acd081` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:43.493576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8514a47f28e34e96ad926c3d67acd081)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:43.495643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:43.562809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b184f278e2447c1bc710914329d2e80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.565448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b184f278e2447c1bc710914329d2e80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.573461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b184f278e2447c1bc710914329d2e80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.587613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8514a47f28e34e96ad926c3d67acd081'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.589173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8514a47f28e34e96ad926c3d67acd081'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.591070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8514a47f28e34e96ad926c3d67acd081'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.592820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b184f278e2447c1bc710914329d2e80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.609553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8514a47f28e34e96ad926c3d67acd081'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.612631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b184f278e2447c1bc710914329d2e80'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.638737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0795103-8cb4-4e86-a3ac-a7e59d5eda7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8514a47f28e34e96ad926c3d67acd081'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:43.648585 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:43.649186 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3348/6658] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:43 2022] DELETE /identity/v3/users/1b184f278e2447c1bc710914329d2e80 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:43.650381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:43.651852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:43.664327 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:43.680573 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3311/6659] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:43 2022] DELETE /identity/v3/users/8514a47f28e34e96ad926c3d67acd081 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:43.680573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:43.680573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:43.681157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:43.727785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:43.731235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:43.811024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8883e-cc48-4506-b0c8-4194aad1840c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:43.881781 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3312/6660] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:43.905127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:43.908038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:43.940031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:43.940691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:43.940967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:43.941259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] PATH_INFO: `/v3/projects/e896bdebe5054594a74206d1e88fef0f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:43.942851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e896bdebe5054594a74206d1e88fef0f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:43.944776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:44.049869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c9bf-e784-4864-8df5-88f0626b4cbd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:44.064405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e896bdebe5054594a74206d1e88fef0f', 'request_id': 'req-34b2265c-ba94-4ef6-b800-9a0443a4ba65'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.077395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e896bdebe5054594a74206d1e88fef0f', 'request_id': 'req-34b2265c-ba94-4ef6-b800-9a0443a4ba65'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.093634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e896bdebe5054594a74206d1e88fef0f', 'request_id': 'req-34b2265c-ba94-4ef6-b800-9a0443a4ba65'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.123271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] The token cache is being invalidate because project e896bdebe5054594a74206d1e88fef0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:44.123556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.125910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-34b2265c-ba94-4ef6-b800-9a0443a4ba65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.131466 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3349/6661] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:43 2022] DELETE /identity/v3/projects/e896bdebe5054594a74206d1e88fef0f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:44.133882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17f0b-d2b2-4290-bc72-4e69b44a0406 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.134183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17f0b-d2b2-4290-bc72-4e69b44a0406 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.134443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17f0b-d2b2-4290-bc72-4e69b44a0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.180790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:44.181376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.181653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.181921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.184030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a6e17f0b-d2b2-4290-bc72-4e69b44a0406 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:44.185282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a6e17f0b-d2b2-4290-bc72-4e69b44a0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:44.187046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:44.248187 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:44.273590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3350/6662] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:44.283637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3e250-2c80-4427-9cd6-0ac153edcb20 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.284506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3e250-2c80-4427-9cd6-0ac153edcb20 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.284506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3e250-2c80-4427-9cd6-0ac153edcb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.311766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f9b3e250-2c80-4427-9cd6-0ac153edcb20 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:44.313356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f9b3e250-2c80-4427-9cd6-0ac153edcb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:44.328745 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3351/6663] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:44.332205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3e250-2c80-4427-9cd6-0ac153edcb20 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:44.356115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3e250-2c80-4427-9cd6-0ac153edcb20 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:44.368253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:44.370075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.370360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.370631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.372965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:44.373298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:44.375895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:44.377732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:44.385644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:44.407830 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:44.415454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3352/6664] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:31:44.417663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:44.433820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3313/6665] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:44.437557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632de0df-6895-4967-bb31-111b499aebca admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:44.451856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:44.452489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.453859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.454143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.456201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:44.460328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:44.531502 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3353/6666] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:44 2022] POST /identity/v3/projects => generated 359 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:44.536905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:44.553634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014be2-086f-40aa-a7fb-954906cf337c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:44.679344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:44.682371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:44.689898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:44.690464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.693290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.693594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.694716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:44.697817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:44.701978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002813-9c73-47a2-a877-c2eb6146aaef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:44.707786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:44.708716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.709472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.709755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] PATH_INFO: `/v3/projects/20478da2cd804882b5e611f2f28fe70c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:44.711444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20478da2cd804882b5e611f2f28fe70c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:44.714159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:44.783353 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3314/6667] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:44 2022] POST /identity/v3/users => generated 280 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:44.788216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:44.822753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d9bf-ebbf-478e-b552-bd08860f9559 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:44.825152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20478da2cd804882b5e611f2f28fe70c', 'request_id': 'req-f81edbcc-234c-49cc-8071-9d3de5d3eb88'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.845360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20478da2cd804882b5e611f2f28fe70c', 'request_id': 'req-f81edbcc-234c-49cc-8071-9d3de5d3eb88'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.878489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20478da2cd804882b5e611f2f28fe70c', 'request_id': 'req-f81edbcc-234c-49cc-8071-9d3de5d3eb88'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.917695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] The token cache is being invalidate because project 20478da2cd804882b5e611f2f28fe70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:44.918373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.920363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f81edbcc-234c-49cc-8071-9d3de5d3eb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:44.930239 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3354/6668] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:44 2022] DELETE /identity/v3/projects/20478da2cd804882b5e611f2f28fe70c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:44.934177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09836035-6006-4e97-807d-6654ea60300e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:44.934465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09836035-6006-4e97-807d-6654ea60300e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:44.934738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09836035-6006-4e97-807d-6654ea60300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.029104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-09836035-6006-4e97-807d-6654ea60300e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:45.036529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-09836035-6006-4e97-807d-6654ea60300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:45.041820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.042901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.043338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.044082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.052298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.055285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:45.069818 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3355/6669] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:45.079971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611dbb-d2d7-4f21-b8f6-ecbeb3db3b35 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.079971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611dbb-d2d7-4f21-b8f6-ecbeb3db3b35 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.080284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611dbb-d2d7-4f21-b8f6-ecbeb3db3b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.088027 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3315/6670] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:45.092368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:45.098877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:45.137844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d298-062c-4115-92a1-1703e3c36bab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:45.139202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0d611dbb-d2d7-4f21-b8f6-ecbeb3db3b35 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:45.144698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d611dbb-d2d7-4f21-b8f6-ecbeb3db3b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:45.154747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.156306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.157159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.164633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.168714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.172986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:45.183816 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3356/6671] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:45.184825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611dbb-d2d7-4f21-b8f6-ecbeb3db3b35 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:45.214331 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3316/6672] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:45.215424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:45.215858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611dbb-d2d7-4f21-b8f6-ecbeb3db3b35 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:45.231862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.232503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.232873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.233203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.234529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:45.236627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.242864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:45.244408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319719a4-40b0-4efb-9e91-eedaf4a7b366 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:45.258277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.267007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.267394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.270657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] PATH_INFO: `/v3/projects/8644bb016a5f4890b5ded6379a8b3380/users/6c106d5061084dcda31733273e3decb2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.295316 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3357/6673] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:45.299820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:45.314808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b74c8-eb75-44a5-b979-d76a91f03a7d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:45.321430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8644bb016a5f4890b5ded6379a8b3380, user_id=6c106d5061084dcda31733273e3decb2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.327998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:45.331308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9717c-0741-4489-9879-e8fb373ee74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.332118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9717c-0741-4489-9879-e8fb373ee74e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.332514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9717c-0741-4489-9879-e8fb373ee74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.332902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9717c-0741-4489-9879-e8fb373ee74e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.333705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9717c-0741-4489-9879-e8fb373ee74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.337104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9717c-0741-4489-9879-e8fb373ee74e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:45.356736 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3317/6674] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:45 2022] PUT /identity/v3/projects/8644bb016a5f4890b5ded6379a8b3380/users/6c106d5061084dcda31733273e3decb2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:45.356736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:45.363851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:45.386823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3358/6675] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:45 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:45.388458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20269-d3fb-478a-b8be-6129bf60e904 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.388874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20269-d3fb-478a-b8be-6129bf60e904 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.389338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20269-d3fb-478a-b8be-6129bf60e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.426395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e8b20269-d3fb-478a-b8be-6129bf60e904 None None] MFA Rules not processed for user `6c106d5061084dcda31733273e3decb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:45.428063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e8b20269-d3fb-478a-b8be-6129bf60e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:45.457958 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:45.472953 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:45.482093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26267230-0a86-44f4-857a-149df2daad2c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:45.566253 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3359/6676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:45.566253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b20269-d3fb-478a-b8be-6129bf60e904 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:45.637694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.638377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.642026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.642932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] PATH_INFO: `/v3/projects/a6677331581943e48b571a5377d83f93` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.644869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6677331581943e48b571a5377d83f93)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.647264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:45.715960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b20269-d3fb-478a-b8be-6129bf60e904 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:45.752309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6677331581943e48b571a5377d83f93', 'request_id': 'req-5c19b5a1-6829-4933-aaf0-b7de540c4855'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:45.763973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6677331581943e48b571a5377d83f93', 'request_id': 'req-5c19b5a1-6829-4933-aaf0-b7de540c4855'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:45.784755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6677331581943e48b571a5377d83f93', 'request_id': 'req-5c19b5a1-6829-4933-aaf0-b7de540c4855'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:45.802545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] The token cache is being invalidate because project a6677331581943e48b571a5377d83f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:45.802841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:45.803544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:45.805105 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3318/6677] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:45 2022] DELETE /identity/v3/projects/a6677331581943e48b571a5377d83f93 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:45.805878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:45.812025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:45.920738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bab76-981d-449a-8a6c-e7a4639d0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.921411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bab76-981d-449a-8a6c-e7a4639d0703 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.922070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bab76-981d-449a-8a6c-e7a4639d0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.922070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bab76-981d-449a-8a6c-e7a4639d0703 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.923053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bab76-981d-449a-8a6c-e7a4639d0703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.924577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bab76-981d-449a-8a6c-e7a4639d0703 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:45.972149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19b5a1-6829-4933-aaf0-b7de540c4855 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:45.982222 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3360/6678] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:45 2022] POST /identity/v3/users => generated 284 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:45.990141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:45.991023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.991695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.992198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] PATH_INFO: `/v3/users/6c106d5061084dcda31733273e3decb2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.992597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:45.993557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:45.993801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:45.995212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c106d5061084dcda31733273e3decb2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:45.998296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:46.084520 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:46.097794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] MFA Rules not processed for user `ea477d27693440a9a41d0aa12db57a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:46.103010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:46.120549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c106d5061084dcda31733273e3decb2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:46.122425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c106d5061084dcda31733273e3decb2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:46.123196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c106d5061084dcda31733273e3decb2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:46.160600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c106d5061084dcda31733273e3decb2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:46.211753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bad8ab0f-b081-4886-93df-17958a61486a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c106d5061084dcda31733273e3decb2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:46.242620 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3319/6679] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:45 2022] DELETE /identity/v3/users/6c106d5061084dcda31733273e3decb2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:46.247460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63776-77a1-4c50-b2c2-1eb729d632f9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:46.247728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63776-77a1-4c50-b2c2-1eb729d632f9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:46.248006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63776-77a1-4c50-b2c2-1eb729d632f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:46.294685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-34a63776-77a1-4c50-b2c2-1eb729d632f9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:46.296638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-34a63776-77a1-4c50-b2c2-1eb729d632f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:46.336697 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:46.393197 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3361/6680] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:46.394762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:46.400602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:46.440268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ddde8-6a69-4952-a3f9-3593c0258d92 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:46.538436 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3320/6681] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:46.539934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:46.540227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:46.540502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:46.624365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:46.631953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:46.646082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8266f89-d2be-4b88-89c1-bbb02a20c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:46.647032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266f89-d2be-4b88-89c1-bbb02a20c2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:46.651655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266f89-d2be-4b88-89c1-bbb02a20c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:46.652000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266f89-d2be-4b88-89c1-bbb02a20c2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:46.653739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8266f89-d2be-4b88-89c1-bbb02a20c2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:46.656318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8266f89-d2be-4b88-89c1-bbb02a20c2c8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:46.657849 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3321/6682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:46.663187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:46.670616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:46.675115 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3362/6683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:46.676942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff995a-0afc-4bba-9d07-0c0943e0ccc4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:46.678090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff995a-0afc-4bba-9d07-0c0943e0ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:46.678582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff995a-0afc-4bba-9d07-0c0943e0ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:46.723906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b0ff995a-0afc-4bba-9d07-0c0943e0ccc4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:46.725165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b0ff995a-0afc-4bba-9d07-0c0943e0ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:46.752557 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3363/6684] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:46.753730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff995a-0afc-4bba-9d07-0c0943e0ccc4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:46.770855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff995a-0afc-4bba-9d07-0c0943e0ccc4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:46.784684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:46.785360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:46.786211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:46.786211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:46.786536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:46.790651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:46.814684 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3364/6685] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:46.814684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:46.842115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed1c82-07e1-464a-b3cf-574fff2ece3e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:46.853085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:46.856313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:46.856313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:46.856313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:46.856313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:46.856737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:46.858098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:46.865595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60d16-27d1-4ffe-969e-7d3092c8e52b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:46.885277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:46.885926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:46.886204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:46.886475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:46.895130 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3365/6686] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:46.920036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:46.923331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:47.014352 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:47.075657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.078095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:47.090361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9e0b8-a436-4047-82af-25fd11c7c42e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.095511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:47.096187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.096453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.096767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.112617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3322/6687] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:47.113936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:47.120078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.126301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:47.149818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273a1a-53c4-4351-aaa3-dfb3033382fd service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.154303 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3366/6688] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:47.154769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:47.171208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac27d8-39a4-4447-b779-fe3578d02045 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.177477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:47.178892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.183813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2b165-7d3d-4af3-b40c-f2c4f3f99612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:47.188890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2b165-7d3d-4af3-b40c-f2c4f3f99612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.189465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2b165-7d3d-4af3-b40c-f2c4f3f99612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.190029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2b165-7d3d-4af3-b40c-f2c4f3f99612 admin admin] PATH_INFO: `/v3/projects/85119c6725d14f2abf4618faeee793b7/users/ab6b4c26d25a42b09346cafbe11be1d0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.191970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.192400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.193667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.204919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:47.242645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2b165-7d3d-4af3-b40c-f2c4f3f99612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85119c6725d14f2abf4618faeee793b7, user_id=ab6b4c26d25a42b09346cafbe11be1d0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.248120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2b165-7d3d-4af3-b40c-f2c4f3f99612 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:47.280719 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3367/6689] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:47 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:47.287457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:47.288398 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3323/6690] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:47 2022] PUT /identity/v3/projects/85119c6725d14f2abf4618faeee793b7/users/ab6b4c26d25a42b09346cafbe11be1d0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:47.302513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5b8a8-1b08-4197-aeb5-b5bb2a9d326b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.302792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5b8a8-1b08-4197-aeb5-b5bb2a9d326b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.303067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5b8a8-1b08-4197-aeb5-b5bb2a9d326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.378749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3ad5b8a8-1b08-4197-aeb5-b5bb2a9d326b None None] MFA Rules not processed for user `ab6b4c26d25a42b09346cafbe11be1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:47.380282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3ad5b8a8-1b08-4197-aeb5-b5bb2a9d326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:47.380867 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:47.443305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f68281-3d5b-4259-84b0-f619ece0c4d6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.491854 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3324/6691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:47.493611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5b8a8-1b08-4197-aeb5-b5bb2a9d326b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:47.596834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:47.597517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.597808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.598078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.598722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.600666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:47.623522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5b8a8-1b08-4197-aeb5-b5bb2a9d326b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.636861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:47.637692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.637968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.638425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.639573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.642598 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3368/6692] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:47 2022] POST /identity/v3/users => generated 292 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:47.647183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:47.650426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:47.665679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbe0a7-eea0-4ab4-980c-d82abed3d13c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.675790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:47.676978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.677546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.678143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.679663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.682462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:47.721920 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3325/6693] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:47 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:31:47.722919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:47.741184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3369/6694] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:47.744071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:47.784257 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:47.808983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22afe-21de-4277-9fb2-bc3c406e90bd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.905769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b4880-6ca8-4552-89a8-fa11ea1754d2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:47.943140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:47.943991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:47.944324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:47.944612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:47.945324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:47.947350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.005407 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3326/6695] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:47 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:48.009211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.029108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7646d-6240-46eb-b99a-9eeced443471 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.038087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.038749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.039107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.039453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.040178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.040674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.041429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.041968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.042142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.042362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.043197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.045679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.054971 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3370/6696] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:48.063458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.065643 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3327/6697] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:48.066737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.071600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52825-9a78-4bf0-8f9b-b4a196f55d40 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.081095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2963ce5-1e4c-4a54-a19f-4d8b04bee315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.081894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2963ce5-1e4c-4a54-a19f-4d8b04bee315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.082247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2963ce5-1e4c-4a54-a19f-4d8b04bee315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.082594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2963ce5-1e4c-4a54-a19f-4d8b04bee315 admin admin] PATH_INFO: `/v3/projects/4a523744d9c749938650b524314d1db8/users/d29824a20dd44c01a991ba7f540abb7c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.100396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732daa4c-fb5b-476a-8e67-06e4eb9331ee admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.108564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.109901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.110336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.110760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] PATH_INFO: `/v3/projects/d168b74853ce41038672dc374270a95d/users/1456e8dd3a554cd29935eca7a5759248/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.114913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2963ce5-1e4c-4a54-a19f-4d8b04bee315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a523744d9c749938650b524314d1db8, user_id=d29824a20dd44c01a991ba7f540abb7c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.121726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2963ce5-1e4c-4a54-a19f-4d8b04bee315 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.145597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d168b74853ce41038672dc374270a95d, user_id=1456e8dd3a554cd29935eca7a5759248, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.151897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.153573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3371/6698] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:48 2022] PUT /identity/v3/projects/4a523744d9c749938650b524314d1db8/users/d29824a20dd44c01a991ba7f540abb7c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:48.164076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.164462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.164775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.197184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3328/6699] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:48 2022] PUT /identity/v3/projects/d168b74853ce41038672dc374270a95d/users/1456e8dd3a554cd29935eca7a5759248/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:48.198288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.208279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] MFA Rules not processed for user `d29824a20dd44c01a991ba7f540abb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:48.211635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:48.264708 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:48.409492 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3372/6700] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:48.420887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912322d-481c-41c8-b910-14109c79a443 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.421758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.424017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:48.427226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.430561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.431205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.431774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.436920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.440267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.459301 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3329/6701] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:48.461994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.496269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5423c-02b3-4bf0-929f-3d7def80d7f2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.517641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d7975-085d-45cd-9368-0ceaa2aa37d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.522548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d7975-085d-45cd-9368-0ceaa2aa37d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.525270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d7975-085d-45cd-9368-0ceaa2aa37d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.525776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d7975-085d-45cd-9368-0ceaa2aa37d4 admin admin] PATH_INFO: `/v3/projects/d168b74853ce41038672dc374270a95d/users/1456e8dd3a554cd29935eca7a5759248/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.532529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d7975-085d-45cd-9368-0ceaa2aa37d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d168b74853ce41038672dc374270a95d, user_id=1456e8dd3a554cd29935eca7a5759248, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.539154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d7975-085d-45cd-9368-0ceaa2aa37d4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.567042 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3330/6702] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:48 2022] PUT /identity/v3/projects/d168b74853ce41038672dc374270a95d/users/1456e8dd3a554cd29935eca7a5759248/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:48.569116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.569416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.569687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.586150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff81c76-a9cd-4ed5-8307-5c72ab9465ae None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.623930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] MFA Rules not processed for user `1456e8dd3a554cd29935eca7a5759248`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:48.629192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:48.678754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.679552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.680058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.680366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.792929 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:48.821935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.826009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.862750 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3331/6703] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:48.862979 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3373/6704] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:31:48.863077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.863165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:48.864311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:48.899271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae20c0b-b994-43cf-b571-a1b57d03fca2 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:48.919133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:48.921047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:48.921369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:48.921670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:48.923897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:48.929122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:48.988555 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3374/6705] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:31:48 2022] POST /identity/v3/services => generated 240 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:48.990393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:49.072181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1431-06af-4a32-824c-ad758a36fe11 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:49.093796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:49.098920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:49.101170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:49.101669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/0bdaa7cfdd3a451ebd0b6032300d9a89` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:49.102819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0bdaa7cfdd3a451ebd0b6032300d9a89)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:49.105336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:49.114450 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:49.116211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19a5ce-e858-47d3-a9f5-6a86a588f9a7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:49.146928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:49.149019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:49.150329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:49.150618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] PATH_INFO: `/v3/projects/8644bb016a5f4890b5ded6379a8b3380` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:49.152842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8644bb016a5f4890b5ded6379a8b3380)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:49.158578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:49.159596 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3375/6706] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:48 2022] DELETE /identity/v3/services/0bdaa7cfdd3a451ebd0b6032300d9a89 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:49.160706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:49.184860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0823-70fd-4380-9ef0-8e9300c9de32 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:49.193675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:49.194878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:49.195315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:49.195879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:49.196798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:49.198726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:49.225111 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3376/6707] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:49 2022] POST /identity/v3/services => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:49.226365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:49.287389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2962b8-8504-4b24-ab02-a790977938de tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:49.307920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:49.309495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:49.310382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:49.312817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/9050c368802b4803b8715142cf0378c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:49.313770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:update_service(service_id=9050c368802b4803b8715142cf0378c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:49.318816 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:49.318816 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:31:49.318816 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:31:49.322026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:49.377201 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3377/6708] 10.222.0.16 () {60 vars in 1252 bytes} [Sun Sep 11 01:31:49 2022] PATCH /identity/v3/services/9050c368802b4803b8715142cf0378c7 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:49.383403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:49.454281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fe71a-8fde-4b89-8d60-d4bfd4226ca7 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:49.474445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:49.476590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:49.476774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:49.489102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/9050c368802b4803b8715142cf0378c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:49.494221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:get_service(service_id=9050c368802b4803b8715142cf0378c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:49.497839 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:49.497839 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:31:49.497839 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:31:49.502702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:49.527508 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3378/6709] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:49 2022] GET /identity/v3/services/9050c368802b4803b8715142cf0378c7 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:49.529200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:49.559010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e925-cd61-4b8f-9ee5-ee4951768777 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:49.581712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:49.590443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:49.590881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:49.590984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/9050c368802b4803b8715142cf0378c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:49.591608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9050c368802b4803b8715142cf0378c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:49.593277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:49.679527 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3379/6710] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:49 2022] DELETE /identity/v3/services/9050c368802b4803b8715142cf0378c7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:49.683498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:49.694401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8644bb016a5f4890b5ded6379a8b3380', 'request_id': 'req-d713973e-1c09-42e8-ba64-0cfc5b712950'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:49.724600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8644bb016a5f4890b5ded6379a8b3380', 'request_id': 'req-d713973e-1c09-42e8-ba64-0cfc5b712950'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:49.751810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8644bb016a5f4890b5ded6379a8b3380', 'request_id': 'req-d713973e-1c09-42e8-ba64-0cfc5b712950'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:49.761304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0e9f-9000-4082-8cd2-f7a41e930704 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:49.770732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] The token cache is being invalidate because project 8644bb016a5f4890b5ded6379a8b3380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:49.771221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:49.774064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:49.782212 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3332/6711] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:48 2022] DELETE /identity/v3/projects/8644bb016a5f4890b5ded6379a8b3380 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:49.784821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:49.789570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:49.987883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a9721-c55e-49d6-92a2-49aee9ac6b8f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:49.992684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9721-c55e-49d6-92a2-49aee9ac6b8f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:49.992975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9721-c55e-49d6-92a2-49aee9ac6b8f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:49.993310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9721-c55e-49d6-92a2-49aee9ac6b8f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/9050c368802b4803b8715142cf0378c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:49.993914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a9721-c55e-49d6-92a2-49aee9ac6b8f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:get_service(service_id=9050c368802b4803b8715142cf0378c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.003675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a9721-c55e-49d6-92a2-49aee9ac6b8f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-063a9721-c55e-49d6-92a2-49aee9ac6b8f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Could not find service: 9050c368802b4803b8715142cf0378c7.: keystone.exception.ServiceNotFound: Could not find service: 9050c368802b4803b8715142cf0378c7. Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 9050c368802b4803b8715142cf0378c7. Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:50.042266 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:31:50.043373 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application with Lock( Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 9050c368802b4803b8715142cf0378c7. Sep 11 01:31:50.044393 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:31:50.049638 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3380/6712] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:49 2022] GET /identity/v3/services/9050c368802b4803b8715142cf0378c7 => generated 113 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:50.053081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.053081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.053081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.117989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:50.119629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:50.124737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713973e-1c09-42e8-ba64-0cfc5b712950 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:50.150274 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:50.193762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:50.195053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.195053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.195053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.198748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:50.215166 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:50.309366 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3381/6713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:50.310232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:50.318159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:50.355548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09005b-0a00-4dbc-bf20-576628ccf4de None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:50.379652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec136eb-1385-4bbd-b472-4da1e499939b tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:50.383065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec136eb-1385-4bbd-b472-4da1e499939b tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.383347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec136eb-1385-4bbd-b472-4da1e499939b tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.386917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec136eb-1385-4bbd-b472-4da1e499939b tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.389408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec136eb-1385-4bbd-b472-4da1e499939b tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.397633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec136eb-1385-4bbd-b472-4da1e499939b tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.420947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.424694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.442066 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3382/6714] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:50 2022] POST /identity/v3/services => generated 274 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:50.446032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4abe4-94ce-4646-8df7-d66f03ce3266 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.446319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4abe4-94ce-4646-8df7-d66f03ce3266 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.453198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4abe4-94ce-4646-8df7-d66f03ce3266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.464804 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3333/6715] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:31:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:31:50.465700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:50.499443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae85a-2c01-4284-9d00-41154660dc37 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:50.508121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-17c4abe4-94ce-4646-8df7-d66f03ce3266 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:50.509366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-17c4abe4-94ce-4646-8df7-d66f03ce3266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:50.568937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:50.570781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.571104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.573981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.574811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.582748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.603483 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3383/6716] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3406 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:50.604529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4abe4-94ce-4646-8df7-d66f03ce3266 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:50.624097 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3334/6717] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:50 2022] POST /identity/v3/services => generated 273 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:50.628912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:50.642896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4abe4-94ce-4646-8df7-d66f03ce3266 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:50.690977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098dbe8-7874-45f9-9628-16a3e98444cd tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:50.692852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:50.694134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.694418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.694688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.695349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:50.695650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.698705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.705726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:50.706350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.706626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.706895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.707551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.709169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.744363 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3384/6718] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:50.745564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:50.774312 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3335/6719] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:50 2022] POST /identity/v3/services => generated 275 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:50.779902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:50.796704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a58141-44d7-4414-a59e-d75c329337d9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:50.853499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d03c60-9e05-4fbf-9bff-c6a6645dd19e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:50.858597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:50.859235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.861628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.861628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.868970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.871308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.882244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:50.883151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:50.883571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:50.883982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:50.884917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:50.896772 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:50.896772 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:31:50.896772 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:31:50.897785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:50.960644 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3336/6720] 10.222.0.16 () {58 vars in 1131 bytes} [Sun Sep 11 01:31:50 2022] GET /identity/v3/services => generated 2977 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:50.966494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.018513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51734fc-68c6-4dc9-8db7-18db734d1d05 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.037677 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3385/6721] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:50 2022] POST /identity/v3/projects => generated 365 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:51.043791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.045095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.046747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.051586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.052656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.054539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1942604476) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:51.055931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.066147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.099175 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3337/6722] 10.222.0.16 () {58 vars in 1222 bytes} [Sun Sep 11 01:31:50 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1942604476 => generated 417 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:51.104392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.160650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be225ef-1a5d-4a06-ac42-38ad2af2197e tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.394124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487f398-a4e9-4b29-a4bc-463913b73380 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.416899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.420319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.421490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.423053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.425002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.434319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.457110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.462352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.465747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.471112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.474295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-800571137) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:51.480930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.497079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.545178 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3338/6723] 10.222.0.16 () {58 vars in 1220 bytes} [Sun Sep 11 01:31:51 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-800571137 => generated 415 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:51.549049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.555715 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3386/6724] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:51 2022] POST /identity/v3/users => generated 283 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:51.559638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.574408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780e956-737b-4928-9a2f-2b5f007f050d tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.590606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5524cd-a466-4416-9432-bca264382a28 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.594231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.597515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.597834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.600037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.600776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1184684099) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:51.601107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.603536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.610939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.611591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.611930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.612291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.612972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.614638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.621915 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3339/6725] 10.222.0.16 () {58 vars in 1222 bytes} [Sun Sep 11 01:31:51 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1184684099 => generated 418 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:51.626946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.651891 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3387/6726] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:31:51.662759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.663779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cf203-5fca-4c8e-ae7b-d6dc04448ec9 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.684177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.686683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.686910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.687270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/83083d97313d4e3cb18a17bc7884c735` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.692943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:delete_service(service_id=83083d97313d4e3cb18a17bc7884c735)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.697156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.701210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54892-413f-45c6-8748-90ad8cb07b9d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.723215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.723859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.724127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.724399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.733108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.735910 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:51.744938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.780088 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3340/6727] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:51 2022] DELETE /identity/v3/services/83083d97313d4e3cb18a17bc7884c735 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:51.782204 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3388/6728] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:51.788061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.788560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.814216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b04d-4c34-4dd2-85f7-4d24ad85e409 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.817143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdabe92-1b6f-4198-b8cc-8f7005761842 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.823590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.825579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.825939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.826320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/18d44dcdf9b14a3bbd2fe5ef9b4435fe` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.827109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:delete_service(service_id=18d44dcdf9b14a3bbd2fe5ef9b4435fe)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.829338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.856164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c214e04-c868-48f7-b1d8-aadd55e98b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.858743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214e04-c868-48f7-b1d8-aadd55e98b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.859023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214e04-c868-48f7-b1d8-aadd55e98b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.859584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214e04-c868-48f7-b1d8-aadd55e98b84 admin admin] PATH_INFO: `/v3/projects/91fa4dc2b5c14cd78daa77031bf43e10/users/4b4c320c890a40c198c622c3b60fc8b5/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.869131 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3341/6729] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:51 2022] DELETE /identity/v3/services/18d44dcdf9b14a3bbd2fe5ef9b4435fe => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:51.873119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:51.908949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de79ad2-a51f-4c8f-a642-bfee5e43e894 tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:51.914250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c214e04-c868-48f7-b1d8-aadd55e98b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fa4dc2b5c14cd78daa77031bf43e10, user_id=4b4c320c890a40c198c622c3b60fc8b5, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.918117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c214e04-c868-48f7-b1d8-aadd55e98b84 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.919285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1456e8dd3a554cd29935eca7a5759248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd168b74853ce41038672dc374270a95d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:51.919969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.920253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.920607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] PATH_INFO: `/v3/services/5535a457f0604d14b84cd81516b88a00` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.921248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5535a457f0604d14b84cd81516b88a00)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:51.923613 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:51.925247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:51.965291 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3389/6730] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:51 2022] PUT /identity/v3/projects/91fa4dc2b5c14cd78daa77031bf43e10/users/4b4c320c890a40c198c622c3b60fc8b5/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:51.977172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3c32-fd03-4641-ae93-df13e853ac6d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:51.977172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3c32-fd03-4641-ae93-df13e853ac6d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:51.977574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3c32-fd03-4641-ae93-df13e853ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:51.992270 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3342/6731] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:51 2022] DELETE /identity/v3/services/5535a457f0604d14b84cd81516b88a00 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:51.998030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:52.000775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:52.043123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2ead3c32-fd03-4641-ae93-df13e853ac6d None None] MFA Rules not processed for user `4b4c320c890a40c198c622c3b60fc8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:52.045444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2ead3c32-fd03-4641-ae93-df13e853ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:52.084961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85639d4e-d2f0-4029-a748-cda3bb0b2e2f tempest-ServicesTestJSON-894024415 tempest-ServicesTestJSON-894024415-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:52.236130 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3390/6732] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:31:52.241520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead3c32-fd03-4641-ae93-df13e853ac6d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:52.306713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:52.309001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:52.310018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:52.310478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] PATH_INFO: `/v3/users/ab6b4c26d25a42b09346cafbe11be1d0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:52.313821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6b4c26d25a42b09346cafbe11be1d0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:52.317520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:52.424208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6b4c26d25a42b09346cafbe11be1d0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:52.427347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6b4c26d25a42b09346cafbe11be1d0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:52.428480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6b4c26d25a42b09346cafbe11be1d0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:52.438436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6b4c26d25a42b09346cafbe11be1d0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:52.456928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8a2c3411-a366-49ca-92dc-36000ab851c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6b4c26d25a42b09346cafbe11be1d0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:52.461428 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:52.486338 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3343/6733] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:51 2022] DELETE /identity/v3/users/ab6b4c26d25a42b09346cafbe11be1d0 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:52.488109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:52.488534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:52.490096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:52.499333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead3c32-fd03-4641-ae93-df13e853ac6d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:52.549354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:52.551663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:52.617668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:52.618294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:52.618584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:52.618858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:52.619503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:52.621464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:52.686892 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3344/6734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:52.707168 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3391/6735] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:52 2022] POST /identity/v3/projects => generated 367 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:52.711001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:52.714165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:52.726647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:52.728477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:52.747694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01d5b-13cc-4415-9b6c-5e0b87af425c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:52.808942 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:52.894585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:52.895133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:52.895405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:52.897099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:52.897769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:52.899680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:52.918959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded37303-7ecf-4c98-bf2a-f4d5bb2db823 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:52.929162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:52.929901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:52.930186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:52.930462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:52.951648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:52.956041 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3345/6736] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:52 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:52.959219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:52.959804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:52.979794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748b016-55d3-4fae-a6f3-892638074cf7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:52.989276 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3392/6737] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:31:52.990849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:52.991476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:52.991750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:52.992016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:52.992662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:52.994264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:53.033511 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3346/6738] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:31:53.036850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:53.061697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522977b0-1461-419a-bbf1-7051ed35a4c5 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:53.088791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:53.089833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:53.090781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:53.091183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] PATH_INFO: `/v3/projects/d01633228f584317a4650d14acfc715b/users/8f1ba9713eaf41ed9a1202828eab5f4d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:53.155868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01633228f584317a4650d14acfc715b, user_id=8f1ba9713eaf41ed9a1202828eab5f4d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:53.161324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:53.208092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3393/6739] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:53 2022] PUT /identity/v3/projects/d01633228f584317a4650d14acfc715b/users/8f1ba9713eaf41ed9a1202828eab5f4d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:53.208760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:53.241403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e655db-db7c-4b43-9ab7-838632d12d3f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:53.362775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866e9f8-d932-4a93-a541-c4a54d7232eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:53.363856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e9f8-d932-4a93-a541-c4a54d7232eb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:53.364300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e9f8-d932-4a93-a541-c4a54d7232eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:53.365011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e9f8-d932-4a93-a541-c4a54d7232eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:53.367021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866e9f8-d932-4a93-a541-c4a54d7232eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:53.368902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866e9f8-d932-4a93-a541-c4a54d7232eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:53.404355 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3347/6740] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:53.408517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:53.425504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c4101-099b-40af-aaf9-1df28635ca71 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:53.434549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c02a2-7dd0-4c65-9d86-8b08ee5424c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:53.435683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c02a2-7dd0-4c65-9d86-8b08ee5424c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:53.435840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c02a2-7dd0-4c65-9d86-8b08ee5424c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:53.436389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c02a2-7dd0-4c65-9d86-8b08ee5424c3 admin admin] PATH_INFO: `/v3/projects/d01633228f584317a4650d14acfc715b/users/8f1ba9713eaf41ed9a1202828eab5f4d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:53.443804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c02a2-7dd0-4c65-9d86-8b08ee5424c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01633228f584317a4650d14acfc715b, user_id=8f1ba9713eaf41ed9a1202828eab5f4d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:53.450197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c02a2-7dd0-4c65-9d86-8b08ee5424c3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:53.477940 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3394/6741] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:53 2022] PUT /identity/v3/projects/d01633228f584317a4650d14acfc715b/users/8f1ba9713eaf41ed9a1202828eab5f4d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:53.488508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538177-1374-4070-9784-179634c710a5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:53.488783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538177-1374-4070-9784-179634c710a5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:53.489048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538177-1374-4070-9784-179634c710a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:53.533565 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:53.551683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2d538177-1374-4070-9784-179634c710a5 None None] MFA Rules not processed for user `8f1ba9713eaf41ed9a1202828eab5f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:53.551683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2d538177-1374-4070-9784-179634c710a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:53.657444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d24d5a-79f6-4691-b674-980d8a82adbc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:53.657444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d24d5a-79f6-4691-b674-980d8a82adbc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:53.658067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d24d5a-79f6-4691-b674-980d8a82adbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:53.710092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-20d24d5a-79f6-4691-b674-980d8a82adbc None None] MFA Rules not processed for user `ea477d27693440a9a41d0aa12db57a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:53.713743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20d24d5a-79f6-4691-b674-980d8a82adbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:53.745537 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3348/6742] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:53.755616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d538177-1374-4070-9784-179634c710a5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:53.784315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d538177-1374-4070-9784-179634c710a5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:53.799515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:53.800153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:53.800648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:53.800777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:53.802146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:53.802394 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:53.802394 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:31:53.802394 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:31:53.807485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:53.853784 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3349/6743] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:31:53 2022] POST /identity/v3/regions => generated 223 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:53.855217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:53.926743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ed36b-8b17-4e1d-b065-2ce094699efa tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:53.946133 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3395/6744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:53.948483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:53.949136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:53.949424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:53.949699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:53.950351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:53.952186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:53.996291 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3350/6745] 10.222.0.16 () {60 vars in 1149 bytes} [Sun Sep 11 01:31:53 2022] POST /identity/v3/regions => generated 224 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:31:54.000523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d24d5a-79f6-4691-b674-980d8a82adbc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.017291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d24d5a-79f6-4691-b674-980d8a82adbc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.052198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.053963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.054617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.055396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/d667cd84-1168-4883-810f-51ca66939a84` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.057263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:create_region(region_id=d667cd84-1168-4883-810f-51ca66939a84)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.059190 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:54.059190 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:31:54.059190 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:31:54.070184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.132665 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3396/6746] 10.222.0.16 () {60 vars in 1259 bytes} [Sun Sep 11 01:31:53 2022] PUT /identity/v3/regions/d667cd84-1168-4883-810f-51ca66939a84 => generated 232 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:31:54.134599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.151448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f3278-7c82-4c2e-8227-db2759a27357 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.175825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.176766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.177563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.178006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/d667cd84-1168-4883-810f-51ca66939a84` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.178758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d667cd84-1168-4883-810f-51ca66939a84)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.180586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.232809 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3351/6747] 10.222.0.16 () {58 vars in 1242 bytes} [Sun Sep 11 01:31:54 2022] DELETE /identity/v3/regions/d667cd84-1168-4883-810f-51ca66939a84 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:54.258524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.295945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d78fa-acf0-4c20-9dfc-a764e6cc7be9 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.322551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.323203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.323488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.323776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.324447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.326122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.386369 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3397/6748] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 11 01:31:54 2022] POST /identity/v3/regions => generated 254 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:54.390832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.406955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d574a-1100-4c9e-bf94-046df7eba967 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.456520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.457848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.459368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.460548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/f85fd029f4344bff81d61bc3ffce65ee` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.462640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:update_region(region_id=f85fd029f4344bff81d61bc3ffce65ee)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.465232 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:31:54.465232 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:31:54.465232 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:31:54.467747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.522271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3352/6749] 10.222.0.16 () {60 vars in 1250 bytes} [Sun Sep 11 01:31:54 2022] PATCH /identity/v3/regions/f85fd029f4344bff81d61bc3ffce65ee => generated 254 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:31:54.532700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.543637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e15a73-758c-43e6-8ca8-b9a5a48f4079 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.584510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.585150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.587353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.587656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/f85fd029f4344bff81d61bc3ffce65ee` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.588236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:get_region(region_id=f85fd029f4344bff81d61bc3ffce65ee)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.593697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.605369 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:54.618806 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3398/6750] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:31:54 2022] GET /identity/v3/regions/f85fd029f4344bff81d61bc3ffce65ee => generated 254 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:54.623413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.646705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f067-6330-48fe-b9f5-47fbe94e8dd5 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.668488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.671154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.671598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.671909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/f85fd029f4344bff81d61bc3ffce65ee` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.673683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f85fd029f4344bff81d61bc3ffce65ee)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.677897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.732759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3353/6751] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:54 2022] DELETE /identity/v3/regions/f85fd029f4344bff81d61bc3ffce65ee => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:54.737706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.751767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbacbb-99cf-49c5-822e-e661cde9243c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.789671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.791222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.792098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.793017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.796981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.797526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.814335 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3399/6752] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 11 01:31:54 2022] GET /identity/v3/regions => generated 669 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:54.818232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.870029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998f8c-547e-4f72-81c5-ae90e43ad5f8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.888745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.889618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.889982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.890284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/f85fd029f4344bff81d61bc3ffce65ee` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.891104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f85fd029f4344bff81d61bc3ffce65ee)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.893304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Could not find region: f85fd029f4344bff81d61bc3ffce65ee.: keystone.exception.RegionNotFound: Could not find region: f85fd029f4344bff81d61bc3ffce65ee. Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: f85fd029f4344bff81d61bc3ffce65ee. Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:31:54.911010 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: f85fd029f4344bff81d61bc3ffce65ee. Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:31:54.912324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3354/6753] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:54 2022] DELETE /identity/v3/regions/f85fd029f4344bff81d61bc3ffce65ee => generated 112 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:31:54.917488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.930981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc771d40-ca5d-481a-af98-c6b4784eb12a tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:54.948083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:54.948931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:54.949256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:54.949589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:54.950320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:54.955352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:54.957254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:54.961819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:54.980274 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3400/6754] 10.222.0.16 () {58 vars in 1128 bytes} [Sun Sep 11 01:31:54 2022] GET /identity/v3/regions => generated 669 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:54.986220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.004511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bf7ca-fab8-492f-8ecd-abbc4f1889b2 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.010095 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:55.019673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.023208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.023208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.023427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.023994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.027714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.086191 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3401/6755] 10.222.0.16 () {60 vars in 1150 bytes} [Sun Sep 11 01:31:54 2022] POST /identity/v3/regions => generated 253 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:55.087836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.138820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d992e8-5f47-41a5-9278-9c8d08acfbb3 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.140311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077d09-4c8f-496e-847c-946d422cf4d8 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.152016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.154642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.154916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.155197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.158121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Adding query filter params (parent_region_id=7e1c2728179d4ea4b64fd39e1011663c) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:55.158434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.162665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.178048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.183293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.183293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.183293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] PATH_INFO: `/v3/projects/85119c6725d14f2abf4618faeee793b7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.183811 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3402/6756] 10.222.0.16 () {58 vars in 1227 bytes} [Sun Sep 11 01:31:55 2022] GET /identity/v3/regions?parent_region_id=7e1c2728179d4ea4b64fd39e1011663c => generated 399 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:55.183910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85119c6725d14f2abf4618faeee793b7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.184287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.185215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.206296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26effa2-928e-4990-b59d-b52b15fe0ea6 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.226395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.227812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.227812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.227993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/d1ff1d4adbd0416f97fe74bb2d3e1e69` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.234597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d1ff1d4adbd0416f97fe74bb2d3e1e69)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.234597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.323613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3403/6757] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:55 2022] DELETE /identity/v3/regions/d1ff1d4adbd0416f97fe74bb2d3e1e69 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:55.324649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.329098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:55.348890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85119c6725d14f2abf4618faeee793b7', 'request_id': 'req-d5721763-560a-4a4d-8a56-b7cb6a35430e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:55.374309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85119c6725d14f2abf4618faeee793b7', 'request_id': 'req-d5721763-560a-4a4d-8a56-b7cb6a35430e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:55.398562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85119c6725d14f2abf4618faeee793b7', 'request_id': 'req-d5721763-560a-4a4d-8a56-b7cb6a35430e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:55.416077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] The token cache is being invalidate because project 85119c6725d14f2abf4618faeee793b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:55.416687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:55.418473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:55.422476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3355/6758] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:54 2022] DELETE /identity/v3/projects/85119c6725d14f2abf4618faeee793b7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:55.427945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.431109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:55.490424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e7bb6-7637-463a-94c0-6beb5caebf50 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.579989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5721763-560a-4a4d-8a56-b7cb6a35430e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.603056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.603856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.604243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.604763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/8ca30f16233547e5b4734e8e758892ba` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.605609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:delete_region(region_id=8ca30f16233547e5b4734e8e758892ba)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.607924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.615815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.616446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.617011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.617338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.619406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:55.661767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.662799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.664276 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3356/6759] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:55 2022] DELETE /identity/v3/regions/8ca30f16233547e5b4734e8e758892ba => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:55.668044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.678239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:55.711088 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3404/6760] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:55.712087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.719631 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:55.745089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeca7f8-e23d-4dda-b1d6-c8aebfb37f81 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.787453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f1ba9713eaf41ed9a1202828eab5f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd01633228f584317a4650d14acfc715b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.788534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.791104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.791544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] PATH_INFO: `/v3/regions/7e1c2728179d4ea4b64fd39e1011663c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.792161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7e1c2728179d4ea4b64fd39e1011663c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.793824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.820605 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:55.849870 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3405/6761] 10.222.0.16 () {58 vars in 1230 bytes} [Sun Sep 11 01:31:55 2022] DELETE /identity/v3/regions/7e1c2728179d4ea4b64fd39e1011663c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:55.854480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:55.857189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:55.866811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44fe1e-e022-48b7-9331-9df908d4f53c tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.891983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b91b2-3c7f-468c-bacd-231e94b48c29 tempest-RegionsTestJSON-1576107605 tempest-RegionsTestJSON-1576107605-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:55.896819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.897719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.898001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.898761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] PATH_INFO: `/v3/users/4b4c320c890a40c198c622c3b60fc8b5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.899674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4c320c890a40c198c622c3b60fc8b5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.901632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.902700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:55.905779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:55.906841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:55.907240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] PATH_INFO: `/v3/users/1456e8dd3a554cd29935eca7a5759248` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:55.909150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1456e8dd3a554cd29935eca7a5759248)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:55.911287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:55.999113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1456e8dd3a554cd29935eca7a5759248'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.000891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1456e8dd3a554cd29935eca7a5759248'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.001677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1456e8dd3a554cd29935eca7a5759248'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.016419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1456e8dd3a554cd29935eca7a5759248'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.026100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4c320c890a40c198c622c3b60fc8b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.026827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4c320c890a40c198c622c3b60fc8b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.028190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4c320c890a40c198c622c3b60fc8b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.037694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0390b91-3654-4067-86f2-7156a3ba6fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1456e8dd3a554cd29935eca7a5759248'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.070989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4c320c890a40c198c622c3b60fc8b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.096454 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3357/6762] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:55 2022] DELETE /identity/v3/users/1456e8dd3a554cd29935eca7a5759248 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:56.098818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4c320c890a40c198c622c3b60fc8b5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:56.140279 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3406/6763] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:55 2022] DELETE /identity/v3/users/4b4c320c890a40c198c622c3b60fc8b5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:56.145485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:56.153137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:56.153137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:56.205213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:56.211363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:56.379350 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3358/6764] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:56.460416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:56.461924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:56.683556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccb33f-2ec6-4501-b51f-5f1b35c08a9d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:56.697544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeea31-80a5-4348-bca4-199d08f9110d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:56.697544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeea31-80a5-4348-bca4-199d08f9110d service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:56.697544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeea31-80a5-4348-bca4-199d08f9110d service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:56.697544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeea31-80a5-4348-bca4-199d08f9110d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:56.726303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeea31-80a5-4348-bca4-199d08f9110d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:56.727969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeea31-80a5-4348-bca4-199d08f9110d service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:56.755684 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3407/6765] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:57.217853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:57.219891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:57.243750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0b958-3a3d-4c90-ad42-0bcf73075319 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:57.262644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:57.263646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:57.263993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:57.264331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] PATH_INFO: `/v3/projects/d168b74853ce41038672dc374270a95d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:57.265912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d168b74853ce41038672dc374270a95d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:57.268551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:57.279268 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:57.388036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd168b74853ce41038672dc374270a95d', 'request_id': 'req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.397410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd168b74853ce41038672dc374270a95d', 'request_id': 'req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.410997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd168b74853ce41038672dc374270a95d', 'request_id': 'req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.437410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] The token cache is being invalidate because project d168b74853ce41038672dc374270a95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:57.438506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.440667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.443547 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3359/6766] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:57 2022] DELETE /identity/v3/projects/d168b74853ce41038672dc374270a95d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:57.450301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3a9cb-d17c-4b95-82b8-394c7153ee9b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:57.450727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3a9cb-d17c-4b95-82b8-394c7153ee9b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:57.450940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3a9cb-d17c-4b95-82b8-394c7153ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:57.516044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b7a3a9cb-d17c-4b95-82b8-394c7153ee9b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:57.518630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b7a3a9cb-d17c-4b95-82b8-394c7153ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:57.606872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:57.611105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:57.635676 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:57.770648 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3408/6767] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:57.777453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:57.777749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:57.778029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:57.803570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d47dae-7eac-4f68-9db7-166f5b1c0bc8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:57.819449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:57.820120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:57.820397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:57.820669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] PATH_INFO: `/v3/projects/91fa4dc2b5c14cd78daa77031bf43e10` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:57.829547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fa4dc2b5c14cd78daa77031bf43e10)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:57.833450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:57.883850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:57.890045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:57.932768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3409/6768] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:57.936057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:57.941439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fa4dc2b5c14cd78daa77031bf43e10', 'request_id': 'req-8529151f-e311-4513-b493-f4401610e1c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.947571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:57.950683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fa4dc2b5c14cd78daa77031bf43e10', 'request_id': 'req-8529151f-e311-4513-b493-f4401610e1c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.974291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fa4dc2b5c14cd78daa77031bf43e10', 'request_id': 'req-8529151f-e311-4513-b493-f4401610e1c4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:57.984409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea71d22-db07-452f-ab02-5fee50fcf59b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:58.011644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] The token cache is being invalidate because project 91fa4dc2b5c14cd78daa77031bf43e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:58.011851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.014687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.020423 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3360/6769] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:57 2022] DELETE /identity/v3/projects/91fa4dc2b5c14cd78daa77031bf43e10 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:31:58.021516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:58.027414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:58.084778 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:58.141889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529151f-e311-4513-b493-f4401610e1c4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:58.149991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:58.151056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:58.151457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:58.152615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:58.153163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:58.153698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:58.154129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:58.154401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:31:58.154735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] PATH_INFO: `/v3/users/d29824a20dd44c01a991ba7f540abb7c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:58.154860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:58.157669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:58.158426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29824a20dd44c01a991ba7f540abb7c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:58.163369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:58.174675 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3361/6770] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:31:58.175888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:58.178483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:58.216390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9ca32-98fb-4e0d-8ec7-0a26f5950083 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:58.230027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:58.230716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:58.233407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:58.233980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] PATH_INFO: `/v3/users/8f1ba9713eaf41ed9a1202828eab5f4d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:58.237403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1ba9713eaf41ed9a1202828eab5f4d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:58.240593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:58.319700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29824a20dd44c01a991ba7f540abb7c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.321638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29824a20dd44c01a991ba7f540abb7c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.322774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29824a20dd44c01a991ba7f540abb7c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.370149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29824a20dd44c01a991ba7f540abb7c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.406026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29824a20dd44c01a991ba7f540abb7c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.423891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1ba9713eaf41ed9a1202828eab5f4d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.425185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1ba9713eaf41ed9a1202828eab5f4d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.426889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1ba9713eaf41ed9a1202828eab5f4d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.442940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1ba9713eaf41ed9a1202828eab5f4d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.448639 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3410/6771] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:57 2022] DELETE /identity/v3/users/d29824a20dd44c01a991ba7f540abb7c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:58.449902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:58.452977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:58.474227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-af7a7e6b-a93d-48a4-9fe6-1b71595b8cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1ba9713eaf41ed9a1202828eab5f4d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:58.505250 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3362/6772] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:31:58 2022] DELETE /identity/v3/users/8f1ba9713eaf41ed9a1202828eab5f4d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:58.505250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:58.505250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:58.505250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:58.569884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:58.585735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:58.642909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d02d6-8677-4c1a-b17a-2477d1f2a17e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:58.659856 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:58.826608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:58.827580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:58.828812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:58.829562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:58.830336 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3363/6773] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:31:58.831647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:58.835737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:58.859486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:58.861992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:58.929362 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3411/6774] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:31:58 2022] POST /identity/v3/projects => generated 379 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:58.931773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:58.935345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:58.990726 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:59.069419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451a358-07c4-435b-98bd-81d9231d7000 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:59.184512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086f667-2b9e-4ba9-9706-52936a8b4723 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:59.218128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:59.221178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.221464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.223983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.224733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:59.228616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:59.252225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:59.252917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.253309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.255239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.286233 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3412/6775] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:31:58 2022] POST /identity/v3/users => generated 290 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:31:59.292606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:59.293614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:59.296084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:59.327164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f8f75-14c1-4c9f-a808-2028effbff5d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:59.332251 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3364/6776] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:31:59.336576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:59.337450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.337915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.338345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.339146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:59.341262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:59.373420 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3413/6777] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:59.378480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:59.394667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128bb73-e3fc-4ec3-aafe-4eb763eac061 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:59.414830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:59.415464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.415738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.416049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.417145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:59.419511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:59.438167 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3365/6778] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:31:59.440091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:59.480835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745764e1-7156-4d0a-9cf3-629520c780ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:59.501464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c8c96-5bbe-4e9f-82b8-0febdf05dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:59.502342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8c96-5bbe-4e9f-82b8-0febdf05dda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.502624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8c96-5bbe-4e9f-82b8-0febdf05dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.502901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c8c96-5bbe-4e9f-82b8-0febdf05dda5 admin admin] PATH_INFO: `/v3/projects/6bfdf7fbd2454b5cad90d5876aa4061f/users/51103499549741ad92d16e8e08fd90a4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.542017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c8c96-5bbe-4e9f-82b8-0febdf05dda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfdf7fbd2454b5cad90d5876aa4061f, user_id=51103499549741ad92d16e8e08fd90a4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:59.553854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c8c96-5bbe-4e9f-82b8-0febdf05dda5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:59.555241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:59.557324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:59.586335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f2a1-f915-4020-aa7c-b10efaa88416 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:31:59.618519 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3414/6779] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:31:59 2022] PUT /identity/v3/projects/6bfdf7fbd2454b5cad90d5876aa4061f/users/51103499549741ad92d16e8e08fd90a4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:59.620790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:31:59.621671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.622817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.623263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] PATH_INFO: `/v3/projects/d01633228f584317a4650d14acfc715b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.627961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01633228f584317a4650d14acfc715b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:31:59.631163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:31:59.741623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28cc1-d4cf-4491-968d-3b0225f6f78f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.741994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28cc1-d4cf-4491-968d-3b0225f6f78f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.742232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28cc1-d4cf-4491-968d-3b0225f6f78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.803273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9fc28cc1-d4cf-4491-968d-3b0225f6f78f None None] MFA Rules not processed for user `51103499549741ad92d16e8e08fd90a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:59.804635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9fc28cc1-d4cf-4491-968d-3b0225f6f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:59.820349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01633228f584317a4650d14acfc715b', 'request_id': 'req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:59.835931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01633228f584317a4650d14acfc715b', 'request_id': 'req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:59.851917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01633228f584317a4650d14acfc715b', 'request_id': 'req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:59.872854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] The token cache is being invalidate because project d01633228f584317a4650d14acfc715b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:31:59.873194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:59.873960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2ebe9106-2b8f-4d2e-a213-cc14d50a4494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:31:59.880295 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3366/6780] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:31:59 2022] DELETE /identity/v3/projects/d01633228f584317a4650d14acfc715b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:31:59.882684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73f439-dfec-4379-9ff8-f470f4606381 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:31:59.882968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73f439-dfec-4379-9ff8-f470f4606381 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:31:59.883239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73f439-dfec-4379-9ff8-f470f4606381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:31:59.903060 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:31:59.914906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fa73f439-dfec-4379-9ff8-f470f4606381 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:31:59.935780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa73f439-dfec-4379-9ff8-f470f4606381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:31:59.974027 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3415/6781] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:31:59.974999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc28cc1-d4cf-4491-968d-3b0225f6f78f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:31:59.999723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc28cc1-d4cf-4491-968d-3b0225f6f78f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:00.011101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51103499549741ad92d16e8e08fd90a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bfdf7fbd2454b5cad90d5876aa4061f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:00.011760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.012078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.012407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] PATH_INFO: `/v3/domains/default` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.018117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:00.020664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:00.022654 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3416/6782] 10.222.0.16 () {58 vars in 1152 bytes} [Sun Sep 11 01:31:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:00.027535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:00.030772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:00.053108 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3367/6783] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:00.058904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7cf19-1d08-494d-9831-49c4642e1ade tempest-DefaultDomainTestJSON-1428256092 tempest-DefaultDomainTestJSON-1428256092-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:00.059344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e690a-b3d7-4885-a13f-820a8e10fd3f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.059743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e690a-b3d7-4885-a13f-820a8e10fd3f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.060635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e690a-b3d7-4885-a13f-820a8e10fd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.089475 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:00.091992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:00.092655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.092929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.093228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] PATH_INFO: `/v3/users/51103499549741ad92d16e8e08fd90a4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.095510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51103499549741ad92d16e8e08fd90a4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:00.097513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:00.118732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-297e690a-b3d7-4885-a13f-820a8e10fd3f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:00.120702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-297e690a-b3d7-4885-a13f-820a8e10fd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:00.146011 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3368/6784] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:00.147008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e690a-b3d7-4885-a13f-820a8e10fd3f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:00.165033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e690a-b3d7-4885-a13f-820a8e10fd3f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:00.180869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:00.181658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.181939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.182221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.182863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:00.183166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:00.184756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:00.218747 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3369/6785] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:00.219938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:00.233049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51103499549741ad92d16e8e08fd90a4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.236686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51103499549741ad92d16e8e08fd90a4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.241549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51103499549741ad92d16e8e08fd90a4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.242626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e135abc-5c4b-4488-9d69-c35095db6aad admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:00.257976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386216cc-4143-4501-925e-f68818047181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:00.259343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386216cc-4143-4501-925e-f68818047181 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.259633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386216cc-4143-4501-925e-f68818047181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.261158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386216cc-4143-4501-925e-f68818047181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.263728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386216cc-4143-4501-925e-f68818047181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:00.265414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51103499549741ad92d16e8e08fd90a4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.269020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386216cc-4143-4501-925e-f68818047181 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:00.282907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51103499549741ad92d16e8e08fd90a4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.347499 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3370/6786] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:00 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:00.348637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386216cc-4143-4501-925e-f68818047181 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:00.352050 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3417/6787] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:00 2022] DELETE /identity/v3/users/51103499549741ad92d16e8e08fd90a4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:00.353198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:00.356626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-386216cc-4143-4501-925e-f68818047181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:00.358036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:00.518369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fa114-7ce3-43fa-bff3-ae208bfd98f4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:00.518788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386216cc-4143-4501-925e-f68818047181 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:00.539508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:00.539508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.539508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.539508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] PATH_INFO: `/v3/projects/4a523744d9c749938650b524314d1db8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.549146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87155fe6-72c0-4c88-a186-6b2a4316fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:00.549146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155fe6-72c0-4c88-a186-6b2a4316fc3c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.549146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155fe6-72c0-4c88-a186-6b2a4316fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.549146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155fe6-72c0-4c88-a186-6b2a4316fc3c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.549605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a523744d9c749938650b524314d1db8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:00.549719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87155fe6-72c0-4c88-a186-6b2a4316fc3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:00.549808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:00.549894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87155fe6-72c0-4c88-a186-6b2a4316fc3c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:00.595272 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3418/6788] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:00 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:00.596797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:00.597309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:00.597736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:00.646189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a523744d9c749938650b524314d1db8', 'request_id': 'req-086fc92f-4321-448f-b416-ac6855fea2f1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.659216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:00.665598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:00.673676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a523744d9c749938650b524314d1db8', 'request_id': 'req-086fc92f-4321-448f-b416-ac6855fea2f1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.691759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a523744d9c749938650b524314d1db8', 'request_id': 'req-086fc92f-4321-448f-b416-ac6855fea2f1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.729427 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:00.731441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] The token cache is being invalidate because project 4a523744d9c749938650b524314d1db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:00.731736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.733525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:00.740589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3371/6789] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:00 2022] DELETE /identity/v3/projects/4a523744d9c749938650b524314d1db8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:00.755640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:00.755640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:00.864397 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3419/6790] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:00.904192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:00.908264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:00.978567 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:01.034479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc92f-4321-448f-b416-ac6855fea2f1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.052132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.052789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.053088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.053376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.054078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.056201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:01.092850 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3372/6791] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:01.105356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:01.117789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e15ba-ffe3-4ac4-ae40-522c9c0ccf28 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.125026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.125987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.126582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.127349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.128083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.134875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:01.178842 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3373/6792] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:01.180093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:01.205337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b3c7-697a-4408-87ad-3f14f343f5bb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.235035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7ffb-cfd9-4663-aea2-be10b0576062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.236228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7ffb-cfd9-4663-aea2-be10b0576062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.236714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7ffb-cfd9-4663-aea2-be10b0576062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.237199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7ffb-cfd9-4663-aea2-be10b0576062 admin admin] PATH_INFO: `/v3/projects/6b4fc1a907994e23897eb5f8e46ba54c/users/6d76b9738b474ab08d06880e650105ae/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.246557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef448-209e-417f-8df6-95fa8701fdb4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.271329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.276016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.276458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.276839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.306060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7ffb-cfd9-4663-aea2-be10b0576062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4fc1a907994e23897eb5f8e46ba54c, user_id=6d76b9738b474ab08d06880e650105ae, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.310442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7ffb-cfd9-4663-aea2-be10b0576062 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:01.311994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.318233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:01.333196 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3374/6793] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:01 2022] PUT /identity/v3/projects/6b4fc1a907994e23897eb5f8e46ba54c/users/6d76b9738b474ab08d06880e650105ae/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:01.349509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335d1c8-a1fa-4821-a22c-dd2c512267ea None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.350069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335d1c8-a1fa-4821-a22c-dd2c512267ea None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.350501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335d1c8-a1fa-4821-a22c-dd2c512267ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.353951 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3420/6794] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:32:01.413498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9335d1c8-a1fa-4821-a22c-dd2c512267ea None None] MFA Rules not processed for user `6d76b9738b474ab08d06880e650105ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:01.414974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9335d1c8-a1fa-4821-a22c-dd2c512267ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:01.536711 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3375/6795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:01.540973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:01.556233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6185c0-6c5e-4a1b-b31f-623467d6b275 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.671405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.673026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.673464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.673858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.674960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.677376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:01.721632 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3421/6796] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:01 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:01.722824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335d1c8-a1fa-4821-a22c-dd2c512267ea None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:01.738512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335d1c8-a1fa-4821-a22c-dd2c512267ea None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.824415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.825582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.826043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.826316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.826960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.830150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:01.872563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:01.872752 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3376/6797] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:01 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:01.887131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ec81-019b-44fc-bc9a-0e8084063968 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.893480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.894245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.894636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.895560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.895906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.898256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:01.916421 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3422/6798] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:32:01.917863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:01.930775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b15cd9-d8c6-4cb5-a085-f6dbd338ee86 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:01.935847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:01.936685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:01.936974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:01.937520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] PATH_INFO: `/v3/projects/db4d6a07ab6b496eac628e8dfdf056db/users/7dc77457b36f449d804329135e15cf8c/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:01.987731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4d6a07ab6b496eac628e8dfdf056db, user_id=7dc77457b36f449d804329135e15cf8c, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:01.991253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:02.066083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:02.067082 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3377/6799] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:01 2022] PUT /identity/v3/projects/db4d6a07ab6b496eac628e8dfdf056db/users/7dc77457b36f449d804329135e15cf8c/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:02.090863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2580-3ca1-4c48-87f3-f98581b4102a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:02.215497 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:02.227299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dadbc-584e-4ec4-b510-9d08e8d4a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:02.228344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dadbc-584e-4ec4-b510-9d08e8d4a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:02.228627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dadbc-584e-4ec4-b510-9d08e8d4a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:02.228922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dadbc-584e-4ec4-b510-9d08e8d4a3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:02.229541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dadbc-584e-4ec4-b510-9d08e8d4a3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:02.231184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dadbc-584e-4ec4-b510-9d08e8d4a3f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:02.244529 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3423/6800] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:02.248376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:02.260870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e07f8-8581-4e1f-84bb-0402588e9e53 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:02.268731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:02.269918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:02.270422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:02.270902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] PATH_INFO: `/v3/projects/db4d6a07ab6b496eac628e8dfdf056db/users/7dc77457b36f449d804329135e15cf8c/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:02.273225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4d6a07ab6b496eac628e8dfdf056db, user_id=7dc77457b36f449d804329135e15cf8c, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:02.278060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:02.283014 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:02.297401 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3378/6801] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:02 2022] PUT /identity/v3/projects/db4d6a07ab6b496eac628e8dfdf056db/users/7dc77457b36f449d804329135e15cf8c/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:02.308940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb78b0-fe4c-4a2b-b499-f197cc390e72 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:02.309265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb78b0-fe4c-4a2b-b499-f197cc390e72 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:02.309549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb78b0-fe4c-4a2b-b499-f197cc390e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:02.368430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1bbb78b0-fe4c-4a2b-b499-f197cc390e72 None None] MFA Rules not processed for user `7dc77457b36f449d804329135e15cf8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:02.370843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1bbb78b0-fe4c-4a2b-b499-f197cc390e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:02.551023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3424/6802] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:02.555662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:02.572435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa4141-11cd-4e29-965e-3cbc4235d4a0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:02.580730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:02.581725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:02.582202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:02.582665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:02.589683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:02.592341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:02.692255 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3379/6803] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:32:02 2022] POST /identity/v3/projects => generated 329 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:02.696858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb78b0-fe4c-4a2b-b499-f197cc390e72 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:02.735347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb78b0-fe4c-4a2b-b499-f197cc390e72 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:02.759762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:02.761588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:02.841434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:02.843118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:02.843523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:02.845541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:02.846657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:02.850712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:02.891832 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3425/6804] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:02 2022] POST /identity/v3/users => generated 413 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:02.897286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:02.905877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1960-0e66-4555-80a9-efc84675a293 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:02.926898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:02.926898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:02.926898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:02.926898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] PATH_INFO: `/v3/projects/6bfdf7fbd2454b5cad90d5876aa4061f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:02.927392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290bbca-9036-4fe5-b8c3-50460797bd29 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:02.928756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfdf7fbd2454b5cad90d5876aa4061f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:02.930923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:02.932577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:02.933479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:02.933980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:02.934486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:02.935387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:02.937255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:02.960674 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3426/6805] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:02 2022] POST /identity/v3/roles => generated 244 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:02.964495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:02.978487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a67c-f458-4369-a975-d12ae6c74980 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:03.033805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfdf7fbd2454b5cad90d5876aa4061f', 'request_id': 'req-1895b636-51a0-4517-9d60-9e6631b89465'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:03.042719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfdf7fbd2454b5cad90d5876aa4061f', 'request_id': 'req-1895b636-51a0-4517-9d60-9e6631b89465'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:03.061226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfdf7fbd2454b5cad90d5876aa4061f', 'request_id': 'req-1895b636-51a0-4517-9d60-9e6631b89465'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:03.092754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] The token cache is being invalidate because project 6bfdf7fbd2454b5cad90d5876aa4061f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:03.093115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:03.094818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1895b636-51a0-4517-9d60-9e6631b89465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:03.097573 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3380/6806] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:02 2022] DELETE /identity/v3/projects/6bfdf7fbd2454b5cad90d5876aa4061f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:03.101979 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:03.104762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c073-f353-4a32-8fda-ee941f7e625b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.105051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c073-f353-4a32-8fda-ee941f7e625b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.105377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c073-f353-4a32-8fda-ee941f7e625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.128088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:03.128833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.129698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.129698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.131571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:03.135360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:03.137367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-84c7c073-f353-4a32-8fda-ee941f7e625b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:03.138636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-84c7c073-f353-4a32-8fda-ee941f7e625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:03.174758 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3427/6807] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:02 2022] POST /identity/v3/roles => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:03.179143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:03.181257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:03.213904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055fdf6-8c77-407d-a031-09ff84e8986b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:03.238436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:03.240197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.241755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.242858 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3381/6808] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:03.243225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/36f4255e26ba4ddd9a120746825067c7/users/539104e996d64e22a37b2a6dff70c212/roles/712f489e951e4efeb79bb593eb516703` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.253559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c476-76ab-4420-bd77-98dd80bf44a4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.254047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c476-76ab-4420-bd77-98dd80bf44a4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.254422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c476-76ab-4420-bd77-98dd80bf44a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.286955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=36f4255e26ba4ddd9a120746825067c7, user_id=539104e996d64e22a37b2a6dff70c212, role_id=712f489e951e4efeb79bb593eb516703)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:03.290272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:03.309849 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:03.321924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3428/6809] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:03 2022] PUT /identity/v3/projects/36f4255e26ba4ddd9a120746825067c7/users/539104e996d64e22a37b2a6dff70c212/roles/712f489e951e4efeb79bb593eb516703 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:03.325960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:03.351572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5d96c476-76ab-4420-bd77-98dd80bf44a4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:03.365052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5d96c476-76ab-4420-bd77-98dd80bf44a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:03.461337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d70a-f91b-47b9-96ed-29a7604f141b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:03.467535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:03.469544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.470091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.470688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/36f4255e26ba4ddd9a120746825067c7/users/539104e996d64e22a37b2a6dff70c212/roles/08e18ec5478b4df3a4232445e116eb5a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.473532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=36f4255e26ba4ddd9a120746825067c7, user_id=539104e996d64e22a37b2a6dff70c212, role_id=08e18ec5478b4df3a4232445e116eb5a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:03.479776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:03.552198 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3429/6810] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:03 2022] PUT /identity/v3/projects/36f4255e26ba4ddd9a120746825067c7/users/539104e996d64e22a37b2a6dff70c212/roles/08e18ec5478b4df3a4232445e116eb5a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:03.556270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:03.572381 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3382/6811] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:03.577444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96c476-76ab-4420-bd77-98dd80bf44a4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:03.605710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96c476-76ab-4420-bd77-98dd80bf44a4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:03.694709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e2368-ca3e-4424-98fd-a96a39ce32fb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:03.710260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596ac37-ca41-40f7-843c-b9f4fd10515c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:03.710718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596ac37-ca41-40f7-843c-b9f4fd10515c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.714051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596ac37-ca41-40f7-843c-b9f4fd10515c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.714480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596ac37-ca41-40f7-843c-b9f4fd10515c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.715682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596ac37-ca41-40f7-843c-b9f4fd10515c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:03.721308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596ac37-ca41-40f7-843c-b9f4fd10515c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:03.788166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:03.790334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.790880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.792121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.793477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:03.793598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:03.799609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:03.814741 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3430/6812] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:03 2022] GET /identity/v3/users => generated 7188 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:03.822523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4654-6137-419c-b4bc-20c54649a9e0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.831936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4654-6137-419c-b4bc-20c54649a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.832451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c4654-6137-419c-b4bc-20c54649a9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.907324 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3383/6813] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:03.911916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:03.928627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594c26e-269a-4d4f-a558-7e3038b3a8df admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:03.943824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:03.944516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:03.945318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:03.945609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:03.947755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:03.952928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:03.962694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-820c4654-6137-419c-b4bc-20c54649a9e0 None None] MFA Rules not processed for user `539104e996d64e22a37b2a6dff70c212`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:03.963931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-820c4654-6137-419c-b4bc-20c54649a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:04.019710 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3384/6814] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:03 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:04.020722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:04.025286 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:04.115392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3431/6815] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:04.117415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da282f8-0204-41bf-95c8-69a8ac27a4e7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:04.117709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da282f8-0204-41bf-95c8-69a8ac27a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:04.118017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da282f8-0204-41bf-95c8-69a8ac27a4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:04.164722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8da282f8-0204-41bf-95c8-69a8ac27a4e7 None None] MFA Rules not processed for user `539104e996d64e22a37b2a6dff70c212`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:04.168495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8da282f8-0204-41bf-95c8-69a8ac27a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:04.175368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36a18-94e7-4e45-85b8-7ac126aca30a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:04.193648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:04.194351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:04.197424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:04.197711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:04.198365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:04.204364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:04.276420 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3385/6816] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:04 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:04.282034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:04.311928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560da0-6f31-4b04-8b53-34aca36e0f85 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:04.335049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:04.335685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:04.335974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:04.336233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:04.336884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:04.341515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:04.348105 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:04.366179 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3432/6817] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:04.372264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da282f8-0204-41bf-95c8-69a8ac27a4e7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:04.374894 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3386/6818] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:04 2022] GET /identity/v3/roles => generated 1893 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:04.395574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da282f8-0204-41bf-95c8-69a8ac27a4e7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:04.404233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539104e996d64e22a37b2a6dff70c212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f4255e26ba4ddd9a120746825067c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1879327002', 'tempest-NotDelegatedRole-1147931894'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:04.405776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:04.406728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:04.407535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:04.409034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] RBAC: Authorizing `identity:create_trust()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:04.410675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:04.412246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:04.437342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e753-9577-44e5-bf7b-3533da3dbce3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:04.445545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:04.446385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:04.446883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:04.447460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:04.448172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:04.451197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:04.500762 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3387/6819] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:04 2022] GET /identity/v3/roles => generated 1893 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:04.503702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:04.548652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f22ee-4513-4af7-afe5-d35c4b61a33b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:04.576163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39348eca-868c-4b58-ad52-338697eb0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:04.594716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348eca-868c-4b58-ad52-338697eb0d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:04.595255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348eca-868c-4b58-ad52-338697eb0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:04.596050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348eca-868c-4b58-ad52-338697eb0d87 admin admin] PATH_INFO: `/v3/projects/7cf38ef23df94893a45be77defff46da/users/24bf8fd1c3ba4546b87856a8e30798d8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:04.684053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39348eca-868c-4b58-ad52-338697eb0d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf38ef23df94893a45be77defff46da, user_id=24bf8fd1c3ba4546b87856a8e30798d8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:04.688789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39348eca-868c-4b58-ad52-338697eb0d87 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:04.749106 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3388/6820] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:04 2022] PUT /identity/v3/projects/7cf38ef23df94893a45be77defff46da/users/24bf8fd1c3ba4546b87856a8e30798d8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:04.755691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873a76-6fc8-45ee-8330-68aa518d8ebd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:04.761603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873a76-6fc8-45ee-8330-68aa518d8ebd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:04.762113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a873a76-6fc8-45ee-8330-68aa518d8ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:04.780742 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3433/6821] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 11 01:32:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:04.786061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:04.850917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9a873a76-6fc8-45ee-8330-68aa518d8ebd None None] MFA Rules not processed for user `24bf8fd1c3ba4546b87856a8e30798d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:04.852967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9a873a76-6fc8-45ee-8330-68aa518d8ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:04.966144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f04b1-e9ee-44f3-9403-4791bfeddcb2 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.010883 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3389/6822] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:05.012879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873a76-6fc8-45ee-8330-68aa518d8ebd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.021441 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:05.023320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a873a76-6fc8-45ee-8330-68aa518d8ebd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.028858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.029712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.030095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.030468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.031244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.032861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.060337 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3390/6823] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 11 01:32:05 2022] POST /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2 => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:05.062076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.082070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a9c87-471c-4854-9818-55d37021b4ea tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.093304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.094141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.094601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.094999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/1c7a80789deb45748b7098b6d05685d1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.100365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8, credential_id=1c7a80789deb45748b7098b6d05685d1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.102151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.131366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.132165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.132535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.133015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.133789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.144248 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3391/6824] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 11 01:32:05 2022] DELETE /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/1c7a80789deb45748b7098b6d05685d1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:05.144915 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:32:05.144915 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:32:05.144915 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:32:05.146129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.150827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.163309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f0f7-5daf-403b-bbd6-8f2a8ddcc5c5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.166770 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3434/6825] 10.222.0.16 () {58 vars in 1155 bytes} [Sun Sep 11 01:32:04 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:05.169775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.175618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.177556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.179134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.179134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.180786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.185847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.222258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3392/6826] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 11 01:32:05 2022] POST /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2 => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:05.225414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.257392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342cf29-30a0-4a54-a600-9e225e01b88e tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.269568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.270508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.270792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.271823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/71f64bb348db40bfb2cb02b2892f0ccb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.284818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8, credential_id=71f64bb348db40bfb2cb02b2892f0ccb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.288271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.366036 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3393/6827] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 11 01:32:05 2022] DELETE /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/71f64bb348db40bfb2cb02b2892f0ccb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:05.367246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.373742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a68233-7735-4bfe-8dc4-ea49caa0e6be tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.378760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defb3c7-dc25-4ccc-8f68-b67278de176a tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.384141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccab766-aebc-47c1-98ba-2a7db28d1981 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.385121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccab766-aebc-47c1-98ba-2a7db28d1981 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.385464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccab766-aebc-47c1-98ba-2a7db28d1981 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.385751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccab766-aebc-47c1-98ba-2a7db28d1981 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/71f64bb348db40bfb2cb02b2892f0ccb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.392254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539104e996d64e22a37b2a6dff70c212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f4255e26ba4ddd9a120746825067c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1879327002', 'tempest-NotDelegatedRole-1147931894'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.393029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.393450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.393866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] PATH_INFO: `/v3/OS-TRUST/trusts/841e74a9423f466aabeadfb2f56489f0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-5ccab766-aebc-47c1-98ba-2a7db28d1981 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Could not find credential: 796648960956af77794b61db3f68ede8a44b93666034762f8f79d15aad7f4c70.: keystone.exception.CredentialNotFound: Could not find credential: 796648960956af77794b61db3f68ede8a44b93666034762f8f79d15aad7f4c70. Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Sep 11 01:32:05.413955 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application with Lock( Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 01:32:05.414986 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._enter() Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.creator() Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application created_value = creator( Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 796648960956af77794b61db3f68ede8a44b93666034762f8f79d15aad7f4c70. Sep 11 01:32:05.416056 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:05.418339 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3394/6828] 10.222.0.16 () {58 vars in 1377 bytes} [Sun Sep 11 01:32:05 2022] GET /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/71f64bb348db40bfb2cb02b2892f0ccb => generated 148 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:32:05.426565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] RBAC: Authorizing `identity:delete_trust(trust_id=841e74a9423f466aabeadfb2f56489f0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.426755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccab766-aebc-47c1-98ba-2a7db28d1981 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.428291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.462112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccab766-aebc-47c1-98ba-2a7db28d1981 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.474639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.475540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.475989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.476405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.477273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.478916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.483065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '841e74a9423f466aabeadfb2f56489f0', 'request_id': 'req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:05.483994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '841e74a9423f466aabeadfb2f56489f0', 'request_id': 'req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:05.485659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '841e74a9423f466aabeadfb2f56489f0', 'request_id': 'req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:05.513381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3435/6829] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 11 01:32:05 2022] DELETE /identity/v3/OS-TRUST/trusts/841e74a9423f466aabeadfb2f56489f0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:05.518197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.519757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:05.523385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3395/6830] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 11 01:32:05 2022] POST /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2 => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:05.533390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.535504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:05.553314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3c8f3-5ffc-442e-8c89-137301c9c25c tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.557175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b565-1e4e-4871-802e-e3f9a26cc9f7 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.563411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539104e996d64e22a37b2a6dff70c212', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f4255e26ba4ddd9a120746825067c7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1879327002', 'tempest-NotDelegatedRole-1147931894'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.564181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.564529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.564974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] PATH_INFO: `/v3/OS-TRUST/trusts/841e74a9423f466aabeadfb2f56489f0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.571361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.572424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.572945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.573411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.574186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.577404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Could not find trust: 841e74a9423f466aabeadfb2f56489f0.: keystone.exception.TrustNotFound: Could not find trust: 841e74a9423f466aabeadfb2f56489f0. Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 11 01:32:05.607786 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 841e74a9423f466aabeadfb2f56489f0. Sep 11 01:32:05.608807 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:05.610914 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3436/6831] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:05 2022] GET /identity/v3/OS-TRUST/trusts/841e74a9423f466aabeadfb2f56489f0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:32:05.613951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.615867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:05.622616 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3396/6832] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 11 01:32:05 2022] POST /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2 => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:05.625656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.642338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ddadd-3b85-4571-bc29-82eeb5803121 tempest-TrustsV3TestJSON-1806630487 tempest-user-865388022] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.648347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.649209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.649607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.650038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/08e18ec5478b4df3a4232445e116eb5a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.651919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=08e18ec5478b4df3a4232445e116eb5a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.654326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.665923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061963bc-bb13-4178-a0aa-d48edf6c3385 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.679900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.681928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.682567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.682944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.684139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=24bf8fd1c3ba4546b87856a8e30798d8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.687025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.702539 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3397/6833] 10.222.0.16 () {58 vars in 1278 bytes} [Sun Sep 11 01:32:05 2022] GET /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2 => generated 865 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:05.713953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.737833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1560-dd0a-4214-bb5d-bee01a8f4e10 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.750494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.752535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.753429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.754188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/fa26c2522f8a48deb6c09b95a8d82ed7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.757445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8, credential_id=fa26c2522f8a48deb6c09b95a8d82ed7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.757666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 08e18ec5478b4df3a4232445e116eb5a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:05.758117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:05.758901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.759031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:05.760904 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3437/6834] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:05 2022] DELETE /identity/v3/roles/08e18ec5478b4df3a4232445e116eb5a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:05.766012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.767754 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:05.768177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:05.789472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3398/6835] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 11 01:32:05 2022] DELETE /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/fa26c2522f8a48deb6c09b95a8d82ed7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:05.793480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:05.796407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:05.817753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be400d83-98c2-47c7-8e75-f645adde354d tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.828486 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:05.880420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc3217-fc0e-4d6a-83bc-6004f0f79d5e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:05.893831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.897983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.898354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.901581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/712f489e951e4efeb79bb593eb516703` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.905296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=712f489e951e4efeb79bb593eb516703)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.910346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.942146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:05.943150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:05.943649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:05.944131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/014358628999477a973db2568aca9626` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:05.947219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8, credential_id=014358628999477a973db2568aca9626)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:05.949417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:05.975584 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3399/6836] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 11 01:32:05 2022] DELETE /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/014358628999477a973db2568aca9626 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:05.985270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.008001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63d214-1526-41cb-ad9c-2f88b889a090 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:06.015356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:06.016489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:06.016880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:06.017398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:06.018583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:06.021782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:06.024735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 712f489e951e4efeb79bb593eb516703 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:06.025248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.026910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.029137 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3438/6837] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:05 2022] DELETE /identity/v3/roles/712f489e951e4efeb79bb593eb516703 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:06.034104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.035993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:06.052913 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3400/6838] 10.222.0.16 () {60 vars in 1299 bytes} [Sun Sep 11 01:32:05 2022] POST /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2 => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:06.058112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.064255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:06.077561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429d1d1-380d-4342-9a17-201909c6db45 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:06.178344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:06.179405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:06.181595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:06.181884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/46cb75c7c5494ad0a848a108d4909ac0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:06.184192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8, credential_id=46cb75c7c5494ad0a848a108d4909ac0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:06.186115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:06.190273 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3401/6839] 10.222.0.16 () {58 vars in 1377 bytes} [Sun Sep 11 01:32:06 2022] GET /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/46cb75c7c5494ad0a848a108d4909ac0 => generated 367 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:06.194004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.206247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e04cd-e546-4f33-b6fd-eaa630b38f95 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:06.208133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f166fb-2e9b-43b2-a494-514220ce396b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:06.212635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24bf8fd1c3ba4546b87856a8e30798d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cf38ef23df94893a45be77defff46da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:06.214355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:06.214916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:06.215442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/46cb75c7c5494ad0a848a108d4909ac0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:06.220597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=24bf8fd1c3ba4546b87856a8e30798d8, credential_id=46cb75c7c5494ad0a848a108d4909ac0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:06.221225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:06.222553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:06.222553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:06.225269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:06.227757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users/539104e996d64e22a37b2a6dff70c212` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:06.230537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_user(user_id=539104e996d64e22a37b2a6dff70c212)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:06.233506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:06.268981 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3402/6840] 10.222.0.16 () {58 vars in 1380 bytes} [Sun Sep 11 01:32:06 2022] DELETE /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8/credentials/OS-EC2/46cb75c7c5494ad0a848a108d4909ac0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:06.271950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.277669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:06.327042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539104e996d64e22a37b2a6dff70c212'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.328028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539104e996d64e22a37b2a6dff70c212'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.329528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539104e996d64e22a37b2a6dff70c212'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.350132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539104e996d64e22a37b2a6dff70c212'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.365948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539104e996d64e22a37b2a6dff70c212'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.419472 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3439/6841] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:06 2022] DELETE /identity/v3/users/539104e996d64e22a37b2a6dff70c212 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:06.424670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.428360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:06.479547 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:06.507014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef900-1e98-4d70-a91c-0315d44c9cf5 tempest-EC2CredentialsTest-1749826564 tempest-EC2CredentialsTest-1749826564-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:06.533598 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:06.559120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfdc91-e672-400b-abd0-4d44a6ccd115 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:06.585395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:06.586313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:06.586726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:06.587008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/36f4255e26ba4ddd9a120746825067c7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:06.588467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36f4255e26ba4ddd9a120746825067c7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:06.590685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:06.611842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:06.612604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:06.612881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:06.613184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] PATH_INFO: `/v3/users/24bf8fd1c3ba4546b87856a8e30798d8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:06.614984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bf8fd1c3ba4546b87856a8e30798d8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:06.617448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:06.697279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bf8fd1c3ba4546b87856a8e30798d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.698703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bf8fd1c3ba4546b87856a8e30798d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.699602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bf8fd1c3ba4546b87856a8e30798d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.711173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bf8fd1c3ba4546b87856a8e30798d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.727743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-601b7cb5-4bf2-420b-9b33-5bef729c6ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bf8fd1c3ba4546b87856a8e30798d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.782559 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3403/6842] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:06 2022] DELETE /identity/v3/users/24bf8fd1c3ba4546b87856a8e30798d8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:06.787703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:06.789115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:06.791211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:06.822033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:06.825294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:06.915367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f4255e26ba4ddd9a120746825067c7', 'request_id': 'req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.921279 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3404/6843] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:06.925736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f4255e26ba4ddd9a120746825067c7', 'request_id': 'req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.933179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f4255e26ba4ddd9a120746825067c7', 'request_id': 'req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.935185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.936956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:06.950274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] The token cache is being invalidate because project 36f4255e26ba4ddd9a120746825067c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:06.950585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.951415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:06.958177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3440/6844] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:06 2022] DELETE /identity/v3/projects/36f4255e26ba4ddd9a120746825067c7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:06.960066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:06.961569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:07.005406 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:07.059010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a564f0-8174-4182-8228-a164ff599574 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.072215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4ced-bac0-48e4-8ce7-30dc0c930d17 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.079851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.080492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.080763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.081041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.081696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.083592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.148352 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3441/6845] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:32:06 2022] POST /identity/v3/projects => generated 328 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:07.148574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.149417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:07.149841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.150204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.150408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.152544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:07.201329 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:07.265580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.267484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.279262 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3405/6846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:32:07.289450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca0064-aefc-4738-8946-e5c400140701 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.307575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.308313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.308659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.309016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.309783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.311842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.366286 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3442/6847] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:07 2022] POST /identity/v3/users => generated 416 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:07.367515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:07.381714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fad6b-192a-422c-ad22-f2d838e15c19 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.389366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.390770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.391201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.391853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.392698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.395285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.421361 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3406/6848] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:07 2022] POST /identity/v3/roles => generated 243 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:07.423246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:07.448188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554322-e67a-4b6b-9848-2c7dc149444d tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.467905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.469322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.469806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.470273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.471149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.473482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.561521 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3443/6849] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:07 2022] POST /identity/v3/roles => generated 247 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:07.563352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:07.591399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56602daa-982b-4518-b60a-63bdfa57efa0 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.598702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.599396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.599680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.599962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/b1895fe836b2462eb3b9d26bc2b48f22/users/325a63998b6e4590ba3a4a52e7f48958/roles/323b83508dfa41c4b476ebf7a4332307` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.652961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b1895fe836b2462eb3b9d26bc2b48f22, user_id=325a63998b6e4590ba3a4a52e7f48958, role_id=323b83508dfa41c4b476ebf7a4332307)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.660827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.717655 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3407/6850] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:07 2022] PUT /identity/v3/projects/b1895fe836b2462eb3b9d26bc2b48f22/users/325a63998b6e4590ba3a4a52e7f48958/roles/323b83508dfa41c4b476ebf7a4332307 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:07.722104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:07.740834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b0235-9db2-4b04-b77d-7cd9a646f4d6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.754234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:07.756710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:07.922717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.923753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.924219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.924650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/b1895fe836b2462eb3b9d26bc2b48f22/users/325a63998b6e4590ba3a4a52e7f48958/roles/d5e3405b9c2e4b9f81b5cb2c1106a451` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.927292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b1895fe836b2462eb3b9d26bc2b48f22, user_id=325a63998b6e4590ba3a4a52e7f48958, role_id=d5e3405b9c2e4b9f81b5cb2c1106a451)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.930275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.933416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03cb03-3cef-476b-8c18-666d7c3be768 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:07.941269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:07.942366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:07.943208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:07.943614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] PATH_INFO: `/v3/projects/7cf38ef23df94893a45be77defff46da` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:07.945553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf38ef23df94893a45be77defff46da)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:07.948523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:07.960703 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3444/6851] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:07 2022] PUT /identity/v3/projects/b1895fe836b2462eb3b9d26bc2b48f22/users/325a63998b6e4590ba3a4a52e7f48958/roles/d5e3405b9c2e4b9f81b5cb2c1106a451 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:07.962051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:07.964009 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:08.064326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf38ef23df94893a45be77defff46da', 'request_id': 'req-d8b10043-1b42-45d3-b80a-0457a86000ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:08.081492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf38ef23df94893a45be77defff46da', 'request_id': 'req-d8b10043-1b42-45d3-b80a-0457a86000ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:08.102538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf38ef23df94893a45be77defff46da', 'request_id': 'req-d8b10043-1b42-45d3-b80a-0457a86000ad'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:08.132922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] The token cache is being invalidate because project 7cf38ef23df94893a45be77defff46da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:08.133386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:08.134467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8b10043-1b42-45d3-b80a-0457a86000ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:08.140934 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3408/6852] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:07 2022] DELETE /identity/v3/projects/7cf38ef23df94893a45be77defff46da => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:08.145373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5a55-591f-4a99-9afd-1a24b21ca216 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.145746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5a55-591f-4a99-9afd-1a24b21ca216 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.146234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5a55-591f-4a99-9afd-1a24b21ca216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.149753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fc814-6ec3-4ba9-8cd8-029f2bbe6a6b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:08.184178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ef3a5a55-591f-4a99-9afd-1a24b21ca216 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:08.186051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef3a5a55-591f-4a99-9afd-1a24b21ca216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:08.247904 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:08.260916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bfd8f-f1f7-434a-8b07-98f42f94f5ff tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:08.261864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfd8f-f1f7-434a-8b07-98f42f94f5ff tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.262300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfd8f-f1f7-434a-8b07-98f42f94f5ff tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.262714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfd8f-f1f7-434a-8b07-98f42f94f5ff tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.263533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bfd8f-f1f7-434a-8b07-98f42f94f5ff tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:08.268455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bfd8f-f1f7-434a-8b07-98f42f94f5ff tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:08.278385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3409/6853] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:08.289271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372ad9-5152-4f1e-a913-1a3bd085d2e5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.289705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372ad9-5152-4f1e-a913-1a3bd085d2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.290079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372ad9-5152-4f1e-a913-1a3bd085d2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.302799 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3445/6854] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:07 2022] GET /identity/v3/users => generated 7191 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:08.304192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b153415-7b55-4807-96cc-1d8e650140a5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.304483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b153415-7b55-4807-96cc-1d8e650140a5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.304763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b153415-7b55-4807-96cc-1d8e650140a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.337536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-14372ad9-5152-4f1e-a913-1a3bd085d2e5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:08.341850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-14372ad9-5152-4f1e-a913-1a3bd085d2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:08.365405 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3410/6855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:08.379271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372ad9-5152-4f1e-a913-1a3bd085d2e5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:08.387427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0b153415-7b55-4807-96cc-1d8e650140a5 None None] MFA Rules not processed for user `325a63998b6e4590ba3a4a52e7f48958`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:08.389180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0b153415-7b55-4807-96cc-1d8e650140a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:08.415455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372ad9-5152-4f1e-a913-1a3bd085d2e5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:08.447094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:08.447817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.448103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.448376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.450789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:08.451111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:08.457225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:08.492407 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3411/6856] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:08.496384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:08.535579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19cbeb-4189-42b3-892b-0c4c4866cbbf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:08.543957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:08.544810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.545237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.545714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.546411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:08.548502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:08.609315 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3412/6857] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:08 2022] POST /identity/v3/projects => generated 397 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:08.613320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:08.616752 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3446/6858] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:08.618258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412d8c-dc74-4169-9fc9-9022174063dc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.618541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412d8c-dc74-4169-9fc9-9022174063dc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.618815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412d8c-dc74-4169-9fc9-9022174063dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.711712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-98412d8c-dc74-4169-9fc9-9022174063dc None None] MFA Rules not processed for user `325a63998b6e4590ba3a4a52e7f48958`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:08.722264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98412d8c-dc74-4169-9fc9-9022174063dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:08.737605 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:08.761012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c832-5b46-4f67-8cf3-dc246bebc2ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:08.773793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:08.774686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.777791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.778230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.785185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:08.787440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:08.837702 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3413/6859] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:08 2022] POST /identity/v3/users => generated 305 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:08.838512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:08.867495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3447/6860] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:08.867729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d109d-4078-4210-be79-cf71c676652c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:08.868740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98412d8c-dc74-4169-9fc9-9022174063dc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:08.883118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98412d8c-dc74-4169-9fc9-9022174063dc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:08.889500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '325a63998b6e4590ba3a4a52e7f48958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1895fe836b2462eb3b9d26bc2b48f22', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1532763887', 'tempest-DelegatedRole-150729009'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:08.890821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.891750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.892074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.892479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:08.893158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.893442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.893587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: Authorizing `identity:create_trust()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:08.893715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:08.894370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:08.895729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:08.899388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:08.925549 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3414/6861] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:08 2022] GET /identity/v3/roles => generated 1892 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:08.933497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:08.958630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d313c-43b5-4930-acf7-d15c434adc31 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:08.977406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:08.977406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:08.977406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:08.977406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] PATH_INFO: `/v3/projects/d8a084cf87244cf28bfa2c6d8e174b34/users/1e5f345435544477be34010469026141/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.017939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a084cf87244cf28bfa2c6d8e174b34, user_id=1e5f345435544477be34010469026141, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:09.022720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:09.055405 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3415/6862] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:08 2022] PUT /identity/v3/projects/d8a084cf87244cf28bfa2c6d8e174b34/users/1e5f345435544477be34010469026141/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:09.059328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.216894 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3448/6863] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 11 01:32:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:09.228492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.236292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ed06-48be-4a4f-b469-163bf22a233f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:09.245362 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:09.254071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:09.254734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:09.255018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:09.255290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.258153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b62f-c899-4f92-859c-b6300fb0d6f1 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:09.258503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:09.260971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:09.299381 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3416/6864] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:09 2022] GET /identity/v3/roles => generated 1892 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:32:09.304970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.337784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d8cd-6eea-4076-854d-5aca3dd5416a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:09.358035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1fb8f-9300-4807-a130-cc3e7a696156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:09.360632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1fb8f-9300-4807-a130-cc3e7a696156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:09.360632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1fb8f-9300-4807-a130-cc3e7a696156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:09.361612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1fb8f-9300-4807-a130-cc3e7a696156 admin admin] PATH_INFO: `/v3/projects/d8a084cf87244cf28bfa2c6d8e174b34/users/1e5f345435544477be34010469026141/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.365484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1fb8f-9300-4807-a130-cc3e7a696156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a084cf87244cf28bfa2c6d8e174b34, user_id=1e5f345435544477be34010469026141, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:09.372774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1fb8f-9300-4807-a130-cc3e7a696156 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:09.412913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '325a63998b6e4590ba3a4a52e7f48958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1895fe836b2462eb3b9d26bc2b48f22', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1532763887', 'tempest-DelegatedRole-150729009'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:09.413157 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3417/6865] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:09 2022] PUT /identity/v3/projects/d8a084cf87244cf28bfa2c6d8e174b34/users/1e5f345435544477be34010469026141/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:09.413995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:09.414554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:09.415316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.416130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:09.417999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:09.430284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a097-7938-4548-803c-c2d54f9298c2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:09.431233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a097-7938-4548-803c-c2d54f9298c2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:09.431552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a097-7938-4548-803c-c2d54f9298c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.437037 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3449/6866] 10.222.0.16 () {58 vars in 1252 bytes} [Sun Sep 11 01:32:09 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=325a63998b6e4590ba3a4a52e7f48958 => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:09.439027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.459192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a81fc-a120-486a-b66c-85f811603e62 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:09.501726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cb17a097-7938-4548-803c-c2d54f9298c2 None None] MFA Rules not processed for user `1e5f345435544477be34010469026141`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:09.503933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb17a097-7938-4548-803c-c2d54f9298c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:09.646298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '325a63998b6e4590ba3a4a52e7f48958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1895fe836b2462eb3b9d26bc2b48f22', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1532763887', 'tempest-DelegatedRole-150729009'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:09.647024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:09.647359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:09.647527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] PATH_INFO: `/v3/OS-TRUST/trusts/227a46de924540b7b6b6fc019a96013d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.661184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: Authorizing `identity:delete_trust(trust_id=227a46de924540b7b6b6fc019a96013d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:09.663098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:09.690377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '227a46de924540b7b6b6fc019a96013d', 'request_id': 'req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:09.691735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '227a46de924540b7b6b6fc019a96013d', 'request_id': 'req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:09.692505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '227a46de924540b7b6b6fc019a96013d', 'request_id': 'req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:09.703735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3418/6867] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:09.716768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a097-7938-4548-803c-c2d54f9298c2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.765115 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3450/6868] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 11 01:32:09 2022] DELETE /identity/v3/OS-TRUST/trusts/227a46de924540b7b6b6fc019a96013d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:09.769915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.774155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:09.777884 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:09.825390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1fe0e-b192-44ee-bdb2-6ddc2e9ed419 tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:09.845833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '325a63998b6e4590ba3a4a52e7f48958', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1895fe836b2462eb3b9d26bc2b48f22', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1532763887', 'tempest-DelegatedRole-150729009'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:09.846340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:09.846626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:09.846904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] PATH_INFO: `/v3/OS-TRUST/trusts/227a46de924540b7b6b6fc019a96013d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Could not find trust: 227a46de924540b7b6b6fc019a96013d.: keystone.exception.TrustNotFound: Could not find trust: 227a46de924540b7b6b6fc019a96013d. Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 11 01:32:09.863564 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 227a46de924540b7b6b6fc019a96013d. Sep 11 01:32:09.864601 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:09.873540 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3451/6869] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:09 2022] GET /identity/v3/OS-TRUST/trusts/227a46de924540b7b6b6fc019a96013d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:32:09.875150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.880180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:09.883821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a097-7938-4548-803c-c2d54f9298c2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:09.888742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:09.889402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:09.889684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:09.889956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:09.890885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:09.892976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:09.933126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3419/6870] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:09 2022] POST /identity/v3/projects => generated 399 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:09.936750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:09.939530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:10.066232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36ab9-7658-457a-ae77-767d469bb76d tempest-TrustsV3TestJSON-784072847 tempest-user-1138987299] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:10.086799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca150353-db84-4e0f-a898-124614819429 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:10.098556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:10.098814 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:10.099622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:10.102230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:10.102942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:10.103631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:10.112633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:10.179682 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3420/6871] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:09 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:10.189606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:10.218241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9c8a-6337-4ae0-a4d9-f7b3bf91375f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:10.239168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:10.239168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:10.239168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:10.239168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:10.239627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:10.240280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:10.273900 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3421/6872] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:10 2022] GET /identity/v3/roles => generated 1892 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:10.275495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:10.275956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:10.276845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:10.277628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:10.278535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/d5e3405b9c2e4b9f81b5cb2c1106a451` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:10.280319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d5e3405b9c2e4b9f81b5cb2c1106a451)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:10.283047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:10.302183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c47-8fb7-474b-9bac-a3fe0eba38ec admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:10.322988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:10.324151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:10.325407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:10.325998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:10.329605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:10.331445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:10.374399 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3422/6873] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:10 2022] GET /identity/v3/roles => generated 1892 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:10.380630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:10.388616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role d5e3405b9c2e4b9f81b5cb2c1106a451 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:10.388840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:10.392605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:10.399226 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3452/6874] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:09 2022] DELETE /identity/v3/roles/d5e3405b9c2e4b9f81b5cb2c1106a451 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:10.400940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:10.409257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe86480-e6f7-445c-90e2-dea5328dbe0a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:10.410268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:10.591529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d704b75-6d22-4955-a726-7c4e174e01ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:10.592217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704b75-6d22-4955-a726-7c4e174e01ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:10.592498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704b75-6d22-4955-a726-7c4e174e01ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:10.592777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704b75-6d22-4955-a726-7c4e174e01ff admin admin] PATH_INFO: `/v3/projects/c43e8a4e508044b48f8ba4af96def3b6/users/d0a3bdb1ad5749538dc0e4ca829b19ed/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:10.604318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dc6df-951a-467b-8e31-1246066c7bfa tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:10.617839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:10.618556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:10.618845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:10.619132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/323b83508dfa41c4b476ebf7a4332307` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:10.623281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=323b83508dfa41c4b476ebf7a4332307)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:10.627541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:10.629270 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:10.636972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d704b75-6d22-4955-a726-7c4e174e01ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43e8a4e508044b48f8ba4af96def3b6, user_id=d0a3bdb1ad5749538dc0e4ca829b19ed, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:10.645666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d704b75-6d22-4955-a726-7c4e174e01ff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:10.706528 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3423/6875] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:10 2022] PUT /identity/v3/projects/c43e8a4e508044b48f8ba4af96def3b6/users/d0a3bdb1ad5749538dc0e4ca829b19ed/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:10.716889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:10.717196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:10.717471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:10.810247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 323b83508dfa41c4b476ebf7a4332307 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:10.810867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:10.812906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:10.818036 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3453/6876] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:10 2022] DELETE /identity/v3/roles/323b83508dfa41c4b476ebf7a4332307 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:10.822735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:10.828413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:10.870821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] MFA Rules not processed for user `d0a3bdb1ad5749538dc0e4ca829b19ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:10.872500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:10.988669 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:11.041557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97a11-7154-4f87-8ccd-b10043904722 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:11.056422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3424/6877] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:11.065458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:11.067125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:11.074682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:11.075357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:11.075649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:11.075915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users/325a63998b6e4590ba3a4a52e7f48958` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:11.081902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_user(user_id=325a63998b6e4590ba3a4a52e7f48958)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:11.083998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:11.210669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325a63998b6e4590ba3a4a52e7f48958'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.214874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325a63998b6e4590ba3a4a52e7f48958'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.216061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325a63998b6e4590ba3a4a52e7f48958'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.283423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ccc9-fdcc-4222-80d8-c5b0c311c92f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:11.289393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:11.293618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:11.294642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:11.297373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:11.301226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325a63998b6e4590ba3a4a52e7f48958'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.302733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:11.316082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325a63998b6e4590ba3a4a52e7f48958'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.349397 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3454/6878] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:10 2022] DELETE /identity/v3/users/325a63998b6e4590ba3a4a52e7f48958 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:11.353505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:11.356616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:11.448347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:11.450335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:11.465048 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3425/6879] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:32:11.495420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b73c8-77c6-4470-b2b5-da93aa8ff52e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:11.502216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:11.503202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:11.503371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:11.503621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/b1895fe836b2462eb3b9d26bc2b48f22` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:11.504786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1895fe836b2462eb3b9d26bc2b48f22)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:11.506959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:11.619989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1895fe836b2462eb3b9d26bc2b48f22', 'request_id': 'req-353127e2-0bd2-478a-8391-57448c6582eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.638255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1895fe836b2462eb3b9d26bc2b48f22', 'request_id': 'req-353127e2-0bd2-478a-8391-57448c6582eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.653255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1895fe836b2462eb3b9d26bc2b48f22', 'request_id': 'req-353127e2-0bd2-478a-8391-57448c6582eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.664241 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:11.700828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] The token cache is being invalidate because project b1895fe836b2462eb3b9d26bc2b48f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:11.701156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.706832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:11.714892 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3455/6880] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:11 2022] DELETE /identity/v3/projects/b1895fe836b2462eb3b9d26bc2b48f22 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:11.721483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:11.738187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690728-0ec7-4981-a1bd-2aed463c60bc service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:11.787740 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:11.887117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:11.887840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:11.888033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:11.888309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:11.888953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:11.896549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:11.977175 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3426/6881] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:32:11 2022] POST /identity/v3/projects => generated 328 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:11.983320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:11.985870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:12.019316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353127e2-0bd2-478a-8391-57448c6582eb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:12.144872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:12.147859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:12.148528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:12.148970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:12.151106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:12.160362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:12.231475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:12.241827 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3456/6882] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:11 2022] POST /identity/v3/users => generated 416 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:12.267781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68831545-0b49-42cd-a946-55eb0c2f04ba tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:12.302206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:12.302206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:12.302206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:12.303863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:12.303863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:12.303863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:12.356166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:12.358085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:12.366606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3427/6883] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:12 2022] POST /identity/v3/roles => generated 244 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:12.369813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:12.399225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc6927-3cb0-4ca3-8afe-5b92fb477f44 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:12.415619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:12.416835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:12.417543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:12.418281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:12.420010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:12.423826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:12.453370 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3428/6884] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:12 2022] POST /identity/v3/roles => generated 245 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:12.457019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:12.472151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d767f59-385d-4128-945c-e924088685c3 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:12.492168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:12.493091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:12.493422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:12.493805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/0055e0d251a2408cb4c82dc021a159e6/users/0eb0f495444948138d037229e833e2eb/roles/74daaefe7324416dafea57dac85bbba2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:12.531757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0055e0d251a2408cb4c82dc021a159e6, user_id=0eb0f495444948138d037229e833e2eb, role_id=74daaefe7324416dafea57dac85bbba2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:12.536664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:12.564812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3429/6885] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:12 2022] PUT /identity/v3/projects/0055e0d251a2408cb4c82dc021a159e6/users/0eb0f495444948138d037229e833e2eb/roles/74daaefe7324416dafea57dac85bbba2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:12.568633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:12.595904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61715d-ac56-4fcc-afd3-600b4db5c54b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:12.729720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a080d-6f36-4df6-93e9-2343d340bd23 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:12.737818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:12.738774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:12.739150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:12.739750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/0055e0d251a2408cb4c82dc021a159e6/users/0eb0f495444948138d037229e833e2eb/roles/75717db0a2ce4e6d8898f0dd9f1921c3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:12.743490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0055e0d251a2408cb4c82dc021a159e6, user_id=0eb0f495444948138d037229e833e2eb, role_id=75717db0a2ce4e6d8898f0dd9f1921c3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:12.746404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:12.761332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:12.762323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:12.764055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:12.764485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] PATH_INFO: `/v3/users/1e5f345435544477be34010469026141` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:12.768615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5f345435544477be34010469026141)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:12.773920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:12.779301 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3430/6886] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:12 2022] PUT /identity/v3/projects/0055e0d251a2408cb4c82dc021a159e6/users/0eb0f495444948138d037229e833e2eb/roles/75717db0a2ce4e6d8898f0dd9f1921c3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:12.783928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:12.908629 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:12.948707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5f345435544477be34010469026141'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:12.950035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5f345435544477be34010469026141'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:12.956448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5f345435544477be34010469026141'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:12.998257 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:12.998740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5f345435544477be34010469026141'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:13.019336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8d5b3a6b-0578-4e57-8495-b697e3b4e2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5f345435544477be34010469026141'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:13.036524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530dac-220b-4aa5-be6e-19f7411611fd tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:13.049573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa8627-cbfe-4341-8c3f-92ef34ef70d9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:13.053036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa8627-cbfe-4341-8c3f-92ef34ef70d9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.053946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa8627-cbfe-4341-8c3f-92ef34ef70d9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.054309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa8627-cbfe-4341-8c3f-92ef34ef70d9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.055069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa8627-cbfe-4341-8c3f-92ef34ef70d9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:13.059117 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3457/6887] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:12 2022] DELETE /identity/v3/users/1e5f345435544477be34010469026141 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:13.060506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.060794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.062570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.063027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa8627-cbfe-4341-8c3f-92ef34ef70d9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:13.108091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:13.110596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:13.198753 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3431/6888] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:12 2022] GET /identity/v3/users => generated 7482 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:13.200404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e31f-3c8d-46c3-a231-91f8404de25b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.216600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e31f-3c8d-46c3-a231-91f8404de25b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.218000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e31f-3c8d-46c3-a231-91f8404de25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.298460 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3458/6889] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:13.348852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7779e31f-3c8d-46c3-a231-91f8404de25b None None] MFA Rules not processed for user `0eb0f495444948138d037229e833e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:13.351828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7779e31f-3c8d-46c3-a231-91f8404de25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:13.367991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:13.370634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:13.536736 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3432/6890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:13.538456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b731-b58c-40c8-85f1-6e3f6edf9f65 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.538752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b731-b58c-40c8-85f1-6e3f6edf9f65 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.538903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7f1f-935f-4e69-b4bd-22c3c5f483f2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:13.539018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b731-b58c-40c8-85f1-6e3f6edf9f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.543748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:13.544369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.544651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.544926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.558220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:13.559587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:13.575724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3459/6891] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:32:13.589009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9121b731-b58c-40c8-85f1-6e3f6edf9f65 None None] MFA Rules not processed for user `0eb0f495444948138d037229e833e2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:13.594324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9121b731-b58c-40c8-85f1-6e3f6edf9f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:13.618125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3433/6892] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:13.620274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:13.647363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6402c-8108-427e-aeac-94499ddf9f8a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:13.653144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:13.654226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.654614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.655173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.658267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:create_trust()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:13.660205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:13.753778 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:13.853008 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3460/6893] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 11 01:32:13 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:13.857326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b731-b58c-40c8-85f1-6e3f6edf9f65 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:13.870714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b731-b58c-40c8-85f1-6e3f6edf9f65 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:13.886099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:13.888922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.889340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.891095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.915298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:get_trust(trust_id=46bd04b36ce548b69e14cfcadcacd529)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:13.918298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:13.938466 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3434/6894] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:13 2022] GET /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529 => generated 859 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:13.942638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:13.954888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef121b-769d-47c7-a58c-bf6500c0a020 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:13.962402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:13.963458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:13.963986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:13.964443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:13.972977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=46bd04b36ce548b69e14cfcadcacd529)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:13.975825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:13.987410 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3461/6895] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 11 01:32:13 2022] GET /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles => generated 371 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:13.991207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.001965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bcf13-8ced-4d74-ba83-1f2dc1e4ad69 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:14.015033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:14.017016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:14.017360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:14.017766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/74daaefe7324416dafea57dac85bbba2` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:14.034868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:get_role_for_trust(trust_id=46bd04b36ce548b69e14cfcadcacd529, role_id=74daaefe7324416dafea57dac85bbba2)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:14.036344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:14.054787 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3435/6896] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 11 01:32:13 2022] GET /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/74daaefe7324416dafea57dac85bbba2 => generated 244 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:14.057756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.074184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671ada6-94c4-483c-af13-993f8a6f7280 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:14.086960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:14.087639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:14.088080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:14.088371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/74daaefe7324416dafea57dac85bbba2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:14.099028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:get_role_for_trust(trust_id=46bd04b36ce548b69e14cfcadcacd529, role_id=74daaefe7324416dafea57dac85bbba2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:14.102183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:14.115780 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3462/6897] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 11 01:32:14 2022] HEAD /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/74daaefe7324416dafea57dac85bbba2 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 11 01:32:14.119875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.148130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93e465-7228-40b5-85c6-ad4c5691c83d tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:14.158856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:14.161852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:14.162340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:14.163937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/75717db0a2ce4e6d8898f0dd9f1921c3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:14.210752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:get_role_for_trust(trust_id=46bd04b36ce548b69e14cfcadcacd529, role_id=75717db0a2ce4e6d8898f0dd9f1921c3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:14.215780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Could not find role: 75717db0a2ce4e6d8898f0dd9f1921c3.: keystone.exception.RoleNotFound: Could not find role: 75717db0a2ce4e6d8898f0dd9f1921c3. Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 01:32:14.256634 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 75717db0a2ce4e6d8898f0dd9f1921c3. Sep 11 01:32:14.257726 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:14.261480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3436/6898] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 11 01:32:14 2022] GET /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/75717db0a2ce4e6d8898f0dd9f1921c3 => generated 110 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:32:14.267376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.282095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daef4e-899e-45cf-86f5-081e0596d1ab tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:14.291421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:14.295574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:14.296430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:14.296945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/75717db0a2ce4e6d8898f0dd9f1921c3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:14.320681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:get_role_for_trust(trust_id=46bd04b36ce548b69e14cfcadcacd529, role_id=75717db0a2ce4e6d8898f0dd9f1921c3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:14.323361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Could not find role: 75717db0a2ce4e6d8898f0dd9f1921c3.: keystone.exception.RoleNotFound: Could not find role: 75717db0a2ce4e6d8898f0dd9f1921c3. Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 01:32:14.352705 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 75717db0a2ce4e6d8898f0dd9f1921c3. Sep 11 01:32:14.354451 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:14.360817 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3463/6899] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 11 01:32:14 2022] HEAD /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529/roles/75717db0a2ce4e6d8898f0dd9f1921c3 => generated 0 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 11 01:32:14.364792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.411126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4df66-bab6-47e0-aeed-37a1d80bbfc9 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:14.447412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:14.448340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:14.448764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:14.449224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:14.469496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorizing `identity:delete_trust(trust_id=46bd04b36ce548b69e14cfcadcacd529)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:14.471490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:14.546582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '46bd04b36ce548b69e14cfcadcacd529', 'request_id': 'req-7889c75f-77bf-4613-826a-47018713a3a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:14.547874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '46bd04b36ce548b69e14cfcadcacd529', 'request_id': 'req-7889c75f-77bf-4613-826a-47018713a3a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:14.548652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '46bd04b36ce548b69e14cfcadcacd529', 'request_id': 'req-7889c75f-77bf-4613-826a-47018713a3a2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:14.576505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3437/6900] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 11 01:32:14 2022] DELETE /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:14.580695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.583285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:14.614000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee279f5a-7181-4f90-b56e-5c1bd0c3fac2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:14.632968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0eb0f495444948138d037229e833e2eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0055e0d251a2408cb4c82dc021a159e6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1305124432', 'tempest-NotDelegatedRole-66581717'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:14.634953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.637503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:14.645414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:14.647581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:14.652009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] PATH_INFO: `/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Could not find trust: 46bd04b36ce548b69e14cfcadcacd529.: keystone.exception.TrustNotFound: Could not find trust: 46bd04b36ce548b69e14cfcadcacd529. Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 11 01:32:14.685896 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 46bd04b36ce548b69e14cfcadcacd529. Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:14.687090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3464/6901] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:14 2022] GET /identity/v3/OS-TRUST/trusts/46bd04b36ce548b69e14cfcadcacd529 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:32:14.688146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889c75f-77bf-4613-826a-47018713a3a2 tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:14.696806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:14.702388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:14.705932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:14.707250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:14.707649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:14.707929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] PATH_INFO: `/v3/projects/d8a084cf87244cf28bfa2c6d8e174b34` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:14.712804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a084cf87244cf28bfa2c6d8e174b34)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:14.722856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:14.909869 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:14.991743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a084cf87244cf28bfa2c6d8e174b34', 'request_id': 'req-a3160479-f060-408b-882d-13ad5e7fad15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.002731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a084cf87244cf28bfa2c6d8e174b34', 'request_id': 'req-a3160479-f060-408b-882d-13ad5e7fad15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.005374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f8c4b-7b70-4179-a9c2-8a994337cb1a tempest-TrustsV3TestJSON-636993530 tempest-user-2091350431] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:15.019215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a084cf87244cf28bfa2c6d8e174b34', 'request_id': 'req-a3160479-f060-408b-882d-13ad5e7fad15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.081773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] The token cache is being invalidate because project d8a084cf87244cf28bfa2c6d8e174b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:15.082073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.088202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.096163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3438/6902] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:14 2022] DELETE /identity/v3/projects/d8a084cf87244cf28bfa2c6d8e174b34 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:15.105710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:15.114424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:15.169091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:15.169773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:15.170239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:15.170682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/75717db0a2ce4e6d8898f0dd9f1921c3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:15.174155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=75717db0a2ce4e6d8898f0dd9f1921c3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:15.176213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:15.257109 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:15.276107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 75717db0a2ce4e6d8898f0dd9f1921c3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:15.276370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.285612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.287902 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3465/6903] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:14 2022] DELETE /identity/v3/roles/75717db0a2ce4e6d8898f0dd9f1921c3 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:15.292346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:15.294026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:15.382884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160479-f060-408b-882d-13ad5e7fad15 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:15.472184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e6a62-9987-4e1c-a498-c3755a404db4 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:15.495186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:15.496999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:15.500612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:15.502099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/74daaefe7324416dafea57dac85bbba2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:15.511180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=74daaefe7324416dafea57dac85bbba2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:15.513082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:15.613656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:15.614612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:15.615079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:15.615546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] PATH_INFO: `/v3/users/d0a3bdb1ad5749538dc0e4ca829b19ed` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:15.616992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a3bdb1ad5749538dc0e4ca829b19ed)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:15.619387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:15.667126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 74daaefe7324416dafea57dac85bbba2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:15.667625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.670576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.685491 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3466/6904] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:15 2022] DELETE /identity/v3/roles/74daaefe7324416dafea57dac85bbba2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:15.694089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:15.697111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:15.769424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a3bdb1ad5749538dc0e4ca829b19ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.771502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a3bdb1ad5749538dc0e4ca829b19ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.772885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a3bdb1ad5749538dc0e4ca829b19ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.789454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a3bdb1ad5749538dc0e4ca829b19ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.803306 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:15.820573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a3bdb1ad5749538dc0e4ca829b19ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:15.856738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05cc99-004c-49e0-ad40-1bd5ee96f670 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:15.860243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3439/6905] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:15 2022] DELETE /identity/v3/users/d0a3bdb1ad5749538dc0e4ca829b19ed => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:15.996059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:15.996815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:15.997118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:15.997402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users/0eb0f495444948138d037229e833e2eb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:16.001584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0eb0f495444948138d037229e833e2eb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:16.007149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:16.039657 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:16.166385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb0f495444948138d037229e833e2eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.170435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb0f495444948138d037229e833e2eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.171826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb0f495444948138d037229e833e2eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.211275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb0f495444948138d037229e833e2eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.233648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb0f495444948138d037229e833e2eb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.259713 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3467/6906] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:15 2022] DELETE /identity/v3/users/0eb0f495444948138d037229e833e2eb => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:16.263593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:16.265440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:16.290477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5942-af6d-4df5-82ce-3650e9ae1f90 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:16.414581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:16.415397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:16.415755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:16.416108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/0055e0d251a2408cb4c82dc021a159e6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:16.417509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0055e0d251a2408cb4c82dc021a159e6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:16.423123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:16.521933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0055e0d251a2408cb4c82dc021a159e6', 'request_id': 'req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.545683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0055e0d251a2408cb4c82dc021a159e6', 'request_id': 'req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.580927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0055e0d251a2408cb4c82dc021a159e6', 'request_id': 'req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.599663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] The token cache is being invalidate because project 0055e0d251a2408cb4c82dc021a159e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:16.599961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.600810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:16.610357 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3440/6907] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:16 2022] DELETE /identity/v3/projects/0055e0d251a2408cb4c82dc021a159e6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:16.616399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:16.617897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:16.645373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2b229-3fcb-404b-96c8-b51dff22789f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:16.772306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:16.772986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:16.773302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:16.775407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:16.776077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:16.783789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:16.861183 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3468/6908] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:32:16 2022] POST /identity/v3/projects => generated 328 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:16.862518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:16.863987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:16.891987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fab6bf-1c6a-4f4d-a68f-03cae88ab340 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:17.026154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:17.028840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.030316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.030963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.034287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:17.036496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:17.099961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:17.102880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:17.130904 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=9,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:17.139209 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3441/6909] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:16 2022] POST /identity/v3/users => generated 413 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:17.143449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:17.163962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b7215-8f43-482e-b2dd-712e577c5f9c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:17.183663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:17.184213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.184496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.184770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.186357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:17.188857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:17.226425 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3442/6910] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:17 2022] POST /identity/v3/roles => generated 244 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:17.227599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:17.243662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efb5b-f773-4773-9971-513c046bc47e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:17.250870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:17.251546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.251829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.252102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.252765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:17.254396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:17.271342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1ebf1-4dd6-484d-96d9-14183cd36f01 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:17.280230 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3443/6911] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:17 2022] POST /identity/v3/roles => generated 247 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:17.283071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:17.286103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:17.287033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.287314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.287583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] PATH_INFO: `/v3/projects/c43e8a4e508044b48f8ba4af96def3b6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.289979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43e8a4e508044b48f8ba4af96def3b6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:17.294150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:17.309979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024881e7-2f29-4186-8b37-8eb8807b3876 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:17.321527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:17.322429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.322715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.326424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/32b63b382ca849fc889650872486f510/users/4be968155d1248f7a65d15726c7cf670/roles/3e98606ef52a4f2783dfee4ed45b321b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.335330 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:17.361641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32b63b382ca849fc889650872486f510, user_id=4be968155d1248f7a65d15726c7cf670, role_id=3e98606ef52a4f2783dfee4ed45b321b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:17.369829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:17.400251 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3444/6912] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:17 2022] PUT /identity/v3/projects/32b63b382ca849fc889650872486f510/users/4be968155d1248f7a65d15726c7cf670/roles/3e98606ef52a4f2783dfee4ed45b321b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:17.404367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:17.410731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43e8a4e508044b48f8ba4af96def3b6', 'request_id': 'req-66f06624-cb3c-4fc2-b022-152bd4d6d010'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:17.419821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43e8a4e508044b48f8ba4af96def3b6', 'request_id': 'req-66f06624-cb3c-4fc2-b022-152bd4d6d010'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:17.430444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43e8a4e508044b48f8ba4af96def3b6', 'request_id': 'req-66f06624-cb3c-4fc2-b022-152bd4d6d010'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:17.455017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] The token cache is being invalidate because project c43e8a4e508044b48f8ba4af96def3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:17.455321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:17.457631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66f06624-cb3c-4fc2-b022-152bd4d6d010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:17.460102 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3469/6913] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:17 2022] DELETE /identity/v3/projects/c43e8a4e508044b48f8ba4af96def3b6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:17.465267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a46f-8543-45bf-9cb0-a9b6f3989aa7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.465545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a46f-8543-45bf-9cb0-a9b6f3989aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.465918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456a46f-8543-45bf-9cb0-a9b6f3989aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.511486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2456a46f-8543-45bf-9cb0-a9b6f3989aa7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:17.513553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2456a46f-8543-45bf-9cb0-a9b6f3989aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:17.577287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afb122-ca64-40d8-9d8a-d871b5253767 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:17.738381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3470/6914] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:17.742218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.742513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.743708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.783880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:17.785577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:17.786623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:17.787929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/32b63b382ca849fc889650872486f510/users/4be968155d1248f7a65d15726c7cf670/roles/727c20451c714c669382146ce4c47fbd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:17.794018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32b63b382ca849fc889650872486f510, user_id=4be968155d1248f7a65d15726c7cf670, role_id=727c20451c714c669382146ce4c47fbd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:17.799921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:17.803508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:17.804831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:17.841483 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3471/6915] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:17.846882 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3445/6916] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:17 2022] PUT /identity/v3/projects/32b63b382ca849fc889650872486f510/users/4be968155d1248f7a65d15726c7cf670/roles/727c20451c714c669382146ce4c47fbd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:17.853170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:17.854442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:17.860754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:17.907641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7aa59-d1c1-4f8b-9cf3-e4e05f69071d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.001087 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:18.040240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beab0a-0c2b-4b1f-9c24-20f502bd828e tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.052827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.053834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.054245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.054619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.055655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:18.056080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.057891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.064358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef713e-9b54-482c-a368-77637a3a7eef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.065255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef713e-9b54-482c-a368-77637a3a7eef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.065899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef713e-9b54-482c-a368-77637a3a7eef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.066428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef713e-9b54-482c-a368-77637a3a7eef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.067483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef713e-9b54-482c-a368-77637a3a7eef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.070260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef713e-9b54-482c-a368-77637a3a7eef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.077936 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3446/6917] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:18.079268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.095041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589a82-ebb3-4d17-b3dd-f7ca2a084eba admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.118079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.123972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.125343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.125630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.126612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.130806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.162549 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3472/6918] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:17 2022] GET /identity/v3/users => generated 7188 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:18.164361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c02e3-8dc3-462b-ad12-c572e346491e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.165243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c02e3-8dc3-462b-ad12-c572e346491e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.171808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c02e3-8dc3-462b-ad12-c572e346491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.220844 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3447/6919] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:18 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:18.224518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.306306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-142c02e3-8dc3-462b-ad12-c572e346491e None None] MFA Rules not processed for user `4be968155d1248f7a65d15726c7cf670`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:18.307678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-142c02e3-8dc3-462b-ad12-c572e346491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:18.332334 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:18.371232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068503-7467-42dc-83ba-7b759792071a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.377459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.378091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.378371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.378639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.379277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.381232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.426567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3448/6920] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:18 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:18.429290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.454573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3473/6921] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:18.467778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77155240-b0cf-4899-8bc2-3466fce81c7e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.468222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77155240-b0cf-4899-8bc2-3466fce81c7e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.468574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77155240-b0cf-4899-8bc2-3466fce81c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.477826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef1b36-dd15-4f48-94de-8105d9f2ce08 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.488054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.489583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.490684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.492709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.493971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.494514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-77155240-b0cf-4899-8bc2-3466fce81c7e None None] MFA Rules not processed for user `4be968155d1248f7a65d15726c7cf670`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:18.495750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-77155240-b0cf-4899-8bc2-3466fce81c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:18.501918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.524262 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3449/6922] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:18 2022] GET /identity/v3/roles => generated 1893 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:32:18.525254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.526596 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3474/6923] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:18.531913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77155240-b0cf-4899-8bc2-3466fce81c7e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.543217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77155240-b0cf-4899-8bc2-3466fce81c7e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.548521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be968155d1248f7a65d15726c7cf670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32b63b382ca849fc889650872486f510', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1978117013', 'tempest-NotDelegatedRole-1914782931'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.549185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.549461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.549818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.550532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] RBAC: Authorizing `identity:create_trust()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.551944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.566385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8713cb-d1d8-4d37-b4c7-29b00bf561d6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.601303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.602754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.603247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.603724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] PATH_INFO: `/v3/projects/8ad507874fb14311a3f5786e8b86ea55/users/ec32074a5fab4a86814c5cd529777d94/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.647073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad507874fb14311a3f5786e8b86ea55, user_id=ec32074a5fab4a86814c5cd529777d94, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.657740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.692919 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3450/6924] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:18 2022] PUT /identity/v3/projects/8ad507874fb14311a3f5786e8b86ea55/users/ec32074a5fab4a86814c5cd529777d94/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:18.694302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Sep 11 01:32:18.701888 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise ValueError(str(e)) Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Sep 11 01:32:18.703709 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Sep 11 01:32:18.705001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Sep 11 01:32:18.705001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Sep 11 01:32:18.705001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Sep 11 01:32:18.705001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Sep 11 01:32:18.705001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 11 01:32:18.705001 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:18.705001 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3475/6925] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 11 01:32:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 173 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:32:18.708228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.815349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc40ff-8ae6-461f-bcea-8e29abe12222 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.822446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.823633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.823918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.824198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.824849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.826538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.852808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367875a-b24f-4e0b-91ff-9a25948bd37d tempest-TrustsV3TestJSON-967321308 tempest-user-581292396] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.853941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3451/6926] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:18 2022] GET /identity/v3/roles => generated 1893 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:18.857342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:18.888011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3aed8-1747-4076-b52d-1563943ffbf9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:18.901728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59b232-80c3-47ec-89fd-330b278df6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:18.902835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b232-80c3-47ec-89fd-330b278df6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.903111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b232-80c3-47ec-89fd-330b278df6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.904907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b232-80c3-47ec-89fd-330b278df6c5 admin admin] PATH_INFO: `/v3/projects/8ad507874fb14311a3f5786e8b86ea55/users/ec32074a5fab4a86814c5cd529777d94/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:18.912116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59b232-80c3-47ec-89fd-330b278df6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad507874fb14311a3f5786e8b86ea55, user_id=ec32074a5fab4a86814c5cd529777d94, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:18.923819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59b232-80c3-47ec-89fd-330b278df6c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:18.952536 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:18.976592 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3452/6927] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:18 2022] PUT /identity/v3/projects/8ad507874fb14311a3f5786e8b86ea55/users/ec32074a5fab4a86814c5cd529777d94/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:18.978308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:18.978591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:18.978902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.000969 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:19.016486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.018232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.019852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.020246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/727c20451c714c669382146ce4c47fbd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.023880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=727c20451c714c669382146ce4c47fbd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.025650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.040254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] MFA Rules not processed for user `ec32074a5fab4a86814c5cd529777d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:19.041536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.118171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 727c20451c714c669382146ce4c47fbd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:19.118619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.119627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.122315 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3476/6928] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:18 2022] DELETE /identity/v3/roles/727c20451c714c669382146ce4c47fbd => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:19.128381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.131531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.195760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3453/6929] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:19.196963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.199099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.284201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255974f-c14b-4390-8b28-7f6b3e955ea6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.289917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.290588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.290865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.291135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/3e98606ef52a4f2783dfee4ed45b321b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.292576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3e98606ef52a4f2783dfee4ed45b321b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.294355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.336892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d887d-3461-4d5f-a8be-bbe35c319e5e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.357850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 3e98606ef52a4f2783dfee4ed45b321b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:19.358408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.360415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.363312 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3477/6930] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:19 2022] DELETE /identity/v3/roles/3e98606ef52a4f2783dfee4ed45b321b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:19.377640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.379799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.442770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.443557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.443988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.444306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.444951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.448735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.472590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445d09-3a51-43f8-8b5b-0525e5b6a985 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.477959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.478780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.479184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.479568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users/4be968155d1248f7a65d15726c7cf670` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.480727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4be968155d1248f7a65d15726c7cf670)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.482882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.495853 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3454/6931] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:19 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:19.500470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.502661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.524069 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:19.546323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be968155d1248f7a65d15726c7cf670'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.550217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be968155d1248f7a65d15726c7cf670'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.550416 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:19.550913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be968155d1248f7a65d15726c7cf670'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.568380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be968155d1248f7a65d15726c7cf670'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.576785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be968155d1248f7a65d15726c7cf670'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.594022 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3478/6932] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:19 2022] DELETE /identity/v3/users/4be968155d1248f7a65d15726c7cf670 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:19.599341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.616940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.617185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2860e-19ed-4d2f-9034-ba2c573a5a1f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.688050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.688929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.689510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.689851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.690563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.692642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.722027 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3455/6933] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:19 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:19.725779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.727607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.741494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b658b0-b29c-476b-9ffb-0bedb093b600 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.743223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee102081-1b86-4951-8405-9ee427edbc06 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.748683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.751484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.752454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.753405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/32b63b382ca849fc889650872486f510` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.755120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.755921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.757316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32b63b382ca849fc889650872486f510)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.757780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.758394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.760054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.763177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.764998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.781644 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3456/6934] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:19.791488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.808918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865d011-0162-4139-a27b-14eb02917846 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.818200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.819052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.819475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.819939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.820597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.822318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.838943 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3457/6935] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:19.844257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.858559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b63b382ca849fc889650872486f510', 'request_id': 'req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.859197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1651227-2256-4e14-8811-b902d9e3d543 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:19.865664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b63b382ca849fc889650872486f510', 'request_id': 'req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.873938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b63b382ca849fc889650872486f510', 'request_id': 'req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.900214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] The token cache is being invalidate because project 32b63b382ca849fc889650872486f510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:19.901104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.901964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:19.904522 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3479/6936] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:19 2022] DELETE /identity/v3/projects/32b63b382ca849fc889650872486f510 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:19.911530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:19.913392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:19.941123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29de570-be48-4b23-ab48-e55b4cc4f4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:19.941835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29de570-be48-4b23-ab48-e55b4cc4f4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:19.942117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29de570-be48-4b23-ab48-e55b4cc4f4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:19.942394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29de570-be48-4b23-ab48-e55b4cc4f4b3 admin admin] PATH_INFO: `/v3/projects/869d982efd7849cc9cc1f2fcd9688d36/users/fa8e2a3c43b140e4a21d5d41bd75bf82/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:19.962951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29de570-be48-4b23-ab48-e55b4cc4f4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869d982efd7849cc9cc1f2fcd9688d36, user_id=fa8e2a3c43b140e4a21d5d41bd75bf82, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:19.966357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29de570-be48-4b23-ab48-e55b4cc4f4b3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:19.975551 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:19.998558 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3458/6937] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:19 2022] PUT /identity/v3/projects/869d982efd7849cc9cc1f2fcd9688d36/users/fa8e2a3c43b140e4a21d5d41bd75bf82/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:20.000820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.002013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.002290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.020169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0c4a6-2fd5-4c48-ad91-9dcf322c1f8a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.038988 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:20.044102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] MFA Rules not processed for user `fa8e2a3c43b140e4a21d5d41bd75bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:20.047342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:20.088998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:20.090175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.090613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.092034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.092823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:20.095209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:20.143308 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3480/6938] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:32:19 2022] POST /identity/v3/projects => generated 329 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:20.147178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:20.153165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3459/6939] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:20.167952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:20.169918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:20.244257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1959289-13ea-40bc-b7fc-9f0e874bbce9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.274657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd94c8a-09c3-4827-b216-03340d03a967 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.292803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:20.294044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.295373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.295916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.297190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:20.300641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:20.335112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:20.335812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.336234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.336576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.339090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:20.353110 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3481/6940] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:20 2022] POST /identity/v3/users => generated 416 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:20.355060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:20.384762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902b3c9-1793-4ac8-8c82-ac795d78a4c1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.395145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:20.397135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.398252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.401992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.403017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:20.404836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:20.432363 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3482/6941] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:20 2022] POST /identity/v3/roles => generated 243 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:20.435445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:20.456243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7c9b-d9bb-4380-8a69-b542940fbbe5 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.467054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:20.470951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.471356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.471739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.473324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:20.477287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:20.490498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:20.493027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:20.514209 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3483/6942] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:20 2022] POST /identity/v3/roles => generated 246 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:20.519289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:20.545222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dc32a-6428-41a6-8e54-f8b8c587c249 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.552536 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3460/6943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:32:20.554803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:20.556117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.556458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.556854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/0dd6bce9bd574c02af55254414a505cf/users/5e1060f86caa42dca7d38ddb22435df1/roles/ecd04b498b9441a384d44729b8910d87` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.603233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dd6bce9bd574c02af55254414a505cf, user_id=5e1060f86caa42dca7d38ddb22435df1, role_id=ecd04b498b9441a384d44729b8910d87)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:20.610415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:20.639751 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3484/6944] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:20 2022] PUT /identity/v3/projects/0dd6bce9bd574c02af55254414a505cf/users/5e1060f86caa42dca7d38ddb22435df1/roles/ecd04b498b9441a384d44729b8910d87 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:20.644724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:20.667039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6be4d-97c9-4888-b204-9c685111cdb1 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.681969 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:20.829918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd1a33-2571-42f7-8450-3e319f9bb87b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:20.830550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1a33-2571-42f7-8450-3e319f9bb87b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:20.830833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1a33-2571-42f7-8450-3e319f9bb87b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:20.831109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1a33-2571-42f7-8450-3e319f9bb87b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/0dd6bce9bd574c02af55254414a505cf/users/5e1060f86caa42dca7d38ddb22435df1/roles/28c0555fea1645dbb6bcec9863b6d757` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:20.837581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd1a33-2571-42f7-8450-3e319f9bb87b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dd6bce9bd574c02af55254414a505cf, user_id=5e1060f86caa42dca7d38ddb22435df1, role_id=28c0555fea1645dbb6bcec9863b6d757)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:20.840396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd1a33-2571-42f7-8450-3e319f9bb87b tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:20.875344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3461/6945] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:20 2022] PUT /identity/v3/projects/0dd6bce9bd574c02af55254414a505cf/users/5e1060f86caa42dca7d38ddb22435df1/roles/28c0555fea1645dbb6bcec9863b6d757 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:20.880218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:20.904713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b692f-ffdd-44cd-b0f0-ab9ba159c22c tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:20.925258 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:21.094440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55251a73-7b05-48ff-9e3c-53db24f5bac1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:21.094976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251a73-7b05-48ff-9e3c-53db24f5bac1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:21.095254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251a73-7b05-48ff-9e3c-53db24f5bac1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:21.095527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251a73-7b05-48ff-9e3c-53db24f5bac1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:21.096197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55251a73-7b05-48ff-9e3c-53db24f5bac1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:21.102657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55251a73-7b05-48ff-9e3c-53db24f5bac1 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:21.169354 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3485/6946] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:20 2022] GET /identity/v3/users => generated 7760 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:21.173517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493247c-890f-4230-a8bb-9df9e38b6aa6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:21.173804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493247c-890f-4230-a8bb-9df9e38b6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:21.174079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493247c-890f-4230-a8bb-9df9e38b6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:21.255729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8493247c-890f-4230-a8bb-9df9e38b6aa6 None None] MFA Rules not processed for user `5e1060f86caa42dca7d38ddb22435df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:21.256987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8493247c-890f-4230-a8bb-9df9e38b6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:21.401841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3462/6947] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:21.404961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd4cbb-236a-4b56-a6ee-d5a83385e5f0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:21.405398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd4cbb-236a-4b56-a6ee-d5a83385e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:21.406545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd4cbb-236a-4b56-a6ee-d5a83385e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:21.434311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-70fd4cbb-236a-4b56-a6ee-d5a83385e5f0 None None] MFA Rules not processed for user `5e1060f86caa42dca7d38ddb22435df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:21.435875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-70fd4cbb-236a-4b56-a6ee-d5a83385e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:21.461122 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3486/6948] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:21.465046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493247c-890f-4230-a8bb-9df9e38b6aa6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:21.497886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493247c-890f-4230-a8bb-9df9e38b6aa6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:21.506431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:21.507122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:21.507407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:21.507679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:21.508356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:create_trust()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:21.511626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:21.749151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd4cbb-236a-4b56-a6ee-d5a83385e5f0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:21.756291 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3463/6949] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 11 01:32:21 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:21.764605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd4cbb-236a-4b56-a6ee-d5a83385e5f0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:21.780451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:21.785647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:21.786156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:21.787621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:21.805466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:get_trust(trust_id=f2a067dc07334062b4ecc5a9820681e0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:21.806950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:21.831510 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3487/6950] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:21 2022] GET /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0 => generated 833 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:21.836565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:21.850950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a25ac-92f5-4318-8752-b5a793513b40 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:21.860351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:21.862152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:21.862504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:21.863193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:21.878135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=f2a067dc07334062b4ecc5a9820681e0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:21.882936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:21.919999 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:21.940166 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3464/6951] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 11 01:32:21 2022] GET /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles => generated 370 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:21.940917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:21.964815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6e0e-9ee9-47ca-bb8c-ecb2bebbd3f6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:21.989313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:21.991284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:21.991792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:21.992255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/ecd04b498b9441a384d44729b8910d87` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.002025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f2a067dc07334062b4ecc5a9820681e0, role_id=ecd04b498b9441a384d44729b8910d87)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.003653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.021024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.029613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3488/6952] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 11 01:32:21 2022] GET /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/ecd04b498b9441a384d44729b8910d87 => generated 243 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:22.034410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca388-284e-41d0-8458-3d5e46e0b59b tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.040023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.040937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.041396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.041846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/ecd04b498b9441a384d44729b8910d87` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.054738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f2a067dc07334062b4ecc5a9820681e0, role_id=ecd04b498b9441a384d44729b8910d87)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.056942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.085281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.085661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3465/6953] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 11 01:32:22 2022] HEAD /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/ecd04b498b9441a384d44729b8910d87 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 11 01:32:22.095847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5290a-51c5-431d-a29c-674fbc01e83a tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.102385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.103209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.103491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.103765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/28c0555fea1645dbb6bcec9863b6d757` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.121307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f2a067dc07334062b4ecc5a9820681e0, role_id=28c0555fea1645dbb6bcec9863b6d757)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.123117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Could not find role: 28c0555fea1645dbb6bcec9863b6d757.: keystone.exception.RoleNotFound: Could not find role: 28c0555fea1645dbb6bcec9863b6d757. Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 01:32:22.139050 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 28c0555fea1645dbb6bcec9863b6d757. Sep 11 01:32:22.140777 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:22.143674 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3489/6954] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 11 01:32:22 2022] GET /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/28c0555fea1645dbb6bcec9863b6d757 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:32:22.148406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.170439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5602b-1bdc-4153-bede-7f46b23b6274 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.197907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.198661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.201584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.201584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/28c0555fea1645dbb6bcec9863b6d757` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.211199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f2a067dc07334062b4ecc5a9820681e0, role_id=28c0555fea1645dbb6bcec9863b6d757)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.213755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Could not find role: 28c0555fea1645dbb6bcec9863b6d757.: keystone.exception.RoleNotFound: Could not find role: 28c0555fea1645dbb6bcec9863b6d757. Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 01:32:22.237987 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 28c0555fea1645dbb6bcec9863b6d757. Sep 11 01:32:22.243838 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:22.243838 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3466/6955] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 11 01:32:22 2022] HEAD /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0/roles/28c0555fea1645dbb6bcec9863b6d757 => generated 0 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 11 01:32:22.244906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.246892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:22.267173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.315218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a46f9-d66c-42a3-b600-961c57e1bf4d tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.333709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.334367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.335521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.335747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.364769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorizing `identity:delete_trust(trust_id=f2a067dc07334062b4ecc5a9820681e0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.367961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.462293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e16cf-9cb7-4485-ad24-0d786dd538e8 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.468760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.469498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.469790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.470105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] PATH_INFO: `/v3/users/ec32074a5fab4a86814c5cd529777d94` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.471749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec32074a5fab4a86814c5cd529777d94)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.473790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.474217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f2a067dc07334062b4ecc5a9820681e0', 'request_id': 'req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.474970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f2a067dc07334062b4ecc5a9820681e0', 'request_id': 'req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.475673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f2a067dc07334062b4ecc5a9820681e0', 'request_id': 'req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.507379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3467/6956] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 11 01:32:22 2022] DELETE /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:22.531119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.535762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:22.570921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bae13-f0fc-4413-80c7-ffb2182c0d49 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.580271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1060f86caa42dca7d38ddb22435df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dd6bce9bd574c02af55254414a505cf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-217234270', 'tempest-NotDelegatedRole-196381468'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.585157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.586672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.586672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] PATH_INFO: `/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Could not find trust: f2a067dc07334062b4ecc5a9820681e0.: keystone.exception.TrustNotFound: Could not find trust: f2a067dc07334062b4ecc5a9820681e0. Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 11 01:32:22.601917 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: f2a067dc07334062b4ecc5a9820681e0. Sep 11 01:32:22.603000 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:22.606386 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3468/6957] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:22 2022] GET /identity/v3/OS-TRUST/trusts/f2a067dc07334062b4ecc5a9820681e0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:32:22.611289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.613392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:22.619828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec32074a5fab4a86814c5cd529777d94'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.620614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec32074a5fab4a86814c5cd529777d94'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.621415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec32074a5fab4a86814c5cd529777d94'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.622661 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:22.652527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec32074a5fab4a86814c5cd529777d94'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.652877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46ab2f-5ac7-4749-acf6-edc5bc8c5cc6 tempest-TrustsV3TestJSON-1680762974 tempest-user-1602180280] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.667785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.669973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.671724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.672555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/28c0555fea1645dbb6bcec9863b6d757` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.674474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cab5eef7-61ba-4414-b07a-df61a8b32c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec32074a5fab4a86814c5cd529777d94'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.675834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28c0555fea1645dbb6bcec9863b6d757)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.680692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.724489 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3490/6958] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:22 2022] DELETE /identity/v3/users/ec32074a5fab4a86814c5cd529777d94 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:22.729091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.729488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.729885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.791879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 28c0555fea1645dbb6bcec9863b6d757 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:22.792189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.793100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:22.796418 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3469/6959] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:22 2022] DELETE /identity/v3/roles/28c0555fea1645dbb6bcec9863b6d757 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:22.800054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:22.800706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.802877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:22.803059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:22.910507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb0076-77e4-42f1-87ae-e93b90747dc8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:22.928897 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3491/6960] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:22.929026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:22.929026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:22.929026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:22.929410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/ecd04b498b9441a384d44729b8910d87` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:22.930488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ecd04b498b9441a384d44729b8910d87)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:22.934125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:22.950464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:22.953049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:23.017954 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:23.023483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role ecd04b498b9441a384d44729b8910d87 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:23.024059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.024878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.027423 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3470/6961] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:22 2022] DELETE /identity/v3/roles/ecd04b498b9441a384d44729b8910d87 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:23.032130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:23.036462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:23.097913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f14b0-1fb2-440d-8638-e7e90f66ca86 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:23.223501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287f077-d011-48a7-8789-53dbfd79ae4f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:23.236366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:23.237031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:23.237366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:23.237607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users/5e1060f86caa42dca7d38ddb22435df1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:23.241566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5e1060f86caa42dca7d38ddb22435df1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:23.242482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:23.243119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:23.243397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:23.243504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:23.243667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:23.246995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:23.352231 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:23.357716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1060f86caa42dca7d38ddb22435df1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.358456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1060f86caa42dca7d38ddb22435df1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.359685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1060f86caa42dca7d38ddb22435df1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.390662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1060f86caa42dca7d38ddb22435df1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.422267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1060f86caa42dca7d38ddb22435df1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.428307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:23.430380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:23.454321 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3492/6962] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:32:23.455901 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3471/6963] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:23 2022] DELETE /identity/v3/users/5e1060f86caa42dca7d38ddb22435df1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:23.460259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:23.488379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09569088-d644-4974-a883-7b9f93b832a5 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:23.667751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:23.668573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:23.668942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:23.669249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/0dd6bce9bd574c02af55254414a505cf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:23.674301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0dd6bce9bd574c02af55254414a505cf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:23.676908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:23.803050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd6bce9bd574c02af55254414a505cf', 'request_id': 'req-ab679a20-2580-4b68-a1c8-b6c24ac872cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.812320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd6bce9bd574c02af55254414a505cf', 'request_id': 'req-ab679a20-2580-4b68-a1c8-b6c24ac872cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.827881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd6bce9bd574c02af55254414a505cf', 'request_id': 'req-ab679a20-2580-4b68-a1c8-b6c24ac872cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.848828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] The token cache is being invalidate because project 0dd6bce9bd574c02af55254414a505cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:23.849227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.853372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:23.855207 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3493/6964] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:23 2022] DELETE /identity/v3/projects/0dd6bce9bd574c02af55254414a505cf => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:23.861360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:23.862819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:23.888557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1085-ac87-48b6-a660-48ab8e4f03f2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:24.006415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:24.008420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:24.008941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:24.010602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:24.013495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:24.016523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:24.104100 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3472/6965] 10.222.0.16 () {60 vars in 1152 bytes} [Sun Sep 11 01:32:23 2022] POST /identity/v3/projects => generated 328 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:24.108343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:24.113766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:24.193182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679a20-2580-4b68-a1c8-b6c24ac872cb tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:24.370394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:24.371655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:24.371783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:24.372007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:24.372665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:24.381013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:24.404569 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:24.447290 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3494/6966] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:24 2022] POST /identity/v3/users => generated 416 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:24.449792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:24.457801 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:24.473515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32e81-275b-4480-b2d5-657529d0424f tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:24.481775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:24.482350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:24.483357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:24.483357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:24.484653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:24.487750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:24.530834 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3473/6967] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:24 2022] POST /identity/v3/roles => generated 244 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:24.531686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:24.552607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03da49-f2c6-4099-a3c3-88bd33330c2a tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:24.557661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:24.558062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:24.558341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:24.558615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:24.569686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:24.572248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:24.611232 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3495/6968] 10.222.0.16 () {60 vars in 1143 bytes} [Sun Sep 11 01:32:24 2022] POST /identity/v3/roles => generated 246 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:24.615177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:24.646509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00a16-8d35-44e8-a250-5d012a89ecef tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:24.662008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:24.662767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:24.663050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:24.663381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/a38dd2e1233b4c639c95f744bb0c0667/users/6a25195c4d304c32a2c4406e39d02bc6/roles/984a1ded24f843d9afa239b7d9fbf36d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:24.694192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a38dd2e1233b4c639c95f744bb0c0667, user_id=6a25195c4d304c32a2c4406e39d02bc6, role_id=984a1ded24f843d9afa239b7d9fbf36d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:24.701168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:24.728789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3474/6969] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:24 2022] PUT /identity/v3/projects/a38dd2e1233b4c639c95f744bb0c0667/users/6a25195c4d304c32a2c4406e39d02bc6/roles/984a1ded24f843d9afa239b7d9fbf36d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:24.733043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:24.749539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28964-c692-4cdb-afb1-c6500de4cee6 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:24.961493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:24.963556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:24.985129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:24.988312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:24.988679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:24.988967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/a38dd2e1233b4c639c95f744bb0c0667/users/6a25195c4d304c32a2c4406e39d02bc6/roles/e7da781e79554e1e9a2cdcd11098ce0e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:25.010949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a38dd2e1233b4c639c95f744bb0c0667, user_id=6a25195c4d304c32a2c4406e39d02bc6, role_id=e7da781e79554e1e9a2cdcd11098ce0e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:25.036312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:25.078166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3496/6970] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:24 2022] PUT /identity/v3/projects/a38dd2e1233b4c639c95f744bb0c0667/users/6a25195c4d304c32a2c4406e39d02bc6/roles/e7da781e79554e1e9a2cdcd11098ce0e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:25.079198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:25.115781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472af59-a17b-401f-a787-f3834191b998 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:25.244667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59de7d9-b145-4f37-9d5f-5781dec9b969 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:25.259263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de62d73-a198-4bd9-8953-25ed54bebab2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:25.260018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de62d73-a198-4bd9-8953-25ed54bebab2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:25.260320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de62d73-a198-4bd9-8953-25ed54bebab2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:25.260598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de62d73-a198-4bd9-8953-25ed54bebab2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:25.261869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de62d73-a198-4bd9-8953-25ed54bebab2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:25.271331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de62d73-a198-4bd9-8953-25ed54bebab2 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:25.276679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:25.285525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:25.286675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:25.286973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] PATH_INFO: `/v3/projects/8ad507874fb14311a3f5786e8b86ea55` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:25.292787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad507874fb14311a3f5786e8b86ea55)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:25.298372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:25.349315 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3497/6971] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:25 2022] GET /identity/v3/users => generated 7473 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:25.350852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c66c7-6e3f-4fde-9e6b-dfcbaa2011ca None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:25.351136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c66c7-6e3f-4fde-9e6b-dfcbaa2011ca None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:25.351406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c66c7-6e3f-4fde-9e6b-dfcbaa2011ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:25.429630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad507874fb14311a3f5786e8b86ea55', 'request_id': 'req-178b150b-c437-4d6b-b6ab-ff8a9517bd15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.437832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad507874fb14311a3f5786e8b86ea55', 'request_id': 'req-178b150b-c437-4d6b-b6ab-ff8a9517bd15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.454804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad507874fb14311a3f5786e8b86ea55', 'request_id': 'req-178b150b-c437-4d6b-b6ab-ff8a9517bd15'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.458979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dd8c66c7-6e3f-4fde-9e6b-dfcbaa2011ca None None] MFA Rules not processed for user `6a25195c4d304c32a2c4406e39d02bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:25.460237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dd8c66c7-6e3f-4fde-9e6b-dfcbaa2011ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:25.479085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] The token cache is being invalidate because project 8ad507874fb14311a3f5786e8b86ea55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:25.479470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.480637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.488966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3475/6972] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:24 2022] DELETE /identity/v3/projects/8ad507874fb14311a3f5786e8b86ea55 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:25.491200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:25.492767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:25.506585 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:25.589537 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:25.628289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3498/6973] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:25.640775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fd90-1e40-4cf0-99c2-8420d249ca53 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:25.641298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fd90-1e40-4cf0-99c2-8420d249ca53 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:25.641646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fd90-1e40-4cf0-99c2-8420d249ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:25.695122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b150b-c437-4d6b-b6ab-ff8a9517bd15 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:25.699732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-de41fd90-1e40-4cf0-99c2-8420d249ca53 None None] MFA Rules not processed for user `6a25195c4d304c32a2c4406e39d02bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:25.702775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:25.703567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-de41fd90-1e40-4cf0-99c2-8420d249ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:25.704107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:25.705206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:25.705430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] PATH_INFO: `/v3/users/fa8e2a3c43b140e4a21d5d41bd75bf82` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:25.706813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8e2a3c43b140e4a21d5d41bd75bf82)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:25.709520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:25.722521 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3499/6974] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:25.734512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41fd90-1e40-4cf0-99c2-8420d249ca53 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:25.757901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41fd90-1e40-4cf0-99c2-8420d249ca53 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:25.775576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:25.776444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:25.776847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:25.777836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:25.787328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:create_trust()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:25.790844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:25.809693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8e2a3c43b140e4a21d5d41bd75bf82'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.810797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8e2a3c43b140e4a21d5d41bd75bf82'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.812745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8e2a3c43b140e4a21d5d41bd75bf82'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.823346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8e2a3c43b140e4a21d5d41bd75bf82'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.845453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8e2a3c43b140e4a21d5d41bd75bf82'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:25.873048 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3476/6975] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:25 2022] DELETE /identity/v3/users/fa8e2a3c43b140e4a21d5d41bd75bf82 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:25.956507 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3500/6976] 10.222.0.16 () {60 vars in 1174 bytes} [Sun Sep 11 01:32:25 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:25.962487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:25.964722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:26.110050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50029-0705-4480-86db-e4f893dd85e6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.122582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.166194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.168608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.168997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.187887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:get_trust(trust_id=a85cf84dcb5d4e93bc25e20230e55c39)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:26.187887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:26.203953 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3477/6977] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:25 2022] GET /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39 => generated 835 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:26.209399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.222743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78e1a-08c2-4feb-8598-59cad4e74539 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.229026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.229986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.230275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.233052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.247445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a85cf84dcb5d4e93bc25e20230e55c39)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:26.253013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:26.266353 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3501/6978] 10.222.0.16 () {58 vars in 1269 bytes} [Sun Sep 11 01:32:26 2022] GET /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles => generated 371 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:26.274159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.293229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61680d-ae9c-4f0d-a58f-0274b1f01d33 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.302365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.303342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.303855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.304340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/984a1ded24f843d9afa239b7d9fbf36d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.312924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a85cf84dcb5d4e93bc25e20230e55c39, role_id=984a1ded24f843d9afa239b7d9fbf36d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:26.314795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:26.319652 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:26.343501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3478/6979] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 11 01:32:26 2022] GET /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/984a1ded24f843d9afa239b7d9fbf36d => generated 244 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:26.348987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.369512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a61bc-d635-40dc-9e11-9f30c7563171 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.381617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.385438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.385748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.386036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/984a1ded24f843d9afa239b7d9fbf36d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.401508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a85cf84dcb5d4e93bc25e20230e55c39, role_id=984a1ded24f843d9afa239b7d9fbf36d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:26.412495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:26.429327 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3502/6980] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 11 01:32:26 2022] HEAD /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/984a1ded24f843d9afa239b7d9fbf36d => generated 0 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 11 01:32:26.433298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.450121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126819c-0950-4647-81fa-10d431c613d9 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.459866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.460757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.461173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.461546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/e7da781e79554e1e9a2cdcd11098ce0e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.477039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a85cf84dcb5d4e93bc25e20230e55c39, role_id=e7da781e79554e1e9a2cdcd11098ce0e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:26.478796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Could not find role: e7da781e79554e1e9a2cdcd11098ce0e.: keystone.exception.RoleNotFound: Could not find role: e7da781e79554e1e9a2cdcd11098ce0e. Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 01:32:26.510991 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e7da781e79554e1e9a2cdcd11098ce0e. Sep 11 01:32:26.512365 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:26.513825 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3479/6981] 10.222.0.16 () {58 vars in 1368 bytes} [Sun Sep 11 01:32:26 2022] GET /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/e7da781e79554e1e9a2cdcd11098ce0e => generated 110 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:32:26.517989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.534109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ff6ac-1e98-4b48-b4c8-c0d7d6c31444 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.545564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.551661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.552474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.552765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/e7da781e79554e1e9a2cdcd11098ce0e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.566624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a85cf84dcb5d4e93bc25e20230e55c39, role_id=e7da781e79554e1e9a2cdcd11098ce0e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:26.568164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Could not find role: e7da781e79554e1e9a2cdcd11098ce0e.: keystone.exception.RoleNotFound: Could not find role: e7da781e79554e1e9a2cdcd11098ce0e. Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 01:32:26.584795 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e7da781e79554e1e9a2cdcd11098ce0e. Sep 11 01:32:26.585993 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:26.586130 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3503/6982] 10.222.0.16 () {58 vars in 1369 bytes} [Sun Sep 11 01:32:26 2022] HEAD /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39/roles/e7da781e79554e1e9a2cdcd11098ce0e => generated 0 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 11 01:32:26.590435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.617195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bacd9-777d-4958-bce3-0d26eb933f7e tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.630199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.631892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.632452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.632558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.658677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorizing `identity:delete_trust(trust_id=a85cf84dcb5d4e93bc25e20230e55c39)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:26.662994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:26.713751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a85cf84dcb5d4e93bc25e20230e55c39', 'request_id': 'req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:26.716029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a85cf84dcb5d4e93bc25e20230e55c39', 'request_id': 'req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:26.716902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a85cf84dcb5d4e93bc25e20230e55c39', 'request_id': 'req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:26.760443 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3480/6983] 10.222.0.16 () {58 vars in 1254 bytes} [Sun Sep 11 01:32:26 2022] DELETE /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:26.766222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.768239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:26.804795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cba6a5-ae9a-4a61-b755-d560b0c07fff tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:26.816141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a25195c4d304c32a2c4406e39d02bc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a38dd2e1233b4c639c95f744bb0c0667', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-485821752', 'tempest-DelegatedRole-1756212477'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:26.818434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:26.818824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:26.819196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] PATH_INFO: `/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Could not find trust: a85cf84dcb5d4e93bc25e20230e55c39.: keystone.exception.TrustNotFound: Could not find trust: a85cf84dcb5d4e93bc25e20230e55c39. Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 11 01:32:26.845640 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a85cf84dcb5d4e93bc25e20230e55c39. Sep 11 01:32:26.846874 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:26.851694 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3504/6984] 10.222.0.16 () {58 vars in 1251 bytes} [Sun Sep 11 01:32:26 2022] GET /identity/v3/OS-TRUST/trusts/a85cf84dcb5d4e93bc25e20230e55c39 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:32:26.852967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:26.854449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:27.104342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93c1d-e5f9-4137-80cd-c813b1d74f9d tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:27.142838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:27.144340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:27.144955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:27.145486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/e7da781e79554e1e9a2cdcd11098ce0e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:27.148672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e7da781e79554e1e9a2cdcd11098ce0e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:27.151299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:27.167271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:27.169152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:27.285589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role e7da781e79554e1e9a2cdcd11098ce0e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:27.285893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.287993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.293533 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3481/6985] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:26 2022] DELETE /identity/v3/roles/e7da781e79554e1e9a2cdcd11098ce0e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:27.299222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:27.301686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:27.402027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40104716-6552-4658-94ba-e373c83c7dc3 tempest-TrustsV3TestJSON-618968995 tempest-user-1920796755] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:27.437354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:27.494506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6e24d-2e54-424b-b971-144f35ea0cc9 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:27.507444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:27.508372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:27.508793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:27.509398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/roles/984a1ded24f843d9afa239b7d9fbf36d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:27.512220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_role(role_id=984a1ded24f843d9afa239b7d9fbf36d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:27.514579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:27.516188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:27.516951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:27.517287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:27.518458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] PATH_INFO: `/v3/projects/869d982efd7849cc9cc1f2fcd9688d36` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:27.527787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869d982efd7849cc9cc1f2fcd9688d36)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:27.529962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:27.552318 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:27.617418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invalidating the token cache because role 984a1ded24f843d9afa239b7d9fbf36d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:27.617766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.622350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.624841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3482/6986] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:27 2022] DELETE /identity/v3/roles/984a1ded24f843d9afa239b7d9fbf36d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:27.628763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:27.630238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:27.692772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869d982efd7849cc9cc1f2fcd9688d36', 'request_id': 'req-8f1c6955-f86a-4987-972b-4be0b0b1bd46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.724566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869d982efd7849cc9cc1f2fcd9688d36', 'request_id': 'req-8f1c6955-f86a-4987-972b-4be0b0b1bd46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.753447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869d982efd7849cc9cc1f2fcd9688d36', 'request_id': 'req-8f1c6955-f86a-4987-972b-4be0b0b1bd46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.777755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] The token cache is being invalidate because project 869d982efd7849cc9cc1f2fcd9688d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:27.778502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.780940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8f1c6955-f86a-4987-972b-4be0b0b1bd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:27.784448 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3505/6987] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:27 2022] DELETE /identity/v3/projects/869d982efd7849cc9cc1f2fcd9688d36 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:27.789484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412fa86-e187-4f45-b45d-6a1a92d98612 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:27.790115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412fa86-e187-4f45-b45d-6a1a92d98612 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:27.790606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412fa86-e187-4f45-b45d-6a1a92d98612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:27.794069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3130a-e6bb-4c3f-86de-432ac13279e8 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:27.843347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1412fa86-e187-4f45-b45d-6a1a92d98612 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:27.845032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1412fa86-e187-4f45-b45d-6a1a92d98612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:27.965608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:27.966864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:27.967378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:27.968045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/users/6a25195c4d304c32a2c4406e39d02bc6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:27.969712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a25195c4d304c32a2c4406e39d02bc6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:27.972946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.000246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3506/6988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:28.007901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245a0b8-9bb1-4002-be09-d101c8d69a7c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.008240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245a0b8-9bb1-4002-be09-d101c8d69a7c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.008472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245a0b8-9bb1-4002-be09-d101c8d69a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.035329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a25195c4d304c32a2c4406e39d02bc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.037499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a25195c4d304c32a2c4406e39d02bc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.039906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a25195c4d304c32a2c4406e39d02bc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.054314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a245a0b8-9bb1-4002-be09-d101c8d69a7c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:28.055881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a245a0b8-9bb1-4002-be09-d101c8d69a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:28.056922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a25195c4d304c32a2c4406e39d02bc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.077247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a25195c4d304c32a2c4406e39d02bc6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.084821 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3507/6989] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:28.085841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245a0b8-9bb1-4002-be09-d101c8d69a7c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.100384 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:28.104105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245a0b8-9bb1-4002-be09-d101c8d69a7c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.121405 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3483/6990] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:27 2022] DELETE /identity/v3/users/6a25195c4d304c32a2c4406e39d02bc6 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:28.123981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.124693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.125439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.125714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.125988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.126649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:28.126956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.127256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:28.128570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.154432 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3508/6991] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:28.156151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.180253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3135159-9cc8-40fd-a68e-d1a2146e1451 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.254692 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:28.291596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3206fc-609b-44fa-9560-2cb5497701af tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.297505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dc77457b36f449d804329135e15cf8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db4d6a07ab6b496eac628e8dfdf056db', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.298159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.298640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.298922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] PATH_INFO: `/v3/projects/a38dd2e1233b4c639c95f744bb0c0667` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.300116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a38dd2e1233b4c639c95f744bb0c0667)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.302147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.326532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.327557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.328078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.328700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.329579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.331717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.382662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38dd2e1233b4c639c95f744bb0c0667', 'request_id': 'req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.391404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38dd2e1233b4c639c95f744bb0c0667', 'request_id': 'req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.396776 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3509/6992] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:28 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:28.402708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.407646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38dd2e1233b4c639c95f744bb0c0667', 'request_id': 'req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.432752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] The token cache is being invalidate because project a38dd2e1233b4c639c95f744bb0c0667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:28.433052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.433735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.435697 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3484/6993] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:28 2022] DELETE /identity/v3/projects/a38dd2e1233b4c639c95f744bb0c0667 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:28.440742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.445609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:28.517796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1432-7937-4f9f-87d3-280019ca064b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.529487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.531947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.532239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.532521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.536243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.538446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.560556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5abb-1b88-4ae2-bcfd-5ac0fd877679 tempest-TrustsV3TestJSON-529513275 tempest-TrustsV3TestJSON-529513275-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.568664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.569175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.569665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.569980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] PATH_INFO: `/v3/users/6d76b9738b474ab08d06880e650105ae` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.571389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d76b9738b474ab08d06880e650105ae)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.574237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.590426 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3510/6994] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:28 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:28.595726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.598620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:28.633241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848eac2-6e92-4e7e-9951-afc761bb61b5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.641941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.643334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.643698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.644130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.645282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.652509 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:28.654094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.697560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d76b9738b474ab08d06880e650105ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.697918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3511/6995] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:28.698983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d76b9738b474ab08d06880e650105ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.699605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d76b9738b474ab08d06880e650105ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.701038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.704486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:28.724652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d76b9738b474ab08d06880e650105ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.742890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142411-c122-47d2-aee8-0a26a3b84dad admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.765347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.767134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.767482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.767682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.770709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.771954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8472cffa-bd0a-48f1-a672-4a66109a05bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d76b9738b474ab08d06880e650105ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:28.774033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:28.804285 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3485/6996] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:28 2022] DELETE /identity/v3/users/6d76b9738b474ab08d06880e650105ae => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:28.809339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.809632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.809907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.833212 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3512/6997] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:28.833212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:28.875603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707a2f-5877-4b6f-936d-9f5103c06325 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:28.905684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:28.907208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:28.968707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c20515-6802-454b-9d62-982a5c20a9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:28.969938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20515-6802-454b-9d62-982a5c20a9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:28.970426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20515-6802-454b-9d62-982a5c20a9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:28.971003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20515-6802-454b-9d62-982a5c20a9ca admin admin] PATH_INFO: `/v3/projects/3c35ff1e3b704bb2ae4052a035615baa/users/e88baeb6d6504fedace4c0ce9a45b84e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:28.987253 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3486/6998] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:28.990469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c20515-6802-454b-9d62-982a5c20a9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c35ff1e3b704bb2ae4052a035615baa, user_id=e88baeb6d6504fedace4c0ce9a45b84e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:28.993206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c20515-6802-454b-9d62-982a5c20a9ca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:29.009919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:29.011722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:29.023591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3513/6999] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:28 2022] PUT /identity/v3/projects/3c35ff1e3b704bb2ae4052a035615baa/users/e88baeb6d6504fedace4c0ce9a45b84e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:29.025164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:29.025516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:29.025803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:29.047990 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:29.092084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] MFA Rules not processed for user `e88baeb6d6504fedace4c0ce9a45b84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:29.094006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:29.133604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2fbf3-5ef6-4d58-b652-66997c131033 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:29.227905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f35e11-a5ba-4303-9e94-161f3406eba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:29.228528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35e11-a5ba-4303-9e94-161f3406eba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:29.228808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35e11-a5ba-4303-9e94-161f3406eba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:29.229096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f35e11-a5ba-4303-9e94-161f3406eba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:29.271409 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3514/7000] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:29.272523 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:29.294679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:29.297986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:29.444269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b8b90-2950-4bbd-8be7-4b60a7cd8426 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:29.461799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:29.464846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f35e11-a5ba-4303-9e94-161f3406eba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:29.468495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:29.468868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:29.469149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f35e11-a5ba-4303-9e94-161f3406eba5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:29.469370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:29.501166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:29.502754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:29.507004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3487/7001] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:32:29.546689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3515/7002] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:32:29.850212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:29.850545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:29.851476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:29.890116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:29.891760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:30.078235 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3488/7003] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:30.159442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:30.161141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:30.367219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44e090-e560-43ff-8916-a9cc24da1419 service glance] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:30.376761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:30.377686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:30.378042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:30.378387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:30.404810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:30.408177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:30.423828 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3516/7004] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:32:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:32:30.663607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:30.664678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:30.703479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd48611-9729-45fa-9d58-00a199893e39 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:30.715877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:30.719583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:30.721964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:30.722425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] PATH_INFO: `/v3/projects/6b4fc1a907994e23897eb5f8e46ba54c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:30.723935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4fc1a907994e23897eb5f8e46ba54c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:30.731065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:30.849721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4fc1a907994e23897eb5f8e46ba54c', 'request_id': 'req-85432994-5038-4824-83c8-2facd3f68d34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:30.857802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4fc1a907994e23897eb5f8e46ba54c', 'request_id': 'req-85432994-5038-4824-83c8-2facd3f68d34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:30.876298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4fc1a907994e23897eb5f8e46ba54c', 'request_id': 'req-85432994-5038-4824-83c8-2facd3f68d34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:30.897804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] The token cache is being invalidate because project 6b4fc1a907994e23897eb5f8e46ba54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:30.898115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:30.898834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-85432994-5038-4824-83c8-2facd3f68d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:30.900822 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3489/7005] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:30 2022] DELETE /identity/v3/projects/6b4fc1a907994e23897eb5f8e46ba54c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:30.904975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:30.925037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cc9c4-c3ca-44ca-8ada-a2f3e1fc53d5 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:30.954368 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:31.043407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:31.044232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:31.044232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:31.044232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] PATH_INFO: `/v3/users/7dc77457b36f449d804329135e15cf8c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:31.045641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc77457b36f449d804329135e15cf8c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:31.047913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:31.137582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc77457b36f449d804329135e15cf8c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:31.138566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc77457b36f449d804329135e15cf8c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:31.139255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc77457b36f449d804329135e15cf8c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:31.141682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:31.142231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:31.142742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:31.171909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:31.177206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc77457b36f449d804329135e15cf8c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:31.179292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:31.201924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc77457b36f449d804329135e15cf8c'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:31.235080 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3517/7006] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:30 2022] DELETE /identity/v3/users/7dc77457b36f449d804329135e15cf8c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:31.246516 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:31.331386 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3490/7007] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:31.346447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:31.348398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:31.541872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7570-a07d-4de4-aa0c-7f59f79ffcd2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:31.556595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a1422-8158-42f2-b240-f370a731f32a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:31.557810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a1422-8158-42f2-b240-f370a731f32a service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:31.557810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a1422-8158-42f2-b240-f370a731f32a service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:31.558008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a1422-8158-42f2-b240-f370a731f32a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:31.646853 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:31.684561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a1422-8158-42f2-b240-f370a731f32a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:31.686951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a1422-8158-42f2-b240-f370a731f32a service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:31.730390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3518/7008] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:32:31.747576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:31.750569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:31.800743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832e70c-d3b9-4f6a-ad7c-24f91ef4dd88 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:31.963648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:31.964758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:31.965187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:31.965374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] PATH_INFO: `/v3/projects/db4d6a07ab6b496eac628e8dfdf056db` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:31.967325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4d6a07ab6b496eac628e8dfdf056db)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:31.969980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.061618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4d6a07ab6b496eac628e8dfdf056db', 'request_id': 'req-5782f176-c600-409c-bf4a-ee268fc369ec'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:32.081288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4d6a07ab6b496eac628e8dfdf056db', 'request_id': 'req-5782f176-c600-409c-bf4a-ee268fc369ec'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:32.128267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4d6a07ab6b496eac628e8dfdf056db', 'request_id': 'req-5782f176-c600-409c-bf4a-ee268fc369ec'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:32.162021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] The token cache is being invalidate because project db4d6a07ab6b496eac628e8dfdf056db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:32.162021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:32.162357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5782f176-c600-409c-bf4a-ee268fc369ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:32.164351 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3491/7009] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:31 2022] DELETE /identity/v3/projects/db4d6a07ab6b496eac628e8dfdf056db => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:32.173371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12677ba-c984-4510-953e-499c2e4871a9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.173941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12677ba-c984-4510-953e-499c2e4871a9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.177560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12677ba-c984-4510-953e-499c2e4871a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.218478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f12677ba-c984-4510-953e-499c2e4871a9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:32.222244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f12677ba-c984-4510-953e-499c2e4871a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:32.309529 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3519/7010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:32.311188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f02ed-eff5-4331-87bd-1c06897af7b6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.311995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f02ed-eff5-4331-87bd-1c06897af7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.312328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f02ed-eff5-4331-87bd-1c06897af7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.354452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4a4f02ed-eff5-4331-87bd-1c06897af7b6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:32.356220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4a4f02ed-eff5-4331-87bd-1c06897af7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:32.371701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12677ba-c984-4510-953e-499c2e4871a9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:32.380730 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3492/7011] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:32.389772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12677ba-c984-4510-953e-499c2e4871a9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:32.396170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:32.396798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.397099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.397580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.399030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:32.399349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:32.401675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.415141 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3520/7012] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:32.419303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f02ed-eff5-4331-87bd-1c06897af7b6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:32.434330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f02ed-eff5-4331-87bd-1c06897af7b6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:32.442598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4eb58e-5297-41bc-adab-ef792ad9709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:32.443680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eb58e-5297-41bc-adab-ef792ad9709a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.444108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eb58e-5297-41bc-adab-ef792ad9709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.444572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4eb58e-5297-41bc-adab-ef792ad9709a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.445595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4eb58e-5297-41bc-adab-ef792ad9709a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:32.448695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4eb58e-5297-41bc-adab-ef792ad9709a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.496604 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3493/7013] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:32 2022] POST /identity/v3/projects => generated 359 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:32.501509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:32.516690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.517408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.518791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.521492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b8c6-82d3-4c47-b65f-9a2c808c9d62 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:32.552729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:32.554013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:32.594583 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:32.630010 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3494/7014] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:32.641890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:32.642585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.643101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.643699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.644531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:32.645014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:32.646695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:32.648107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.695104 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3521/7015] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:32 2022] POST /identity/v3/users => generated 280 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:32.707344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:32.735763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8f5da-18aa-4c9b-bed1-32b89910ba79 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:32.742697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:32.743277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.743557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.743990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.744877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:32.747249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.769501 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3522/7016] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:32.771110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:32.790752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97587ac-a4f0-4b2e-87f5-027b84cf6431 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:32.795982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:32.796613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.796891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.797204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.808266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b994-b036-4ac3-aff7-76d73092920c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:32.813097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:32.814724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.816010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5f87-c9f9-49bb-9bb9-d635e05a8c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:32.816628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5f87-c9f9-49bb-9bb9-d635e05a8c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.816901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5f87-c9f9-49bb-9bb9-d635e05a8c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.817202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5f87-c9f9-49bb-9bb9-d635e05a8c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.818123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5f87-c9f9-49bb-9bb9-d635e05a8c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:32.821829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5f87-c9f9-49bb-9bb9-d635e05a8c7c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.829400 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3495/7017] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:32:32.841795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:32.842336 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3523/7018] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:32.876403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3dfbf-0f75-4af2-a1a1-0c2cce595e71 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:32.898243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c64a6-7d6c-4e0c-b8fd-ba370ff1d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:32.899347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c64a6-7d6c-4e0c-b8fd-ba370ff1d0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.899789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c64a6-7d6c-4e0c-b8fd-ba370ff1d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.899966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c64a6-7d6c-4e0c-b8fd-ba370ff1d0ac admin admin] PATH_INFO: `/v3/projects/93689d681f5744b49aa3958814df4d5c/users/1b8c9ff7563d44078d3c983333385774/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:32.927710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c64a6-7d6c-4e0c-b8fd-ba370ff1d0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=93689d681f5744b49aa3958814df4d5c, user_id=1b8c9ff7563d44078d3c983333385774, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:32.936874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c64a6-7d6c-4e0c-b8fd-ba370ff1d0ac admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:32.972245 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3496/7019] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:32 2022] PUT /identity/v3/projects/93689d681f5744b49aa3958814df4d5c/users/1b8c9ff7563d44078d3c983333385774/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:32.974877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204df7e-e108-4eeb-8a15-6a1374b9261e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:32.975400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204df7e-e108-4eeb-8a15-6a1374b9261e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:32.975862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204df7e-e108-4eeb-8a15-6a1374b9261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.032433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2204df7e-e108-4eeb-8a15-6a1374b9261e None None] MFA Rules not processed for user `1b8c9ff7563d44078d3c983333385774`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:33.033762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2204df7e-e108-4eeb-8a15-6a1374b9261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:33.101131 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:33.125373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e0f0-a3ed-45e7-9047-a5af73713551 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.126545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e0f0-a3ed-45e7-9047-a5af73713551 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.127309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e0f0-a3ed-45e7-9047-a5af73713551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.161725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2849e0f0-a3ed-45e7-9047-a5af73713551 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:33.163841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2849e0f0-a3ed-45e7-9047-a5af73713551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:33.236192 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3524/7020] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:33.239080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72748-299e-4f35-b275-4ea0667bcdf8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.239370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72748-299e-4f35-b275-4ea0667bcdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.239761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72748-299e-4f35-b275-4ea0667bcdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.295414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a7d72748-299e-4f35-b275-4ea0667bcdf8 None None] MFA Rules not processed for user `1b8c9ff7563d44078d3c983333385774`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:33.297044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7d72748-299e-4f35-b275-4ea0667bcdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:33.305100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3525/7021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:33 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 01:32:33.310496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a75d3-81ed-44c2-b96c-52a54cf473e2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.310786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a75d3-81ed-44c2-b96c-52a54cf473e2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.311018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a75d3-81ed-44c2-b96c-52a54cf473e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.349225 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3497/7022] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:33.350482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849e0f0-a3ed-45e7-9047-a5af73713551 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:33.362981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-900a75d3-81ed-44c2-b96c-52a54cf473e2 None None] MFA Rules not processed for user `1b8c9ff7563d44078d3c983333385774`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:33.364057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-900a75d3-81ed-44c2-b96c-52a54cf473e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:33.375687 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3526/7023] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:33 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 01:32:33.378144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a75d3-81ed-44c2-b96c-52a54cf473e2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:33.398615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a75d3-81ed-44c2-b96c-52a54cf473e2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:33.450881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b8c9ff7563d44078d3c983333385774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93689d681f5744b49aa3958814df4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:33.451529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] REQUEST_METHOD: `HEAD` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.451809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.452243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.482136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorizing `identity:check_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:33.486721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:33.501940 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:33.503285 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3527/7024] 10.222.0.16 () {56 vars in 1264 bytes} [Sun Sep 11 01:32:33 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Sep 11 01:32:33.507381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:33.524771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10b8a-a983-422d-825d-b2f74b717c20 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:33.538479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b8c9ff7563d44078d3c983333385774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93689d681f5744b49aa3958814df4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:33.539104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.539385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.539664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.555243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:33.557392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:33.564616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849e0f0-a3ed-45e7-9047-a5af73713551 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:33.569172 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3528/7025] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 11 01:32:33 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 01:32:33.573558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:33.583696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:33.584456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.584847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.585259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.593424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61db46b-c772-4913-9546-b1903ef6ddd5 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:33.603026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1d963-598f-4190-9ab6-740f4e01352d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b8c9ff7563d44078d3c983333385774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93689d681f5744b49aa3958814df4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:33.603986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1d963-598f-4190-9ab6-740f4e01352d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.604451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1d963-598f-4190-9ab6-740f4e01352d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.604876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1d963-598f-4190-9ab6-740f4e01352d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.607467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:33.609799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:33.613358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1d963-598f-4190-9ab6-740f4e01352d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:33.616206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1d963-598f-4190-9ab6-740f4e01352d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:33.624177 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3498/7026] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:32:33.646657 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3529/7027] 10.222.0.16 () {56 vars in 1266 bytes} [Sun Sep 11 01:32:33 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:33.647952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:33.663797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcafe7-87d6-41aa-a4a6-5345caf7806e service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:33.675623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b8c9ff7563d44078d3c983333385774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93689d681f5744b49aa3958814df4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:33.676254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.676558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.676884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.681634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Sep 11 01:32:33.717944 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 11 01:32:33.719173 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 11 01:32:33.724204 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:33.724204 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:33.724204 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 11 01:32:33.724204 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 11 01:32:33.724204 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 11 01:32:33.724204 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:33.724204 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3499/7028] 10.222.0.16 () {56 vars in 1264 bytes} [Sun Sep 11 01:32:33 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Sep 11 01:32:33.725312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea840785-2a73-4d50-ab37-5b43c84e5ba1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.725615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea840785-2a73-4d50-ab37-5b43c84e5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.725886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea840785-2a73-4d50-ab37-5b43c84e5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.762807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ea840785-2a73-4d50-ab37-5b43c84e5ba1 None None] MFA Rules not processed for user `1b8c9ff7563d44078d3c983333385774`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:33.764030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ea840785-2a73-4d50-ab37-5b43c84e5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:33.771305 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3530/7029] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:33 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:32:33.773240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:33.789718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9d98c-ecbb-43c2-9601-66f559ce002d tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:33.810720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b8c9ff7563d44078d3c983333385774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93689d681f5744b49aa3958814df4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:33.811938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.813901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.814364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.828854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:33.831222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:33.845826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea840785-2a73-4d50-ab37-5b43c84e5ba1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:33.846038 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3500/7030] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 11 01:32:33 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 01:32:33.884056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea840785-2a73-4d50-ab37-5b43c84e5ba1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:33.896543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b8c9ff7563d44078d3c983333385774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93689d681f5744b49aa3958814df4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:33.897647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:33.897930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:33.898207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:33.916928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:33.918479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:34.013729 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3531/7031] 10.222.0.16 () {56 vars in 1266 bytes} [Sun Sep 11 01:32:33 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:34.017907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:34.035404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1339-8318-4dc6-a310-df1ecaced860 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:34.072145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099b247-d3bb-44f5-bf50-104649b50711 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b8c9ff7563d44078d3c983333385774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93689d681f5744b49aa3958814df4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:34.072784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b247-d3bb-44f5-bf50-104649b50711 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:34.073141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b247-d3bb-44f5-bf50-104649b50711 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:34.073457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b247-d3bb-44f5-bf50-104649b50711 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:34.078714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3099b247-d3bb-44f5-bf50-104649b50711 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-3099b247-d3bb-44f5-bf50-104649b50711 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 11 01:32:34.115292 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 11 01:32:34.116464 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 11 01:32:34.117755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:34.117755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:34.117755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 11 01:32:34.117755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 11 01:32:34.117755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 11 01:32:34.117755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:34.121818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:34.122194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3501/7032] 10.222.0.16 () {56 vars in 1263 bytes} [Sun Sep 11 01:32:34 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 01:32:34.257244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9ac57-3787-4525-abc4-2141c01ea855 tempest-TokensV3Test-646062878 tempest-TokensV3Test-646062878-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:34.269825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:34.270508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:34.270836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:34.271053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] PATH_INFO: `/v3/users/1b8c9ff7563d44078d3c983333385774` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:34.272278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8c9ff7563d44078d3c983333385774)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:34.274729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:34.337619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:34.337988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:34.338180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:34.342802 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:34.352558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8c9ff7563d44078d3c983333385774'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:34.353515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8c9ff7563d44078d3c983333385774'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:34.354397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8c9ff7563d44078d3c983333385774'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:34.376168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8c9ff7563d44078d3c983333385774'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:34.385953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-300dfbb5-9449-4c8c-9177-f7c184e557eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8c9ff7563d44078d3c983333385774'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:34.413843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:34.415232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:34.418424 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3532/7033] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:34 2022] DELETE /identity/v3/users/1b8c9ff7563d44078d3c983333385774 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:34.424526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:34.424817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:34.425448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:34.472635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:34.473914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:34.547333 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3502/7034] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:34.563660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:34.565300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:34.656667 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3533/7035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:34.676070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:34.677780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:34.735969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aa9fe-5810-4a00-b22b-7ef1b656bcb7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:34.749705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a47cd-e0b8-4022-9d70-db007ce1ae71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:34.750742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a47cd-e0b8-4022-9d70-db007ce1ae71 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:34.751099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a47cd-e0b8-4022-9d70-db007ce1ae71 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:34.751512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a47cd-e0b8-4022-9d70-db007ce1ae71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:34.775247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a47cd-e0b8-4022-9d70-db007ce1ae71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:34.777563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a47cd-e0b8-4022-9d70-db007ce1ae71 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:34.795505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3503/7036] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:32:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:32:34.841480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ad756-5a16-4418-a0a5-07ddace4c5ac None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:34.853251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:34.854104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:34.854449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:34.854788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:34.871897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:34.873590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:34.899628 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3534/7037] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:32:35.152088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:35.152902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:35.152902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:35.197721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:35.198987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:35.217750 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3504/7038] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:35.232948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:35.250329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bda553-9226-4514-bfb2-24ed73eabf4a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:35.260742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:35.262310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:35.262969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:35.263473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:35.279568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:35.284014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:35.317137 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3535/7039] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:32:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:32:35.553433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:35.555860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:35.566455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:35.568229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:35.597745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ca06-96c3-4e00-8a10-5310332e13fc service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:35.599975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084625d-8aa2-4c2f-846f-ba9d16aa53c0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:35.609893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:35.611344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:35.612218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:35.613183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:35.613678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] PATH_INFO: `/v3/projects/93689d681f5744b49aa3958814df4d5c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:35.615470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:35.615903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:35.616329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] PATH_INFO: `/v3/users/e88baeb6d6504fedace4c0ce9a45b84e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:35.617179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93689d681f5744b49aa3958814df4d5c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:35.619468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88baeb6d6504fedace4c0ce9a45b84e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:35.622211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:35.626207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:35.729235 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:35.741163 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:35.774371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88baeb6d6504fedace4c0ce9a45b84e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.775101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93689d681f5744b49aa3958814df4d5c', 'request_id': 'req-b2d2ae28-6642-422a-aede-551471b61506'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.779492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88baeb6d6504fedace4c0ce9a45b84e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.781429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88baeb6d6504fedace4c0ce9a45b84e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.793251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93689d681f5744b49aa3958814df4d5c', 'request_id': 'req-b2d2ae28-6642-422a-aede-551471b61506'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.800050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88baeb6d6504fedace4c0ce9a45b84e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.812286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93689d681f5744b49aa3958814df4d5c', 'request_id': 'req-b2d2ae28-6642-422a-aede-551471b61506'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.886122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-feeca271-795c-496b-8969-7005212ef41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88baeb6d6504fedace4c0ce9a45b84e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.900262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] The token cache is being invalidate because project 93689d681f5744b49aa3958814df4d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:35.900560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.901523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b2d2ae28-6642-422a-aede-551471b61506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:35.904663 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3536/7040] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:35 2022] DELETE /identity/v3/projects/93689d681f5744b49aa3958814df4d5c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:35.913407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf16bc-c336-49f7-bb00-361d10d546ee None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:35.913701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf16bc-c336-49f7-bb00-361d10d546ee None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:35.913965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf16bc-c336-49f7-bb00-361d10d546ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:35.931367 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3505/7041] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:32:35 2022] DELETE /identity/v3/users/e88baeb6d6504fedace4c0ce9a45b84e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:35.936260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:35.936959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:35.937437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:35.967567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-11bf16bc-c336-49f7-bb00-361d10d546ee None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:35.972740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-11bf16bc-c336-49f7-bb00-361d10d546ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:36.020858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:36.026349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:36.197618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3537/7042] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:36.207561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196a3f-4ce8-4f66-b980-e17b7aeb4439 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.208246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196a3f-4ce8-4f66-b980-e17b7aeb4439 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.208705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196a3f-4ce8-4f66-b980-e17b7aeb4439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.241678 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3506/7043] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:36.257937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b1196a3f-4ce8-4f66-b980-e17b7aeb4439 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:36.261592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b1196a3f-4ce8-4f66-b980-e17b7aeb4439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:36.271291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:36.272753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:36.284786 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3538/7044] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:36.289052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196a3f-4ce8-4f66-b980-e17b7aeb4439 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:36.308441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196a3f-4ce8-4f66-b980-e17b7aeb4439 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:36.315854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:36.317386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.326115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.327327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.328285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:36.328860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:36.336864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:36.355322 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3539/7045] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:32:36.360574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:36.379082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237dbd1-30ee-4588-b4ed-b228ee0a1a89 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:36.393807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:36.394541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.394965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.395326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.395974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:36.397914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:36.402523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6d0dd-94bc-4fde-b33f-744c8ab9c437 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:36.416144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:36.416788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.417094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.417370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.455192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:36.460012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:36.470505 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3540/7046] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:36 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:36.471816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:36.495723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3507/7047] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:32:36.656262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d0f7-51ca-4014-bff6-1fb51ee648ec admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:36.674401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:36.675521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.681122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.681670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.682728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:36.690241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:36.770100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3541/7048] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:36 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:36.775521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:36.792800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ed45-f59d-48a7-9a54-09b746106284 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:36.819466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:36.820374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.820803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.821207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.822190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:36.824713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:36.843848 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3508/7049] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:36.850077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:36.867574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7befe-449e-46ba-97cb-af7e461658c5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:36.879579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52fcf-c0ee-4c4c-bd1e-72d5cd25bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:36.880689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52fcf-c0ee-4c4c-bd1e-72d5cd25bca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.881017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52fcf-c0ee-4c4c-bd1e-72d5cd25bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.881315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52fcf-c0ee-4c4c-bd1e-72d5cd25bca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.881961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52fcf-c0ee-4c4c-bd1e-72d5cd25bca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:36.884704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52fcf-c0ee-4c4c-bd1e-72d5cd25bca0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:36.904056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3542/7050] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:36.909263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:36.925558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550632b-33d9-4a30-a033-1294d6f1a433 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:36.931527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:36.932309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.932680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.933012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] PATH_INFO: `/v3/projects/1fb424b46f104045b0081e4303e14952/users/03732f410ab64639bf967b9a5bb3f688/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:36.954397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb424b46f104045b0081e4303e14952, user_id=03732f410ab64639bf967b9a5bb3f688, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:36.958134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:36.981602 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3509/7051] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:36 2022] PUT /identity/v3/projects/1fb424b46f104045b0081e4303e14952/users/03732f410ab64639bf967b9a5bb3f688/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:36.993916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:36.994504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:36.995132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:37.014581 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:37.048046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:37.049328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:37.195982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3543/7052] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:37.201767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:37.217547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441daf07-9ab9-462b-8705-f23049752a2d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:37.224157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a801-f977-4169-8b0c-630cbbcc0d9e tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:37.225213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a801-f977-4169-8b0c-630cbbcc0d9e tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:37.225707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a801-f977-4169-8b0c-630cbbcc0d9e tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:37.226233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a801-f977-4169-8b0c-630cbbcc0d9e tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:37.263067 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:37.279965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3827a801-f977-4169-8b0c-630cbbcc0d9e tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:37.297223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3510/7053] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:37 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:37.803396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:37.806314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:37.907557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f28c10-fbcb-4edd-9d78-1b35a6792be4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:37.920357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:37.920357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:37.920805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:37.925107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] PATH_INFO: `/v3/projects/3c35ff1e3b704bb2ae4052a035615baa` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:37.926836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c35ff1e3b704bb2ae4052a035615baa)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:37.928573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:38.060203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c35ff1e3b704bb2ae4052a035615baa', 'request_id': 'req-8b23cd68-1063-4e72-9edb-3970ed7bbd17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:38.069571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c35ff1e3b704bb2ae4052a035615baa', 'request_id': 'req-8b23cd68-1063-4e72-9edb-3970ed7bbd17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:38.077392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c35ff1e3b704bb2ae4052a035615baa', 'request_id': 'req-8b23cd68-1063-4e72-9edb-3970ed7bbd17'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:38.094334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] The token cache is being invalidate because project 3c35ff1e3b704bb2ae4052a035615baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:32:38.094990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:38.096137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b23cd68-1063-4e72-9edb-3970ed7bbd17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:38.098849 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3544/7054] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:32:37 2022] DELETE /identity/v3/projects/3c35ff1e3b704bb2ae4052a035615baa => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:38.104232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca988b1b-3d87-4524-8321-b5360dff7cb6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.104722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca988b1b-3d87-4524-8321-b5360dff7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.105198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca988b1b-3d87-4524-8321-b5360dff7cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.134135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ca988b1b-3d87-4524-8321-b5360dff7cb6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:38.135706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca988b1b-3d87-4524-8321-b5360dff7cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:38.244833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3511/7055] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:38.254806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6276536-6436-43d8-ad18-0d1aefa7f297 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.255106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6276536-6436-43d8-ad18-0d1aefa7f297 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.255363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6276536-6436-43d8-ad18-0d1aefa7f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.303137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183cd6-2c84-489e-8bc8-55235f37c09e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.303721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183cd6-2c84-489e-8bc8-55235f37c09e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.303721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183cd6-2c84-489e-8bc8-55235f37c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.314021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d6276536-6436-43d8-ad18-0d1aefa7f297 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:38.316333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d6276536-6436-43d8-ad18-0d1aefa7f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:38.344975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6d183cd6-2c84-489e-8bc8-55235f37c09e None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:38.349539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6d183cd6-2c84-489e-8bc8-55235f37c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:38.351139 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3545/7056] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:38.352600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6276536-6436-43d8-ad18-0d1aefa7f297 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.361215 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3512/7057] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 01:32:38.364075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083eff-f250-41e0-998b-2454cf195eaf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.364766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083eff-f250-41e0-998b-2454cf195eaf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.367249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6276536-6436-43d8-ad18-0d1aefa7f297 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.367794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b083eff-f250-41e0-998b-2454cf195eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.383836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.384896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.385426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.385899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.386756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:32:38.387355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:38.389604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:38.409580 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3546/7058] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:32:38.411213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.423048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b083eff-f250-41e0-998b-2454cf195eaf None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:38.424278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b083eff-f250-41e0-998b-2454cf195eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:38.440311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578759a0-7796-460e-a377-c3821f655aa1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.454215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.455275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.455768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.456243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.457136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:38.459309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:38.471769 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:38.501177 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3513/7059] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:38.505284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b083eff-f250-41e0-998b-2454cf195eaf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.536025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b083eff-f250-41e0-998b-2454cf195eaf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.537629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3547/7060] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/projects => generated 397 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:32:38.541442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.612335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17f12-894c-4ead-95f9-a6cd2acc3c0a tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.613334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17f12-894c-4ead-95f9-a6cd2acc3c0a tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.613637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17f12-894c-4ead-95f9-a6cd2acc3c0a tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.614972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17f12-894c-4ead-95f9-a6cd2acc3c0a tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-2ad17f12-894c-4ead-95f9-a6cd2acc3c0a tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:38.719666 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 11 01:32:38.720530 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:38.721487 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3514/7061] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 188 bytes in 216 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:32:38.726693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972d98b-cd22-4c7d-ab8e-21594b4c981a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.728294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17f12-894c-4ead-95f9-a6cd2acc3c0a tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.734216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.736677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.736959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.737298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.740536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:38.740830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17f12-894c-4ead-95f9-a6cd2acc3c0a tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.741383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:38.744819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebca9d-8839-4658-a2c2-231a57308ea4 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.745563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebca9d-8839-4658-a2c2-231a57308ea4 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.745967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebca9d-8839-4658-a2c2-231a57308ea4 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.746343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebca9d-8839-4658-a2c2-231a57308ea4 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.767541 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-91ebca9d-8839-4658-a2c2-231a57308ea4 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:38.799347 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 11 01:32:38.800257 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:32:38.804734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3548/7062] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:32:38.806077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.813444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3515/7063] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 188 bytes in 75 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:32:38.815844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebca9d-8839-4658-a2c2-231a57308ea4 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.819374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29ed1-225d-47a0-af5c-570d805fef23 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.839698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebca9d-8839-4658-a2c2-231a57308ea4 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.841897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.845018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.845396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.845673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.847111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:38.849774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:38.852665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730413a5-c32a-4194-8003-51aa3f0f305c tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.853382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730413a5-c32a-4194-8003-51aa3f0f305c tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.853668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730413a5-c32a-4194-8003-51aa3f0f305c tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.853988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730413a5-c32a-4194-8003-51aa3f0f305c tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.885036 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3549/7064] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:38.891173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.905728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8499b3-2c4a-4ba5-b042-cf1219060468 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.910731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-730413a5-c32a-4194-8003-51aa3f0f305c tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:38.912379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944423e-d8ff-4736-b43a-5cee3fefebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.913418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944423e-d8ff-4736-b43a-5cee3fefebde admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.913913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944423e-d8ff-4736-b43a-5cee3fefebde admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.914630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944423e-d8ff-4736-b43a-5cee3fefebde admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.915487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944423e-d8ff-4736-b43a-5cee3fefebde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:38.917932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944423e-d8ff-4736-b43a-5cee3fefebde admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:38.928567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3516/7065] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:38 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:38.935705 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3550/7066] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:32:38.939735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730413a5-c32a-4194-8003-51aa3f0f305c tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:38.953591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730413a5-c32a-4194-8003-51aa3f0f305c tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:38.959948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:38.960668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:38.960968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:38.965368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] PATH_INFO: `/v3/projects/79a1afb370514ea7b17e6722d084d10e/users/d72f7b86e5a4470d8909fdea561abe7f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:38.994994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a1afb370514ea7b17e6722d084d10e, user_id=d72f7b86e5a4470d8909fdea561abe7f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:38.997889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:39.030946 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3517/7067] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:32:38 2022] PUT /identity/v3/projects/79a1afb370514ea7b17e6722d084d10e/users/d72f7b86e5a4470d8909fdea561abe7f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:39.031102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92c2b-3bfa-4b10-9ae1-0e85c8911a37 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:39.031361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92c2b-3bfa-4b10-9ae1-0e85c8911a37 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:39.031643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92c2b-3bfa-4b10-9ae1-0e85c8911a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:39.073801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-20e92c2b-3bfa-4b10-9ae1-0e85c8911a37 None None] MFA Rules not processed for user `d72f7b86e5a4470d8909fdea561abe7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:39.075553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20e92c2b-3bfa-4b10-9ae1-0e85c8911a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:39.163967 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3551/7068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:39.173766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:39.175549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:39.313261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb872a-3dc1-4ccc-9c1c-95074fd5cbb8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:39.322686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959324-5346-4292-84ae-3cc73e7d6508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:39.323402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959324-5346-4292-84ae-3cc73e7d6508 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:39.323747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959324-5346-4292-84ae-3cc73e7d6508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:39.324087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959324-5346-4292-84ae-3cc73e7d6508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:39.349241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959324-5346-4292-84ae-3cc73e7d6508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:39.350819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959324-5346-4292-84ae-3cc73e7d6508 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:39.372178 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3518/7069] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:32:39.934303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706315-2c15-4ef8-b3e4-d1b8338299a2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:39.935720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706315-2c15-4ef8-b3e4-d1b8338299a2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:39.936781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706315-2c15-4ef8-b3e4-d1b8338299a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:39.976094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0f706315-2c15-4ef8-b3e4-d1b8338299a2 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:39.977675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0f706315-2c15-4ef8-b3e4-d1b8338299a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:39.981408 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3552/7070] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:39 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:32:39.986409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09bd6-b18a-42a1-858d-9d66f0a1332a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:39.986693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09bd6-b18a-42a1-858d-9d66f0a1332a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:39.986969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e09bd6-b18a-42a1-858d-9d66f0a1332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:40.025003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a2e09bd6-b18a-42a1-858d-9d66f0a1332a None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:40.026668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a2e09bd6-b18a-42a1-858d-9d66f0a1332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:40.111712 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3519/7071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:32:40.115751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f706315-2c15-4ef8-b3e4-d1b8338299a2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:40.130422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f706315-2c15-4ef8-b3e4-d1b8338299a2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:40.135739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff11efa-a482-431f-970d-63c05f3c9a44 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:40.136930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11efa-a482-431f-970d-63c05f3c9a44 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:40.137398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11efa-a482-431f-970d-63c05f3c9a44 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:40.137821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11efa-a482-431f-970d-63c05f3c9a44 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:40.229037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1ff11efa-a482-431f-970d-63c05f3c9a44 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:40.254660 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:40.277555 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3553/7072] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:40 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:41.283892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cc7bc-0d48-4a80-aeae-f41f09273290 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:41.284443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cc7bc-0d48-4a80-aeae-f41f09273290 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:41.284524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cc7bc-0d48-4a80-aeae-f41f09273290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:41.326627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f36cc7bc-0d48-4a80-aeae-f41f09273290 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:41.330696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f36cc7bc-0d48-4a80-aeae-f41f09273290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:41.340205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3520/7073] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:41 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 01:32:41.341839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973ec5-90b0-4648-8ff4-b282d6ae1466 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:41.342289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973ec5-90b0-4648-8ff4-b282d6ae1466 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:41.342385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973ec5-90b0-4648-8ff4-b282d6ae1466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:41.377771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d2973ec5-90b0-4648-8ff4-b282d6ae1466 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:41.378933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d2973ec5-90b0-4648-8ff4-b282d6ae1466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:41.397261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3554/7074] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:41.403150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cc7bc-0d48-4a80-aeae-f41f09273290 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:41.421611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cc7bc-0d48-4a80-aeae-f41f09273290 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:41.429962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7b54b-d59f-432c-9042-b3dc99df6671 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:41.430988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7b54b-d59f-432c-9042-b3dc99df6671 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:41.431506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7b54b-d59f-432c-9042-b3dc99df6671 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:41.432099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7b54b-d59f-432c-9042-b3dc99df6671 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:41.502958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-27e7b54b-d59f-432c-9042-b3dc99df6671 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:41.520927 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3521/7075] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:41 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:32:42.526886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca2da8-2433-4314-a538-fb4ba32c6d6e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:42.530358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca2da8-2433-4314-a538-fb4ba32c6d6e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:42.531730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca2da8-2433-4314-a538-fb4ba32c6d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:42.582774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d5ca2da8-2433-4314-a538-fb4ba32c6d6e None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:42.583998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d5ca2da8-2433-4314-a538-fb4ba32c6d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:42.589493 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3555/7076] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:42 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:32:42.594199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65c25-1bda-425b-88d8-04df5b6f6d46 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:42.594607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65c25-1bda-425b-88d8-04df5b6f6d46 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:42.594937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65c25-1bda-425b-88d8-04df5b6f6d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:42.603817 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:42.629781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e5a65c25-1bda-425b-88d8-04df5b6f6d46 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:42.631799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e5a65c25-1bda-425b-88d8-04df5b6f6d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:42.662209 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3522/7077] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:42.663309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca2da8-2433-4314-a538-fb4ba32c6d6e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:42.677825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca2da8-2433-4314-a538-fb4ba32c6d6e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:42.684314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9d09f-d24c-496b-a716-eb68d1bc864f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:42.685218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9d09f-d24c-496b-a716-eb68d1bc864f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:42.685513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9d09f-d24c-496b-a716-eb68d1bc864f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:42.685792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9d09f-d24c-496b-a716-eb68d1bc864f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:42.757756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32d9d09f-d24c-496b-a716-eb68d1bc864f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:42.801520 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3556/7078] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:42 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:43.807870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc96d13-0c55-402d-ae32-dd245a736130 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:43.808316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc96d13-0c55-402d-ae32-dd245a736130 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:43.808719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc96d13-0c55-402d-ae32-dd245a736130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:43.867051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5dc96d13-0c55-402d-ae32-dd245a736130 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:43.869127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5dc96d13-0c55-402d-ae32-dd245a736130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:43.875607 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3523/7079] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:43 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 01:32:44.881585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9d65d-5a8f-48c1-8316-64a8714bec72 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:44.882657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9d65d-5a8f-48c1-8316-64a8714bec72 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:44.883192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9d65d-5a8f-48c1-8316-64a8714bec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:44.924467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6ad9d65d-5a8f-48c1-8316-64a8714bec72 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:44.925827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6ad9d65d-5a8f-48c1-8316-64a8714bec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:44.948048 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3557/7080] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:44.957761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9265b-4323-4378-85b5-369f94e1b03f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:44.958700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9265b-4323-4378-85b5-369f94e1b03f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:44.959244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9265b-4323-4378-85b5-369f94e1b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:45.042686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f3f9265b-4323-4378-85b5-369f94e1b03f None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:45.044134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f3f9265b-4323-4378-85b5-369f94e1b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:45.051583 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3524/7081] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:44 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:32:45.056040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e6724-f277-437e-a274-f6a59dc010cb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:45.056517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e6724-f277-437e-a274-f6a59dc010cb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:45.056961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e6724-f277-437e-a274-f6a59dc010cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:45.208371 n-d-master-1 devstack@keystone.service[81859]: WARNING keystone.server.flask.application [None req-d57e6724-f277-437e-a274-f6a59dc010cb None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 11 01:32:45.210445 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3558/7082] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 156 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 11 01:32:45.215190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12981-2d3c-493f-9213-a29219ce3b92 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:45.216008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12981-2d3c-493f-9213-a29219ce3b92 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:45.216477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a12981-2d3c-493f-9213-a29219ce3b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:45.299700 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.server.flask.application [None req-46a12981-2d3c-493f-9213-a29219ce3b92 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 11 01:32:45.303887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3525/7083] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 90 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 11 01:32:45.309012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f3a07-5aa1-4398-ae7f-7ecd70f43491 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:45.309616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f3a07-5aa1-4398-ae7f-7ecd70f43491 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:45.310152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f3a07-5aa1-4398-ae7f-7ecd70f43491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:45.363473 n-d-master-1 devstack@keystone.service[81859]: WARNING keystone.server.flask.application [None req-cc1f3a07-5aa1-4398-ae7f-7ecd70f43491 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 11 01:32:45.372065 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3559/7084] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:45 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 64 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 11 01:32:55.289604 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=16,keystone:UPDATE=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:55.349373 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=33,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:56.385677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142fc6d-109f-438c-8250-c38b4d2733b0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:56.386294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142fc6d-109f-438c-8250-c38b4d2733b0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:56.386924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142fc6d-109f-438c-8250-c38b4d2733b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:56.535127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2142fc6d-109f-438c-8250-c38b4d2733b0 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:56.540860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2142fc6d-109f-438c-8250-c38b4d2733b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:56.557183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3526/7085] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:56 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:32:56.562777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f3a07-5aa1-4398-ae7f-7ecd70f43491 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:56.582181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f3a07-5aa1-4398-ae7f-7ecd70f43491 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:56.594392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:56.595338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:56.595958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:56.596459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:56.700737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:56.726940 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3560/7086] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:56 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:56.921644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755abf33-0490-40cb-8488-17448d320ab0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:56.922621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755abf33-0490-40cb-8488-17448d320ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:56.922955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755abf33-0490-40cb-8488-17448d320ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:56.951952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-755abf33-0490-40cb-8488-17448d320ab0 None None] MFA Rules not processed for user `5551cca8143b455b822d283fb00d1932`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:56.954361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-755abf33-0490-40cb-8488-17448d320ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:57.064890 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3527/7087] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:57.127066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:57.128996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:57.289880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c7037-46fc-49ce-8846-d89ab81fdf0b tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:57.297604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35785ed-6083-4a1d-952c-1d9f5be1400d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:57.298719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35785ed-6083-4a1d-952c-1d9f5be1400d service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:57.299242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35785ed-6083-4a1d-952c-1d9f5be1400d service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:57.299845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35785ed-6083-4a1d-952c-1d9f5be1400d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:57.302624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b35785ed-6083-4a1d-952c-1d9f5be1400d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:57.443842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35785ed-6083-4a1d-952c-1d9f5be1400d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:32:57.455191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35785ed-6083-4a1d-952c-1d9f5be1400d service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:32:57.491928 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3561/7088] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:32:57.734773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd06d-a061-44ea-984b-5a984385d0ea None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:57.735335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd06d-a061-44ea-984b-5a984385d0ea None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:57.735335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd06d-a061-44ea-984b-5a984385d0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:57.756016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-688cd06d-a061-44ea-984b-5a984385d0ea None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:57.757295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-688cd06d-a061-44ea-984b-5a984385d0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:57.760571 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3528/7089] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:32:57.770182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316aaf-0c72-4009-81d4-6a181556320f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:57.770712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316aaf-0c72-4009-81d4-6a181556320f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:57.770712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316aaf-0c72-4009-81d4-6a181556320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-1c316aaf-0c72-4009-81d4-6a181556320f None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 11 01:32:57.801938 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:57.803229 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 11 01:32:57.804385 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:32:57.818271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322676a-edaa-464a-9779-82eaa8a0731e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:57.818870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322676a-edaa-464a-9779-82eaa8a0731e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:57.819148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322676a-edaa-464a-9779-82eaa8a0731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:57.822715 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3562/7090] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:57 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 01:32:57.878738 n-d-master-1 devstack@keystone.service[81860]: WARNING keystone.server.flask.application [None req-b322676a-edaa-464a-9779-82eaa8a0731e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 11 01:32:57.880479 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3529/7091] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:57 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 70 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 11 01:32:57.885575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec23ea-2e35-433d-926f-1aa52730f418 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:57.885861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec23ea-2e35-433d-926f-1aa52730f418 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:57.886287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec23ea-2e35-433d-926f-1aa52730f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:57.942113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dcec23ea-2e35-433d-926f-1aa52730f418 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:57.944304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dcec23ea-2e35-433d-926f-1aa52730f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:57.955079 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3563/7092] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:57.959769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322676a-edaa-464a-9779-82eaa8a0731e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:57.974188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322676a-edaa-464a-9779-82eaa8a0731e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:57.981783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db0911-ca06-4971-ac38-0fe3608e8287 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:57.983136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0911-ca06-4971-ac38-0fe3608e8287 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:57.983627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0911-ca06-4971-ac38-0fe3608e8287 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:57.984164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0911-ca06-4971-ac38-0fe3608e8287 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:58.072836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-67db0911-ca06-4971-ac38-0fe3608e8287 tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:58.102584 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3530/7093] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:57 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:32:59.106087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51f49c-6717-481a-90b3-893e34d03620 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:59.106643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51f49c-6717-481a-90b3-893e34d03620 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:59.106850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51f49c-6717-481a-90b3-893e34d03620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:59.149908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9c51f49c-6717-481a-90b3-893e34d03620 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:59.151928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9c51f49c-6717-481a-90b3-893e34d03620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:59.161829 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3564/7094] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:32:59.162555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:59.163033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:59.163277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:59.193015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:32:59.194927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:32:59.215173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3531/7095] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:32:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:32:59.217958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51f49c-6717-481a-90b3-893e34d03620 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:32:59.235812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51f49c-6717-481a-90b3-893e34d03620 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:32:59.244638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0379cd1-c0b0-464c-a266-4724d9e3599f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:32:59.245738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0379cd1-c0b0-464c-a266-4724d9e3599f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:32:59.246197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0379cd1-c0b0-464c-a266-4724d9e3599f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:32:59.247229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0379cd1-c0b0-464c-a266-4724d9e3599f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:32:59.338112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0379cd1-c0b0-464c-a266-4724d9e3599f tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:32:59.340397 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:UPDATE=3,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:32:59.355710 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3565/7096] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:32:59 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:00.223770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:00.225776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:00.257687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a099-0848-4fd6-b2aa-0c6e0e661ea8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:00.266270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5d385-fc56-4b4a-b9c8-65ec23b753ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:00.267891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d385-fc56-4b4a-b9c8-65ec23b753ed service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:00.269931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d385-fc56-4b4a-b9c8-65ec23b753ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:00.270524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d385-fc56-4b4a-b9c8-65ec23b753ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:00.274522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-55e5d385-fc56-4b4a-b9c8-65ec23b753ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:00.319301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5d385-fc56-4b4a-b9c8-65ec23b753ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:00.321221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5d385-fc56-4b4a-b9c8-65ec23b753ed service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:00.361166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66817eb8-3857-4786-8b3a-e29a6e805ff9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:00.361655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66817eb8-3857-4786-8b3a-e29a6e805ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:00.361734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66817eb8-3857-4786-8b3a-e29a6e805ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:00.369899 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3532/7097] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:00.391617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-66817eb8-3857-4786-8b3a-e29a6e805ff9 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:00.392840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-66817eb8-3857-4786-8b3a-e29a6e805ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:00.396351 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3566/7098] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:00 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:33:00.401257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489debb-fbad-4f40-a33c-df837b365b51 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:00.401542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489debb-fbad-4f40-a33c-df837b365b51 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:00.401808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489debb-fbad-4f40-a33c-df837b365b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:00.425752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e489debb-fbad-4f40-a33c-df837b365b51 None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:00.427918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e489debb-fbad-4f40-a33c-df837b365b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:00.436969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3533/7099] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:00.442132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66817eb8-3857-4786-8b3a-e29a6e805ff9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:00.459359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66817eb8-3857-4786-8b3a-e29a6e805ff9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:00.466269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01a974-9375-42f6-8c53-2c06d87e0cbb tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03732f410ab64639bf967b9a5bb3f688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb424b46f104045b0081e4303e14952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:00.467199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a974-9375-42f6-8c53-2c06d87e0cbb tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:00.467761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a974-9375-42f6-8c53-2c06d87e0cbb tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:00.468325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01a974-9375-42f6-8c53-2c06d87e0cbb tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688/password` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:00.579438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ca01a974-9375-42f6-8c53-2c06d87e0cbb tempest-IdentityV3UsersTest-1863200885 tempest-IdentityV3UsersTest-1863200885-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:00.602867 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3567/7100] 10.222.0.16 () {60 vars in 1269 bytes} [Sun Sep 11 01:33:00 2022] POST /identity/v3/users/03732f410ab64639bf967b9a5bb3f688/password => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:01.609015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:01.609708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:01.610099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:01.673783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:01.675563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:01.688500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3534/7101] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:01 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 01:33:02.693807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66f85e-f5ce-4bc1-935b-d75c67e20e9e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:02.694700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66f85e-f5ce-4bc1-935b-d75c67e20e9e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:02.695263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66f85e-f5ce-4bc1-935b-d75c67e20e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:02.738850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3d66f85e-f5ce-4bc1-935b-d75c67e20e9e None None] MFA Rules not processed for user `03732f410ab64639bf967b9a5bb3f688`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:02.740103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d66f85e-f5ce-4bc1-935b-d75c67e20e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:02.761852 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3568/7102] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:02.767684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:02.769839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:02.860221 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:02.933611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81cce4-f305-4e22-947d-0c41e6e4a78a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:02.939627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:02.941044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:02.941658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:02.942136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] PATH_INFO: `/v3/users/03732f410ab64639bf967b9a5bb3f688` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:02.943546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03732f410ab64639bf967b9a5bb3f688)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:02.946125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:03.054027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:03.056789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:03.058324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:03.080783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:03.098829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03732f410ab64639bf967b9a5bb3f688'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:03.118862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3535/7103] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:02 2022] DELETE /identity/v3/users/03732f410ab64639bf967b9a5bb3f688 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:03.123619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:03.123963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:03.124261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:03.144233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:03.145807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:03.258011 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3569/7104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:03.290052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:03.291518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:03.382727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82d82c-8c59-4e8c-9d67-3296633514a7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:03.388734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cebb9-0627-4192-99ff-6ebf2b503fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:03.390227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cebb9-0627-4192-99ff-6ebf2b503fde service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:03.390621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cebb9-0627-4192-99ff-6ebf2b503fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:03.390901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cebb9-0627-4192-99ff-6ebf2b503fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:03.418498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cebb9-0627-4192-99ff-6ebf2b503fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:03.421181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cebb9-0627-4192-99ff-6ebf2b503fde service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:03.433673 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3536/7105] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:05.349839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:05.351955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:05.376694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc933-f981-4ebf-8b07-a71f25ad2bb3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:05.394604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:05.395795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:05.396230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:05.396669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] PATH_INFO: `/v3/projects/1fb424b46f104045b0081e4303e14952` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:05.405240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb424b46f104045b0081e4303e14952)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:05.407556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:05.520997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb424b46f104045b0081e4303e14952', 'request_id': 'req-f41f43eb-59f7-4ccf-b277-ee46893419f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:05.540066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb424b46f104045b0081e4303e14952', 'request_id': 'req-f41f43eb-59f7-4ccf-b277-ee46893419f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:05.556184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb424b46f104045b0081e4303e14952', 'request_id': 'req-f41f43eb-59f7-4ccf-b277-ee46893419f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:05.623964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] The token cache is being invalidate because project 1fb424b46f104045b0081e4303e14952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:05.624299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:05.625757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f41f43eb-59f7-4ccf-b277-ee46893419f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:05.627513 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3570/7106] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:05 2022] DELETE /identity/v3/projects/1fb424b46f104045b0081e4303e14952 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:05.633212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba88a-8c43-47d9-ab00-3be5ad3e48f3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:05.634055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba88a-8c43-47d9-ab00-3be5ad3e48f3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:05.634555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba88a-8c43-47d9-ab00-3be5ad3e48f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:05.689594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f01ba88a-8c43-47d9-ab00-3be5ad3e48f3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:05.691103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f01ba88a-8c43-47d9-ab00-3be5ad3e48f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:05.825022 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3537/7107] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:05.827651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5c786-5618-437a-a434-62e7c47fb79a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:05.827878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5c786-5618-437a-a434-62e7c47fb79a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:05.828157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5c786-5618-437a-a434-62e7c47fb79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:05.883879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-47c5c786-5618-437a-a434-62e7c47fb79a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:05.887488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-47c5c786-5618-437a-a434-62e7c47fb79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:05.911182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3571/7108] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:05.915101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ba88a-8c43-47d9-ab00-3be5ad3e48f3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:05.920654 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:05.935251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ba88a-8c43-47d9-ab00-3be5ad3e48f3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:05.943102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:05.943771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:05.945565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:05.946055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:05.946960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:33:05.947278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:05.948946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:05.983021 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3538/7109] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:33:05.986546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5c786-5618-437a-a434-62e7c47fb79a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:05.997417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5c786-5618-437a-a434-62e7c47fb79a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.022676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.023473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.023862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.024079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.025367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.027643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.064419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:06.066247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:06.074260 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=85,keystone:UPDATE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:06.092768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb067e-b967-4e48-a5b3-5709a727594f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.106479 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3572/7110] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:05 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:06.108077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:06.189299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de100ade-056f-40f9-9477-087eb060099f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.196238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.197035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.197447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.198209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.199184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.202988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.232818 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3573/7111] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:06 2022] POST /identity/v3/users => generated 281 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:06.237052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:06.237302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.237748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.238027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.238304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] PATH_INFO: `/v3/users/d72f7b86e5a4470d8909fdea561abe7f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.241287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72f7b86e5a4470d8909fdea561abe7f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.243322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.250548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819cc5d-4848-4035-92dc-722aad5ae25f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.261488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.263489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.265723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.266137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.268470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.272815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.307720 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3574/7112] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:33:06.309325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:06.333744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d6434-fa9c-4aa5-b1d2-7fe86c33a54e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.346529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.347164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.347480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.347790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.348612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.351652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.378841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72f7b86e5a4470d8909fdea561abe7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:06.383718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72f7b86e5a4470d8909fdea561abe7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:06.385885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72f7b86e5a4470d8909fdea561abe7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:06.399372 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3575/7113] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:06.399586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72f7b86e5a4470d8909fdea561abe7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:06.402098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:06.406746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:06.435483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d94cc885-b677-41ce-ac1f-c4faeb07096a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72f7b86e5a4470d8909fdea561abe7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:06.442472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31ea6-e05d-4cbc-9adc-a1e686dac909 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.454909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ed7f-213e-4fcc-aabb-037eb7c35c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.455591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ed7f-213e-4fcc-aabb-037eb7c35c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.456083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ed7f-213e-4fcc-aabb-037eb7c35c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.456558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ed7f-213e-4fcc-aabb-037eb7c35c26 admin admin] PATH_INFO: `/v3/projects/69d5eaf87d474cc6a7a4d5623e3a02d0/users/6cc230bbaa364ba68b32717ffa4e1e14/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.462980 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3539/7114] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:06 2022] DELETE /identity/v3/users/d72f7b86e5a4470d8909fdea561abe7f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:06.465274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.465633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.466112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.499763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:06.501244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:06.502281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ed7f-213e-4fcc-aabb-037eb7c35c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d5eaf87d474cc6a7a4d5623e3a02d0, user_id=6cc230bbaa364ba68b32717ffa4e1e14, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.507374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ed7f-213e-4fcc-aabb-037eb7c35c26 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.550909 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3576/7115] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:06 2022] PUT /identity/v3/projects/69d5eaf87d474cc6a7a4d5623e3a02d0/users/6cc230bbaa364ba68b32717ffa4e1e14/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:06.552815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0dc1-0edf-42d0-ada4-d574350739be None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.553348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0dc1-0edf-42d0-ada4-d574350739be None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.553723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0dc1-0edf-42d0-ada4-d574350739be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.618969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3540/7116] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:33:06.636513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:06.638715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:06.646630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3cfe0dc1-0edf-42d0-ada4-d574350739be None None] MFA Rules not processed for user `6cc230bbaa364ba68b32717ffa4e1e14`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:06.649284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3cfe0dc1-0edf-42d0-ada4-d574350739be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:06.678655 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:06.771682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b6801-be8b-4061-86d8-b8f6038b6cae None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.788346 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3577/7117] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:33:06.803429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe0dc1-0edf-42d0-ada4-d574350739be None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:06.849840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03619e-c17b-42ad-b9be-bfb50a47e72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.850841 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:06.851692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03619e-c17b-42ad-b9be-bfb50a47e72e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.852098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03619e-c17b-42ad-b9be-bfb50a47e72e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.852379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03619e-c17b-42ad-b9be-bfb50a47e72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.915920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe0dc1-0edf-42d0-ada4-d574350739be None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:06.922466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:06.923762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:06.924241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:06.924630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] PATH_INFO: `/v3/users/6cc230bbaa364ba68b32717ffa4e1e14` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:06.926752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc230bbaa364ba68b32717ffa4e1e14)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.929355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.970593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03619e-c17b-42ad-b9be-bfb50a47e72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:06.972268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03619e-c17b-42ad-b9be-bfb50a47e72e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:06.991407 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3541/7118] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:07.039369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc230bbaa364ba68b32717ffa4e1e14'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.040549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc230bbaa364ba68b32717ffa4e1e14'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.041239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc230bbaa364ba68b32717ffa4e1e14'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.065399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc230bbaa364ba68b32717ffa4e1e14'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.082860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc230bbaa364ba68b32717ffa4e1e14'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.131046 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3578/7119] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:06 2022] DELETE /identity/v3/users/6cc230bbaa364ba68b32717ffa4e1e14 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:07.138114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:07.139303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:07.139807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:07.174977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:07.177458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:07.337169 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3542/7120] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:07.386692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:07.389092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:07.465467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:07.467263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:07.484736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c36c17-c824-4378-9cfc-5d8dbc4d23da None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:07.521382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:07.522051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:07.522343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:07.522588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] PATH_INFO: `/v3/projects/79a1afb370514ea7b17e6722d084d10e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:07.532438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a1afb370514ea7b17e6722d084d10e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:07.541650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:07.579575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7532a9-dcfe-4c49-9836-fdb034ac418c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:07.587821 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:07.591251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8928d2-2138-409e-96bc-8727677332b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:07.593723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8928d2-2138-409e-96bc-8727677332b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:07.594014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8928d2-2138-409e-96bc-8727677332b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:07.594286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8928d2-2138-409e-96bc-8727677332b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:07.636227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8928d2-2138-409e-96bc-8727677332b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:07.637742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8928d2-2138-409e-96bc-8727677332b4 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:07.690018 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3579/7121] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:07.763447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a1afb370514ea7b17e6722d084d10e', 'request_id': 'req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.791331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a1afb370514ea7b17e6722d084d10e', 'request_id': 'req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.826688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a1afb370514ea7b17e6722d084d10e', 'request_id': 'req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.852843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] The token cache is being invalidate because project 79a1afb370514ea7b17e6722d084d10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:07.853182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.855871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b3a6cdb5-d6f2-448f-8290-0fd71ef45603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:07.859872 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3543/7122] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:07 2022] DELETE /identity/v3/projects/79a1afb370514ea7b17e6722d084d10e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:07.866279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f05cc3-a5ef-46fd-a629-e16f13254225 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:07.866560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f05cc3-a5ef-46fd-a629-e16f13254225 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:07.866941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f05cc3-a5ef-46fd-a629-e16f13254225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:07.914370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-38f05cc3-a5ef-46fd-a629-e16f13254225 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:07.915679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-38f05cc3-a5ef-46fd-a629-e16f13254225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:08.027819 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:08.068954 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3580/7123] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:08.078191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7905-8f8e-4119-ac3a-978576c961b2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.079656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7905-8f8e-4119-ac3a-978576c961b2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.081502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7905-8f8e-4119-ac3a-978576c961b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.113737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-57ad7905-8f8e-4119-ac3a-978576c961b2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:08.115903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-57ad7905-8f8e-4119-ac3a-978576c961b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:08.128798 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3544/7124] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:08.133851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f05cc3-a5ef-46fd-a629-e16f13254225 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:08.146747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f05cc3-a5ef-46fd-a629-e16f13254225 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:08.153595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:08.154516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.155315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.157275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.158556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:33:08.159041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:08.162340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:08.190733 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3581/7125] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:33:08.193592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad7905-8f8e-4119-ac3a-978576c961b2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:08.210095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad7905-8f8e-4119-ac3a-978576c961b2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:08.218640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:08.219402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.219822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.220201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.221780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:08.224345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:08.290935 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3545/7126] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:08 2022] POST /identity/v3/projects => generated 361 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:08.295517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:08.310922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dd59b-2539-4347-87f3-9c2d253aaa6a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:08.434935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:08.436327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.436764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.437151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.437814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:08.443470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:08.491418 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3582/7127] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:08 2022] POST /identity/v3/users => generated 281 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:08.495763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:08.546559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942e403-f50e-49c9-88f3-b310f4e04cfb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:08.558096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:08.559519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.560028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.561201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.562522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:08.564372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:08.580107 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3546/7128] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:33:08.581451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:08.593930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9e671-5c91-421d-a08a-3c3a3f90cfe8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:08.599301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86285a-a540-4bd3-8986-b8c89aa872ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:08.601536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86285a-a540-4bd3-8986-b8c89aa872ce admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.602192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86285a-a540-4bd3-8986-b8c89aa872ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.602687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86285a-a540-4bd3-8986-b8c89aa872ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.604326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86285a-a540-4bd3-8986-b8c89aa872ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:08.606266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86285a-a540-4bd3-8986-b8c89aa872ce admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:08.627450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:08.628693 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3583/7129] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:33:08.639849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e372e18-ea79-4d67-97d0-4a0543e2c984 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:08.648844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:08.650249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.650731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.651217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] PATH_INFO: `/v3/projects/a8f14dc2beca49658ed23b7430dc1f82/users/8683f47ab898499789b030d7d42cea5f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.690144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f14dc2beca49658ed23b7430dc1f82, user_id=8683f47ab898499789b030d7d42cea5f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:08.692917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:08.723946 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3547/7130] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:08 2022] PUT /identity/v3/projects/a8f14dc2beca49658ed23b7430dc1f82/users/8683f47ab898499789b030d7d42cea5f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:08.725981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:08.726463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:08.727077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:08.800250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] MFA Rules not processed for user `8683f47ab898499789b030d7d42cea5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:08.801937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:08.951500 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3584/7131] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:08.967004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:08.969383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:09.037447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:09.040771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:09.118717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb728ccb-a791-4748-989f-4af01153429d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:09.128014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70708c7d-d6e1-416f-bcaf-5f55ac28de01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:09.129595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708c7d-d6e1-416f-bcaf-5f55ac28de01 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:09.131335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708c7d-d6e1-416f-bcaf-5f55ac28de01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:09.132136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70708c7d-d6e1-416f-bcaf-5f55ac28de01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:09.157572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70708c7d-d6e1-416f-bcaf-5f55ac28de01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:09.159790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70708c7d-d6e1-416f-bcaf-5f55ac28de01 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:09.182043 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:09.195142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3548/7132] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:33:09.220107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27daf0-fa32-4412-a296-33e32321622a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:09.226095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:09.226095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:09.226337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:09.226699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] PATH_INFO: `/v3/projects/69d5eaf87d474cc6a7a4d5623e3a02d0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:09.228136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d5eaf87d474cc6a7a4d5623e3a02d0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:09.230463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:09.297003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d5eaf87d474cc6a7a4d5623e3a02d0', 'request_id': 'req-21f8b623-0fea-4253-9460-535835f61db3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:09.306695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d5eaf87d474cc6a7a4d5623e3a02d0', 'request_id': 'req-21f8b623-0fea-4253-9460-535835f61db3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:09.329269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d5eaf87d474cc6a7a4d5623e3a02d0', 'request_id': 'req-21f8b623-0fea-4253-9460-535835f61db3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:09.366102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] The token cache is being invalidate because project 69d5eaf87d474cc6a7a4d5623e3a02d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:09.366402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:09.369451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-21f8b623-0fea-4253-9460-535835f61db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:09.371391 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3585/7133] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:09 2022] DELETE /identity/v3/projects/69d5eaf87d474cc6a7a4d5623e3a02d0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:09.377135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3469b6-cb3d-4b86-911e-ab86746cb0ef None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:09.377502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3469b6-cb3d-4b86-911e-ab86746cb0ef None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:09.377846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3469b6-cb3d-4b86-911e-ab86746cb0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:09.441514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cb3469b6-cb3d-4b86-911e-ab86746cb0ef None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:09.444537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb3469b6-cb3d-4b86-911e-ab86746cb0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:09.541096 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:09.584803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3549/7134] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:09.593228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833a04-cf03-4b74-b0fb-56b59225bc71 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:09.593827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833a04-cf03-4b74-b0fb-56b59225bc71 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:09.593827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833a04-cf03-4b74-b0fb-56b59225bc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:09.626468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-57833a04-cf03-4b74-b0fb-56b59225bc71 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:09.628311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-57833a04-cf03-4b74-b0fb-56b59225bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:09.647437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3586/7135] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:09.652026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3469b6-cb3d-4b86-911e-ab86746cb0ef None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:09.668771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3469b6-cb3d-4b86-911e-ab86746cb0ef None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:09.676017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:09.678351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:09.678937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:09.679586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:09.680499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:33:09.681019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:09.683307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:09.700504 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3550/7136] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:33:09.707256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833a04-cf03-4b74-b0fb-56b59225bc71 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:09.725737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833a04-cf03-4b74-b0fb-56b59225bc71 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:09.734983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:09.736189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:09.736777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:09.737319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:09.738202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:09.741320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:09.816655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3587/7137] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:09 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:09.821824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:09.844373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0b14-8a08-4b25-b677-e40d5ad95a02 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:09.964428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:09.965097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:09.965390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:09.965660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:09.966300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:09.970553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:10.012541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3551/7138] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:09 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:10.017160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:10.040194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb1eb4-e4ee-46a7-88c9-b2e1965fbc07 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:10.054560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:10.059158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:10.059494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:10.059993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:10.063534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:10.069703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:10.104048 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3588/7139] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:10.108084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:10.126559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3be8e8-ab6f-44a9-9634-d02f2ae22f22 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:10.137912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d47de-360a-462f-9584-a2a3560ff42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:10.138631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d47de-360a-462f-9584-a2a3560ff42a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:10.138819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d47de-360a-462f-9584-a2a3560ff42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:10.139094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d47de-360a-462f-9584-a2a3560ff42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:10.139747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d47de-360a-462f-9584-a2a3560ff42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:10.141391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d47de-360a-462f-9584-a2a3560ff42a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:10.160134 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3552/7140] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:33:10.163906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:10.185923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315771-7576-4182-92d4-10f9e668ceed admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:10.194296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:10.195243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:10.195894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:10.196565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] PATH_INFO: `/v3/projects/f5469769819545a181e043c3d671f852/users/ebc4306464004a8791b8e55ef17a5af3/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:10.216271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5469769819545a181e043c3d671f852, user_id=ebc4306464004a8791b8e55ef17a5af3, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:10.219603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:10.267363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156f58-c500-4d42-b9eb-e72b595ef020 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:10.268020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156f58-c500-4d42-b9eb-e72b595ef020 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:10.268020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156f58-c500-4d42-b9eb-e72b595ef020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:10.271180 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3589/7141] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:10 2022] PUT /identity/v3/projects/f5469769819545a181e043c3d671f852/users/ebc4306464004a8791b8e55ef17a5af3/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:10.322524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1a156f58-c500-4d42-b9eb-e72b595ef020 None None] MFA Rules not processed for user `ebc4306464004a8791b8e55ef17a5af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:10.323844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1a156f58-c500-4d42-b9eb-e72b595ef020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:10.428203 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3553/7142] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:10.433211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:10.558218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c483d2-03ec-42cd-bd78-01195f1337cb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:10.565082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:10.565819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:10.566188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:10.566660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:10.567373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:10.569446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:10.593993 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:10.623113 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3590/7143] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:10 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:10.627045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156f58-c500-4d42-b9eb-e72b595ef020 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:10.642892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156f58-c500-4d42-b9eb-e72b595ef020 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:10.734843 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:10.803922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:10.804667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:10.805220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:10.805501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:10.806248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:10.808563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:10.900735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:10.902810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3554/7144] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:10 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:33:10.920240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5c50f-4d2a-475a-b41a-5c9bf5d3218c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:10.932751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:10.933950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:10.934279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:10.934655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:10.936637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:10.939648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:10.996580 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3591/7145] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:33:10.998529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:11.017347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a71002-16a3-4df3-af05-8f15daa1fa45 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:11.028911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:11.029912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:11.030194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:11.030582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] PATH_INFO: `/v3/projects/a88217131a5145a0af462eb55d8c5ef9/users/30195ebed7ed4eb790b3e4d109304b7d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:11.068931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88217131a5145a0af462eb55d8c5ef9, user_id=30195ebed7ed4eb790b3e4d109304b7d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:11.071894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:11.102536 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3555/7146] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:10 2022] PUT /identity/v3/projects/a88217131a5145a0af462eb55d8c5ef9/users/30195ebed7ed4eb790b3e4d109304b7d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:11.106536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:11.121447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c2323-2635-4e96-90ec-8ad1f20fb52f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:11.270931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda239e-6d9b-490a-a006-94f47325616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:11.272337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda239e-6d9b-490a-a006-94f47325616b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:11.274060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda239e-6d9b-490a-a006-94f47325616b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:11.275079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda239e-6d9b-490a-a006-94f47325616b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:11.291831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda239e-6d9b-490a-a006-94f47325616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:11.295112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda239e-6d9b-490a-a006-94f47325616b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:11.320919 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3592/7147] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:11.325151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:11.345592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc060ed-a5ca-422b-9d77-f65d318f2b3a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:11.364912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:11.366102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:11.366597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:11.367116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] PATH_INFO: `/v3/projects/a88217131a5145a0af462eb55d8c5ef9/users/30195ebed7ed4eb790b3e4d109304b7d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:11.370464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88217131a5145a0af462eb55d8c5ef9, user_id=30195ebed7ed4eb790b3e4d109304b7d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:11.376080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:11.392333 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3556/7148] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:11 2022] PUT /identity/v3/projects/a88217131a5145a0af462eb55d8c5ef9/users/30195ebed7ed4eb790b3e4d109304b7d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:11.403987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:11.403987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:11.404280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:11.505620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] MFA Rules not processed for user `30195ebed7ed4eb790b3e4d109304b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:11.506954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:11.680432 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3593/7149] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:11.705479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:11.708799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:11.850927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde91ca6-6cae-407d-8bb1-3cfcd0cfeafd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:11.855786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:11.857931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:11.858244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:11.858555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:11.886215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:11.895822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:11.929899 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3557/7150] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:16.966960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:16.968801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:16.993875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bbe9d-a6bf-4526-80fc-3f9da48af92b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:16.998549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b5c60-587f-4bfa-9366-0c61dfb5b146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:16.999491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5c60-587f-4bfa-9366-0c61dfb5b146 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:16.999911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5c60-587f-4bfa-9366-0c61dfb5b146 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:17.000335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b5c60-587f-4bfa-9366-0c61dfb5b146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:17.169528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b5c60-587f-4bfa-9366-0c61dfb5b146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:17.174128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b5c60-587f-4bfa-9366-0c61dfb5b146 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:17.188841 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3594/7151] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:19.384263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:19.509955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f94c6-a6ec-4020-a023-ec2dd2bb75d5 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:19.519568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:19.520477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:19.520908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:19.521388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] PATH_INFO: `/v3/users/ebc4306464004a8791b8e55ef17a5af3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:19.523285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc4306464004a8791b8e55ef17a5af3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:19.529023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:19.628779 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:19.672124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc4306464004a8791b8e55ef17a5af3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:19.673003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc4306464004a8791b8e55ef17a5af3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:19.675130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc4306464004a8791b8e55ef17a5af3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:19.695617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc4306464004a8791b8e55ef17a5af3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:19.741457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc4306464004a8791b8e55ef17a5af3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:19.821325 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3558/7152] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:19 2022] DELETE /identity/v3/users/ebc4306464004a8791b8e55ef17a5af3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:19.826628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:19.827082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:19.827082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:19.835457 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:19.850650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:19.851886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:19.942959 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3595/7153] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:19.972485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:19.974009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:20.079960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91332357-3740-4d02-990f-8e963e8ec72d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:20.087352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:20.088046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:20.088322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:20.088630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:20.103424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:20.104988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:20.121472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3559/7154] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:21.026164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:21.027885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:21.074940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb49ad-8e4e-46c3-afd0-43d4cd29e90b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:21.095728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:21.096620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:21.097188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:21.097629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] PATH_INFO: `/v3/projects/f5469769819545a181e043c3d671f852` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:21.099079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5469769819545a181e043c3d671f852)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:21.101650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:21.256723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5469769819545a181e043c3d671f852', 'request_id': 'req-ffeedd4f-6381-4532-ae50-9be49fad9711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.265628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5469769819545a181e043c3d671f852', 'request_id': 'req-ffeedd4f-6381-4532-ae50-9be49fad9711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.318678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5469769819545a181e043c3d671f852', 'request_id': 'req-ffeedd4f-6381-4532-ae50-9be49fad9711'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.348492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] The token cache is being invalidate because project f5469769819545a181e043c3d671f852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:21.353830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.355260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.370024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:21.371176 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3596/7155] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:21 2022] DELETE /identity/v3/projects/f5469769819545a181e043c3d671f852 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:21.383206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed565f-418c-4859-a272-169910e003d8 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:21.476763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:21.519009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:21.519009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:21.519228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] PATH_INFO: `/v3/users/30195ebed7ed4eb790b3e4d109304b7d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:21.532260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30195ebed7ed4eb790b3e4d109304b7d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:21.534269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:21.678249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30195ebed7ed4eb790b3e4d109304b7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.681871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30195ebed7ed4eb790b3e4d109304b7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.682647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30195ebed7ed4eb790b3e4d109304b7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.697279 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:21.711115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30195ebed7ed4eb790b3e4d109304b7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.757124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b4b810dc-6c8e-498a-856a-b6ff2becc26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30195ebed7ed4eb790b3e4d109304b7d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:21.786661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3560/7156] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:21 2022] DELETE /identity/v3/users/30195ebed7ed4eb790b3e4d109304b7d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:23.250177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:23.251776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:23.272593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeedd4f-6381-4532-ae50-9be49fad9711 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:23.454011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:23.454550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:23.454837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:23.455117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] PATH_INFO: `/v3/projects/a88217131a5145a0af462eb55d8c5ef9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:23.458119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88217131a5145a0af462eb55d8c5ef9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:23.460182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:23.584853 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:23.612718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88217131a5145a0af462eb55d8c5ef9', 'request_id': 'req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:23.628815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88217131a5145a0af462eb55d8c5ef9', 'request_id': 'req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:23.648429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88217131a5145a0af462eb55d8c5ef9', 'request_id': 'req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:23.691089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] The token cache is being invalidate because project a88217131a5145a0af462eb55d8c5ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:23.691499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:23.693539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50bf20ca-fe2f-4c80-87a9-4c37e376b04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:23.695512 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3597/7157] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:23 2022] DELETE /identity/v3/projects/a88217131a5145a0af462eb55d8c5ef9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:23.702595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06467d10-a5c6-444f-97a6-df1bfe81662b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:23.703161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06467d10-a5c6-444f-97a6-df1bfe81662b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:23.703325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06467d10-a5c6-444f-97a6-df1bfe81662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:23.768220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-06467d10-a5c6-444f-97a6-df1bfe81662b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:23.769531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-06467d10-a5c6-444f-97a6-df1bfe81662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:24.011923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cbad0-1247-468b-9b6f-3b46bf36b2e3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.012213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cbad0-1247-468b-9b6f-3b46bf36b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.012494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cbad0-1247-468b-9b6f-3b46bf36b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:24.028396 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3561/7158] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:24.075750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-521cbad0-1247-468b-9b6f-3b46bf36b2e3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:24.077731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-521cbad0-1247-468b-9b6f-3b46bf36b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:24.117584 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3598/7159] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:24.121629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06467d10-a5c6-444f-97a6-df1bfe81662b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:24.137600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06467d10-a5c6-444f-97a6-df1bfe81662b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:24.169417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:24.170694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.171604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.172399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:24.173620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:33:24.174283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:24.176143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:24.197595 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3562/7160] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:33:24.202290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cbad0-1247-468b-9b6f-3b46bf36b2e3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:24.219219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cbad0-1247-468b-9b6f-3b46bf36b2e3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:24.225963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:24.226602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.227015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.227301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:24.227947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:24.230395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:24.298635 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3599/7161] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:24 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:24.302648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:24.326762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e64a3-e0e5-42c0-9fff-864d1ad894d6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:24.506097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:24.506799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.507079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.507603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:24.508422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:24.515632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:24.573217 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3563/7162] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:24 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:24.577838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:24.594921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fe18c-ff52-4fa9-89c4-85f62579bc9a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:24.614917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:24.615536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.615811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.616082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:24.616742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:24.618397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:24.667125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:24.669092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3600/7163] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:24.706159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5066-75e8-42c4-802a-e020df7e45ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:24.730747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ee22a-f147-4e04-beae-332b9b3f9927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:24.736648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee22a-f147-4e04-beae-332b9b3f9927 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.737793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee22a-f147-4e04-beae-332b9b3f9927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.739493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ee22a-f147-4e04-beae-332b9b3f9927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:24.740611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ee22a-f147-4e04-beae-332b9b3f9927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:24.746494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ee22a-f147-4e04-beae-332b9b3f9927 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:24.804823 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3564/7164] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:24.810591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:24.824835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b3d0b-7007-456c-a84a-1f28b09f37f8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:24.857789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:24.858624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.858822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.860566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] PATH_INFO: `/v3/projects/9afcc92227b5431bbd30b956ea0f3ba7/users/6609d1a8681047bf8345a69189b87277/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:24.908881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afcc92227b5431bbd30b956ea0f3ba7, user_id=6609d1a8681047bf8345a69189b87277, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:24.915316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:24.975780 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3601/7165] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:24 2022] PUT /identity/v3/projects/9afcc92227b5431bbd30b956ea0f3ba7/users/6609d1a8681047bf8345a69189b87277/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:24.979738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0488-9080-43cf-9885-27775d69f66f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:24.980229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0488-9080-43cf-9885-27775d69f66f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:24.982136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac0488-9080-43cf-9885-27775d69f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:25.025975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aaac0488-9080-43cf-9885-27775d69f66f None None] MFA Rules not processed for user `6609d1a8681047bf8345a69189b87277`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:25.030423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aaac0488-9080-43cf-9885-27775d69f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:25.099721 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:25.224431 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3565/7166] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:25.230225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:25.431652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef0103-5291-4de0-ab41-637bb8b39d6c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:25.439238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:25.439876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:25.440154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:25.440429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:25.441088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:25.444460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:25.496854 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3602/7167] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:25 2022] POST /identity/v3/projects => generated 365 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:25.498691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac0488-9080-43cf-9885-27775d69f66f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:25.516978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac0488-9080-43cf-9885-27775d69f66f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:25.686203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:25.686834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:25.687120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:25.687393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:25.688071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:25.690067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:25.727982 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3566/7168] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:25 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:25.733314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:25.756955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6db450-c785-4108-acfd-d7c2b362e71e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:25.774179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:25.775993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:25.777022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:25.779210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:25.781793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:25.785205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:25.818032 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3603/7169] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:33:25.822524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:25.840841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27608e-7256-4f1e-9fdc-02cf5ffb989a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:25.857671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:25.858393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:25.858672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:25.858946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] PATH_INFO: `/v3/projects/f6850385836449c0bb6ff1a829481028/users/45178524a7f74b53a3b8aaa9eb8bcb8f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:25.892556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6850385836449c0bb6ff1a829481028, user_id=45178524a7f74b53a3b8aaa9eb8bcb8f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:25.899165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:25.931526 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3567/7170] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:25 2022] PUT /identity/v3/projects/f6850385836449c0bb6ff1a829481028/users/45178524a7f74b53a3b8aaa9eb8bcb8f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:25.935912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:25.952481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5de77-6937-4ce9-b51f-bf50d5d704ba admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:26.022575 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:26.153535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671742fc-b5b2-495e-b92d-8f4e68de1516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:26.158935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671742fc-b5b2-495e-b92d-8f4e68de1516 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:26.159220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671742fc-b5b2-495e-b92d-8f4e68de1516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:26.160863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671742fc-b5b2-495e-b92d-8f4e68de1516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:26.161579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671742fc-b5b2-495e-b92d-8f4e68de1516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:26.176628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671742fc-b5b2-495e-b92d-8f4e68de1516 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:26.221802 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3604/7171] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:26.223552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:26.240807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae244c-3228-4eaa-ba5c-d7b852bc6592 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:26.265119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:26.266405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:26.267983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:26.270043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] PATH_INFO: `/v3/projects/f6850385836449c0bb6ff1a829481028/users/45178524a7f74b53a3b8aaa9eb8bcb8f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:26.282539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6850385836449c0bb6ff1a829481028, user_id=45178524a7f74b53a3b8aaa9eb8bcb8f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:26.292500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:26.364262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d9b8-08c7-456a-a241-16237018c97c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:26.364590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d9b8-08c7-456a-a241-16237018c97c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:26.365003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43d9b8-08c7-456a-a241-16237018c97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:26.377033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3568/7172] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:26 2022] PUT /identity/v3/projects/f6850385836449c0bb6ff1a829481028/users/45178524a7f74b53a3b8aaa9eb8bcb8f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:26.470768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7f43d9b8-08c7-456a-a241-16237018c97c None None] MFA Rules not processed for user `45178524a7f74b53a3b8aaa9eb8bcb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:26.476339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7f43d9b8-08c7-456a-a241-16237018c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:26.792218 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3605/7173] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:26.826264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:26.828720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:27.082827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041792d-0df2-435a-93f2-703053f80b92 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:27.091703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:27.092832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:27.093308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:27.093752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:27.111410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:27.126110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:27.158678 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3569/7174] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:27.308258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43d9b8-08c7-456a-a241-16237018c97c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:27.323818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43d9b8-08c7-456a-a241-16237018c97c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:27.329489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07314e-96a8-44b2-996f-a916115e9623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:27.330252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07314e-96a8-44b2-996f-a916115e9623 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:27.330603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07314e-96a8-44b2-996f-a916115e9623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:27.330944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07314e-96a8-44b2-996f-a916115e9623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:27.426506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07314e-96a8-44b2-996f-a916115e9623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:27.427893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07314e-96a8-44b2-996f-a916115e9623 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:27.439739 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3606/7175] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:30.999381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:31.065599 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:31.261721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15270a41-9d84-4d32-b5cd-28e9a45a9b7d service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:31.280533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:31.281913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:31.283067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:31.284110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] PATH_INFO: `/v3/users/6609d1a8681047bf8345a69189b87277` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:31.286240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6609d1a8681047bf8345a69189b87277)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:31.291651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:31.439800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6609d1a8681047bf8345a69189b87277'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:31.441458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6609d1a8681047bf8345a69189b87277'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:31.443282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6609d1a8681047bf8345a69189b87277'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:31.471905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6609d1a8681047bf8345a69189b87277'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:31.533179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6609d1a8681047bf8345a69189b87277'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:31.578924 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3570/7176] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:30 2022] DELETE /identity/v3/users/6609d1a8681047bf8345a69189b87277 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:31.584143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:31.584633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:31.584749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:31.650895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:31.663725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:31.845591 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:31.879918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3607/7177] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:33:31.901282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:31.903221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:32.072341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd00e-d4ff-4d89-95fb-e3eb1fbdc378 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:32.085712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:32.086638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:32.089436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:32.089792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:32.143721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:32.145250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:32.207480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3571/7178] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:33.866300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:33.868428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:33.896447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef6c3e-6e9e-429c-a5a0-0bf408e91b43 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:33.912964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:33.914233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:33.914632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:33.914919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] PATH_INFO: `/v3/projects/9afcc92227b5431bbd30b956ea0f3ba7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:33.916155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afcc92227b5431bbd30b956ea0f3ba7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:33.919673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:34.046657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afcc92227b5431bbd30b956ea0f3ba7', 'request_id': 'req-409e171a-1cb9-4c15-9d1a-bd2290dfec09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.064402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afcc92227b5431bbd30b956ea0f3ba7', 'request_id': 'req-409e171a-1cb9-4c15-9d1a-bd2290dfec09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.080433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afcc92227b5431bbd30b956ea0f3ba7', 'request_id': 'req-409e171a-1cb9-4c15-9d1a-bd2290dfec09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.126881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] The token cache is being invalidate because project 9afcc92227b5431bbd30b956ea0f3ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:34.127214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.129147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.132367 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3608/7179] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:33 2022] DELETE /identity/v3/projects/9afcc92227b5431bbd30b956ea0f3ba7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:34.136234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:34.156488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d9179-723e-401c-a1c3-4a2719ad91a2 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:34.212292 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:34.276378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:34.278369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:34.280768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:34.283137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] PATH_INFO: `/v3/users/45178524a7f74b53a3b8aaa9eb8bcb8f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:34.287234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45178524a7f74b53a3b8aaa9eb8bcb8f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:34.289346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:34.468446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45178524a7f74b53a3b8aaa9eb8bcb8f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.469189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45178524a7f74b53a3b8aaa9eb8bcb8f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.469817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45178524a7f74b53a3b8aaa9eb8bcb8f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.494321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45178524a7f74b53a3b8aaa9eb8bcb8f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.552573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-21aeb560-3f7e-437c-99c6-41a03b786944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45178524a7f74b53a3b8aaa9eb8bcb8f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:34.586422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3572/7180] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:34 2022] DELETE /identity/v3/users/45178524a7f74b53a3b8aaa9eb8bcb8f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:35.394170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:35.395874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:35.424006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e171a-1cb9-4c15-9d1a-bd2290dfec09 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:35.563589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:35.565049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:35.565660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:35.566594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] PATH_INFO: `/v3/projects/f6850385836449c0bb6ff1a829481028` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:35.568423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6850385836449c0bb6ff1a829481028)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:35.570838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:35.714007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6850385836449c0bb6ff1a829481028', 'request_id': 'req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:35.726666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6850385836449c0bb6ff1a829481028', 'request_id': 'req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:35.749029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6850385836449c0bb6ff1a829481028', 'request_id': 'req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:35.783762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] The token cache is being invalidate because project f6850385836449c0bb6ff1a829481028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:35.784066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:35.786528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ff85bd3a-5c4f-45e6-b7e7-b56ab4ab55b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:35.791300 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3609/7181] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:35 2022] DELETE /identity/v3/projects/f6850385836449c0bb6ff1a829481028 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:35.796962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afc96-e6a9-4dc6-9190-a7603a5d6843 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:35.797472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afc96-e6a9-4dc6-9190-a7603a5d6843 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:35.797572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afc96-e6a9-4dc6-9190-a7603a5d6843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:35.825689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a98afc96-e6a9-4dc6-9190-a7603a5d6843 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:35.828527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a98afc96-e6a9-4dc6-9190-a7603a5d6843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:35.998448 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3573/7182] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:36.004827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6eb80-6127-4d29-9485-846506ba4454 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.005144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6eb80-6127-4d29-9485-846506ba4454 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.005432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6eb80-6127-4d29-9485-846506ba4454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.028928 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:36.066372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9ee6eb80-6127-4d29-9485-846506ba4454 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:36.067634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9ee6eb80-6127-4d29-9485-846506ba4454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:36.084328 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3610/7183] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:36.085404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afc96-e6a9-4dc6-9190-a7603a5d6843 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:36.099785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afc96-e6a9-4dc6-9190-a7603a5d6843 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:36.119120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:36.120311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.120749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.121207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.122534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:33:36.123229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:36.125860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:36.144115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3574/7184] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:33:36.148262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6eb80-6127-4d29-9485-846506ba4454 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:36.165039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6eb80-6127-4d29-9485-846506ba4454 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:36.170786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:36.171914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.172410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.172856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.175323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:36.177945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:36.225890 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3611/7185] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:36 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:36.230260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:36.249857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1720a94-ef22-44f3-903d-4d4ca4052532 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:36.318809 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:36.363502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:36.364455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.364940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.366048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.366866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:36.369555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:36.412688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3575/7186] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:36 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:36.416890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:36.449186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253241c-daaf-4fd2-a1b8-054fcaabe652 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:36.457299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:36.458484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.459173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.460453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.462529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:36.465256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:36.492777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3612/7187] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:36.496567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:36.524047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d132683-8b83-4d4c-8847-00d1ae70a8eb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:36.531253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c5d90-f1fc-4db1-9e2f-297c81d76f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:36.532384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5d90-f1fc-4db1-9e2f-297c81d76f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.532907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5d90-f1fc-4db1-9e2f-297c81d76f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.536841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c5d90-f1fc-4db1-9e2f-297c81d76f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.537170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c5d90-f1fc-4db1-9e2f-297c81d76f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:36.538839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c5d90-f1fc-4db1-9e2f-297c81d76f11 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:36.569709 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3576/7188] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:36.570467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:36.589216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccfa0c-b706-473f-be49-fbb5ab0869d8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:36.604072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:36.605284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.605568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.605845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] PATH_INFO: `/v3/projects/8882e54da02f49bc91ea95f451a486b9/users/dc266ecb3afe469b98f335a8688b5b8b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.649073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8882e54da02f49bc91ea95f451a486b9, user_id=dc266ecb3afe469b98f335a8688b5b8b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:36.651960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:36.694561 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3613/7189] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:36 2022] PUT /identity/v3/projects/8882e54da02f49bc91ea95f451a486b9/users/dc266ecb3afe469b98f335a8688b5b8b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:33:36.694827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e4445-e589-4e13-af74-ffaf38988827 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:36.695111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e4445-e589-4e13-af74-ffaf38988827 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:36.695380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e4445-e589-4e13-af74-ffaf38988827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:36.816241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-712e4445-e589-4e13-af74-ffaf38988827 None None] MFA Rules not processed for user `dc266ecb3afe469b98f335a8688b5b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:36.823392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-712e4445-e589-4e13-af74-ffaf38988827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:36.978582 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3577/7190] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:36.983916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:37.133379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63b4f7-b016-49b4-a0c4-c33929faa534 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:37.148563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:37.151079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:37.151079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:37.151471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:37.152073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:37.157801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:37.242290 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3614/7191] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:36 2022] POST /identity/v3/projects => generated 393 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:33:37.246305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e4445-e589-4e13-af74-ffaf38988827 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:37.268289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e4445-e589-4e13-af74-ffaf38988827 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:37.426419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:37.427389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:37.430776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:37.430776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:37.431221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:37.437047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:37.483330 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3578/7192] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:37 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:37.487249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:37.518459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685aae-c723-4c30-9a3e-6dbd3b44c655 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:37.525233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:37.530482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:37.531084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:37.531580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:37.532480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:37.534674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:37.560804 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3615/7193] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:37.564112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:37.583881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f349-40f8-44a5-b517-dc9341a6ba64 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:37.592248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:37.593361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:37.594065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:37.594690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] PATH_INFO: `/v3/projects/4ea756aed84340dd8655cd612922d147/users/7d836e69e030459ab689c557cbd53a70/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:37.620806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea756aed84340dd8655cd612922d147, user_id=7d836e69e030459ab689c557cbd53a70, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:37.625816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:37.660447 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3579/7194] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:37 2022] PUT /identity/v3/projects/4ea756aed84340dd8655cd612922d147/users/7d836e69e030459ab689c557cbd53a70/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:33:37.664587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:37.676498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594d50-f095-4299-bd21-137ebbbe395d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:37.810388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721d259-d919-49f2-95ca-dbcbf63cc32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:37.826470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721d259-d919-49f2-95ca-dbcbf63cc32f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:37.840062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721d259-d919-49f2-95ca-dbcbf63cc32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:37.840231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721d259-d919-49f2-95ca-dbcbf63cc32f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:37.841692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721d259-d919-49f2-95ca-dbcbf63cc32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:37.859688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721d259-d919-49f2-95ca-dbcbf63cc32f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:37.885563 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3616/7195] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:37.889615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:37.906335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf1bbb-0e6b-4acc-869e-7145336d1c90 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:37.918274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d2854-b0e9-4590-bef5-bd9b1a5573f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:37.918806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2854-b0e9-4590-bef5-bd9b1a5573f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:37.921432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2854-b0e9-4590-bef5-bd9b1a5573f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:37.924037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2854-b0e9-4590-bef5-bd9b1a5573f4 admin admin] PATH_INFO: `/v3/projects/4ea756aed84340dd8655cd612922d147/users/7d836e69e030459ab689c557cbd53a70/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:37.931378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d2854-b0e9-4590-bef5-bd9b1a5573f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea756aed84340dd8655cd612922d147, user_id=7d836e69e030459ab689c557cbd53a70, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:37.947075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d2854-b0e9-4590-bef5-bd9b1a5573f4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:37.977979 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:38.015580 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3580/7196] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:37 2022] PUT /identity/v3/projects/4ea756aed84340dd8655cd612922d147/users/7d836e69e030459ab689c557cbd53a70/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:38.028682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:38.029173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:38.029570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:38.058118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:38.060401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:38.061431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:38.088367 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:38.093848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:38.098995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:38.112513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] MFA Rules not processed for user `7d836e69e030459ab689c557cbd53a70`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:38.114435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:38.304721 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3581/7197] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:38.320391 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3617/7198] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:38.329871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:38.332667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:38.374660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:38.376407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:38.500108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3cfb9-cd43-4699-b896-db3da3dddf35 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:38.511765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:38.512892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:38.513416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:38.513906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:38.516074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5a3f-d54d-4fd4-a19f-d3fc8fbdc955 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:38.529530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:38.530182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:38.530467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:38.530927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:38.546052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:38.546580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:38.548221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:38.548761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:38.570000 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3618/7199] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:33:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:33:38.578313 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3582/7200] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:38.696833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:38.698464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:38.753275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3f79e-9ad5-411b-a912-0694a43f153d service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:38.766718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:38.767271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:38.767560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:38.767839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:38.933005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:38.935910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:38.949005 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3619/7201] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:47.752981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:47.754611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:48.032452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2d1a-d700-4ee5-aec6-a8afd9368346 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:48.066172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381f5e2-e26c-4e88-b709-616a75c41709 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:48.066996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f5e2-e26c-4e88-b709-616a75c41709 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:48.066996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f5e2-e26c-4e88-b709-616a75c41709 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:48.068530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f5e2-e26c-4e88-b709-616a75c41709 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:48.074386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c381f5e2-e26c-4e88-b709-616a75c41709 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:48.119022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381f5e2-e26c-4e88-b709-616a75c41709 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:48.120558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381f5e2-e26c-4e88-b709-616a75c41709 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:48.173634 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3583/7202] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:48.942193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:51.467432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:51.686570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19df31f-a5f4-4038-a015-5a4a50307afd service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:51.695179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:51.696918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:51.698447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:51.699142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] PATH_INFO: `/v3/users/dc266ecb3afe469b98f335a8688b5b8b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:51.703026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc266ecb3afe469b98f335a8688b5b8b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:51.705393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:51.822256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc266ecb3afe469b98f335a8688b5b8b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:51.823024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc266ecb3afe469b98f335a8688b5b8b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:51.823715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc266ecb3afe469b98f335a8688b5b8b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:51.852039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc266ecb3afe469b98f335a8688b5b8b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:51.866830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc266ecb3afe469b98f335a8688b5b8b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:51.901281 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3620/7203] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:51 2022] DELETE /identity/v3/users/dc266ecb3afe469b98f335a8688b5b8b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:51.905253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:51.906078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:51.906633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:51.955527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:51.957079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:52.016464 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:52.086395 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3584/7204] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:52.109485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:52.110987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:52.256353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5a97f-2f96-4e83-a230-197bdd887363 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:52.273390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:52.274040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:52.274320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:52.274590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:52.293382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:52.295206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:52.317723 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3621/7205] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:33:54.330519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:54.332548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:54.359331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cef59e-8716-4816-ae16-b6d63b1fbc23 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:54.389711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:54.393091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:54.399541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:54.399827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] PATH_INFO: `/v3/projects/8882e54da02f49bc91ea95f451a486b9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:54.404523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8882e54da02f49bc91ea95f451a486b9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:54.421706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:54.618468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8882e54da02f49bc91ea95f451a486b9', 'request_id': 'req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:54.636315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8882e54da02f49bc91ea95f451a486b9', 'request_id': 'req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:54.663712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8882e54da02f49bc91ea95f451a486b9', 'request_id': 'req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:54.692036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] The token cache is being invalidate because project 8882e54da02f49bc91ea95f451a486b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:54.692587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:54.695224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:54.698187 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3585/7206] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:54 2022] DELETE /identity/v3/projects/8882e54da02f49bc91ea95f451a486b9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:54.702733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:54.724029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf6f47-82a0-49bc-b4d7-3a080f834b82 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:54.779979 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:54.883092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:54.884158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:54.884621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:54.885109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] PATH_INFO: `/v3/users/7d836e69e030459ab689c557cbd53a70` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:54.889792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d836e69e030459ab689c557cbd53a70)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:54.891930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:55.045461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d836e69e030459ab689c557cbd53a70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:55.048510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d836e69e030459ab689c557cbd53a70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:55.049281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d836e69e030459ab689c557cbd53a70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:55.070446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d836e69e030459ab689c557cbd53a70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:55.086236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c687586b-d28d-435f-bd28-de2858e0c715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d836e69e030459ab689c557cbd53a70'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:55.114205 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3622/7207] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:33:54 2022] DELETE /identity/v3/users/7d836e69e030459ab689c557cbd53a70 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:57.874236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:57.876496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:57.913189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d75ed4-fbdb-49b9-8f25-9ebc969a640e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:58.080075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:58.081174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:58.081611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:58.082038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] PATH_INFO: `/v3/projects/4ea756aed84340dd8655cd612922d147` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:58.085625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea756aed84340dd8655cd612922d147)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:58.089705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:58.254578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea756aed84340dd8655cd612922d147', 'request_id': 'req-4f1e723b-07a4-497d-ba29-05c3ca6157c3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:58.269342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea756aed84340dd8655cd612922d147', 'request_id': 'req-4f1e723b-07a4-497d-ba29-05c3ca6157c3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:58.273647 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:58.293818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea756aed84340dd8655cd612922d147', 'request_id': 'req-4f1e723b-07a4-497d-ba29-05c3ca6157c3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:58.311495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] The token cache is being invalidate because project 4ea756aed84340dd8655cd612922d147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:33:58.316002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:58.316798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4f1e723b-07a4-497d-ba29-05c3ca6157c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:33:58.318889 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3586/7208] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:33:57 2022] DELETE /identity/v3/projects/4ea756aed84340dd8655cd612922d147 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:58.325559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fb14-36b5-4908-b525-cd4b385c3b7f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:58.326397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fb14-36b5-4908-b525-cd4b385c3b7f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:58.326682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1fb14-36b5-4908-b525-cd4b385c3b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:58.409369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b5b1fb14-36b5-4908-b525-cd4b385c3b7f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:58.415308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b5b1fb14-36b5-4908-b525-cd4b385c3b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:58.593374 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3623/7209] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:58.602297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d757-becd-4003-8d02-434c5029c246 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:58.602502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d757-becd-4003-8d02-434c5029c246 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:58.602859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d757-becd-4003-8d02-434c5029c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:58.652541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2f09d757-becd-4003-8d02-434c5029c246 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:58.656588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f09d757-becd-4003-8d02-434c5029c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:58.685698 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3587/7210] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:58.690044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1fb14-36b5-4908-b525-cd4b385c3b7f None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:58.709449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1fb14-36b5-4908-b525-cd4b385c3b7f None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:58.720618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:58.721528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:58.721811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:58.722089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:58.722751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:33:58.725850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:58.731644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:58.760022 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3624/7211] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:33:58.764020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d757-becd-4003-8d02-434c5029c246 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:58.776462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d757-becd-4003-8d02-434c5029c246 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:58.787425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:58.789326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:58.790177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:58.790177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:58.792357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:58.797827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:58.878617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3588/7212] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:58 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:58.880751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:58.917199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd48882-88b8-40bf-b595-58eb6667bf4a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:59.018337 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:33:59.071687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:59.072394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:59.072588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:59.072862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:59.073540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:59.076064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:59.126252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3625/7213] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:33:58 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:33:59.128018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:59.148077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb66ea-54b3-4dfa-9549-7234720656af admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:59.157052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:59.158001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:59.158551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:59.159003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:59.159903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:59.163205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:59.177250 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3589/7214] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:59.181275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:59.198731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8ff05-9029-4d0b-9a69-b586bc07588c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:59.218750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc11ef-9c90-4b9a-8cc4-eae8e580cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:59.221242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc11ef-9c90-4b9a-8cc4-eae8e580cc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:59.223228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc11ef-9c90-4b9a-8cc4-eae8e580cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:59.223939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc11ef-9c90-4b9a-8cc4-eae8e580cc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:59.224201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc11ef-9c90-4b9a-8cc4-eae8e580cc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:59.225892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc11ef-9c90-4b9a-8cc4-eae8e580cc93 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:59.259008 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3626/7215] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:33:59.365987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:33:59.380223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa45a5-5a21-4a5c-be18-8ae019556207 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:33:59.398307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:33:59.400158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:59.404384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:59.404912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] PATH_INFO: `/v3/projects/eb25155b5f6c4fccab7733e549d88de1/users/f4459a7acfeb4becb6a8b05488082ef4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:59.456372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb25155b5f6c4fccab7733e549d88de1, user_id=f4459a7acfeb4becb6a8b05488082ef4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:33:59.458965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:33:59.523521 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3590/7216] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:33:59 2022] PUT /identity/v3/projects/eb25155b5f6c4fccab7733e549d88de1/users/f4459a7acfeb4becb6a8b05488082ef4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:33:59.535811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903c48-1ff2-4b67-bf73-23cee8c3ca26 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:33:59.536359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903c48-1ff2-4b67-bf73-23cee8c3ca26 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:33:59.536359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903c48-1ff2-4b67-bf73-23cee8c3ca26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:33:59.649381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d4903c48-1ff2-4b67-bf73-23cee8c3ca26 None None] MFA Rules not processed for user `f4459a7acfeb4becb6a8b05488082ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:33:59.650728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d4903c48-1ff2-4b67-bf73-23cee8c3ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:33:59.852419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3627/7217] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:33:59.857923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:00.109937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5c20a-ded6-4e2d-ba55-0c4e9c1a21ac admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:00.127390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:00.128049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:00.128351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:00.128667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:00.129413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:00.136661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:00.253389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3591/7218] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:33:59 2022] POST /identity/v3/projects => generated 399 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:00.254886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903c48-1ff2-4b67-bf73-23cee8c3ca26 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:00.293898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903c48-1ff2-4b67-bf73-23cee8c3ca26 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:00.545107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:00.545769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:00.546016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:00.546296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:00.547025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:00.548892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:00.647062 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3628/7219] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:00 2022] POST /identity/v3/users => generated 306 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:00.655156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:00.680247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fedfb7d-9805-4c64-83f4-9507704b9a3d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:00.711077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:00.711718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:00.712002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:00.712285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:00.712947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:00.732668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:00.786955 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3592/7220] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:00.788551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:00.809714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69f06-e07c-416c-b05f-f502356ec613 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:00.846697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:00.847489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:00.847832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:00.848283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] PATH_INFO: `/v3/projects/ce399fd2a54a401d9cc690ba82306cb6/users/68247ecfa9174a67b7313d83dd0a7b86/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:00.887486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce399fd2a54a401d9cc690ba82306cb6, user_id=68247ecfa9174a67b7313d83dd0a7b86, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:00.890469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:00.953345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3629/7221] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:00 2022] PUT /identity/v3/projects/ce399fd2a54a401d9cc690ba82306cb6/users/68247ecfa9174a67b7313d83dd0a7b86/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:00.959179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:00.975621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4642a-b46b-469b-ac9b-9ab64e387133 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:01.140247 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:01.185907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29452-34b3-45c4-87fa-3831d66d90e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:01.187102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29452-34b3-45c4-87fa-3831d66d90e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:01.187655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29452-34b3-45c4-87fa-3831d66d90e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:01.188172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29452-34b3-45c4-87fa-3831d66d90e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:01.189090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29452-34b3-45c4-87fa-3831d66d90e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:01.191016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29452-34b3-45c4-87fa-3831d66d90e8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:01.241508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3593/7222] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:34:01.242411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:01.256219 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:01.275973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e25c-4478-47a9-a607-d33d20c8f60b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:01.295896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:01.297552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:01.297830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:01.298101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] PATH_INFO: `/v3/projects/ce399fd2a54a401d9cc690ba82306cb6/users/68247ecfa9174a67b7313d83dd0a7b86/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:01.305492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce399fd2a54a401d9cc690ba82306cb6, user_id=68247ecfa9174a67b7313d83dd0a7b86, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:01.315592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:01.357982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3630/7223] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:01 2022] PUT /identity/v3/projects/ce399fd2a54a401d9cc690ba82306cb6/users/68247ecfa9174a67b7313d83dd0a7b86/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:34:01.360992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1599a-ec08-43a9-83e1-4273cf9e909a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:01.361675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1599a-ec08-43a9-83e1-4273cf9e909a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:01.362170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1599a-ec08-43a9-83e1-4273cf9e909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:01.465078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-76b1599a-ec08-43a9-83e1-4273cf9e909a None None] MFA Rules not processed for user `68247ecfa9174a67b7313d83dd0a7b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:01.466853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-76b1599a-ec08-43a9-83e1-4273cf9e909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:01.761105 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3594/7224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:01 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:01.776874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:01.781421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:01.999098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a35adb-db90-4ab2-92a9-2f4ca07cb02c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:02.022898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:02.023598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:02.023927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:02.024200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:02.062665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:02.064117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:02.085232 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3631/7225] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:01 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:02.346926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1599a-ec08-43a9-83e1-4273cf9e909a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:02.365046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1599a-ec08-43a9-83e1-4273cf9e909a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:02.382950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbde69e-ec14-404d-ab6e-8b8e9a91f872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:02.383683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde69e-ec14-404d-ab6e-8b8e9a91f872 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:02.384029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde69e-ec14-404d-ab6e-8b8e9a91f872 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:02.384418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde69e-ec14-404d-ab6e-8b8e9a91f872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:02.603729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbde69e-ec14-404d-ab6e-8b8e9a91f872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:02.606405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbde69e-ec14-404d-ab6e-8b8e9a91f872 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:02.632313 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3595/7226] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:06.614029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:06.616190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:06.782306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32188a5a-aa69-479c-9f0a-ead9d235a8e6 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:06.787782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:06.788433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:06.788716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:06.789571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] PATH_INFO: `/v3/users/05f56b1ad3bd44c4b9db2c4daa797898` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:06.790914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f56b1ad3bd44c4b9db2c4daa797898)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:06.793076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:06.876781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f56b1ad3bd44c4b9db2c4daa797898'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:06.877504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f56b1ad3bd44c4b9db2c4daa797898'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:06.879044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f56b1ad3bd44c4b9db2c4daa797898'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:06.907903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f56b1ad3bd44c4b9db2c4daa797898'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:06.926943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f56b1ad3bd44c4b9db2c4daa797898'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:06.959753 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3632/7227] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:06 2022] DELETE /identity/v3/users/05f56b1ad3bd44c4b9db2c4daa797898 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:06.966068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:06.966530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:06.966857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:07.017345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:07.018653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:07.190240 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3596/7228] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:07.201248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:07.203590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:07.252852 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:07.403194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e3b3-5395-491c-8eb5-618c911cf961 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:07.418716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac9205-0f80-4761-832c-2eb94ae63a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:07.419963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac9205-0f80-4761-832c-2eb94ae63a96 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:07.420757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac9205-0f80-4761-832c-2eb94ae63a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:07.421245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac9205-0f80-4761-832c-2eb94ae63a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:07.456153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac9205-0f80-4761-832c-2eb94ae63a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:07.458065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac9205-0f80-4761-832c-2eb94ae63a96 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:07.498547 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3633/7229] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:34:07.890188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:07.892979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:07.936354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d255-4959-4e94-ab15-4f4e5287e612 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:07.987369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:07.993378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:07.993994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:08.001685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] PATH_INFO: `/v3/projects/f49f9460e3924c399bba6e684f72dba0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:08.007382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49f9460e3924c399bba6e684f72dba0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:08.013496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:08.029227 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:08.115790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49f9460e3924c399bba6e684f72dba0', 'request_id': 'req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:08.131882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49f9460e3924c399bba6e684f72dba0', 'request_id': 'req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:08.155795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49f9460e3924c399bba6e684f72dba0', 'request_id': 'req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:08.172230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] The token cache is being invalidate because project f49f9460e3924c399bba6e684f72dba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:08.172934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:08.173998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-711d86ce-cb0f-4b98-a3c8-2b4b7705937d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:08.178363 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3597/7230] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:07 2022] DELETE /identity/v3/projects/f49f9460e3924c399bba6e684f72dba0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:08.186027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf4bc-176e-4057-9d5e-289a351d3d6d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:08.186637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf4bc-176e-4057-9d5e-289a351d3d6d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:08.187369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf4bc-176e-4057-9d5e-289a351d3d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:08.268703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-74bdf4bc-176e-4057-9d5e-289a351d3d6d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:08.269992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-74bdf4bc-176e-4057-9d5e-289a351d3d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:08.489362 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3634/7231] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:08.498850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cfe5e-b86b-48df-9ff5-810f2cd3f8dd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:08.499372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cfe5e-b86b-48df-9ff5-810f2cd3f8dd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:08.501052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cfe5e-b86b-48df-9ff5-810f2cd3f8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:08.561375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e00cfe5e-b86b-48df-9ff5-810f2cd3f8dd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:08.562647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e00cfe5e-b86b-48df-9ff5-810f2cd3f8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:08.600214 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3598/7232] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:08.603258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdf4bc-176e-4057-9d5e-289a351d3d6d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:08.626663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdf4bc-176e-4057-9d5e-289a351d3d6d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:08.645449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:08.646106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:08.646488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:08.646735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:08.647397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:34:08.647714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:08.649382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:08.700189 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3635/7233] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:34:08.704969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cfe5e-b86b-48df-9ff5-810f2cd3f8dd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:08.719558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cfe5e-b86b-48df-9ff5-810f2cd3f8dd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:08.736267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:08.737873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:08.738305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:08.738746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:08.739573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:08.743127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:08.879146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:08.884714 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3599/7234] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:08 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:08.891254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3127db7-4619-4efc-b48a-0bf566fa1013 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:09.113942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:09.114601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:09.114887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:09.115211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:09.115870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:09.117891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:09.250844 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3636/7235] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:08 2022] POST /identity/v3/users => generated 292 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:34:09.252007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:09.278104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd87e9f-4a50-4b22-a15a-db86e7f36306 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:09.290494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:09.291447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:09.292450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:09.293618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:09.296748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:09.303038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:09.335185 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3600/7236] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:34:09.335946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:09.357639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bb44-4968-4b03-87ca-7c777b2cfd86 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:09.374080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a73ffd-bf98-4f2e-98aa-c60f98cdc965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:09.374719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a73ffd-bf98-4f2e-98aa-c60f98cdc965 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:09.375001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a73ffd-bf98-4f2e-98aa-c60f98cdc965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:09.375276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a73ffd-bf98-4f2e-98aa-c60f98cdc965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:09.378796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a73ffd-bf98-4f2e-98aa-c60f98cdc965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:09.380728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a73ffd-bf98-4f2e-98aa-c60f98cdc965 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:09.423937 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3637/7237] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:09.425768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:09.451915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be2d0-c0d0-4377-adfe-fdcb8abde504 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:09.466578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:09.467534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:09.468127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:09.468577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] PATH_INFO: `/v3/projects/5be890ff18db42c2a3f3973e4069de1d/users/bb0bf7857f874e8e92eabcf3a73b12ac/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:09.527501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be890ff18db42c2a3f3973e4069de1d, user_id=bb0bf7857f874e8e92eabcf3a73b12ac, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:09.535042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:09.584178 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3601/7238] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:09 2022] PUT /identity/v3/projects/5be890ff18db42c2a3f3973e4069de1d/users/bb0bf7857f874e8e92eabcf3a73b12ac/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:09.597847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:09.598181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:09.598464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:09.670480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] MFA Rules not processed for user `bb0bf7857f874e8e92eabcf3a73b12ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:09.671814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:09.698662 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:09.967078 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3638/7239] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:10.069892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:10.071962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:10.258227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397283-24b5-4659-8b94-e13bcbe956c7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:10.273406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed92d8-7ec2-40d2-b2a3-106dbd2923d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:10.274166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed92d8-7ec2-40d2-b2a3-106dbd2923d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:10.274444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed92d8-7ec2-40d2-b2a3-106dbd2923d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:10.274901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed92d8-7ec2-40d2-b2a3-106dbd2923d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:10.303631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed92d8-7ec2-40d2-b2a3-106dbd2923d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:10.305300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed92d8-7ec2-40d2-b2a3-106dbd2923d8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:10.341216 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3602/7240] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:12.722286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:12.729141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:12.848012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ca56a-09e1-4fbb-af07-d168c317fde6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:12.858653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:12.859410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:12.859714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:12.859979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] PATH_INFO: `/v3/users/f4459a7acfeb4becb6a8b05488082ef4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:12.861687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4459a7acfeb4becb6a8b05488082ef4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:12.863723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:12.994941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4459a7acfeb4becb6a8b05488082ef4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:12.996596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4459a7acfeb4becb6a8b05488082ef4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:12.997429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4459a7acfeb4becb6a8b05488082ef4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:13.036106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4459a7acfeb4becb6a8b05488082ef4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:13.049803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4459a7acfeb4becb6a8b05488082ef4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:13.088252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3639/7241] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:12 2022] DELETE /identity/v3/users/f4459a7acfeb4becb6a8b05488082ef4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:13.092734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:13.093283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:13.093373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:13.133559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:13.135805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:13.211050 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:13.286467 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3603/7242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:34:13.311725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:13.313843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:13.397677 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:13.451027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a823f29-c439-4a0b-99c9-9ffb5c8d8547 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:13.457433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:13.458085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:13.458369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:13.458643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:13.478620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:13.480088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:13.518644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3640/7243] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:14.690865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:14.693235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:14.712034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef80e0-9873-4e03-aabc-29649f930b41 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:14.726129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:14.729919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:14.730522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:14.731019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] PATH_INFO: `/v3/projects/eb25155b5f6c4fccab7733e549d88de1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:14.740938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb25155b5f6c4fccab7733e549d88de1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:14.743415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:14.779741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:14.805781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812da1-89ec-437a-bf25-f2dfa3a1cea0 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:14.823088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:14.823834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:14.824186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:14.824465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:14.833209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:14.845510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb25155b5f6c4fccab7733e549d88de1', 'request_id': 'req-25198eda-52ff-449a-9628-e81c5abb0280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:14.856599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb25155b5f6c4fccab7733e549d88de1', 'request_id': 'req-25198eda-52ff-449a-9628-e81c5abb0280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:14.884491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:14.885998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:14.892021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb25155b5f6c4fccab7733e549d88de1', 'request_id': 'req-25198eda-52ff-449a-9628-e81c5abb0280'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:14.910952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] The token cache is being invalidate because project eb25155b5f6c4fccab7733e549d88de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:14.912165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:14.913102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:14.915629 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3604/7244] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:14 2022] DELETE /identity/v3/projects/eb25155b5f6c4fccab7733e549d88de1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:14.920910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:14.921773 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3641/7245] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:34:14.922882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:15.073927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198eda-52ff-449a-9628-e81c5abb0280 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:15.084018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:15.086910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:15.087224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:15.087563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] PATH_INFO: `/v3/users/68247ecfa9174a67b7313d83dd0a7b86` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:15.090110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68247ecfa9174a67b7313d83dd0a7b86)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:15.093588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:15.171916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68247ecfa9174a67b7313d83dd0a7b86'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:15.173476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68247ecfa9174a67b7313d83dd0a7b86'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:15.174249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68247ecfa9174a67b7313d83dd0a7b86'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:15.186078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68247ecfa9174a67b7313d83dd0a7b86'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:15.192527 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:15.206782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68247ecfa9174a67b7313d83dd0a7b86'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:15.248974 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3605/7246] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:14 2022] DELETE /identity/v3/users/68247ecfa9174a67b7313d83dd0a7b86 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:16.445205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:16.473313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de3dce-921c-4ce9-af40-ab7e26752122 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:16.549140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:16.551468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:16.632635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:16.633421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:16.633779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:16.634123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] PATH_INFO: `/v3/projects/ce399fd2a54a401d9cc690ba82306cb6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:16.635466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce399fd2a54a401d9cc690ba82306cb6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:16.642909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:16.769481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d938c-acc6-42ec-9568-1fb034b7aa89 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:16.770414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce399fd2a54a401d9cc690ba82306cb6', 'request_id': 'req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:16.785644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce399fd2a54a401d9cc690ba82306cb6', 'request_id': 'req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:16.805739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce399fd2a54a401d9cc690ba82306cb6', 'request_id': 'req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:16.838388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] The token cache is being invalidate because project ce399fd2a54a401d9cc690ba82306cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:16.838926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:16.841955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-81b894a3-c81a-4845-ac02-ab9a77cbb4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:16.847920 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3642/7247] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:16 2022] DELETE /identity/v3/projects/ce399fd2a54a401d9cc690ba82306cb6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:16.853933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f372ff7-8d31-4c2d-92ab-f8a6a5d96138 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:16.854357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f372ff7-8d31-4c2d-92ab-f8a6a5d96138 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:16.854741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f372ff7-8d31-4c2d-92ab-f8a6a5d96138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:16.926038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62426c6-b39a-4b5e-a72c-8b59f5e35c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:16.927403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4f372ff7-8d31-4c2d-92ab-f8a6a5d96138 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:16.927901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62426c6-b39a-4b5e-a72c-8b59f5e35c11 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:16.928550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62426c6-b39a-4b5e-a72c-8b59f5e35c11 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:16.928978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4f372ff7-8d31-4c2d-92ab-f8a6a5d96138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:16.929451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62426c6-b39a-4b5e-a72c-8b59f5e35c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:16.931497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c62426c6-b39a-4b5e-a72c-8b59f5e35c11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:16.959877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62426c6-b39a-4b5e-a72c-8b59f5e35c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:16.968415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62426c6-b39a-4b5e-a72c-8b59f5e35c11 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:17.016300 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3606/7248] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:34:17.069504 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:17.124287 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3643/7249] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:17.134731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd5f4-9478-4c9b-92be-d716b6dbf510 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:17.135318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd5f4-9478-4c9b-92be-d716b6dbf510 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:17.135705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd5f4-9478-4c9b-92be-d716b6dbf510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:17.172952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-099bd5f4-9478-4c9b-92be-d716b6dbf510 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:17.174493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-099bd5f4-9478-4c9b-92be-d716b6dbf510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:17.240547 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3607/7250] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:34:17.251400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f372ff7-8d31-4c2d-92ab-f8a6a5d96138 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:17.281975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f372ff7-8d31-4c2d-92ab-f8a6a5d96138 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:17.305593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:17.309755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:17.310109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:17.310514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:17.311846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:34:17.315338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:17.318441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:17.357252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3644/7251] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:34:17.357591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bd5f4-9478-4c9b-92be-d716b6dbf510 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:17.372620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bd5f4-9478-4c9b-92be-d716b6dbf510 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:17.405673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:17.408337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:17.409101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:17.409556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:17.410371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:17.415411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:17.497376 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3608/7252] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:17 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:17.503406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:17.551556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375fa7f-05c5-469d-8f0a-c1676cb0cb5a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:17.754405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:17.756136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:17.756776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:17.757516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:17.762553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:17.768210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:17.830674 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3645/7253] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:17 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:17.836045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:17.864965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde5c1-8f98-42b2-8dea-ab723e36204b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:17.886167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:17.887450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:17.887727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:17.887992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:17.891856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:17.907106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:17.932629 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3609/7254] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:17.934804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:17.957141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b469-49de-4420-b709-e4e17f3f1c6c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:17.964122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21bac1-c07a-4366-b86f-d1aa5b6c1193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:17.965129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21bac1-c07a-4366-b86f-d1aa5b6c1193 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:17.965531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21bac1-c07a-4366-b86f-d1aa5b6c1193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:17.965905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21bac1-c07a-4366-b86f-d1aa5b6c1193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:17.966932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21bac1-c07a-4366-b86f-d1aa5b6c1193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:17.968809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21bac1-c07a-4366-b86f-d1aa5b6c1193 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:17.988024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3646/7255] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:17.989758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:18.010325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d9de3-d566-48bb-a8aa-9fd5ea34c82a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:18.023158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:18.024053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:18.024481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:18.024769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] PATH_INFO: `/v3/projects/68bde0de161a48e2af210a1741b66429/users/456b61b44d3048eba4738787b4b23dd3/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:18.055210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bde0de161a48e2af210a1741b66429, user_id=456b61b44d3048eba4738787b4b23dd3, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:18.058239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:18.079916 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:18.097135 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3610/7256] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:17 2022] PUT /identity/v3/projects/68bde0de161a48e2af210a1741b66429/users/456b61b44d3048eba4738787b4b23dd3/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:34:18.106354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693571-f2b3-47b8-9791-5f19f2aa69ac None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:18.106910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693571-f2b3-47b8-9791-5f19f2aa69ac None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:18.107989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693571-f2b3-47b8-9791-5f19f2aa69ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:18.211605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-47693571-f2b3-47b8-9791-5f19f2aa69ac None None] MFA Rules not processed for user `456b61b44d3048eba4738787b4b23dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:18.213011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-47693571-f2b3-47b8-9791-5f19f2aa69ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:18.445618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3647/7257] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:18.449034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:18.566662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512694c8-7a0f-45fb-883d-94da80503428 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:18.578350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:18.583358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:18.583358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:18.583358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:18.583358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:18.585549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:18.664334 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3611/7258] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:18 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:34:18.670270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693571-f2b3-47b8-9791-5f19f2aa69ac None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:18.690788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693571-f2b3-47b8-9791-5f19f2aa69ac None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:18.854323 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:18.885423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:18.886048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:18.886398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:18.887260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:18.888171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:18.895249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:18.942149 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3648/7259] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:18 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:18.942797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:18.964446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c18f8-dd47-41cb-a0b5-29223cfe6a7c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:18.983104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:18.984224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:18.984224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:18.984423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:18.985013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:18.986660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:19.020125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3612/7260] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:19.021491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:19.044852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39459a76-bca4-4414-be7f-dd975dde405a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:19.059306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0ff25-15e6-4764-a21e-e01e29c1bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:19.060444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0ff25-15e6-4764-a21e-e01e29c1bce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:19.060807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0ff25-15e6-4764-a21e-e01e29c1bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:19.061387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0ff25-15e6-4764-a21e-e01e29c1bce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:19.062140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0ff25-15e6-4764-a21e-e01e29c1bce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:19.066456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0ff25-15e6-4764-a21e-e01e29c1bce3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:19.108695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3649/7261] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:34:19.112664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:19.131988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c49cd-ec23-4f55-aeb3-5d8c6f42cabe admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:19.139593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:19.140770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:19.141339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:19.141846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] PATH_INFO: `/v3/projects/ef9778b0e81e44708150ac454081eb1b/users/ca5be0107012471b85d5768238867f2d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:19.176038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9778b0e81e44708150ac454081eb1b, user_id=ca5be0107012471b85d5768238867f2d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:19.188139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:19.231625 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3613/7262] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:19 2022] PUT /identity/v3/projects/ef9778b0e81e44708150ac454081eb1b/users/ca5be0107012471b85d5768238867f2d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:19.242475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f1c9-7ceb-43e3-a6ee-5cdb9f98382e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:19.243001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f1c9-7ceb-43e3-a6ee-5cdb9f98382e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:19.243462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f1c9-7ceb-43e3-a6ee-5cdb9f98382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:19.328519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ecc1f1c9-7ceb-43e3-a6ee-5cdb9f98382e None None] MFA Rules not processed for user `ca5be0107012471b85d5768238867f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:19.329776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ecc1f1c9-7ceb-43e3-a6ee-5cdb9f98382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:19.561996 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3650/7263] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:19.566137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:19.715010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eb653-7cf6-4f16-88ab-480aa2d3ccb2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:19.755780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:19.757852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:19.758304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:19.758737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:19.759581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:19.763394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:19.862258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3614/7264] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:19 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:19.862514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f1c9-7ceb-43e3-a6ee-5cdb9f98382e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:19.889922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f1c9-7ceb-43e3-a6ee-5cdb9f98382e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:20.050654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:20.051300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:20.051580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:20.051854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:20.052618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:20.054813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:20.095542 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3651/7265] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:19 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:20.097412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:20.122023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0bb50-865b-4912-83e9-5d546ea8b53b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:20.129870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:20.130613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:20.130960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:20.131236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:20.132050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:20.133967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:20.150137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3615/7266] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:20.154525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:20.172838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46664035-a2cc-4801-b8bd-b59853f37fbe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:20.187036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:20.189580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:20.190335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:20.191201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] PATH_INFO: `/v3/projects/c5cf5cfc396045208758ac136da23707/users/f3409bc7aa4f48e6a9786ae96937461d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:20.224168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf5cfc396045208758ac136da23707, user_id=f3409bc7aa4f48e6a9786ae96937461d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:20.227711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:20.255123 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3652/7267] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:20 2022] PUT /identity/v3/projects/c5cf5cfc396045208758ac136da23707/users/f3409bc7aa4f48e6a9786ae96937461d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:20.262896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:20.283130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6ad8-c5b7-4b02-a78b-e8d24383123e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:20.318570 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:20.379630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4df2a-d2f6-4cf7-82a7-c101f2707432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:20.380530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4df2a-d2f6-4cf7-82a7-c101f2707432 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:20.381013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4df2a-d2f6-4cf7-82a7-c101f2707432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:20.381635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4df2a-d2f6-4cf7-82a7-c101f2707432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:20.382502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4df2a-d2f6-4cf7-82a7-c101f2707432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:20.384959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4df2a-d2f6-4cf7-82a7-c101f2707432 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:20.404119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3616/7268] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:20.408208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:20.422590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b713da-9abf-4d20-9d86-f1969adbf776 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:20.434273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:20.435041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:20.435367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:20.435851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] PATH_INFO: `/v3/projects/c5cf5cfc396045208758ac136da23707/users/f3409bc7aa4f48e6a9786ae96937461d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:20.438456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cf5cfc396045208758ac136da23707, user_id=f3409bc7aa4f48e6a9786ae96937461d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:20.441518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:20.480915 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3653/7269] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:20 2022] PUT /identity/v3/projects/c5cf5cfc396045208758ac136da23707/users/f3409bc7aa4f48e6a9786ae96937461d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:20.483514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:20.483514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:20.484038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:20.576944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] MFA Rules not processed for user `f3409bc7aa4f48e6a9786ae96937461d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:20.592113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:20.796444 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3617/7270] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:20.807843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:20.810080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:20.820140 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:20.976469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f6b99-d753-479a-b599-91a5a92505f8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:20.982570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea37b3e-946f-4eba-85b8-07f00b523cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:20.984402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea37b3e-946f-4eba-85b8-07f00b523cef service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:20.984847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea37b3e-946f-4eba-85b8-07f00b523cef service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:20.985331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea37b3e-946f-4eba-85b8-07f00b523cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:21.110686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea37b3e-946f-4eba-85b8-07f00b523cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:21.113933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea37b3e-946f-4eba-85b8-07f00b523cef service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:21.126131 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3654/7271] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:23.317911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:23.320902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:23.567960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91211cf-d0a0-49fb-91f4-32727d7dcc69 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:23.575841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:23.577043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:23.577522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:23.577987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] PATH_INFO: `/v3/users/a8da49a363304ce6a6540b52a41ac866` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:23.583855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8da49a363304ce6a6540b52a41ac866)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:23.586205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:23.695933 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:23.698488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8da49a363304ce6a6540b52a41ac866'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:23.699250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8da49a363304ce6a6540b52a41ac866'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:23.700195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8da49a363304ce6a6540b52a41ac866'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:23.714150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8da49a363304ce6a6540b52a41ac866'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:23.735225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8da49a363304ce6a6540b52a41ac866'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:23.761158 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3618/7272] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:23 2022] DELETE /identity/v3/users/a8da49a363304ce6a6540b52a41ac866 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:23.766876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:23.767776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:23.768270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:23.805427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:23.807063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:23.907414 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3655/7273] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:23.922804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:23.923173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:24.153910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603ada2-05ac-4378-959c-60f17635fa28 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:24.173743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:24.174435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:24.175219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:24.175456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:24.206178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:24.210710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:24.232892 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3619/7274] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:24.317135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:24.318547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:24.340526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d63838-641d-4980-a053-cf1c451da7eb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:24.358336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:24.359174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:24.359591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:24.359999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] PATH_INFO: `/v3/users/8683f47ab898499789b030d7d42cea5f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:24.361809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8683f47ab898499789b030d7d42cea5f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:24.363892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:24.510510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:24.514103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:24.576269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8683f47ab898499789b030d7d42cea5f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:24.577133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8683f47ab898499789b030d7d42cea5f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:24.577612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8683f47ab898499789b030d7d42cea5f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:24.586239 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:24.599488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8683f47ab898499789b030d7d42cea5f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:24.611221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-69c24b50-c4e7-4642-97b0-7b21cdbdaa88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8683f47ab898499789b030d7d42cea5f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:24.633922 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3656/7275] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:24 2022] DELETE /identity/v3/users/8683f47ab898499789b030d7d42cea5f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:24.639763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6136f-fc07-46c3-962e-ef532df174b6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:24.640054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6136f-fc07-46c3-962e-ef532df174b6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:24.640328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6136f-fc07-46c3-962e-ef532df174b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:24.673037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2ff6136f-fc07-46c3-962e-ef532df174b6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:24.674962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2ff6136f-fc07-46c3-962e-ef532df174b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:24.702936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3331e-0a93-4e60-a5a1-fa95b9ae7945 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:24.768835 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3657/7276] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:24.781654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:24.781968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:24.782467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:24.817534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:24.818439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:24.818439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:24.818688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:24.823456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:24.850193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:24.856209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:24.915013 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:24.995512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:25.001281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:25.016598 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3620/7277] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:25.018478 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:25.020027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.099471 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3658/7278] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:25.101170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:25.107265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.164406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b66b9-f0c3-4c91-908c-ebf3a3cc6f06 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:25.188051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:25.189111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:25.189627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:25.190265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:25.197447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d49d-8fad-43f6-8b65-e2c5182f3614 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:25.207215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:25.208945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:25.220415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:25.221101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:25.221394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:25.221674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] PATH_INFO: `/v3/projects/007b2b4d03cc4afda526b20785424403` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:25.223587 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3621/7279] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:25.224680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:25.226655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.228803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007b2b4d03cc4afda526b20785424403)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:25.236550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:25.378254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007b2b4d03cc4afda526b20785424403', 'request_id': 'req-2f398a70-1106-4561-ae8c-de4d0ed979b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:25.405450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007b2b4d03cc4afda526b20785424403', 'request_id': 'req-2f398a70-1106-4561-ae8c-de4d0ed979b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:25.415605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007b2b4d03cc4afda526b20785424403', 'request_id': 'req-2f398a70-1106-4561-ae8c-de4d0ed979b9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:25.425427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77db7c-e0cc-436c-b36d-d9c2eac6216a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:25.428478 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:25.471372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] The token cache is being invalidate because project 007b2b4d03cc4afda526b20785424403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:25.471665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:25.475233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2f398a70-1106-4561-ae8c-de4d0ed979b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:25.484360 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3659/7280] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:25 2022] DELETE /identity/v3/projects/007b2b4d03cc4afda526b20785424403 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:25.489639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30a27e-5406-4dd3-abc7-0f82c9a8849c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:25.490078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30a27e-5406-4dd3-abc7-0f82c9a8849c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:25.490338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30a27e-5406-4dd3-abc7-0f82c9a8849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:25.584116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ba30a27e-5406-4dd3-abc7-0f82c9a8849c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:25.585485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ba30a27e-5406-4dd3-abc7-0f82c9a8849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.762471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:25.766819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:25.767351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:25.767850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:25.771780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.804768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3660/7281] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:25.808111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6f8e2-40f5-4996-b1a2-1582b7aab23e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:25.809828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6f8e2-40f5-4996-b1a2-1582b7aab23e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:25.810111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6f8e2-40f5-4996-b1a2-1582b7aab23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:25.821650 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:25.870068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4ef6f8e2-40f5-4996-b1a2-1582b7aab23e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:25.872568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4ef6f8e2-40f5-4996-b1a2-1582b7aab23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:25.905248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:25.907076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:25.909424 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3661/7282] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:25.911439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6f8e2-40f5-4996-b1a2-1582b7aab23e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:25.928593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3622/7283] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:34:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:34:25.948172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6f8e2-40f5-4996-b1a2-1582b7aab23e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:25.961676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:25.962326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:25.962664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:25.962871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:25.963535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:34:25.964981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:25.990147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.036585 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3662/7284] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:34:26.041917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.063445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c95ac3-f551-401e-8cf4-bf42b34d1ebd service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.075367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.076008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.076291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.076616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.077297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.084895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.159597 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3623/7285] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:26 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:34:26.162104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.181454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418cc6f-cf4a-441d-b1ae-54551d7b91ed admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.197163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.205601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:26.325586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647886b-1cbe-40fa-961d-6cc3d4f08325 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.330669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.331392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.331737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.332730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] PATH_INFO: `/v3/projects/a8f14dc2beca49658ed23b7430dc1f82` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.334064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f14dc2beca49658ed23b7430dc1f82)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.336311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.346736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.347369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.347654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.347923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.348561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.350534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.403909 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3663/7286] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:26 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:26.404872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.407486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f14dc2beca49658ed23b7430dc1f82', 'request_id': 'req-53a66de6-276e-49b5-b83c-2cc59ec292df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:26.408940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:26.417104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f14dc2beca49658ed23b7430dc1f82', 'request_id': 'req-53a66de6-276e-49b5-b83c-2cc59ec292df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:26.431338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f14dc2beca49658ed23b7430dc1f82', 'request_id': 'req-53a66de6-276e-49b5-b83c-2cc59ec292df'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:26.444546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] The token cache is being invalidate because project a8f14dc2beca49658ed23b7430dc1f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:26.444927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:26.445556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:26.452701 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3624/7287] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:26 2022] DELETE /identity/v3/projects/a8f14dc2beca49658ed23b7430dc1f82 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:26.453791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.458041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:26.507005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40259b59-575a-4d17-b757-f0298c07a363 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.511319 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:26.532583 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:26.586824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a66de6-276e-49b5-b83c-2cc59ec292df admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.594346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123da536-5927-471a-8b9e-ade2326ecf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.595347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123da536-5927-471a-8b9e-ade2326ecf30 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.595606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123da536-5927-471a-8b9e-ade2326ecf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.595834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123da536-5927-471a-8b9e-ade2326ecf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.596505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123da536-5927-471a-8b9e-ade2326ecf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.598904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123da536-5927-471a-8b9e-ade2326ecf30 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.611261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.612770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.613349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.613841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.615375 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3625/7288] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:26.616895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a5ecb-ad5e-4bf3-8729-61d2a9ed3948 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.617319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a5ecb-ad5e-4bf3-8729-61d2a9ed3948 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.617519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a5ecb-ad5e-4bf3-8729-61d2a9ed3948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.622022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:26.645244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1d8a5ecb-ad5e-4bf3-8729-61d2a9ed3948 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:26.646657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1d8a5ecb-ad5e-4bf3-8729-61d2a9ed3948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:26.675557 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3626/7289] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:26.676454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a5ecb-ad5e-4bf3-8729-61d2a9ed3948 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.706923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a5ecb-ad5e-4bf3-8729-61d2a9ed3948 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.719650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e936f-36e1-4a1d-a5d7-2b386e33e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.725508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e936f-36e1-4a1d-a5d7-2b386e33e971 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.725508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e936f-36e1-4a1d-a5d7-2b386e33e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.725805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e936f-36e1-4a1d-a5d7-2b386e33e971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.726768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e936f-36e1-4a1d-a5d7-2b386e33e971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.728441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e936f-36e1-4a1d-a5d7-2b386e33e971 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.737858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.739408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.752192 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3627/7290] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:26.753943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d723f3-4a41-4ff8-9931-2aef2f746652 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.754239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d723f3-4a41-4ff8-9931-2aef2f746652 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.754518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d723f3-4a41-4ff8-9931-2aef2f746652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.762953 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3664/7291] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:26.763731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.785553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d5d723f3-4a41-4ff8-9931-2aef2f746652 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:26.787119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5d723f3-4a41-4ff8-9931-2aef2f746652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:26.795056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11377fcd-b79a-4241-b70f-6b7bfb5fcb48 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.801452 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3628/7292] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:26.802797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d723f3-4a41-4ff8-9931-2aef2f746652 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.811393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.813348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.813899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.814445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] PATH_INFO: `/v3/projects/70a01fe8838843b1bb8816643c7ba6af/users/360f5e46657b4ebf9eedbf61e1804ceb/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.836034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a01fe8838843b1bb8816643c7ba6af, user_id=360f5e46657b4ebf9eedbf61e1804ceb, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.838911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d723f3-4a41-4ff8-9931-2aef2f746652 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:26.841930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.846488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d7f56-f48b-4249-b025-d37262298e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:26.847318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d7f56-f48b-4249-b025-d37262298e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.847609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d7f56-f48b-4249-b025-d37262298e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.847935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d7f56-f48b-4249-b025-d37262298e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:26.850748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d7f56-f48b-4249-b025-d37262298e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:34:26.851116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d7f56-f48b-4249-b025-d37262298e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:26.858835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d7f56-f48b-4249-b025-d37262298e7c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:26.875163 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3665/7293] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:26 2022] PUT /identity/v3/projects/70a01fe8838843b1bb8816643c7ba6af/users/360f5e46657b4ebf9eedbf61e1804ceb/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:26.923076 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3629/7294] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:34:26.929125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:26.996249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:26.996249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:26.996249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.113210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] MFA Rules not processed for user `360f5e46657b4ebf9eedbf61e1804ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:27.114710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:27.168641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147eb19-b805-4847-8550-b9238c24d572 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:27.190478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:27.191110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:27.192364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:27.192820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.197120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:27.206866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:27.329425 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3666/7295] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:26 2022] POST /identity/v3/projects => generated 371 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:27.331990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:27.387396 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3630/7296] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:34:27.395235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:27.396981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:27.432614 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:27.502984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5c9f9-aeba-41ee-a0f8-2e4589a76773 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:27.516667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:27.517732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:27.519419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:27.519662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.520312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:27.524143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:27.543795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04c702-3a8c-4126-8190-3152d146f768 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:27.581539 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3667/7297] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:27 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:27.584799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:27.621419 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:27.622641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158d3e-ef91-42b4-a588-d1fe692adf89 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:27.638419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:27.639054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:27.639339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:27.639610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.640264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:27.644757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:27.662219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e06fc-92b1-470c-bcd4-cb20a5a3feee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:27.662488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e06fc-92b1-470c-bcd4-cb20a5a3feee service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:27.662587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e06fc-92b1-470c-bcd4-cb20a5a3feee service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:27.662861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e06fc-92b1-470c-bcd4-cb20a5a3feee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.670788 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3668/7298] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:27.675268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:27.706895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea8598-75f6-4144-ad91-5fa59e25a556 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:27.720411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:27.721093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:27.722058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:27.722058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.722636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:27.724287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:27.754110 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3669/7299] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:27.757721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:27.806936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b8340-4943-49e1-9947-29f438151fb3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:27.828844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e06fc-92b1-470c-bcd4-cb20a5a3feee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:27.835477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:27.839713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e06fc-92b1-470c-bcd4-cb20a5a3feee service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:27.844981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:27.845726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:27.846758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] PATH_INFO: `/v3/projects/4a63c16dd17d43b1b3774717b724c201/users/d249843907244fa0bf9041a53475d69b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.877371 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3631/7300] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:27.898058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a63c16dd17d43b1b3774717b724c201, user_id=d249843907244fa0bf9041a53475d69b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:27.903232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:27.950510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:27.950949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:27.951401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:27.954814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3670/7301] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:27 2022] PUT /identity/v3/projects/4a63c16dd17d43b1b3774717b724c201/users/d249843907244fa0bf9041a53475d69b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:28.021864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] MFA Rules not processed for user `d249843907244fa0bf9041a53475d69b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:28.023196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:28.249762 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3632/7302] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:28.410189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:28.609205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba73967-4ff3-4f54-8173-aa0a30cf2a77 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:28.637886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6dd28-c9b1-489f-bd81-36f82db8f139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:28.638626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6dd28-c9b1-489f-bd81-36f82db8f139 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:28.638991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6dd28-c9b1-489f-bd81-36f82db8f139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:28.639334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6dd28-c9b1-489f-bd81-36f82db8f139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:28.654072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6dd28-c9b1-489f-bd81-36f82db8f139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:28.655773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6dd28-c9b1-489f-bd81-36f82db8f139 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:28.689975 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3671/7303] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:38.223331 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=64 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:38.670048 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=62,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:42.238786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:42.240411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:42.394410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7dd23-4710-432a-aed4-36a551b1d4b7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:42.405382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:42.406054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:42.407493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:42.407794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] PATH_INFO: `/v3/users/456b61b44d3048eba4738787b4b23dd3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:42.411342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456b61b44d3048eba4738787b4b23dd3)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:42.418542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:42.555209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456b61b44d3048eba4738787b4b23dd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:42.559483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456b61b44d3048eba4738787b4b23dd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:42.564029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456b61b44d3048eba4738787b4b23dd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:42.594080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456b61b44d3048eba4738787b4b23dd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:42.634210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456b61b44d3048eba4738787b4b23dd3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:42.664473 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3633/7304] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:42 2022] DELETE /identity/v3/users/456b61b44d3048eba4738787b4b23dd3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:42.669193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:42.669744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:42.669857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:42.735400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:42.742150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:42.967052 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3672/7305] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:42.991279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:42.993159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:43.127276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609680df-46b4-4985-afe0-fa33653f2693 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:43.136272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:43.137128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:43.137580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:43.138079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:43.160725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:43.162303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:43.187133 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3634/7306] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:45.175892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:45.177381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:45.258313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e455a0-8f47-460a-98b8-ee6113d7032c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:45.300023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:45.300905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:45.308568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:45.308870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] PATH_INFO: `/v3/projects/68bde0de161a48e2af210a1741b66429` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:45.319476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68bde0de161a48e2af210a1741b66429)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:45.322753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:45.500252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68bde0de161a48e2af210a1741b66429', 'request_id': 'req-afb41f41-44f1-4507-996e-62a450a8fcb1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.507741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68bde0de161a48e2af210a1741b66429', 'request_id': 'req-afb41f41-44f1-4507-996e-62a450a8fcb1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.553877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68bde0de161a48e2af210a1741b66429', 'request_id': 'req-afb41f41-44f1-4507-996e-62a450a8fcb1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.591691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] The token cache is being invalidate because project 68bde0de161a48e2af210a1741b66429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:45.591991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.592659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.602803 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3673/7307] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:45 2022] DELETE /identity/v3/projects/68bde0de161a48e2af210a1741b66429 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:34:45.603328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:45.619351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9d47-3548-4a2e-98ac-4bc726977fc1 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:45.714281 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:45.793592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:45.794495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:45.794953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:45.795378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] PATH_INFO: `/v3/users/ca5be0107012471b85d5768238867f2d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:45.798266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5be0107012471b85d5768238867f2d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:45.802199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:45.919687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5be0107012471b85d5768238867f2d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.920494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5be0107012471b85d5768238867f2d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.921205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5be0107012471b85d5768238867f2d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.933611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5be0107012471b85d5768238867f2d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.953924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5be0107012471b85d5768238867f2d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:45.996227 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3635/7308] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:45 2022] DELETE /identity/v3/users/ca5be0107012471b85d5768238867f2d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:34:47.500279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:47.503160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:47.563459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41f41-44f1-4507-996e-62a450a8fcb1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:47.724697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:47.725412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:47.725693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:47.725970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] PATH_INFO: `/v3/projects/ef9778b0e81e44708150ac454081eb1b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:47.727326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9778b0e81e44708150ac454081eb1b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:47.752359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:47.856464 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:47.892673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9778b0e81e44708150ac454081eb1b', 'request_id': 'req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:47.906457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9778b0e81e44708150ac454081eb1b', 'request_id': 'req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:47.925761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9778b0e81e44708150ac454081eb1b', 'request_id': 'req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:47.973413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] The token cache is being invalidate because project ef9778b0e81e44708150ac454081eb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:47.974150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:47.979738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:47.981989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3674/7309] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:47 2022] DELETE /identity/v3/projects/ef9778b0e81e44708150ac454081eb1b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:47.985890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:47.987699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:48.014985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef207663-d783-4cd5-bd99-6fa18baaf3f8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:48.128814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:48.129555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:48.129911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:48.130284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] PATH_INFO: `/v3/users/f3409bc7aa4f48e6a9786ae96937461d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:48.133866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3409bc7aa4f48e6a9786ae96937461d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:48.137829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:48.241722 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:48.247729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3409bc7aa4f48e6a9786ae96937461d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:48.249204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3409bc7aa4f48e6a9786ae96937461d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:48.251314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3409bc7aa4f48e6a9786ae96937461d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:48.273758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3409bc7aa4f48e6a9786ae96937461d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:48.309240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-56cbe600-dacd-439c-89b4-7406ed529185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3409bc7aa4f48e6a9786ae96937461d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:48.343045 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3636/7310] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:47 2022] DELETE /identity/v3/users/f3409bc7aa4f48e6a9786ae96937461d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:49.992350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:49.994261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:50.037043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3585c-4177-42a3-b385-5f6a8ed1ea54 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:50.196333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:50.197360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:50.197838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:50.198904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] PATH_INFO: `/v3/projects/c5cf5cfc396045208758ac136da23707` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:50.202302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cf5cfc396045208758ac136da23707)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:50.204615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:50.326823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cf5cfc396045208758ac136da23707', 'request_id': 'req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:50.338757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cf5cfc396045208758ac136da23707', 'request_id': 'req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:50.352155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cf5cfc396045208758ac136da23707', 'request_id': 'req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:50.398367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] The token cache is being invalidate because project c5cf5cfc396045208758ac136da23707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:50.399785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:50.404637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1fceb86d-bb43-4544-a82b-e2fa8f5bdb9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:50.407871 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3675/7311] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:49 2022] DELETE /identity/v3/projects/c5cf5cfc396045208758ac136da23707 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:50.412505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9744a-32e5-416c-989b-e3ae22e500f1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:50.413965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9744a-32e5-416c-989b-e3ae22e500f1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:50.414418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9744a-32e5-416c-989b-e3ae22e500f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:50.446356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-20d9744a-32e5-416c-989b-e3ae22e500f1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:50.447841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-20d9744a-32e5-416c-989b-e3ae22e500f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:50.590666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89273e-ce2b-45c4-96ae-c87eea0e2b68 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:50.591053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89273e-ce2b-45c4-96ae-c87eea0e2b68 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:50.591616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89273e-ce2b-45c4-96ae-c87eea0e2b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:50.600493 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3637/7312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:50.637708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6f89273e-ce2b-45c4-96ae-c87eea0e2b68 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:50.638956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6f89273e-ce2b-45c4-96ae-c87eea0e2b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:50.653524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9744a-32e5-416c-989b-e3ae22e500f1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:50.669089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3676/7313] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:50.670466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9744a-32e5-416c-989b-e3ae22e500f1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:50.676859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:50.677545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:50.677877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:50.678154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:50.678820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:34:50.679139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:50.683212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:50.710439 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3638/7314] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:34:50.714940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89273e-ce2b-45c4-96ae-c87eea0e2b68 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:50.732011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89273e-ce2b-45c4-96ae-c87eea0e2b68 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:50.737659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:50.744622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:50.744999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:50.745545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:50.746822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:50.749008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:50.816911 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3677/7315] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:50 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:50.818050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:50.834078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472d1ce-98f6-4360-aa5a-c0d9318b6467 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:50.981991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:50.982762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:50.983143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:50.983604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:50.984430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:50.988030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:51.056197 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3639/7316] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:50 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:51.061494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:51.078621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447232b4-17bd-4180-abe2-86f91c6dd569 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:51.118698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:51.119452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:51.119741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:51.120567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:51.121280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:51.139096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:51.165269 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3678/7317] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:51.170072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:51.190310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4dcbb-cac1-430d-be38-c877aa79ed1b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:51.207970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e67089-217c-4529-83a7-c93b315c6115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:51.208879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67089-217c-4529-83a7-c93b315c6115 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:51.211165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67089-217c-4529-83a7-c93b315c6115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:51.211789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67089-217c-4529-83a7-c93b315c6115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:51.213857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e67089-217c-4529-83a7-c93b315c6115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:51.237022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e67089-217c-4529-83a7-c93b315c6115 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:51.275879 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3640/7318] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:51.278584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:51.289443 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:51.296196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35548c64-fb1c-40ae-a9ef-130ed79d7ef7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:51.303706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:51.304721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:51.305645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:51.306136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] PATH_INFO: `/v3/projects/f3c0f6dabf3f4f03ab49c3fb7d313e36/users/57400bc0eac94d5687ae29f9a19bf2d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:51.329525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c0f6dabf3f4f03ab49c3fb7d313e36, user_id=57400bc0eac94d5687ae29f9a19bf2d4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:51.337894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:51.373045 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3679/7319] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:51 2022] PUT /identity/v3/projects/f3c0f6dabf3f4f03ab49c3fb7d313e36/users/57400bc0eac94d5687ae29f9a19bf2d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:51.388386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f55546-1836-476f-8aa0-77227de12795 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:51.388734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f55546-1836-476f-8aa0-77227de12795 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:51.389013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f55546-1836-476f-8aa0-77227de12795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:51.460242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d6f55546-1836-476f-8aa0-77227de12795 None None] MFA Rules not processed for user `57400bc0eac94d5687ae29f9a19bf2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:51.462752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d6f55546-1836-476f-8aa0-77227de12795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:51.519748 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:51.730137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3641/7320] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:51.744410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:51.748628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:51.975090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6a656-d971-4255-9859-67415e77ef56 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:51.983516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:51.984151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:51.984426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:51.984696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:52.012670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:52.017523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:52.029220 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3680/7321] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:55.224758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d915c7-c8c3-4321-9dc5-2e3e56d42410 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:55.225886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d915c7-c8c3-4321-9dc5-2e3e56d42410 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:55.225886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d915c7-c8c3-4321-9dc5-2e3e56d42410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:55.301912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-63d915c7-c8c3-4321-9dc5-2e3e56d42410 None None] MFA Rules not processed for user `57400bc0eac94d5687ae29f9a19bf2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:55.306485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-63d915c7-c8c3-4321-9dc5-2e3e56d42410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:55.333097 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3642/7322] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:56.381571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:56.383200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:56.501010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b0b6-7c5c-4561-996e-fb0fe0f9917f service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:56.506176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:56.507063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:56.507615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:56.508047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] PATH_INFO: `/v3/users/bb0bf7857f874e8e92eabcf3a73b12ac` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:56.509652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0bf7857f874e8e92eabcf3a73b12ac)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:56.523727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:56.638744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0bf7857f874e8e92eabcf3a73b12ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:56.640124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0bf7857f874e8e92eabcf3a73b12ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:56.641128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0bf7857f874e8e92eabcf3a73b12ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:56.669187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0bf7857f874e8e92eabcf3a73b12ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:56.685425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0bf7857f874e8e92eabcf3a73b12ac'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:56.736613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3681/7323] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:34:56 2022] DELETE /identity/v3/users/bb0bf7857f874e8e92eabcf3a73b12ac => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:56.743654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:56.744515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:56.746231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:56.810611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:56.811791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:56.953156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3643/7324] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:56.980290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:56.981870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:56.988135 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:57.098173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddf3bf-1c6c-460f-8ec3-73c246bcf7a6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:57.106218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdce3ec-b999-4b7e-88f7-be5f9a267de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:57.109235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce3ec-b999-4b7e-88f7-be5f9a267de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:57.110254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce3ec-b999-4b7e-88f7-be5f9a267de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:57.111086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce3ec-b999-4b7e-88f7-be5f9a267de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:57.124806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdce3ec-b999-4b7e-88f7-be5f9a267de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:57.126809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdce3ec-b999-4b7e-88f7-be5f9a267de8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:57.142823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3682/7325] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:57.607618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:57.609859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:57.630345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bda7e-a5b4-4557-9300-42bfaec478f0 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:57.650218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:57.653170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:57.653382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:57.656103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] PATH_INFO: `/v3/projects/5be890ff18db42c2a3f3973e4069de1d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:57.659023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be890ff18db42c2a3f3973e4069de1d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:57.660952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:57.763536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be890ff18db42c2a3f3973e4069de1d', 'request_id': 'req-ac008ec9-c988-4054-8125-808e5408d36b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:57.776533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be890ff18db42c2a3f3973e4069de1d', 'request_id': 'req-ac008ec9-c988-4054-8125-808e5408d36b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:57.793157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be890ff18db42c2a3f3973e4069de1d', 'request_id': 'req-ac008ec9-c988-4054-8125-808e5408d36b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:57.809083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] The token cache is being invalidate because project 5be890ff18db42c2a3f3973e4069de1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:34:57.809572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:57.821943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:34:57.839595 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3644/7326] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:34:57 2022] DELETE /identity/v3/projects/5be890ff18db42c2a3f3973e4069de1d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:57.840399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f0c5-fc1d-40f4-8498-412f667722f5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:57.840906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f0c5-fc1d-40f4-8498-412f667722f5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:57.841007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0f0c5-fc1d-40f4-8498-412f667722f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:57.887600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1bb0f0c5-fc1d-40f4-8498-412f667722f5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:57.888847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1bb0f0c5-fc1d-40f4-8498-412f667722f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:57.891786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:57.894536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:57.999846 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:58.026622 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3683/7327] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:58.034796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe822-58f8-4c3e-b753-f6c320f4cec3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.035252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe822-58f8-4c3e-b753-f6c320f4cec3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.035675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe822-58f8-4c3e-b753-f6c320f4cec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.092211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-231fe822-58f8-4c3e-b753-f6c320f4cec3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:58.093564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-231fe822-58f8-4c3e-b753-f6c320f4cec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:58.093956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008ec9-c988-4054-8125-808e5408d36b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:58.102777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:58.103728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.104748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.105820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.109384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:58.114479 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3684/7328] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:58.123966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe822-58f8-4c3e-b753-f6c320f4cec3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:58.138503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe822-58f8-4c3e-b753-f6c320f4cec3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:58.143198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:58.145599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:58.146867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.147795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.148173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.148899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:34:58.149211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:58.149338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:58.152064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:58.171071 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3685/7329] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:34:58.186316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:58.187681 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3645/7330] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:34:58.216410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b4e78-5d47-40eb-8d91-357bc7687330 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:58.250235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:58.251046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.252219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.252570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.253310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:58.257192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:58.316019 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3686/7331] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:34:58 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:58.320245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:58.343249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab74fc-667f-496d-a7de-b06cf38036ba service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:58.482005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:58.484006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.485672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.486104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.487522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:58.490759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:58.564669 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3646/7332] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:34:58 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:34:58.565343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:58.582734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97965b-bc3e-49e7-8192-65d878d33dd5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:58.588811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:58.589482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.589766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.590038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.590747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:58.592438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:58.610292 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3687/7333] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:58.613052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:58.629968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e04315-c495-4725-aab5-060587980b17 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:58.644662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8e8a8-940d-46a6-b896-18132d52ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:58.645333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8e8a8-940d-46a6-b896-18132d52ecf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.645622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8e8a8-940d-46a6-b896-18132d52ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.645898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8e8a8-940d-46a6-b896-18132d52ecf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.646567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8e8a8-940d-46a6-b896-18132d52ecf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:58.652088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8e8a8-940d-46a6-b896-18132d52ecf8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:58.685817 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3647/7334] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:34:58.689325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:58.708946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52163c24-d4ec-4dbd-8c2f-26b8c56f67e7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:58.733307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:58.734894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.735337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.735805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] PATH_INFO: `/v3/projects/9ac8094a0d9643fea36c17735872efbb/users/25451e0e8b2b4d19a3d4eda8090f92a0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.757787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac8094a0d9643fea36c17735872efbb, user_id=25451e0e8b2b4d19a3d4eda8090f92a0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:58.761976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:58.787594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3688/7335] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:34:58 2022] PUT /identity/v3/projects/9ac8094a0d9643fea36c17735872efbb/users/25451e0e8b2b4d19a3d4eda8090f92a0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:34:58.801194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:58.801194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:58.801194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:58.864578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] MFA Rules not processed for user `25451e0e8b2b4d19a3d4eda8090f92a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:34:58.866812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:58.991578 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3648/7336] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:34:59.008376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:34:59.010794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:34:59.089759 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:34:59.125877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fbde-d6c5-4617-b818-ed85bbdcc344 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:34:59.129614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8abba-8353-47dd-bf91-9ff49cc83978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:34:59.130277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8abba-8353-47dd-bf91-9ff49cc83978 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:34:59.130514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8abba-8353-47dd-bf91-9ff49cc83978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:34:59.130947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8abba-8353-47dd-bf91-9ff49cc83978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:34:59.140860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8abba-8353-47dd-bf91-9ff49cc83978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:34:59.142359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8abba-8353-47dd-bf91-9ff49cc83978 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:34:59.168779 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3689/7337] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:34:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:04.488145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:04.490371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:04.566899 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:04.636330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569c4c6-8d3e-4773-92d8-b6a792584c41 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:04.643326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:04.643970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:04.644249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:04.644521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:04.646846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:04.668691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:04.670372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:04.686747 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3649/7338] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:08.027023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae70d3-cd24-4cb9-bf54-321172334c54 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:08.028344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae70d3-cd24-4cb9-bf54-321172334c54 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:08.028785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae70d3-cd24-4cb9-bf54-321172334c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:08.074228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a4ae70d3-cd24-4cb9-bf54-321172334c54 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:08.078593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4ae70d3-cd24-4cb9-bf54-321172334c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:08.267084 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3690/7339] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:08.280766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:08.282855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:08.497287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a23e1-e8e0-4a4f-98a1-6be9766c8a6c service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:08.520705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:08.521708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:08.522166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:08.522613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:08.543581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:08.545472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:08.566847 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3650/7340] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:35:14.317020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:14.317559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:14.317647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:14.398311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] MFA Rules not processed for user `5551cca8143b455b822d283fb00d1932`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:14.404883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:14.557306 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3691/7341] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:18.555852 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=52 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:20.635409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:20.657026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2baab5-0a12-4a34-a699-c862394798bc service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:20.669046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a244b45-c33d-42fd-8fbc-192d3800c516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:20.669695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244b45-c33d-42fd-8fbc-192d3800c516 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:20.669971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244b45-c33d-42fd-8fbc-192d3800c516 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:20.670242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244b45-c33d-42fd-8fbc-192d3800c516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:20.676589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1a244b45-c33d-42fd-8fbc-192d3800c516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:20.709601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244b45-c33d-42fd-8fbc-192d3800c516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:20.711212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244b45-c33d-42fd-8fbc-192d3800c516 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:20.738904 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3651/7342] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:24.530513 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=63 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:30.724907 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:33.888483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:33.890939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:34.128381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda27a6-316b-42a3-b7ea-b4e013be9381 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:34.134474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:34.135656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:34.136130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:34.136655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] PATH_INFO: `/v3/users/360f5e46657b4ebf9eedbf61e1804ceb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:34.138184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=360f5e46657b4ebf9eedbf61e1804ceb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:34.140360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:34.263573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360f5e46657b4ebf9eedbf61e1804ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:34.264636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360f5e46657b4ebf9eedbf61e1804ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:34.265593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360f5e46657b4ebf9eedbf61e1804ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:34.285916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360f5e46657b4ebf9eedbf61e1804ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:34.297325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360f5e46657b4ebf9eedbf61e1804ceb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:34.336221 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3692/7343] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:35:33 2022] DELETE /identity/v3/users/360f5e46657b4ebf9eedbf61e1804ceb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:34.337528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:34.338041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:34.338041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:34.363130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:34.365853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:34.526204 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3652/7344] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:35:34.586535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:34.588538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:34.678463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee850a-3189-43b4-aca4-2151e9097568 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:34.690635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b6e90-8c50-4d03-9b88-bc248904d85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:34.691522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b6e90-8c50-4d03-9b88-bc248904d85f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:34.692298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b6e90-8c50-4d03-9b88-bc248904d85f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:34.693204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b6e90-8c50-4d03-9b88-bc248904d85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:34.709002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b6e90-8c50-4d03-9b88-bc248904d85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:34.710936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b6e90-8c50-4d03-9b88-bc248904d85f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:34.724444 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3693/7345] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:34.987085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:34.988602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:35.012414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcf06-5157-46d8-94e4-64c18e6968b9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:35.032964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:35.033685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.034176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.034609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] PATH_INFO: `/v3/projects/70a01fe8838843b1bb8816643c7ba6af` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.043599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a01fe8838843b1bb8816643c7ba6af)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:35.045987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:35.199310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a01fe8838843b1bb8816643c7ba6af', 'request_id': 'req-2547a6dc-e090-4905-b31e-b34ada317cff'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:35.208871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a01fe8838843b1bb8816643c7ba6af', 'request_id': 'req-2547a6dc-e090-4905-b31e-b34ada317cff'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:35.232980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a01fe8838843b1bb8816643c7ba6af', 'request_id': 'req-2547a6dc-e090-4905-b31e-b34ada317cff'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:35.251334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] The token cache is being invalidate because project 70a01fe8838843b1bb8816643c7ba6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:35:35.251633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:35.252319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2547a6dc-e090-4905-b31e-b34ada317cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:35.255770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3653/7346] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:35:34 2022] DELETE /identity/v3/projects/70a01fe8838843b1bb8816643c7ba6af => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:35.261183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2af0f3-e3d8-4ec6-8832-ee20db9bbfb3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.261738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2af0f3-e3d8-4ec6-8832-ee20db9bbfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.261738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2af0f3-e3d8-4ec6-8832-ee20db9bbfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.302018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ee2af0f3-e3d8-4ec6-8832-ee20db9bbfb3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:35.308760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ee2af0f3-e3d8-4ec6-8832-ee20db9bbfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:35.366748 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:35.459718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875c3f-8d30-487f-bbed-3f7901bba0e7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.460699 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3694/7347] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:35.461267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875c3f-8d30-487f-bbed-3f7901bba0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.461630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875c3f-8d30-487f-bbed-3f7901bba0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.503339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.503339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.503339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.506721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-52875c3f-8d30-487f-bbed-3f7901bba0e7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:35.509335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-52875c3f-8d30-487f-bbed-3f7901bba0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:35.543827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:35.545077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:35.560640 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3654/7348] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:35:35.564912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875c3f-8d30-487f-bbed-3f7901bba0e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:35.616165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875c3f-8d30-487f-bbed-3f7901bba0e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:35.641235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:35.641866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.642331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.642785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.647475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:35:35.647797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:35.649447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:35.689414 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3695/7349] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:35.719206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:35.722983 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3655/7350] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:35:35.725533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:35.727554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:35.739294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923015c-de9c-4d56-ae15-0ec8d840923b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:35.747256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:35.748423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.748943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.749466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.750320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:35.752800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:35.800271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3656/7351] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:35:35 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:35:35.803717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:35.881699 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:35.913145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377f36c-7f9a-41b2-ba3a-d2a475f276b3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:35.921363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:35.921924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.922353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.922683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.924036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:35.925595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:35.959015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3657/7352] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:35:35 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:35:35.964369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:35.968623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712845-2ef7-45f4-9b4e-cd8e59b33eab None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:35.988508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde529c-edf7-4922-a1ed-30ddde140555 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:35.996466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:35.997645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:35.997880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:35.997976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:35.999071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.000740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.051026 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3658/7353] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:35:36.051974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:36.071474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0f128-4202-4b0e-9eb5-57b6ce4e4c51 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:36.084431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:36.086746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.087035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.088461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.089186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.093252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.126263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3659/7354] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:35:36.127538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:36.138813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8bbc3-0de4-4f7b-8261-b1ecea3c938e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:36.144389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9d292-8f35-4267-8c06-7cf1b64d3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:36.145087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d292-8f35-4267-8c06-7cf1b64d3e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.145375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d292-8f35-4267-8c06-7cf1b64d3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.145663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d292-8f35-4267-8c06-7cf1b64d3e6a admin admin] PATH_INFO: `/v3/projects/9502e8a49a3047aab1fdc4b97239f4eb/users/de2b72afbae94fbc8cfac15f04e959fc/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.150100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:36.153477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.154076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.154510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.164038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9d292-8f35-4267-8c06-7cf1b64d3e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9502e8a49a3047aab1fdc4b97239f4eb, user_id=de2b72afbae94fbc8cfac15f04e959fc, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.168538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9d292-8f35-4267-8c06-7cf1b64d3e6a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.181309 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:36.205503 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3660/7355] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:35:36 2022] PUT /identity/v3/projects/9502e8a49a3047aab1fdc4b97239f4eb/users/de2b72afbae94fbc8cfac15f04e959fc/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:36.207341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84924be5-e28f-4ee0-8e9c-94e3e8784e43 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.208277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84924be5-e28f-4ee0-8e9c-94e3e8784e43 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.208808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84924be5-e28f-4ee0-8e9c-94e3e8784e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.250276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-84924be5-e28f-4ee0-8e9c-94e3e8784e43 None None] MFA Rules not processed for user `de2b72afbae94fbc8cfac15f04e959fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:36.252040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-84924be5-e28f-4ee0-8e9c-94e3e8784e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:36.292259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.293914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.332102 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3696/7356] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:35:36.344169 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3661/7357] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:36.348861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:36.363370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a60cc-f088-4fe6-9065-024d0c788913 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:36.470449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:36.471450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.471905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.472332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.473577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.475805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.578153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84924be5-e28f-4ee0-8e9c-94e3e8784e43 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:36.594724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3697/7358] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:35:36 2022] POST /identity/v3/projects => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:35:36.601333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84924be5-e28f-4ee0-8e9c-94e3e8784e43 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:36.778942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:36.779679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.781589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.781993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.782783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.784949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.835144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:36.845430 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3662/7359] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:35:36 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:35:36.850978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72dce7-0dcb-49a6-a829-79e03bce564b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:36.857381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:36.858054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.859173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.859562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.860327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.862801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.889934 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3698/7360] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:35:36.891276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:36.898439 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:36.917388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59d793-bcc8-4ea7-b722-f29e0250e1de admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:36.929122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:36.929901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:36.930175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:36.930572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] PATH_INFO: `/v3/projects/5203940cf5f74571bbad7496c82ba515/users/3261e9339f6648fea9a2a0bbe628dad2/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:36.957480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5203940cf5f74571bbad7496c82ba515, user_id=3261e9339f6648fea9a2a0bbe628dad2, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:36.960431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:36.984781 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3663/7361] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:35:36 2022] PUT /identity/v3/projects/5203940cf5f74571bbad7496c82ba515/users/3261e9339f6648fea9a2a0bbe628dad2/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:36.989103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:37.003057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5b59e-4902-4e5b-98c5-c8890aef5830 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:37.123342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70892219-603a-474b-8ed6-20acee934310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:37.125944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892219-603a-474b-8ed6-20acee934310 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:37.127189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892219-603a-474b-8ed6-20acee934310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:37.133223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892219-603a-474b-8ed6-20acee934310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:37.134917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70892219-603a-474b-8ed6-20acee934310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:37.137633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70892219-603a-474b-8ed6-20acee934310 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:37.180126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:37.186661 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3699/7362] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:35:37.193758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ca36-84cc-4f82-94ff-7923da1a5fa1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:37.204632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:37.207181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:37.207573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:37.207953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] PATH_INFO: `/v3/projects/5203940cf5f74571bbad7496c82ba515/users/3261e9339f6648fea9a2a0bbe628dad2/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:37.213817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5203940cf5f74571bbad7496c82ba515, user_id=3261e9339f6648fea9a2a0bbe628dad2, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:37.220979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:37.257492 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3664/7363] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:35:37 2022] PUT /identity/v3/projects/5203940cf5f74571bbad7496c82ba515/users/3261e9339f6648fea9a2a0bbe628dad2/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:37.272135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060aedc-44e2-4fb5-afc5-d8437eb79459 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:37.272135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060aedc-44e2-4fb5-afc5-d8437eb79459 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:37.272135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060aedc-44e2-4fb5-afc5-d8437eb79459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:37.332951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5060aedc-44e2-4fb5-afc5-d8437eb79459 None None] MFA Rules not processed for user `3261e9339f6648fea9a2a0bbe628dad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:37.334329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5060aedc-44e2-4fb5-afc5-d8437eb79459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:37.345840 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:37.494865 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3700/7364] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:37.507913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:37.510873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:37.684237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9ef21-0fc7-4e37-bd25-f0c922c965d2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:37.700905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:37.701577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:37.702065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:37.702338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:37.751388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:37.756611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:37.795768 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3665/7365] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:35:37.805350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9579a8-2497-453b-b472-15d8e1199287 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:37.805635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9579a8-2497-453b-b472-15d8e1199287 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:37.805908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9579a8-2497-453b-b472-15d8e1199287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:37.849887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5c9579a8-2497-453b-b472-15d8e1199287 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:37.851506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5c9579a8-2497-453b-b472-15d8e1199287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:37.989844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:38.008515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483073-e19e-4244-8dce-5c2830f4d4a4 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:38.020411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d3a06-7bf8-4335-ac08-87671230f4bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:38.024262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3a06-7bf8-4335-ac08-87671230f4bb service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:38.024625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3a06-7bf8-4335-ac08-87671230f4bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:38.025545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3a06-7bf8-4335-ac08-87671230f4bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:38.094948 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3701/7366] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:35:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:38.113917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9579a8-2497-453b-b472-15d8e1199287 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:38.162542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3a06-7bf8-4335-ac08-87671230f4bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:38.164924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3a06-7bf8-4335-ac08-87671230f4bb service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:38.193143 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3666/7367] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:35:38.319593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9579a8-2497-453b-b472-15d8e1199287 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:38.329580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:38.330285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:38.330630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:38.330912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:38.356602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:38.360576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:38.403835 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3702/7368] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:35:38.978492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:38.979081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:38.979180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:39.012469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:39.013754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:39.022291 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3667/7369] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:39.050122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:39.090021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53b4e-a855-4f02-ae0d-3a9dbd81f273 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:39.119637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39b8f3-4408-486a-a720-e8dcee23822b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:39.120596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39b8f3-4408-486a-a720-e8dcee23822b service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:39.121332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39b8f3-4408-486a-a720-e8dcee23822b service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:39.122013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39b8f3-4408-486a-a720-e8dcee23822b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:39.137393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39b8f3-4408-486a-a720-e8dcee23822b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:39.139723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39b8f3-4408-486a-a720-e8dcee23822b service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:39.150728 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3703/7370] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:35:40.567320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:40.568829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:40.719912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e699c-9b9f-4483-b611-9708dff99735 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:40.734774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:40.735767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:40.736026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:40.739036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] PATH_INFO: `/v3/users/25451e0e8b2b4d19a3d4eda8090f92a0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:40.743875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25451e0e8b2b4d19a3d4eda8090f92a0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:40.752720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:40.761331 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:40.886901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25451e0e8b2b4d19a3d4eda8090f92a0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:40.887973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25451e0e8b2b4d19a3d4eda8090f92a0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:40.888824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25451e0e8b2b4d19a3d4eda8090f92a0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:40.905426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25451e0e8b2b4d19a3d4eda8090f92a0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:40.938248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25451e0e8b2b4d19a3d4eda8090f92a0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:40.974998 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3668/7371] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:35:40 2022] DELETE /identity/v3/users/25451e0e8b2b4d19a3d4eda8090f92a0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:40.979404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:40.980233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:40.980674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:41.032683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:41.036918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:41.096407 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:41.206981 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3704/7372] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:41.217968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:41.219781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:41.398758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2a38-0514-41f7-aa85-d9c3c0d2082c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:41.412089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a2a47-1fd7-4001-ab41-b5449182c433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:41.412942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2a47-1fd7-4001-ab41-b5449182c433 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:41.413405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2a47-1fd7-4001-ab41-b5449182c433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:41.414297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2a47-1fd7-4001-ab41-b5449182c433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:41.452186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a2a47-1fd7-4001-ab41-b5449182c433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:41.453605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a2a47-1fd7-4001-ab41-b5449182c433 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:41.468659 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3669/7373] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:41.904135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:41.905826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:41.939787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ee9dc-7ff9-420b-8a74-b3b669540090 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:41.957328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:41.958491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:41.959235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:41.959775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] PATH_INFO: `/v3/projects/9ac8094a0d9643fea36c17735872efbb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:41.961506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac8094a0d9643fea36c17735872efbb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:41.964490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:42.089164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac8094a0d9643fea36c17735872efbb', 'request_id': 'req-f3be5741-43f1-4b00-801b-f76368479c0a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:42.097326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac8094a0d9643fea36c17735872efbb', 'request_id': 'req-f3be5741-43f1-4b00-801b-f76368479c0a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:42.110033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac8094a0d9643fea36c17735872efbb', 'request_id': 'req-f3be5741-43f1-4b00-801b-f76368479c0a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:42.143399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] The token cache is being invalidate because project 9ac8094a0d9643fea36c17735872efbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:35:42.150512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:42.151441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f3be5741-43f1-4b00-801b-f76368479c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:42.157125 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3705/7374] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:35:41 2022] DELETE /identity/v3/projects/9ac8094a0d9643fea36c17735872efbb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:42.158720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba444-4baa-443a-8b67-fe721f98f122 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:42.159611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba444-4baa-443a-8b67-fe721f98f122 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:42.159977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba444-4baa-443a-8b67-fe721f98f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:42.208054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2b9ba444-4baa-443a-8b67-fe721f98f122 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:42.209670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2b9ba444-4baa-443a-8b67-fe721f98f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:42.326909 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3670/7375] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:42.334614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2741da-d3cd-4eca-b878-89f94007bd87 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:42.334901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2741da-d3cd-4eca-b878-89f94007bd87 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:42.335179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2741da-d3cd-4eca-b878-89f94007bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:42.386641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2d2741da-d3cd-4eca-b878-89f94007bd87 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:42.387875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2d2741da-d3cd-4eca-b878-89f94007bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:42.411875 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3706/7376] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:42.416785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba444-4baa-443a-8b67-fe721f98f122 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:42.431898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba444-4baa-443a-8b67-fe721f98f122 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:42.441429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:42.442531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:42.443104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:42.443684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:42.444617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:35:42.445123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:42.447036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:42.469759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3671/7377] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:35:42.475067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2741da-d3cd-4eca-b878-89f94007bd87 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:42.486151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2741da-d3cd-4eca-b878-89f94007bd87 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:42.492045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:42.492980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:42.494322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:42.495123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:42.495924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:42.498362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:42.569736 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3707/7378] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:35:42 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:35:42.572470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:42.587278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee517411-35b9-4f83-82c8-4bbc6ea25637 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:42.611156 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:42.768116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:42.768755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:42.769039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:42.769349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:42.770265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:42.782526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:42.852026 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3672/7379] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:35:42 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:35:42.856774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:42.876676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab56140-7be7-403f-abb4-8595abc7330f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:42.893189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:42.893871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:42.894155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:42.894433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:42.900240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:42.906376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:42.945347 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3708/7380] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:35:42.946927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:42.961190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961814-f4f8-49e7-a551-e89bef66a03a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:42.979973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b8ff2-af01-4653-974a-750c247e1036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:42.980785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b8ff2-af01-4653-974a-750c247e1036 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:42.981086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b8ff2-af01-4653-974a-750c247e1036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:42.981389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b8ff2-af01-4653-974a-750c247e1036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:42.982053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b8ff2-af01-4653-974a-750c247e1036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:42.986193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b8ff2-af01-4653-974a-750c247e1036 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:43.016961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:43.022897 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3673/7381] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:35:43.032675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62144be-0782-47ea-9311-422db31799e5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:43.049158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:43.052195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:43.052484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:43.052761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] PATH_INFO: `/v3/projects/fa8450847be14ae2aa492da18ad8ff7e/users/a401b1209d964f9ba7be3d3b1001e9c4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:43.104474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8450847be14ae2aa492da18ad8ff7e, user_id=a401b1209d964f9ba7be3d3b1001e9c4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:43.113222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:43.143635 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3709/7382] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:35:43 2022] PUT /identity/v3/projects/fa8450847be14ae2aa492da18ad8ff7e/users/a401b1209d964f9ba7be3d3b1001e9c4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:43.172159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ba66-7df2-42bb-83c9-0fb3186abc53 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:43.172666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ba66-7df2-42bb-83c9-0fb3186abc53 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:43.175557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ba66-7df2-42bb-83c9-0fb3186abc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:43.245473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e626ba66-7df2-42bb-83c9-0fb3186abc53 None None] MFA Rules not processed for user `a401b1209d964f9ba7be3d3b1001e9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:43.246783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e626ba66-7df2-42bb-83c9-0fb3186abc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:43.434237 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3674/7383] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:35:43.488149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:43.490174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:43.629203 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:43.661927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cfef5-f8c0-4f23-a715-5baed8c70261 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:43.669145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:43.670211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:43.670211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:43.670509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:43.711957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:43.714122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:43.737744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3710/7384] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:47.966718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ee61f-5b91-473a-8f7e-a5db36c26174 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:47.967722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ee61f-5b91-473a-8f7e-a5db36c26174 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:47.968326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ee61f-5b91-473a-8f7e-a5db36c26174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:47.992315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-653ee61f-5b91-473a-8f7e-a5db36c26174 None None] MFA Rules not processed for user `ea477d27693440a9a41d0aa12db57a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:47.994660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-653ee61f-5b91-473a-8f7e-a5db36c26174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:48.266075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3675/7385] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:35:53.729524 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:58.028970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:58.154087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810aa6-21cd-47a3-84d8-864c972244e7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:58.159750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:58.160696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:58.161201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:58.161658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] PATH_INFO: `/v3/users/a401b1209d964f9ba7be3d3b1001e9c4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:58.163032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a401b1209d964f9ba7be3d3b1001e9c4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:58.165894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:58.256401 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:35:58.291667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a401b1209d964f9ba7be3d3b1001e9c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:58.295851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a401b1209d964f9ba7be3d3b1001e9c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:58.299432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a401b1209d964f9ba7be3d3b1001e9c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:58.345105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a401b1209d964f9ba7be3d3b1001e9c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:58.378064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a401b1209d964f9ba7be3d3b1001e9c4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:35:58.435132 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3711/7386] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:35:58 2022] DELETE /identity/v3/users/a401b1209d964f9ba7be3d3b1001e9c4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:35:58.439426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:58.439716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:58.440009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:58.478289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:35:58.479482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:58.671064 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3676/7387] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:35:58.703584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:58.717876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:58.944123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a7932-161e-4e02-b551-50e7597f7b18 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:35:58.948332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f872d6-1a42-40a5-a8e3-8b1a2683c616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:35:58.948953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f872d6-1a42-40a5-a8e3-8b1a2683c616 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:35:58.949264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f872d6-1a42-40a5-a8e3-8b1a2683c616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:35:58.949539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f872d6-1a42-40a5-a8e3-8b1a2683c616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:35:58.960721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f872d6-1a42-40a5-a8e3-8b1a2683c616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:35:58.962828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f872d6-1a42-40a5-a8e3-8b1a2683c616 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:35:58.975791 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3712/7388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:35:59.971636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:35:59.973199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:35:59.996562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26db23-ebd0-4f79-8470-865a3e4a87cf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:00.023869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:00.030085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:00.031440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:00.032307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] PATH_INFO: `/v3/projects/fa8450847be14ae2aa492da18ad8ff7e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:00.039385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8450847be14ae2aa492da18ad8ff7e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:00.048126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:00.180994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8450847be14ae2aa492da18ad8ff7e', 'request_id': 'req-9cd84cdc-2db9-477e-b5fc-d32b136240b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:00.191995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8450847be14ae2aa492da18ad8ff7e', 'request_id': 'req-9cd84cdc-2db9-477e-b5fc-d32b136240b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:00.208477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8450847be14ae2aa492da18ad8ff7e', 'request_id': 'req-9cd84cdc-2db9-477e-b5fc-d32b136240b0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:00.232565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] The token cache is being invalidate because project fa8450847be14ae2aa492da18ad8ff7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:36:00.233017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:00.234697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9cd84cdc-2db9-477e-b5fc-d32b136240b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:00.243706 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3677/7389] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:35:59 2022] DELETE /identity/v3/projects/fa8450847be14ae2aa492da18ad8ff7e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:00.245565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d2f32-5d7e-40b8-91c6-3d8f10e47c55 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:00.246048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d2f32-5d7e-40b8-91c6-3d8f10e47c55 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:00.246158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d2f32-5d7e-40b8-91c6-3d8f10e47c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:00.279829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-386d2f32-5d7e-40b8-91c6-3d8f10e47c55 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:00.280910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-386d2f32-5d7e-40b8-91c6-3d8f10e47c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:00.312634 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:00.454656 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3713/7390] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:00.458623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d368766-452f-47a1-8b3c-700f87883e24 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:00.458916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d368766-452f-47a1-8b3c-700f87883e24 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:00.459196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d368766-452f-47a1-8b3c-700f87883e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:00.513925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9d368766-452f-47a1-8b3c-700f87883e24 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:00.518541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d368766-452f-47a1-8b3c-700f87883e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:00.563968 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3678/7391] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:36:00.565565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d2f32-5d7e-40b8-91c6-3d8f10e47c55 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:00.583777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d2f32-5d7e-40b8-91c6-3d8f10e47c55 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:00.601021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:00.606147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:00.607358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:00.607358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:00.608796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:36:00.608796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:00.609922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:00.639905 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3714/7392] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:36:00.644004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d368766-452f-47a1-8b3c-700f87883e24 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:00.657836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d368766-452f-47a1-8b3c-700f87883e24 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:00.669321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:00.670871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:00.670871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:00.670871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:00.673168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:00.673168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:00.746131 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3679/7393] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:00 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:00.758064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:00.771606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a5c54-bb2a-4b9b-b84d-eae8dacb819d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:01.007256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:01.011151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:01.011498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:01.011833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:01.012579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:01.015521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:01.062498 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3715/7394] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:00 2022] POST /identity/v3/users => generated 287 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:01.064788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:01.107326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68939cbb-28cb-4a3a-b3f3-02656a2d9e65 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:01.143031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:01.145437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:01.148636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:01.148925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:01.153021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:01.158278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:01.181494 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3680/7395] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:01.185261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:01.203420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255066de-de79-4442-a4d1-0e594c5b44ff admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:01.216995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb1334-a889-41c7-b9eb-9d756f95e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:01.217643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1334-a889-41c7-b9eb-9d756f95e45a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:01.217934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1334-a889-41c7-b9eb-9d756f95e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:01.218195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb1334-a889-41c7-b9eb-9d756f95e45a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:01.218836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb1334-a889-41c7-b9eb-9d756f95e45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:01.220919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb1334-a889-41c7-b9eb-9d756f95e45a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:01.256712 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3716/7396] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:01.260566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:01.283565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa5d07-3033-49e9-97ae-7d66e5cb6081 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:01.305715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:01.306553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:01.306844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:01.307124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] PATH_INFO: `/v3/projects/e140c50aa5164be09dd4bd71325091d6/users/343527df4e5e4984974edf7a7ccc1b7b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:01.373337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e140c50aa5164be09dd4bd71325091d6, user_id=343527df4e5e4984974edf7a7ccc1b7b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:01.373337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:01.409596 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3681/7397] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:01 2022] PUT /identity/v3/projects/e140c50aa5164be09dd4bd71325091d6/users/343527df4e5e4984974edf7a7ccc1b7b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:01.421819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749507b8-f42d-48b9-92b3-22d2be4b4127 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:01.422089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749507b8-f42d-48b9-92b3-22d2be4b4127 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:01.422670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749507b8-f42d-48b9-92b3-22d2be4b4127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:01.476881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-749507b8-f42d-48b9-92b3-22d2be4b4127 None None] MFA Rules not processed for user `343527df4e5e4984974edf7a7ccc1b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:01.478574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-749507b8-f42d-48b9-92b3-22d2be4b4127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:01.670172 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3717/7398] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:01.688406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:01.690041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:01.738753 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:01.814140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1476e2-a836-4e26-aa55-a7b098680596 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:01.830166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea138c8-9d2a-410a-89cf-3ba323cb1762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:01.831057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea138c8-9d2a-410a-89cf-3ba323cb1762 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:01.831524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea138c8-9d2a-410a-89cf-3ba323cb1762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:01.831937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea138c8-9d2a-410a-89cf-3ba323cb1762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:01.853765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea138c8-9d2a-410a-89cf-3ba323cb1762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:01.856663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea138c8-9d2a-410a-89cf-3ba323cb1762 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:01.883175 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3682/7399] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:02.544153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749507b8-f42d-48b9-92b3-22d2be4b4127 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:02.580043 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:02.697877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749507b8-f42d-48b9-92b3-22d2be4b4127 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:02.709468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:02.710184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:02.710781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:02.711157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] PATH_INFO: `/v3/users/343527df4e5e4984974edf7a7ccc1b7b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:02.713555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343527df4e5e4984974edf7a7ccc1b7b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:02.716096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:02.884177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343527df4e5e4984974edf7a7ccc1b7b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:02.885160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343527df4e5e4984974edf7a7ccc1b7b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:02.885794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343527df4e5e4984974edf7a7ccc1b7b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:02.948268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343527df4e5e4984974edf7a7ccc1b7b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:02.961154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343527df4e5e4984974edf7a7ccc1b7b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:02.985441 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3718/7400] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:36:02 2022] DELETE /identity/v3/users/343527df4e5e4984974edf7a7ccc1b7b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:02.989490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:02.990279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:02.990711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:03.050049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:03.051562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:03.175292 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3683/7401] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:03.183756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:03.185379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:03.291037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0eba-b2e1-40fb-9cd2-3f1577a93163 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:03.300665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c66f0-84b6-4aff-9f7b-3f36a5e01766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:03.303262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c66f0-84b6-4aff-9f7b-3f36a5e01766 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:03.304285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c66f0-84b6-4aff-9f7b-3f36a5e01766 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:03.305786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c66f0-84b6-4aff-9f7b-3f36a5e01766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:03.365413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c66f0-84b6-4aff-9f7b-3f36a5e01766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:03.368160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c66f0-84b6-4aff-9f7b-3f36a5e01766 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:03.403251 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3719/7402] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:03.855416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:03.857359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:03.894455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2c4b1-06c7-47eb-bdac-4fc524fef4f4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:03.909673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:03.911339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:03.911683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:03.911904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] PATH_INFO: `/v3/projects/e140c50aa5164be09dd4bd71325091d6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:03.914367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e140c50aa5164be09dd4bd71325091d6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:03.918571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:04.031487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e140c50aa5164be09dd4bd71325091d6', 'request_id': 'req-c345fad1-956f-4166-b4c0-af5a9c59e3ca'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:04.044974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e140c50aa5164be09dd4bd71325091d6', 'request_id': 'req-c345fad1-956f-4166-b4c0-af5a9c59e3ca'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:04.057409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e140c50aa5164be09dd4bd71325091d6', 'request_id': 'req-c345fad1-956f-4166-b4c0-af5a9c59e3ca'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:04.086002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] The token cache is being invalidate because project e140c50aa5164be09dd4bd71325091d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:36:04.086783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:04.090753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c345fad1-956f-4166-b4c0-af5a9c59e3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:04.094225 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3684/7403] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:36:03 2022] DELETE /identity/v3/projects/e140c50aa5164be09dd4bd71325091d6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:04.100734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50f46d-c798-462a-8e5c-86b91fc15a3c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.103888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50f46d-c798-462a-8e5c-86b91fc15a3c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.104524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50f46d-c798-462a-8e5c-86b91fc15a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.170513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1a50f46d-c798-462a-8e5c-86b91fc15a3c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:04.172907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1a50f46d-c798-462a-8e5c-86b91fc15a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:04.253451 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:04.340505 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3720/7404] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:04.350845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df8e0-b2f1-4654-ae38-be2641f75bf7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.351484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df8e0-b2f1-4654-ae38-be2641f75bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.351913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df8e0-b2f1-4654-ae38-be2641f75bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.395382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0b5df8e0-b2f1-4654-ae38-be2641f75bf7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:04.399404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b5df8e0-b2f1-4654-ae38-be2641f75bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:04.422366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3685/7405] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:04.426878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50f46d-c798-462a-8e5c-86b91fc15a3c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:04.448012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50f46d-c798-462a-8e5c-86b91fc15a3c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:04.456750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:04.458271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.458682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.459059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.459822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:36:04.460231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:04.463922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:04.493211 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3721/7406] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:36:04.497574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df8e0-b2f1-4654-ae38-be2641f75bf7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:04.515298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df8e0-b2f1-4654-ae38-be2641f75bf7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:04.530179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:04.531032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.531374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.531748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.532764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:04.534826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:04.589679 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3686/7407] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:04 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:04.593254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:04.608484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20764a7a-0fc9-408d-9cdd-1b2e064e8db9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:04.679547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:04.680410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.680799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.681386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.682131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:04.684232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:04.715968 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3722/7408] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:04 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:04.720807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:04.742292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452dc06-da1c-4712-b57b-48113fef29b1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:04.753690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:04.754497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.754871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.755247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.756013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:04.757762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:04.781308 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3687/7409] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:04.785432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:04.801073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367798-a8ed-48df-bbcb-9ad9081dafee admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:04.817680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aabc38-da61-4162-95f7-a7b3699db3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:04.820199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabc38-da61-4162-95f7-a7b3699db3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.821407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabc38-da61-4162-95f7-a7b3699db3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.822944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aabc38-da61-4162-95f7-a7b3699db3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.823690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aabc38-da61-4162-95f7-a7b3699db3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:04.828149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aabc38-da61-4162-95f7-a7b3699db3f4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:04.851956 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3723/7410] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:04.856356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:04.869356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923fcb9-4ea4-44f6-9b64-669b31a3acba admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:04.878079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:04.879469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.879918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.880362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] PATH_INFO: `/v3/projects/e59b2fcab1be4343b209020fedb2fcb0/users/6818cdae5a334cc2ac8132e5461ae69d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:04.886482 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:04.917260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59b2fcab1be4343b209020fedb2fcb0, user_id=6818cdae5a334cc2ac8132e5461ae69d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:04.922084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:04.953249 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3688/7411] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:04 2022] PUT /identity/v3/projects/e59b2fcab1be4343b209020fedb2fcb0/users/6818cdae5a334cc2ac8132e5461ae69d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:36:04.964397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027064f-df16-41dc-b55a-75cbd1080188 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:04.965142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027064f-df16-41dc-b55a-75cbd1080188 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:04.965562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027064f-df16-41dc-b55a-75cbd1080188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:05.021824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9027064f-df16-41dc-b55a-75cbd1080188 None None] MFA Rules not processed for user `6818cdae5a334cc2ac8132e5461ae69d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:05.023046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9027064f-df16-41dc-b55a-75cbd1080188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:05.191021 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3724/7412] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:05.194733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:05.344268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be588fdc-d676-4e71-b351-961e683ed54f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:05.350782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:05.351564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:05.352640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:05.352959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:05.354918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:05.358643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:05.399546 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3689/7413] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:05 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:36:05.404194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027064f-df16-41dc-b55a-75cbd1080188 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:05.421823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027064f-df16-41dc-b55a-75cbd1080188 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:05.515778 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:05.573326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:05.574175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:05.576703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:05.577365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:05.580043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:05.585477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:05.616591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:05.619862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:05.656617 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3725/7414] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:05 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:05.660396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:05.682153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb62382-10ba-4165-9ff5-44283a80db6d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:05.701014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:05.703441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:05.704643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:05.708808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:05.716977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:05.725482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:05.767535 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3726/7415] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:05.768639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:05.810717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b599-8d3a-4578-a5fc-1e2e9fef0f98 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:05.835922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:05.838497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:05.838863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:05.839202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] PATH_INFO: `/v3/projects/7e16db7cf2cb4c2cb6e9d7f012a8adfe/users/8e8bed22b5ec4fa4aa85651ecc1433fc/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:05.862775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6837dc-2986-4835-b74e-bb4648249072 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:05.882732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1fcc-cfe5-40ab-a016-4138e32b5f02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:05.883793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e16db7cf2cb4c2cb6e9d7f012a8adfe, user_id=8e8bed22b5ec4fa4aa85651ecc1433fc, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:05.884464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1fcc-cfe5-40ab-a016-4138e32b5f02 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:05.886865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1fcc-cfe5-40ab-a016-4138e32b5f02 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:05.887228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1fcc-cfe5-40ab-a016-4138e32b5f02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:05.889718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:05.893010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b3ef1fcc-cfe5-40ab-a016-4138e32b5f02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:05.938581 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3727/7416] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:05 2022] PUT /identity/v3/projects/7e16db7cf2cb4c2cb6e9d7f012a8adfe/users/8e8bed22b5ec4fa4aa85651ecc1433fc/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:05.940653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:06.134992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5adbd-1eb2-42e0-b944-74f9127d0483 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:06.147598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:06.150656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:06.150963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:06.151248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:06.152651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:06.157622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:06.163185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1fcc-cfe5-40ab-a016-4138e32b5f02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:06.165360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1fcc-cfe5-40ab-a016-4138e32b5f02 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:06.203582 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3728/7417] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:06.207122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:06.232933 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3690/7418] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:36:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:36:06.302996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3d1d-42a0-4a0b-8152-b27172548e9e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:06.348006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:06.348807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:06.349168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:06.349394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] PATH_INFO: `/v3/projects/7e16db7cf2cb4c2cb6e9d7f012a8adfe/users/8e8bed22b5ec4fa4aa85651ecc1433fc/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:06.361948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e16db7cf2cb4c2cb6e9d7f012a8adfe, user_id=8e8bed22b5ec4fa4aa85651ecc1433fc, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:06.371235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:06.412011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa95d-ef7a-4a06-bc7f-0a67f471395a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:06.412294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa95d-ef7a-4a06-bc7f-0a67f471395a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:06.412917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa95d-ef7a-4a06-bc7f-0a67f471395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:06.421188 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3729/7419] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:06 2022] PUT /identity/v3/projects/7e16db7cf2cb4c2cb6e9d7f012a8adfe/users/8e8bed22b5ec4fa4aa85651ecc1433fc/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:06.451264 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:06.470523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-01efa95d-ef7a-4a06-bc7f-0a67f471395a None None] MFA Rules not processed for user `8e8bed22b5ec4fa4aa85651ecc1433fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:06.472886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-01efa95d-ef7a-4a06-bc7f-0a67f471395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:06.626410 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3691/7420] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:36:06.648287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:06.654153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:06.784312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1187434-0f01-4595-a8cb-10b6951eabfd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:06.791588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:06.792973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:06.793542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:06.794097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:06.807190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:06.810559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:06.827349 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3730/7421] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:06.941957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa95d-ef7a-4a06-bc7f-0a67f471395a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:06.957409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa95d-ef7a-4a06-bc7f-0a67f471395a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:06.962922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:06.963788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:06.964301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:06.964735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:07.069787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:07.071845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:07.098660 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3692/7422] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:09.649628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:09.663747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f67c0-dbc4-4429-9b8b-3ada26a917f7 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:09.674454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:09.675078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:09.675352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:09.675618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:09.679355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:09.720088 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:09.835815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:09.837716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:09.879058 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3731/7423] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:17.079711 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=58 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:19.847395 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=21 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:20.137708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:20.140257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:20.421953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130ecc8-fa6d-401b-86b8-4b0c4590ccd2 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:20.443285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:20.451604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:20.453348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:20.453850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:20.462037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:20.524794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:20.527228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:20.600978 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3693/7424] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:23.244193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:23.272046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01451-2a51-4ce0-8900-767cf2528c0f service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:23.282747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa23ccd-938f-46b4-ae1a-a97f6d1cc008 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:23.284554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23ccd-938f-46b4-ae1a-a97f6d1cc008 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:23.286073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23ccd-938f-46b4-ae1a-a97f6d1cc008 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:23.286560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23ccd-938f-46b4-ae1a-a97f6d1cc008 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:23.292712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-daa23ccd-938f-46b4-ae1a-a97f6d1cc008 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:23.334017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa23ccd-938f-46b4-ae1a-a97f6d1cc008 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:23.338650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa23ccd-938f-46b4-ae1a-a97f6d1cc008 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:23.371670 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3732/7425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:25.111056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:25.297668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e455-df73-47c9-85d8-48ad1d04b26d service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:25.303045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:25.303697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:25.303976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:25.304248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] PATH_INFO: `/v3/users/6818cdae5a334cc2ac8132e5461ae69d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:25.318138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6818cdae5a334cc2ac8132e5461ae69d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:25.347839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:25.493095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6818cdae5a334cc2ac8132e5461ae69d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:25.493819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6818cdae5a334cc2ac8132e5461ae69d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:25.500838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6818cdae5a334cc2ac8132e5461ae69d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:25.514897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6818cdae5a334cc2ac8132e5461ae69d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:25.537971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6818cdae5a334cc2ac8132e5461ae69d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:25.560598 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3694/7426] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:36:25 2022] DELETE /identity/v3/users/6818cdae5a334cc2ac8132e5461ae69d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:36:25.565287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:25.565810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:25.565959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:25.619959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:25.621292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:25.738523 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3733/7427] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:25.753448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:25.755030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:25.779952 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:25.908963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf90a-3dcd-473d-aa2b-5071e81c1b70 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:25.923082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:25.923811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:25.925272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:25.925645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:25.944943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:25.947623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:25.960135 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3695/7428] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:26.439658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:26.442056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:26.470364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b9265-3a8f-48f6-8aac-9b8a758b34ea None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:26.479996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:26.480687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:26.480966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:26.481338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] PATH_INFO: `/v3/projects/e59b2fcab1be4343b209020fedb2fcb0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:26.485860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59b2fcab1be4343b209020fedb2fcb0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:26.489084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:26.636049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59b2fcab1be4343b209020fedb2fcb0', 'request_id': 'req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.651845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59b2fcab1be4343b209020fedb2fcb0', 'request_id': 'req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.668412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59b2fcab1be4343b209020fedb2fcb0', 'request_id': 'req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.688884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] The token cache is being invalidate because project e59b2fcab1be4343b209020fedb2fcb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:36:26.689414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.690276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.692394 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3734/7429] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:36:26 2022] DELETE /identity/v3/projects/e59b2fcab1be4343b209020fedb2fcb0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:26.696963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:26.719332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaae94a-d1ae-4b76-9490-cc75373c772f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:26.820229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:26.821428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:26.821708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:26.821986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] PATH_INFO: `/v3/users/8e8bed22b5ec4fa4aa85651ecc1433fc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:26.823272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8bed22b5ec4fa4aa85651ecc1433fc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:26.825235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:26.895420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8bed22b5ec4fa4aa85651ecc1433fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.896313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8bed22b5ec4fa4aa85651ecc1433fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.897029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8bed22b5ec4fa4aa85651ecc1433fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.906642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8bed22b5ec4fa4aa85651ecc1433fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.929347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-19fc96bf-41db-416c-aecc-b88fc5ce90e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8bed22b5ec4fa4aa85651ecc1433fc'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:26.952677 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3696/7430] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:36:26 2022] DELETE /identity/v3/users/8e8bed22b5ec4fa4aa85651ecc1433fc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:27.315873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:27.317348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:27.346258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f2f5-e6b0-415a-bd20-a1ff61a08c46 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:27.438211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:27.439005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:27.439301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:27.439578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] PATH_INFO: `/v3/projects/7e16db7cf2cb4c2cb6e9d7f012a8adfe` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:27.440802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e16db7cf2cb4c2cb6e9d7f012a8adfe)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:27.442988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:27.462447 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:27.538200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e16db7cf2cb4c2cb6e9d7f012a8adfe', 'request_id': 'req-b41d3762-2ca2-46c2-b236-8ee88a43db21'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:27.545516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e16db7cf2cb4c2cb6e9d7f012a8adfe', 'request_id': 'req-b41d3762-2ca2-46c2-b236-8ee88a43db21'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:27.552353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e16db7cf2cb4c2cb6e9d7f012a8adfe', 'request_id': 'req-b41d3762-2ca2-46c2-b236-8ee88a43db21'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:27.575513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] The token cache is being invalidate because project 7e16db7cf2cb4c2cb6e9d7f012a8adfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:36:27.575984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:27.577266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:27.584822 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3735/7431] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:36:27 2022] DELETE /identity/v3/projects/7e16db7cf2cb4c2cb6e9d7f012a8adfe => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:27.591854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d56538-4f96-4508-967c-f5949e2fd339 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:27.592141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d56538-4f96-4508-967c-f5949e2fd339 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:27.592417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d56538-4f96-4508-967c-f5949e2fd339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:27.643825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:27.647475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:27.662356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-68d56538-4f96-4508-967c-f5949e2fd339 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:27.664646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-68d56538-4f96-4508-967c-f5949e2fd339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:27.710504 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:27.751646 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3697/7432] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:27.758861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bcd54-befc-4ff2-9a52-74a224668efa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:27.759181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bcd54-befc-4ff2-9a52-74a224668efa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:27.759456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bcd54-befc-4ff2-9a52-74a224668efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:27.796598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a20bcd54-befc-4ff2-9a52-74a224668efa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:27.798593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a20bcd54-befc-4ff2-9a52-74a224668efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:27.825624 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3698/7433] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:27.829456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bcd54-befc-4ff2-9a52-74a224668efa None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:27.852907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d3762-2ca2-46c2-b236-8ee88a43db21 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:27.855892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bcd54-befc-4ff2-9a52-74a224668efa None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:27.867429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:27.868189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:27.868473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:27.868748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] PATH_INFO: `/v3/users/d249843907244fa0bf9041a53475d69b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:27.869955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d249843907244fa0bf9041a53475d69b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:27.871900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:27.878405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:27.880501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:27.880865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:27.881177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:27.883851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:36:27.884162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:27.890390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:27.916389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3699/7434] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:36:27.923869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:27.951826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433452a3-7b80-4b16-97ae-74fae9416c56 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:27.959109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:27.960614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:27.960614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:27.960614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:27.962868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:27.966501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:27.992303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd249843907244fa0bf9041a53475d69b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:27.993077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd249843907244fa0bf9041a53475d69b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:27.993717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd249843907244fa0bf9041a53475d69b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.010637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd249843907244fa0bf9041a53475d69b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.015499 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3700/7435] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:27 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:36:28.017319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.019915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:28.024520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-12355571-7858-4c48-a298-93fff0222f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd249843907244fa0bf9041a53475d69b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.048519 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3736/7436] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:36:27 2022] DELETE /identity/v3/users/d249843907244fa0bf9041a53475d69b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:36:28.050713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.050877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.051027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.072673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:28.073959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:28.098823 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:28.115675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9758b-7460-457d-9b46-68a0dee00af1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.177644 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3737/7437] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:28.192567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.194652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:28.208354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:28.209243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.209529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.210564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.212115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:28.214394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:28.245661 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3701/7438] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:28 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:28.249671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.263266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35212-b4cb-4479-a800-f760d143fe63 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.271326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:28.272026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.272307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.272598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.274169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:28.276696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:28.310867 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3702/7439] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:36:28.314880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.327183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58cbdc-0a30-46f5-809a-00e35ab675a2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.332336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:28.333109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.333607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.334705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.334939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:28.337719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:28.347618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45969ff0-e044-499f-b2ee-a5be86df22df None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.351835 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3703/7440] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:28.355071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.356075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489cb03-0ddf-4299-b30f-d471d5d78923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:28.356716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489cb03-0ddf-4299-b30f-d471d5d78923 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.357000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489cb03-0ddf-4299-b30f-d471d5d78923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.357323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489cb03-0ddf-4299-b30f-d471d5d78923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.363223 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:28.368081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc59490-acaa-4233-8b8e-caddaaee148e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.369741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489cb03-0ddf-4299-b30f-d471d5d78923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:28.371735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489cb03-0ddf-4299-b30f-d471d5d78923 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:28.374454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:28.375179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.375962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.376474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] PATH_INFO: `/v3/projects/4c9bc6f49aa14b5a952004ede6a5337b/users/ca1cd5a74b454654bc0aec26f112da34/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.389406 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3738/7441] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:28.396789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9bc6f49aa14b5a952004ede6a5337b, user_id=ca1cd5a74b454654bc0aec26f112da34, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:28.400253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:28.424040 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3704/7442] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:28 2022] PUT /identity/v3/projects/4c9bc6f49aa14b5a952004ede6a5337b/users/ca1cd5a74b454654bc0aec26f112da34/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:36:28.437196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.437589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.437948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.477669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] MFA Rules not processed for user `ca1cd5a74b454654bc0aec26f112da34`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:28.480849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:28.606419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3739/7443] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:28.611055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.649912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.654043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:28.716300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48a4ea-8e6e-4395-9b55-7cf08235a3f2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.723331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:28.723957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.724894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.725212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.725860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:28.728264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:28.736062 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:28.760212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2fe3-7a12-4045-a965-18345d9151a0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.766988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:28.767638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.767918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.768192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] PATH_INFO: `/v3/projects/4a63c16dd17d43b1b3774717b724c201` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.769381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a63c16dd17d43b1b3774717b724c201)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:28.771482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:28.776303 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3705/7444] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:28 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:36:28.782073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:28.861589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a63c16dd17d43b1b3774717b724c201', 'request_id': 'req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.879719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a63c16dd17d43b1b3774717b724c201', 'request_id': 'req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.889108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a63c16dd17d43b1b3774717b724c201', 'request_id': 'req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.889629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415aeb5-45c5-4ee5-9d70-a8286db8d7c7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:28.912429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] The token cache is being invalidate because project 4a63c16dd17d43b1b3774717b724c201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:36:28.912721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.913481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e138bbe-a13d-40af-aa9a-8a561c9bfaad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:28.918425 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3740/7445] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:36:28 2022] DELETE /identity/v3/projects/4a63c16dd17d43b1b3774717b724c201 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:28.921362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970baa6-e435-418b-8055-a69baa2ec600 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:28.921680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970baa6-e435-418b-8055-a69baa2ec600 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:28.923236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970baa6-e435-418b-8055-a69baa2ec600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:28.954401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e970baa6-e435-418b-8055-a69baa2ec600 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:28.955654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e970baa6-e435-418b-8055-a69baa2ec600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.063509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.063509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.063509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.063509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.063868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.075966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.104517 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3741/7446] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:29.109676 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3706/7447] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:28 2022] POST /identity/v3/users => generated 295 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:29.112409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007d9c-f9e2-492d-ba81-234898c013fd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.114125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.116111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.117918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007d9c-f9e2-492d-ba81-234898c013fd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.117918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007d9c-f9e2-492d-ba81-234898c013fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.124346 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:29.131015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02b5c-f86a-48ff-8f59-a87a82376c87 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.146621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.146756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.147025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.147297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.147941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.149606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.156610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-21007d9c-f9e2-492d-ba81-234898c013fd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:29.157938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-21007d9c-f9e2-492d-ba81-234898c013fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.161097 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3707/7448] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:29.165088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.167301 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3742/7449] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:29.171253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21007d9c-f9e2-492d-ba81-234898c013fd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.175938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd32b-b912-4f55-a687-7448e6a56792 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.181616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.181926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21007d9c-f9e2-492d-ba81-234898c013fd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.182426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.182864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.183314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] PATH_INFO: `/v3/projects/6d971cac6589402a82d65282f6b67956/users/4abf57f756fa4a7eb38d2b40e6611d22/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.188612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.189280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.189565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.189837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.190480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:36:29.190785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.192400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.201141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d971cac6589402a82d65282f6b67956, user_id=4abf57f756fa4a7eb38d2b40e6611d22, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.204164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.207145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3743/7450] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:36:29.212781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.225816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896562-8c06-44b1-b9c8-79e22508bb22 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.229229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3708/7451] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:29 2022] PUT /identity/v3/projects/6d971cac6589402a82d65282f6b67956/users/4abf57f756fa4a7eb38d2b40e6611d22/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:29.234048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.293113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.293745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.294024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.294298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.294939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.297249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.318742 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:29.320870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909022e-50df-4641-aa58-cd9453ef8516 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.327499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.328467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.328979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.329308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.330137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.332329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.345114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3709/7452] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:29.348332 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3744/7453] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:29 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:36:29.348920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.350045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.359184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327f7b0-f382-4f51-904d-de07d7bdca74 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.422227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f728000-b8fb-40d5-a4da-2fade963b42d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.427022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.427631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.427916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.428734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.428952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.429362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5cdeb-bc5a-467c-a140-ea9d151c70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.430850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5cdeb-bc5a-467c-a140-ea9d151c70a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.431362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5cdeb-bc5a-467c-a140-ea9d151c70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.431484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.432080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5cdeb-bc5a-467c-a140-ea9d151c70a3 admin admin] PATH_INFO: `/v3/projects/6d971cac6589402a82d65282f6b67956/users/4abf57f756fa4a7eb38d2b40e6611d22/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.434307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5cdeb-bc5a-467c-a140-ea9d151c70a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d971cac6589402a82d65282f6b67956, user_id=4abf57f756fa4a7eb38d2b40e6611d22, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.437186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5cdeb-bc5a-467c-a140-ea9d151c70a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.450137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3710/7454] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:29 2022] PUT /identity/v3/projects/6d971cac6589402a82d65282f6b67956/users/4abf57f756fa4a7eb38d2b40e6611d22/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:29.460564 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3745/7455] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:29 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:29.462812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.463168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.463589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.464569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.477836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae677-0951-43a7-9217-4a2edd220b48 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.505248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] MFA Rules not processed for user `4abf57f756fa4a7eb38d2b40e6611d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:29.506898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.556520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.558714 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:29.559374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.560345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.560813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.562082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.564134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.577197 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3746/7456] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:29.581335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.585599 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3711/7457] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:29.598117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.599543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.609390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dedadc-b41a-44b7-9020-aaef2814ddd5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.623338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.624003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.624286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.624562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.625469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.627082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.641780 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3747/7458] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:29.643339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.654661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b733-4879-4f60-abcd-4e6825b3b5d3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.660253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da20239-a0d5-402c-b216-b7ea4393e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.660987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20239-a0d5-402c-b216-b7ea4393e198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.661361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20239-a0d5-402c-b216-b7ea4393e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.661703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da20239-a0d5-402c-b216-b7ea4393e198 admin admin] PATH_INFO: `/v3/projects/a66be3bfaee34c1aa1eacc48bcbcee46/users/6ee8e201bb7a402ca37610e6908dc2f2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.674077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93709f-ba26-4195-884f-9008d9bbb7f9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:29.679799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:29.680546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.680872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.681190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.683053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.683933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da20239-a0d5-402c-b216-b7ea4393e198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66be3bfaee34c1aa1eacc48bcbcee46, user_id=6ee8e201bb7a402ca37610e6908dc2f2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.689383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da20239-a0d5-402c-b216-b7ea4393e198 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.716286 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3748/7459] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:29 2022] PUT /identity/v3/projects/a66be3bfaee34c1aa1eacc48bcbcee46/users/6ee8e201bb7a402ca37610e6908dc2f2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:29.730029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f398b00-a22e-4270-82af-0ef75831ffaf None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:29.730311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f398b00-a22e-4270-82af-0ef75831ffaf None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:29.741124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f398b00-a22e-4270-82af-0ef75831ffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:29.770582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6f398b00-a22e-4270-82af-0ef75831ffaf None None] MFA Rules not processed for user `6ee8e201bb7a402ca37610e6908dc2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:29.772389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6f398b00-a22e-4270-82af-0ef75831ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:29.774819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:29.776626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:29.791410 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3712/7460] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:36:29.830210 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:29.884415 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3749/7461] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:29.905200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:29.906901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:30.004196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f4b5d-7584-4b6e-b2ea-1e8bc9271453 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:30.125686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1e4f5-ac90-4ab3-9a84-a3a73a417315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:30.127086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e4f5-ac90-4ab3-9a84-a3a73a417315 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:30.127364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e4f5-ac90-4ab3-9a84-a3a73a417315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:30.127637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e4f5-ac90-4ab3-9a84-a3a73a417315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:30.152064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1e4f5-ac90-4ab3-9a84-a3a73a417315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:30.156992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1e4f5-ac90-4ab3-9a84-a3a73a417315 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:30.163463 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:30.195646 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3713/7462] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:32.630089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f398b00-a22e-4270-82af-0ef75831ffaf None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:32.704311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f398b00-a22e-4270-82af-0ef75831ffaf None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:32.717249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:32.718563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:32.719225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:32.719678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:32.826268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:32.829924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:32.849339 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3750/7463] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:34.926812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:34.927415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:34.927415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:35.010428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] MFA Rules not processed for user `ea477d27693440a9a41d0aa12db57a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:35.018110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:35.094016 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3714/7464] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:36:35.726966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:35.764946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f085a82-08e8-47ee-abcf-1251455a4a1b service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:35.783076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:35.783816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:35.784099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:35.784466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:35.786366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:35.835100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:35.839962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:35.879108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3751/7465] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:36.666331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:36.667911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:36.786728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e921c-fccf-49f0-ac65-0ff3f431a713 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:36.803603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:36.804262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:36.804823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:36.805211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:36.811655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:36.851414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:36.860379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:36.887653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3715/7466] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:45.865569 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=70 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:46.867732 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=59 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:47.086924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:47.088587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:47.260891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dec7f-70a0-4fed-8170-7c79462ea0d3 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:47.274497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efc0b-8e62-445e-9b0f-dec6a3365178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:47.275424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efc0b-8e62-445e-9b0f-dec6a3365178 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:47.275881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efc0b-8e62-445e-9b0f-dec6a3365178 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:47.276340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efc0b-8e62-445e-9b0f-dec6a3365178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:47.279864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a5efc0b-8e62-445e-9b0f-dec6a3365178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:47.306105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efc0b-8e62-445e-9b0f-dec6a3365178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:47.307764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efc0b-8e62-445e-9b0f-dec6a3365178 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:47.332418 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3752/7467] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:48.335957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:48.598333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6a78-fad3-4e9b-8d33-0ae72248f934 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:48.607582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:48.608398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:48.608842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:48.609199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] PATH_INFO: `/v3/users/ca1cd5a74b454654bc0aec26f112da34` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:48.610723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1cd5a74b454654bc0aec26f112da34)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:48.612779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:48.714559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1cd5a74b454654bc0aec26f112da34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:48.715298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1cd5a74b454654bc0aec26f112da34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:48.716010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1cd5a74b454654bc0aec26f112da34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:48.738529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1cd5a74b454654bc0aec26f112da34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:48.763092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1cd5a74b454654bc0aec26f112da34'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:48.805963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3716/7468] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:36:48 2022] DELETE /identity/v3/users/ca1cd5a74b454654bc0aec26f112da34 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:36:48.807706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:48.808324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:48.808324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:48.868468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:48.869740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:49.115609 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3753/7469] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:49.170690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:49.172298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:49.349166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abd0c5-babf-4d5e-b834-1d775e1b4464 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:49.382247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:49.383578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:49.383820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:49.384100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:49.440065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:49.446730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:49.489863 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3717/7470] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:36:50.470213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:50.476752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:50.516834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42570d13-365b-4761-a733-e5dc91803e33 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:50.536974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:50.542226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:50.542509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:50.545553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] PATH_INFO: `/v3/projects/4c9bc6f49aa14b5a952004ede6a5337b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:50.551140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9bc6f49aa14b5a952004ede6a5337b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:50.560988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:50.781422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9bc6f49aa14b5a952004ede6a5337b', 'request_id': 'req-ffd763b0-428f-4244-bd9d-ef21740f98ad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:50.821201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9bc6f49aa14b5a952004ede6a5337b', 'request_id': 'req-ffd763b0-428f-4244-bd9d-ef21740f98ad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:50.848597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9bc6f49aa14b5a952004ede6a5337b', 'request_id': 'req-ffd763b0-428f-4244-bd9d-ef21740f98ad'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:50.976772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] The token cache is being invalidate because project 4c9bc6f49aa14b5a952004ede6a5337b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:36:50.980615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:50.984611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:50.996179 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3754/7471] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:36:50 2022] DELETE /identity/v3/projects/4c9bc6f49aa14b5a952004ede6a5337b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:50.999856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:51.046466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939308d2-e7a1-4ae9-8d33-c2f48226f601 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:51.120452 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:51.220592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:51.222213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:51.225194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:51.226262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] PATH_INFO: `/v3/users/4abf57f756fa4a7eb38d2b40e6611d22` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:51.237184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abf57f756fa4a7eb38d2b40e6611d22)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:51.243310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:51.369970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abf57f756fa4a7eb38d2b40e6611d22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:51.369970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abf57f756fa4a7eb38d2b40e6611d22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:51.376364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abf57f756fa4a7eb38d2b40e6611d22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:51.403640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abf57f756fa4a7eb38d2b40e6611d22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:51.485315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d3efca0-326b-46b3-9fbd-df7f1c677c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abf57f756fa4a7eb38d2b40e6611d22'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:51.517242 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3718/7472] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:36:50 2022] DELETE /identity/v3/users/4abf57f756fa4a7eb38d2b40e6611d22 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:52.238343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:52.240510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:52.264571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd763b0-428f-4244-bd9d-ef21740f98ad admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:52.276808 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:52.420510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:52.423535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:52.424900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:52.425440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] PATH_INFO: `/v3/projects/6d971cac6589402a82d65282f6b67956` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:52.433037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d971cac6589402a82d65282f6b67956)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:52.439562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:52.611363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d971cac6589402a82d65282f6b67956', 'request_id': 'req-df9f3145-b756-48db-8d4b-38021a3600a3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:52.625761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d971cac6589402a82d65282f6b67956', 'request_id': 'req-df9f3145-b756-48db-8d4b-38021a3600a3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:52.638322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d971cac6589402a82d65282f6b67956', 'request_id': 'req-df9f3145-b756-48db-8d4b-38021a3600a3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:52.680777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] The token cache is being invalidate because project 6d971cac6589402a82d65282f6b67956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:36:52.681118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:52.683396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-df9f3145-b756-48db-8d4b-38021a3600a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:36:52.695674 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3755/7473] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:36:52 2022] DELETE /identity/v3/projects/6d971cac6589402a82d65282f6b67956 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:52.697993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4afd32-c80c-40ff-8a7a-5bdb2f715a99 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:52.698482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4afd32-c80c-40ff-8a7a-5bdb2f715a99 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:52.698647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4afd32-c80c-40ff-8a7a-5bdb2f715a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:52.739901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-af4afd32-c80c-40ff-8a7a-5bdb2f715a99 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:52.740779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-af4afd32-c80c-40ff-8a7a-5bdb2f715a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:52.868255 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3719/7474] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:52.875856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030370-ebff-403b-a9c4-224ba0f0922b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:52.876123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030370-ebff-403b-a9c4-224ba0f0922b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:52.876581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030370-ebff-403b-a9c4-224ba0f0922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:52.915807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2a030370-ebff-403b-a9c4-224ba0f0922b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:52.917029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2a030370-ebff-403b-a9c4-224ba0f0922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:52.936458 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3756/7475] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:52.940919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4afd32-c80c-40ff-8a7a-5bdb2f715a99 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:52.958557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4afd32-c80c-40ff-8a7a-5bdb2f715a99 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:52.967142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:52.967818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:52.968166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:52.968445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:52.972184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:36:52.972699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:52.974697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:53.011181 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3720/7476] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:36:53.013415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030370-ebff-403b-a9c4-224ba0f0922b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:53.031772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030370-ebff-403b-a9c4-224ba0f0922b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:53.037490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:53.038264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:53.038721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:53.039402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:53.045893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:53.046186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:53.110977 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3757/7477] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:53 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:53.122596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:53.139581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3019-432d-4622-88f0-f87c41af0c60 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:53.185360 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:53.230591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:53.231272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:53.231553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:53.231822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:53.232609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:53.235143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:53.264282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3721/7478] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:53 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:53.268388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:53.284130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231438-7db4-4ceb-ba75-c75db3b8e0a5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:53.291042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:53.293256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:53.294267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:53.294267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:53.297179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:53.298383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:53.314699 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3758/7479] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:36:53.316026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:53.330627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a7ae-0c89-41ab-8b09-ca92d53fec7e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:53.338212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad7dc-4430-48be-b21e-1e9d06b52882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:53.341224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad7dc-4430-48be-b21e-1e9d06b52882 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:53.341224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad7dc-4430-48be-b21e-1e9d06b52882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:53.341224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad7dc-4430-48be-b21e-1e9d06b52882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:53.341786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad7dc-4430-48be-b21e-1e9d06b52882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:53.344444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad7dc-4430-48be-b21e-1e9d06b52882 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:53.366082 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3722/7480] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:53.368669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:53.387423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ed046-92dc-4ee0-bd69-30cb44b610d4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:53.400247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:53.400856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:53.403757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:53.404064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] PATH_INFO: `/v3/projects/e6a5d824d7084c248b4f4f0b96992d35/users/5cf2268e677f436ea33a2791f2ca78a7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:53.449625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a5d824d7084c248b4f4f0b96992d35, user_id=5cf2268e677f436ea33a2791f2ca78a7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:53.452738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:53.502573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3759/7481] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:53 2022] PUT /identity/v3/projects/e6a5d824d7084c248b4f4f0b96992d35/users/5cf2268e677f436ea33a2791f2ca78a7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:53.504429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9914c-05ca-40c2-805e-298f60c534b2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:53.504939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9914c-05ca-40c2-805e-298f60c534b2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:53.507273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9914c-05ca-40c2-805e-298f60c534b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:53.580987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f2c9914c-05ca-40c2-805e-298f60c534b2 None None] MFA Rules not processed for user `5cf2268e677f436ea33a2791f2ca78a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:53.583611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f2c9914c-05ca-40c2-805e-298f60c534b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:53.720468 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3723/7482] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:36:53.726589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:53.829169 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:53.901604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62182d58-f036-4c35-8f13-8b0d63d1f90d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:53.908130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:53.908760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:53.909043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:53.909405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:53.910050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:53.911975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:53.969013 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3760/7483] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:36:53 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:36:53.973046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9914c-05ca-40c2-805e-298f60c534b2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:53.990417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9914c-05ca-40c2-805e-298f60c534b2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:54.083145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:54.084577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:54.086822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:54.087590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:54.088627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:54.093546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:54.174136 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3724/7484] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:36:53 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:36:54.175323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:54.191455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91c82-fdbe-4c49-8191-183b70dedd52 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:54.201373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:54.202123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:54.202492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:54.202768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:54.203314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:54.204943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:54.228559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:54.229991 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3761/7485] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:54.252330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f46e8-763f-4763-91c3-35f0bb75de0b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:54.263803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:54.265027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:54.265515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:54.266181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] PATH_INFO: `/v3/projects/53f9203fd4ec41f5accd5458d8ce950c/users/e85b9bc4c77a4dbfbabaa3ea0b4d4f00/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:54.300266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f9203fd4ec41f5accd5458d8ce950c, user_id=e85b9bc4c77a4dbfbabaa3ea0b4d4f00, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:54.306030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:54.344851 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3725/7486] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:54 2022] PUT /identity/v3/projects/53f9203fd4ec41f5accd5458d8ce950c/users/e85b9bc4c77a4dbfbabaa3ea0b4d4f00/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:36:54.349386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:54.360763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3893e8-0e1c-490e-849d-e25ea8e19832 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:54.468176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617029d0-11b6-43ed-ba9f-9ba1630d1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:54.468859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617029d0-11b6-43ed-ba9f-9ba1630d1507 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:54.469166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617029d0-11b6-43ed-ba9f-9ba1630d1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:54.469490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617029d0-11b6-43ed-ba9f-9ba1630d1507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:54.470181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617029d0-11b6-43ed-ba9f-9ba1630d1507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:54.472078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617029d0-11b6-43ed-ba9f-9ba1630d1507 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:54.489119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:54.495870 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:36:54.496065 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3762/7487] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:36:54.505868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57c349-5711-498f-9e36-102cd3e7f817 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:54.518810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:54.519502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:54.519780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:54.520055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] PATH_INFO: `/v3/projects/53f9203fd4ec41f5accd5458d8ce950c/users/e85b9bc4c77a4dbfbabaa3ea0b4d4f00/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:54.525457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f9203fd4ec41f5accd5458d8ce950c, user_id=e85b9bc4c77a4dbfbabaa3ea0b4d4f00, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:54.528379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:54.567888 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3726/7488] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:36:54 2022] PUT /identity/v3/projects/53f9203fd4ec41f5accd5458d8ce950c/users/e85b9bc4c77a4dbfbabaa3ea0b4d4f00/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:36:54.571106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:54.571394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:54.571671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:54.628051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] MFA Rules not processed for user `e85b9bc4c77a4dbfbabaa3ea0b4d4f00`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:36:54.629504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:54.777970 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3763/7489] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:36:54.782744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:36:54.784450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:36:54.895394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46270e3-e004-4aef-b8f5-72ab25817822 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:36:54.900828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb5868-db59-490b-8245-cda52f6bd2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:36:54.901547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb5868-db59-490b-8245-cda52f6bd2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:36:54.901823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb5868-db59-490b-8245-cda52f6bd2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:36:54.902089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb5868-db59-490b-8245-cda52f6bd2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:36:55.011133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb5868-db59-490b-8245-cda52f6bd2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:36:55.011133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb5868-db59-490b-8245-cda52f6bd2f4 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:36:55.023605 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3727/7490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:04.766110 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:05.020116 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:10.715411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:10.718232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:10.926486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68894e-1eae-4691-9ca3-329a827cd221 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:10.937773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:10.938560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:10.938707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:10.938983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] PATH_INFO: `/v3/users/de2b72afbae94fbc8cfac15f04e959fc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:10.943339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2b72afbae94fbc8cfac15f04e959fc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:10.945791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:11.054732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2b72afbae94fbc8cfac15f04e959fc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:11.055759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2b72afbae94fbc8cfac15f04e959fc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:11.057093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2b72afbae94fbc8cfac15f04e959fc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:11.110149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2b72afbae94fbc8cfac15f04e959fc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:11.144870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2b72afbae94fbc8cfac15f04e959fc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:11.181634 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3764/7491] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:10 2022] DELETE /identity/v3/users/de2b72afbae94fbc8cfac15f04e959fc => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:11.190296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:11.190787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:11.190787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:11.243030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:11.258371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:11.393243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3728/7492] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:37:11.402224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:11.404111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:11.624662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732626f4-1543-40b4-bffa-e631aca5b643 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:11.635064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:11.635705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:11.635983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:11.636255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:11.674241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:11.675791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:11.707664 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3765/7493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:13.084308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:13.086533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:13.121657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09546-abfb-4933-b9cd-2f8fb5246043 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:13.135399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:13.139717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:13.140218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:13.140741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] PATH_INFO: `/v3/projects/9502e8a49a3047aab1fdc4b97239f4eb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:13.145047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9502e8a49a3047aab1fdc4b97239f4eb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:13.154311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:13.234847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9502e8a49a3047aab1fdc4b97239f4eb', 'request_id': 'req-88cdbb92-67e6-4ce8-851b-64fe9141565b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.248632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9502e8a49a3047aab1fdc4b97239f4eb', 'request_id': 'req-88cdbb92-67e6-4ce8-851b-64fe9141565b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.268953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9502e8a49a3047aab1fdc4b97239f4eb', 'request_id': 'req-88cdbb92-67e6-4ce8-851b-64fe9141565b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.284246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] The token cache is being invalidate because project 9502e8a49a3047aab1fdc4b97239f4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:13.286102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.290076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.292917 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3729/7494] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:13 2022] DELETE /identity/v3/projects/9502e8a49a3047aab1fdc4b97239f4eb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:13.297981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:13.317344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96554f7-f486-491d-94db-be28ba1a2bb4 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:13.374198 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:13.479697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:13.480357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:13.481010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:13.481325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] PATH_INFO: `/v3/users/3261e9339f6648fea9a2a0bbe628dad2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:13.488874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3261e9339f6648fea9a2a0bbe628dad2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:13.491459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:13.620666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3261e9339f6648fea9a2a0bbe628dad2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.622182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3261e9339f6648fea9a2a0bbe628dad2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.625528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3261e9339f6648fea9a2a0bbe628dad2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.669687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3261e9339f6648fea9a2a0bbe628dad2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.696590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-66d3b44b-f193-4e7a-b0e0-9b92659c109b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3261e9339f6648fea9a2a0bbe628dad2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:13.720525 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3766/7495] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:13 2022] DELETE /identity/v3/users/3261e9339f6648fea9a2a0bbe628dad2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:14.648231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:14.649839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:14.683918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdbb92-67e6-4ce8-851b-64fe9141565b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:14.895928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:14.897729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:14.898203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:14.898482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] PATH_INFO: `/v3/projects/5203940cf5f74571bbad7496c82ba515` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:14.900598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5203940cf5f74571bbad7496c82ba515)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:14.905578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:14.985632 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:15.039930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5203940cf5f74571bbad7496c82ba515', 'request_id': 'req-9c4fa719-398a-4cd2-97e5-f132960c91e3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:15.063405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5203940cf5f74571bbad7496c82ba515', 'request_id': 'req-9c4fa719-398a-4cd2-97e5-f132960c91e3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:15.089542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5203940cf5f74571bbad7496c82ba515', 'request_id': 'req-9c4fa719-398a-4cd2-97e5-f132960c91e3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:15.132227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] The token cache is being invalidate because project 5203940cf5f74571bbad7496c82ba515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:15.132529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:15.138341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9c4fa719-398a-4cd2-97e5-f132960c91e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:15.149893 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3730/7496] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:14 2022] DELETE /identity/v3/projects/5203940cf5f74571bbad7496c82ba515 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:15.155271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d0379-2741-4449-9829-2047b4e7011c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:15.156424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d0379-2741-4449-9829-2047b4e7011c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:15.156914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d0379-2741-4449-9829-2047b4e7011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:15.195047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d96d0379-2741-4449-9829-2047b4e7011c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:15.202191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d96d0379-2741-4449-9829-2047b4e7011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:15.398480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3767/7497] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:15.408376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a65b2-377a-4afc-8b3d-bcbbaad1f580 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:15.408753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a65b2-377a-4afc-8b3d-bcbbaad1f580 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:15.409131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a65b2-377a-4afc-8b3d-bcbbaad1f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:15.480616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b56a65b2-377a-4afc-8b3d-bcbbaad1f580 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:15.481978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b56a65b2-377a-4afc-8b3d-bcbbaad1f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:15.513708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d0379-2741-4449-9829-2047b4e7011c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:15.523389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3731/7498] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:15.562718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d0379-2741-4449-9829-2047b4e7011c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:15.574742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:15.575546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:15.575766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:15.576305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:15.581583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:37:15.582140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:15.583712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:15.622280 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3768/7499] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:37:15.626472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a65b2-377a-4afc-8b3d-bcbbaad1f580 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:15.640775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a65b2-377a-4afc-8b3d-bcbbaad1f580 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:15.653746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:15.654716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:15.655201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:15.655325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:15.656379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:15.660195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:15.746735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:15.766561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:15.816091 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3732/7500] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:37:15 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:15.817781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:15.854113 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:15.986824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741ffcf-3c66-40ae-b268-4d48dd2408d3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:16.016383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e8b1a-7135-4469-af3b-c76e791e0e59 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:16.024956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:16.026203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:16.026836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:16.027280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:16.030184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:16.032703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:16.081084 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3733/7501] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:37:15 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:16.082029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:16.098714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9668-9259-46e8-978b-cde76bf0d2ea admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:16.106800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:16.108468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:16.112306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:16.112581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:16.113514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:16.116293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:16.131877 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3734/7502] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:16.136753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:16.137993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42805fac-18c1-482d-8dfd-873cc32f53d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:16.139589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805fac-18c1-482d-8dfd-873cc32f53d7 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:16.140033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805fac-18c1-482d-8dfd-873cc32f53d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:16.140485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805fac-18c1-482d-8dfd-873cc32f53d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:16.143246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42805fac-18c1-482d-8dfd-873cc32f53d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:16.198084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b3dd4-21e5-4a5a-9b68-b816d14c135b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:16.242650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:16.243683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:16.244389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:16.244847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:16.246272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:16.250000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:16.287438 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3735/7503] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:16.290789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:16.329742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a5c8c-1451-40ae-b485-216c65d32f72 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:16.342343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42805fac-18c1-482d-8dfd-873cc32f53d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:16.345276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:16.349945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:16.350120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42805fac-18c1-482d-8dfd-873cc32f53d7 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:16.350220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:16.350505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] PATH_INFO: `/v3/projects/1fde524c2ea24cfa9eec2a746fa7698d/users/58f26b25bdc6427e841bed5a24ffa694/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:16.377656 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3769/7504] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:37:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:37:16.379204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fde524c2ea24cfa9eec2a746fa7698d, user_id=58f26b25bdc6427e841bed5a24ffa694, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:16.387273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:16.431613 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3736/7505] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:16 2022] PUT /identity/v3/projects/1fde524c2ea24cfa9eec2a746fa7698d/users/58f26b25bdc6427e841bed5a24ffa694/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:16.434915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f2be-c9b0-4196-b31a-27e5c64370d6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:16.435734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f2be-c9b0-4196-b31a-27e5c64370d6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:16.436162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f2be-c9b0-4196-b31a-27e5c64370d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:16.569950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d849f2be-c9b0-4196-b31a-27e5c64370d6 None None] MFA Rules not processed for user `58f26b25bdc6427e841bed5a24ffa694`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:16.575738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d849f2be-c9b0-4196-b31a-27e5c64370d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:16.885445 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3770/7506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:16.890129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:16.996407 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:17.128296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f40ed5-0f70-4300-beaa-841168905e8a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:17.141994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:17.142662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:17.142980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:17.143241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:17.144278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:17.147737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:17.262650 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3737/7507] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:37:16 2022] POST /identity/v3/projects => generated 373 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:17.266998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f2be-c9b0-4196-b31a-27e5c64370d6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:17.284651 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:17.298559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f2be-c9b0-4196-b31a-27e5c64370d6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:17.509936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:17.510572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:17.510853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:17.511121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:17.513540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:17.515768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:17.561053 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3771/7508] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:37:17 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:17.565778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:17.580350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59cedc-f256-48c3-9741-3aa026a46886 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:17.588022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:17.588797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:17.589213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:17.589410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:17.591109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:17.594944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:17.609117 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3738/7509] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:17.612330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:17.623794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092059-09be-4e52-a31e-6f1387b15034 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:17.629132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:17.630107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:17.642717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:17.645398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] PATH_INFO: `/v3/projects/e4322708d9f64567970e1e257d31847f/users/cf992d4fcaac4464ad90bebedc413b6f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:17.685873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4322708d9f64567970e1e257d31847f, user_id=cf992d4fcaac4464ad90bebedc413b6f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:17.690560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:17.720768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3772/7510] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:17 2022] PUT /identity/v3/projects/e4322708d9f64567970e1e257d31847f/users/cf992d4fcaac4464ad90bebedc413b6f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:17.725787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:17.746712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe695e-5ffc-4196-a518-6e6dac95d157 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:17.873459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cce43-29fa-4fa0-a10e-a28580e7f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:17.879050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cce43-29fa-4fa0-a10e-a28580e7f1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:17.880952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cce43-29fa-4fa0-a10e-a28580e7f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:17.882178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cce43-29fa-4fa0-a10e-a28580e7f1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:17.882669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cce43-29fa-4fa0-a10e-a28580e7f1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:17.887798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cce43-29fa-4fa0-a10e-a28580e7f1cf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:17.914125 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3739/7511] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:17.915117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:17.930766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d930e-b70c-41ad-ab05-d717bdb9e3c5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:17.945798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:17.946483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:17.946762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:17.947034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] PATH_INFO: `/v3/projects/e4322708d9f64567970e1e257d31847f/users/cf992d4fcaac4464ad90bebedc413b6f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:17.950237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4322708d9f64567970e1e257d31847f, user_id=cf992d4fcaac4464ad90bebedc413b6f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:17.958941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:18.007152 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3773/7512] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:17 2022] PUT /identity/v3/projects/e4322708d9f64567970e1e257d31847f/users/cf992d4fcaac4464ad90bebedc413b6f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:37:18.016953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f85c-e660-4558-bd3f-5e6e66d07165 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:18.017391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f85c-e660-4558-bd3f-5e6e66d07165 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:18.017731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f85c-e660-4558-bd3f-5e6e66d07165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:18.068514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ef68f85c-e660-4558-bd3f-5e6e66d07165 None None] MFA Rules not processed for user `cf992d4fcaac4464ad90bebedc413b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:18.072583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ef68f85c-e660-4558-bd3f-5e6e66d07165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:18.276831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3740/7513] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:18.348327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:18.350155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:18.502146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4162a73-7c01-4ff6-aa81-d376dc44df15 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:18.524533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301fc50-b1d6-4428-9fa6-ef259d35cd88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:18.525051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fc50-b1d6-4428-9fa6-ef259d35cd88 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:18.525051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fc50-b1d6-4428-9fa6-ef259d35cd88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:18.525287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301fc50-b1d6-4428-9fa6-ef259d35cd88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:18.557025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301fc50-b1d6-4428-9fa6-ef259d35cd88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:18.558489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301fc50-b1d6-4428-9fa6-ef259d35cd88 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:18.578883 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3774/7514] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:19.681243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f85c-e660-4558-bd3f-5e6e66d07165 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:19.782763 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:19.874343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68f85c-e660-4558-bd3f-5e6e66d07165 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:19.888355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:19.889051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:19.889421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:19.889699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] PATH_INFO: `/v3/users/58f26b25bdc6427e841bed5a24ffa694` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:19.891254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f26b25bdc6427e841bed5a24ffa694)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:19.893280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:20.011968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f26b25bdc6427e841bed5a24ffa694'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:20.013187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f26b25bdc6427e841bed5a24ffa694'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:20.015357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f26b25bdc6427e841bed5a24ffa694'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:20.050366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f26b25bdc6427e841bed5a24ffa694'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:20.108844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f26b25bdc6427e841bed5a24ffa694'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:20.158909 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3741/7515] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:19 2022] DELETE /identity/v3/users/58f26b25bdc6427e841bed5a24ffa694 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:20.162157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:20.162157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:20.162157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:20.223808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:20.227375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:20.389282 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:20.421268 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3775/7516] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:20.432264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:20.436858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:20.592343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1da12-f915-4484-b2b8-3d6c2fbf90c8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:20.602902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:20.603551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:20.604494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:20.604800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:20.624953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:20.626418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:20.653199 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3742/7517] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:22.098385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:22.101924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:22.129719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377c218-33d0-4b3f-8883-f4d3e9d6611e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:22.159890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:22.161432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:22.161721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:22.161996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] PATH_INFO: `/v3/projects/1fde524c2ea24cfa9eec2a746fa7698d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:22.171502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fde524c2ea24cfa9eec2a746fa7698d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:22.180864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:22.328584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fde524c2ea24cfa9eec2a746fa7698d', 'request_id': 'req-9bc01393-a2ed-4495-a488-1e515aae38bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.341424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fde524c2ea24cfa9eec2a746fa7698d', 'request_id': 'req-9bc01393-a2ed-4495-a488-1e515aae38bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.358651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fde524c2ea24cfa9eec2a746fa7698d', 'request_id': 'req-9bc01393-a2ed-4495-a488-1e515aae38bd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.386960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] The token cache is being invalidate because project 1fde524c2ea24cfa9eec2a746fa7698d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:22.387255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.388976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.391077 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3776/7518] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:22 2022] DELETE /identity/v3/projects/1fde524c2ea24cfa9eec2a746fa7698d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:22.395080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:22.409561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acc3db-e121-4186-960f-734fad3cb3f7 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:22.475796 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:22.493106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:22.493992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:22.494447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:22.494895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] PATH_INFO: `/v3/users/cf992d4fcaac4464ad90bebedc413b6f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:22.497304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf992d4fcaac4464ad90bebedc413b6f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:22.500008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:22.596668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf992d4fcaac4464ad90bebedc413b6f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.598695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf992d4fcaac4464ad90bebedc413b6f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.600597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf992d4fcaac4464ad90bebedc413b6f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.618503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf992d4fcaac4464ad90bebedc413b6f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.654421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-89d36c44-d38c-433f-91f0-4c2c05dbc841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf992d4fcaac4464ad90bebedc413b6f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:22.690099 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3743/7519] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:22 2022] DELETE /identity/v3/users/cf992d4fcaac4464ad90bebedc413b6f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:23.898544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:23.900317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:23.959004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc01393-a2ed-4495-a488-1e515aae38bd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:24.141255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:24.142338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:24.142843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:24.143561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] PATH_INFO: `/v3/projects/e4322708d9f64567970e1e257d31847f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:24.146171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4322708d9f64567970e1e257d31847f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:24.150027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:24.265372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4322708d9f64567970e1e257d31847f', 'request_id': 'req-6730d243-8e0f-4743-a239-b8f804f869f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:24.281623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4322708d9f64567970e1e257d31847f', 'request_id': 'req-6730d243-8e0f-4743-a239-b8f804f869f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:24.305697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4322708d9f64567970e1e257d31847f', 'request_id': 'req-6730d243-8e0f-4743-a239-b8f804f869f7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:24.344394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] The token cache is being invalidate because project e4322708d9f64567970e1e257d31847f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:24.344693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:24.362926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6730d243-8e0f-4743-a239-b8f804f869f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:24.367316 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3777/7520] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:23 2022] DELETE /identity/v3/projects/e4322708d9f64567970e1e257d31847f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:24.372468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b00d9-eaac-42d7-8ab3-6a1e1a6ededc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:24.372946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b00d9-eaac-42d7-8ab3-6a1e1a6ededc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:24.372946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b00d9-eaac-42d7-8ab3-6a1e1a6ededc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:24.422245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-be0b00d9-eaac-42d7-8ab3-6a1e1a6ededc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:24.423509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-be0b00d9-eaac-42d7-8ab3-6a1e1a6ededc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:24.669303 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3744/7521] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:24.677172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fa7d-4e15-40d2-b454-7afe42428ab9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:24.677476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fa7d-4e15-40d2-b454-7afe42428ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:24.677713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fa7d-4e15-40d2-b454-7afe42428ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:24.717120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-47d2fa7d-4e15-40d2-b454-7afe42428ab9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:24.718963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-47d2fa7d-4e15-40d2-b454-7afe42428ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:24.744646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b00d9-eaac-42d7-8ab3-6a1e1a6ededc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:24.745769 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3778/7522] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:24.755150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b00d9-eaac-42d7-8ab3-6a1e1a6ededc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:24.772552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:24.773084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:24.773356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:24.774036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:24.774326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:37:24.774625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:24.776211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:24.827998 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3745/7523] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:37:24.829966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2fa7d-4e15-40d2-b454-7afe42428ab9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:24.836947 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:24.858392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2fa7d-4e15-40d2-b454-7afe42428ab9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:24.873928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:24.876660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:24.876955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:24.884291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:24.885074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:24.895537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:25.008128 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3779/7524] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:37:24 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:25.012155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:25.023963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1536-5265-4505-abf7-96dfde26051b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:25.211378 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:25.230896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:25.231553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:25.231830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:25.232112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:25.232788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:25.251147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:25.316908 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3746/7525] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:37:25 2022] POST /identity/v3/users => generated 281 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:25.321173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:25.336565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb53e-4a63-449b-a975-a479fa60dc5d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:25.344031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:25.344857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:25.345348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:25.345851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:25.346700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:25.348501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:25.378829 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3780/7526] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:25.383323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:25.416927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efedab0-380c-41ea-917f-abe7f2c4ac30 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:25.443218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930f732-dfd0-4729-ace2-aeaa4d201cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:25.444519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930f732-dfd0-4729-ace2-aeaa4d201cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:25.444806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930f732-dfd0-4729-ace2-aeaa4d201cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:25.445101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930f732-dfd0-4729-ace2-aeaa4d201cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:25.445762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930f732-dfd0-4729-ace2-aeaa4d201cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:25.447363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930f732-dfd0-4729-ace2-aeaa4d201cdd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:25.532085 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3747/7527] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:25.538354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:25.577790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c702-8a12-495c-91d2-dfa74419d5dd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:25.585483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:25.586179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:25.586462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:25.586741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] PATH_INFO: `/v3/projects/97562881d0094d73b6805a627d70cae8/users/5b023eb67c864f85976f1517aa41a380/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:25.609377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=97562881d0094d73b6805a627d70cae8, user_id=5b023eb67c864f85976f1517aa41a380, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:25.613092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:25.640903 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3781/7528] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:25 2022] PUT /identity/v3/projects/97562881d0094d73b6805a627d70cae8/users/5b023eb67c864f85976f1517aa41a380/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:25.652887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2509-90c3-4558-8903-1741c68d401e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:25.653335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2509-90c3-4558-8903-1741c68d401e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:25.653463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2509-90c3-4558-8903-1741c68d401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:25.725672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e90c2509-90c3-4558-8903-1741c68d401e None None] MFA Rules not processed for user `5b023eb67c864f85976f1517aa41a380`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:25.730145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e90c2509-90c3-4558-8903-1741c68d401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:25.991286 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3748/7529] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:25.995859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:26.099510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f7ee-8a3c-4efe-9ed6-646d3c56e8ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:26.107315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:26.108654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:26.109658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:26.110340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:26.112263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:26.119419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:26.188768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3782/7530] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:37:25 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:26.192736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2509-90c3-4558-8903-1741c68d401e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:26.205280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2509-90c3-4558-8903-1741c68d401e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:26.317039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:26.317738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:26.318015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:26.319024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:26.319847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:26.321830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:26.374746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:26.383512 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3749/7531] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:37:26 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:26.389026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513094c-51aa-48b6-9c4f-a22f57f89180 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:26.394492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:26.395409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:26.396030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:26.396426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:26.398044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:26.399861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:26.419947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:26.427567 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3783/7532] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:26.432658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3073-9511-46f4-897f-fcadc3cbb394 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:26.438174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:26.439828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:26.440508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:26.441017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] PATH_INFO: `/v3/projects/7f65ba413d1a4cd997b2d20b3da8252f/users/1d95d2872b76497e9322d80f2f93fe23/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:26.467998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f65ba413d1a4cd997b2d20b3da8252f, user_id=1d95d2872b76497e9322d80f2f93fe23, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:26.476350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:26.510418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:26.511742 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3750/7533] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:26 2022] PUT /identity/v3/projects/7f65ba413d1a4cd997b2d20b3da8252f/users/1d95d2872b76497e9322d80f2f93fe23/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:26.524768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f508d-67a9-4449-9fcd-7908c82b67dd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:26.631711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cb287-c152-4405-9dfa-6996d2bbe829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:26.632348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb287-c152-4405-9dfa-6996d2bbe829 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:26.632942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb287-c152-4405-9dfa-6996d2bbe829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:26.633442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb287-c152-4405-9dfa-6996d2bbe829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:26.634092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cb287-c152-4405-9dfa-6996d2bbe829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:26.635752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cb287-c152-4405-9dfa-6996d2bbe829 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:26.667892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:26.674215 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3784/7534] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:26.679700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891e16-f8da-4fcb-86a6-75cb465c3d5a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:26.684861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:26.685578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:26.685859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:26.686133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] PATH_INFO: `/v3/projects/7f65ba413d1a4cd997b2d20b3da8252f/users/1d95d2872b76497e9322d80f2f93fe23/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:26.688277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f65ba413d1a4cd997b2d20b3da8252f, user_id=1d95d2872b76497e9322d80f2f93fe23, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:26.691115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:26.716423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3783-ca3f-4b29-93bd-ac9e712b3a0c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:26.716669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3783-ca3f-4b29-93bd-ac9e712b3a0c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:26.716948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3783-ca3f-4b29-93bd-ac9e712b3a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:26.719948 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3751/7535] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:26 2022] PUT /identity/v3/projects/7f65ba413d1a4cd997b2d20b3da8252f/users/1d95d2872b76497e9322d80f2f93fe23/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:37:26.758439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-071e3783-ca3f-4b29-93bd-ac9e712b3a0c None None] MFA Rules not processed for user `1d95d2872b76497e9322d80f2f93fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:26.760013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-071e3783-ca3f-4b29-93bd-ac9e712b3a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:26.767489 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:26.880123 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3785/7536] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:26.950770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:26.956460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:26.988201 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:27.081933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320206e-1368-455f-a18b-5ea026df3032 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:27.096475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe693f-fd6b-46e5-b370-a461feecf26f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:27.097370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe693f-fd6b-46e5-b370-a461feecf26f service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:27.097902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe693f-fd6b-46e5-b370-a461feecf26f service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:27.098378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe693f-fd6b-46e5-b370-a461feecf26f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:27.111705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe693f-fd6b-46e5-b370-a461feecf26f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:27.114201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe693f-fd6b-46e5-b370-a461feecf26f service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:27.127700 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3752/7537] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:27.857799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3783-ca3f-4b29-93bd-ac9e712b3a0c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:27.992010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3783-ca3f-4b29-93bd-ac9e712b3a0c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:27.998816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:27.999639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:27.999918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:28.000350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] PATH_INFO: `/v3/users/5b023eb67c864f85976f1517aa41a380` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:28.002154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b023eb67c864f85976f1517aa41a380)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:28.004103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:28.097934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b023eb67c864f85976f1517aa41a380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:28.098867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b023eb67c864f85976f1517aa41a380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:28.100314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b023eb67c864f85976f1517aa41a380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:28.131379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b023eb67c864f85976f1517aa41a380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:28.152806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b023eb67c864f85976f1517aa41a380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:28.189269 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3786/7538] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:27 2022] DELETE /identity/v3/users/5b023eb67c864f85976f1517aa41a380 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:28.189810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:28.190273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:28.190365 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:28.228765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:28.230495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:28.374327 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3753/7539] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:37:28.402726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:28.404170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:28.486319 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:28.580749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c183b7-29fb-441f-880d-52a944270f4f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:28.585638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:28.586324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:28.586602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:28.586874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:28.608574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:28.610103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:28.634642 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3787/7540] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:29.347484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:29.348956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:29.375445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60779-465e-49e2-9f68-1797c3eb509e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:29.389693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:29.390359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:29.390644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:29.390920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] PATH_INFO: `/v3/projects/97562881d0094d73b6805a627d70cae8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:29.392083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97562881d0094d73b6805a627d70cae8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:29.394029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:29.499329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97562881d0094d73b6805a627d70cae8', 'request_id': 'req-d36475c0-7bf1-4f66-8a93-c8f94587d04f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.525397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97562881d0094d73b6805a627d70cae8', 'request_id': 'req-d36475c0-7bf1-4f66-8a93-c8f94587d04f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.558671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97562881d0094d73b6805a627d70cae8', 'request_id': 'req-d36475c0-7bf1-4f66-8a93-c8f94587d04f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.574341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] The token cache is being invalidate because project 97562881d0094d73b6805a627d70cae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:29.574580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.575246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.577176 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3754/7541] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:29 2022] DELETE /identity/v3/projects/97562881d0094d73b6805a627d70cae8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:29.580841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:29.592395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6493fc-0eb7-4b4c-be26-f30a69382166 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:29.658367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:29.659164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:29.659551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:29.659939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] PATH_INFO: `/v3/users/1d95d2872b76497e9322d80f2f93fe23` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:29.661222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d95d2872b76497e9322d80f2f93fe23)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:29.663848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:29.720724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d95d2872b76497e9322d80f2f93fe23'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.721686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d95d2872b76497e9322d80f2f93fe23'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.722685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d95d2872b76497e9322d80f2f93fe23'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.758777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d95d2872b76497e9322d80f2f93fe23'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.767968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4c125e74-561f-4f4a-9e6a-8b7a880f17a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d95d2872b76497e9322d80f2f93fe23'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:29.790493 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3788/7542] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:29 2022] DELETE /identity/v3/users/1d95d2872b76497e9322d80f2f93fe23 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:37:30.460612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:30.466132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:30.503382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36475c0-7bf1-4f66-8a93-c8f94587d04f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:30.657525 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:30.708698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:30.711026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:30.712649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:30.713236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] PATH_INFO: `/v3/projects/7f65ba413d1a4cd997b2d20b3da8252f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:30.714592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f65ba413d1a4cd997b2d20b3da8252f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:30.716868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:30.870899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f65ba413d1a4cd997b2d20b3da8252f', 'request_id': 'req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:30.890958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f65ba413d1a4cd997b2d20b3da8252f', 'request_id': 'req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:30.908378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f65ba413d1a4cd997b2d20b3da8252f', 'request_id': 'req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:30.947179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] The token cache is being invalidate because project 7f65ba413d1a4cd997b2d20b3da8252f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:30.949383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:30.954154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6d0bfc4e-5fb9-4dae-9cc1-a749544a970a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:30.956593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3755/7543] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:30 2022] DELETE /identity/v3/projects/7f65ba413d1a4cd997b2d20b3da8252f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:37:30.962941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387b520-7299-4979-81f1-40ba460d50e0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:30.963474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387b520-7299-4979-81f1-40ba460d50e0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:30.963474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387b520-7299-4979-81f1-40ba460d50e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:31.035158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7387b520-7299-4979-81f1-40ba460d50e0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:31.040385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7387b520-7299-4979-81f1-40ba460d50e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:31.210472 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:31.284879 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3789/7544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:31.286754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bbdae-1672-4587-96c3-f0f87f44bba6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:31.287173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bbdae-1672-4587-96c3-f0f87f44bba6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:31.287464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bbdae-1672-4587-96c3-f0f87f44bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:31.352278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ce6bbdae-1672-4587-96c3-f0f87f44bba6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:31.353715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ce6bbdae-1672-4587-96c3-f0f87f44bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:31.373748 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3756/7545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:31.377451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387b520-7299-4979-81f1-40ba460d50e0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:31.389820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387b520-7299-4979-81f1-40ba460d50e0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:31.406998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:31.409978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:31.410363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:31.411168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:31.414601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:37:31.416424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:31.420762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:31.475568 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3790/7546] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:37:31.479101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bbdae-1672-4587-96c3-f0f87f44bba6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:31.498819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bbdae-1672-4587-96c3-f0f87f44bba6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:31.535626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:31.536460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:31.537380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:31.545254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:31.546296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:31.548371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:31.636512 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3757/7547] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:37:31 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:37:31.640330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:31.683256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f55c64-5d43-40b7-80c6-b3d51cb97f48 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:31.901324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:31.902104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:31.902652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:31.902932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:31.903581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:31.905578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:31.967208 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3791/7548] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:37:31 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:31.968168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:31.981967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd1326-532d-4ced-a019-7cb288a50a23 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:31.986773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:31.987382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:31.987663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:31.987937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:31.988855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:31.990990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:32.005007 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3758/7549] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:37:32.007032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:32.020362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e8fe3-dd1b-442d-af34-28356d142c77 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:32.025580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6f722-5191-403c-97bc-f6a92486ded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:32.026482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f722-5191-403c-97bc-f6a92486ded0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:32.026980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f722-5191-403c-97bc-f6a92486ded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:32.028048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6f722-5191-403c-97bc-f6a92486ded0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:32.028920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6f722-5191-403c-97bc-f6a92486ded0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:32.030752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6f722-5191-403c-97bc-f6a92486ded0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:32.047073 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3792/7550] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:32.050705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:32.062343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f4d9-3bda-4d9c-b221-7ce6cf55df78 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:32.067390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:32.069740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:32.070293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:32.070795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] PATH_INFO: `/v3/projects/d7e32abb99e64b04bfb7660d2ff692b5/users/925365d5e0db4a6f92bb3c3e7f24f114/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:32.091148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e32abb99e64b04bfb7660d2ff692b5, user_id=925365d5e0db4a6f92bb3c3e7f24f114, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:32.094687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:32.113832 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3759/7551] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:32 2022] PUT /identity/v3/projects/d7e32abb99e64b04bfb7660d2ff692b5/users/925365d5e0db4a6f92bb3c3e7f24f114/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:37:32.124636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59977768-2926-4db1-af80-f0e6db934a94 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:32.125333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59977768-2926-4db1-af80-f0e6db934a94 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:32.125902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59977768-2926-4db1-af80-f0e6db934a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:32.170495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-59977768-2926-4db1-af80-f0e6db934a94 None None] MFA Rules not processed for user `925365d5e0db4a6f92bb3c3e7f24f114`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:32.172997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59977768-2926-4db1-af80-f0e6db934a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:32.404952 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3793/7552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:32.408482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:32.648337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81b306-abc3-46b0-81ef-e552da8e65d8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:32.669845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:32.670725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:32.671000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:32.671267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:32.673045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:32.679266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:32.704914 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:32.743031 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3760/7553] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:37:32 2022] POST /identity/v3/projects => generated 383 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:32.747128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59977768-2926-4db1-af80-f0e6db934a94 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:32.767024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59977768-2926-4db1-af80-f0e6db934a94 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:32.898799 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:32.945719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:32.947201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:32.947201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:32.947491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:32.948142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:32.956526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:33.010350 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3794/7554] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:37:32 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:37:33.011228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:33.036436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9409e43-3057-4e35-be21-01c9e1e3f58d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:33.066231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:33.070949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:33.071705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:33.072319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:33.075954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:33.081215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:33.103782 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3761/7555] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:33.108193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:33.126634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45423c4d-a66e-4bd2-a14e-723dfd85283c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:33.135168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:33.136093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:33.136554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:33.136922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] PATH_INFO: `/v3/projects/c88ec16020674476837be0994208db77/users/9b2ee098543e45a5bbaea51c5513a17e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:33.204163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88ec16020674476837be0994208db77, user_id=9b2ee098543e45a5bbaea51c5513a17e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:33.208407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:33.239126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:33.246076 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3795/7556] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:33 2022] PUT /identity/v3/projects/c88ec16020674476837be0994208db77/users/9b2ee098543e45a5bbaea51c5513a17e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:33.252452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf025ff-ce70-4a5a-a632-fd2b0d17741a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:33.493541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18812e75-0a40-4128-9ce9-377fa8e10733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:33.494603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18812e75-0a40-4128-9ce9-377fa8e10733 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:33.494756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18812e75-0a40-4128-9ce9-377fa8e10733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:33.495438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18812e75-0a40-4128-9ce9-377fa8e10733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:33.497456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18812e75-0a40-4128-9ce9-377fa8e10733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:33.503817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18812e75-0a40-4128-9ce9-377fa8e10733 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:33.553941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3762/7557] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:37:33.560999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:33.582082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b942f2-7c9a-4158-9ba6-78250fd7fd46 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:33.590175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:33.591077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:33.591357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:33.591629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] PATH_INFO: `/v3/projects/c88ec16020674476837be0994208db77/users/9b2ee098543e45a5bbaea51c5513a17e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:33.594138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88ec16020674476837be0994208db77, user_id=9b2ee098543e45a5bbaea51c5513a17e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:33.603195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:33.658022 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3796/7558] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:37:33 2022] PUT /identity/v3/projects/c88ec16020674476837be0994208db77/users/9b2ee098543e45a5bbaea51c5513a17e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:33.658351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a0d5-2016-4b56-9d2e-a26661fe26fe None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:33.658850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a0d5-2016-4b56-9d2e-a26661fe26fe None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:33.659611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a0d5-2016-4b56-9d2e-a26661fe26fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:33.741595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0931a0d5-2016-4b56-9d2e-a26661fe26fe None None] MFA Rules not processed for user `9b2ee098543e45a5bbaea51c5513a17e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:33.742818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0931a0d5-2016-4b56-9d2e-a26661fe26fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:33.934185 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3763/7559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:33.938231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:33.942698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:34.108365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264b446-a851-4377-a293-fe9a88cd89ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:34.118661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:34.119718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:34.119995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:34.120265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:34.348467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:34.350573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:34.371111 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3797/7560] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:37:42.254054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a0d5-2016-4b56-9d2e-a26661fe26fe None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:42.274314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a0d5-2016-4b56-9d2e-a26661fe26fe None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:42.280181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:42.281113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:42.282288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:42.286355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:42.342789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:42.344535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:42.371215 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3764/7561] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:44.357349 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:52.353183 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:55.326451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:55.328169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:55.428067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b034-fd29-4060-a5ad-387f88a8b50a service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:55.433849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af259b-62b3-4d26-988d-4b69b758246b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:55.434495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af259b-62b3-4d26-988d-4b69b758246b service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:55.434961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af259b-62b3-4d26-988d-4b69b758246b service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:55.435245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af259b-62b3-4d26-988d-4b69b758246b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:55.437749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-14af259b-62b3-4d26-988d-4b69b758246b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:55.559725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:55.712301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af259b-62b3-4d26-988d-4b69b758246b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:55.716789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af259b-62b3-4d26-988d-4b69b758246b service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:55.736699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f940c-f499-4f20-bf44-e6b47d79112d service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:55.743381 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3798/7562] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:37:55.758531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:55.759755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:55.760253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:55.760735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] PATH_INFO: `/v3/users/925365d5e0db4a6f92bb3c3e7f24f114` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:55.762188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=925365d5e0db4a6f92bb3c3e7f24f114)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:55.764383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:55.866179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925365d5e0db4a6f92bb3c3e7f24f114'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:55.868150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925365d5e0db4a6f92bb3c3e7f24f114'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:55.869826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925365d5e0db4a6f92bb3c3e7f24f114'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:55.889642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925365d5e0db4a6f92bb3c3e7f24f114'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:55.923301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925365d5e0db4a6f92bb3c3e7f24f114'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:55.948265 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3765/7563] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:55 2022] DELETE /identity/v3/users/925365d5e0db4a6f92bb3c3e7f24f114 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:55.955292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:55.955632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:55.957647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:56.035568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:56.042887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:56.219048 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3799/7564] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:56.225661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:56.227383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:56.374154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43885f0-936c-4b68-a523-73488ceae44f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:56.386696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:56.388250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:56.389147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:56.389147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:56.419326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:56.423691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:56.447085 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3766/7565] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:37:58.021489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:58.023346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:58.054857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d7516-76f1-456c-8044-fb58c4adbe19 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:58.060076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:58.060746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:58.061025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:58.061331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] PATH_INFO: `/v3/users/5551cca8143b455b822d283fb00d1932` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:58.062506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5551cca8143b455b822d283fb00d1932)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:58.068329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:58.069654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:58.071798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:58.096472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09c18f-b7af-4c2b-9bd5-d79d1742ce4e service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:58.109688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:58.110342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:58.110628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:58.113608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] PATH_INFO: `/v3/projects/d7e32abb99e64b04bfb7660d2ff692b5` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:58.119362 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e32abb99e64b04bfb7660d2ff692b5)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:58.126727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:58.178752 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:58.183706 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:58.188384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5551cca8143b455b822d283fb00d1932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.191131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5551cca8143b455b822d283fb00d1932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.191821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5551cca8143b455b822d283fb00d1932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.234763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5551cca8143b455b822d283fb00d1932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.262901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5551cca8143b455b822d283fb00d1932'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.277304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e32abb99e64b04bfb7660d2ff692b5', 'request_id': 'req-bc878e2e-a927-42e3-9701-e0dd81fd78b5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.306108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3800/7566] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:58 2022] DELETE /identity/v3/users/5551cca8143b455b822d283fb00d1932 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:58.307517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e32abb99e64b04bfb7660d2ff692b5', 'request_id': 'req-bc878e2e-a927-42e3-9701-e0dd81fd78b5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.323468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e32abb99e64b04bfb7660d2ff692b5', 'request_id': 'req-bc878e2e-a927-42e3-9701-e0dd81fd78b5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.355488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] The token cache is being invalidate because project d7e32abb99e64b04bfb7660d2ff692b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:58.355869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.366455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.367106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:58.372237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:58.375970 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3767/7567] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:58 2022] DELETE /identity/v3/projects/d7e32abb99e64b04bfb7660d2ff692b5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:37:58.517317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532128d8-2255-4243-9c75-9c25f599d551 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:58.566745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:58.567929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:58.568287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:58.568498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] PATH_INFO: `/v3/users/9b2ee098543e45a5bbaea51c5513a17e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:58.575276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2ee098543e45a5bbaea51c5513a17e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:58.577276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:58.691136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2ee098543e45a5bbaea51c5513a17e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.691932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2ee098543e45a5bbaea51c5513a17e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.692650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2ee098543e45a5bbaea51c5513a17e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.717331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2ee098543e45a5bbaea51c5513a17e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.730459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2ee098543e45a5bbaea51c5513a17e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:58.768719 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3801/7568] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:37:58 2022] DELETE /identity/v3/users/9b2ee098543e45a5bbaea51c5513a17e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:58.895852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:58.899160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:59.182149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc878e2e-a927-42e3-9701-e0dd81fd78b5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:59.285186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:59.285961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:59.286392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:59.286827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] PATH_INFO: `/v3/projects/98cae0ff69b24b24b3dca3708d04c53f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:59.288181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cae0ff69b24b24b3dca3708d04c53f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:59.290460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:59.317051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:37:59.320156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:59.364098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b9d7-b258-45c0-aae8-3a1174c292d2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:37:59.396302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cae0ff69b24b24b3dca3708d04c53f', 'request_id': 'req-f2548a72-7337-4e2f-8e22-85be970717e2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.421583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cae0ff69b24b24b3dca3708d04c53f', 'request_id': 'req-f2548a72-7337-4e2f-8e22-85be970717e2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.426445 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:59.445912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cae0ff69b24b24b3dca3708d04c53f', 'request_id': 'req-f2548a72-7337-4e2f-8e22-85be970717e2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.452861 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:37:59.466248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] The token cache is being invalidate because project 98cae0ff69b24b24b3dca3708d04c53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:59.467720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.471024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f2548a72-7337-4e2f-8e22-85be970717e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.475033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3768/7569] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:58 2022] DELETE /identity/v3/projects/98cae0ff69b24b24b3dca3708d04c53f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:59.532692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:37:59.540238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:59.540519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:59.540791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] PATH_INFO: `/v3/projects/c88ec16020674476837be0994208db77` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:59.549035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88ec16020674476837be0994208db77)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:37:59.551532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:37:59.681678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88ec16020674476837be0994208db77', 'request_id': 'req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.706001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88ec16020674476837be0994208db77', 'request_id': 'req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.726517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88ec16020674476837be0994208db77', 'request_id': 'req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.759720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] The token cache is being invalidate because project c88ec16020674476837be0994208db77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:37:59.761398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.764676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d67fde59-e44e-4995-b9c3-9f82d14d1ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:37:59.772612 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3802/7570] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:37:59 2022] DELETE /identity/v3/projects/c88ec16020674476837be0994208db77 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:37:59.774818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6f51-029e-41ca-a5e6-804265fdcbd9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:59.775104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6f51-029e-41ca-a5e6-804265fdcbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:59.775450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6f51-029e-41ca-a5e6-804265fdcbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:37:59.814460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-528f6f51-029e-41ca-a5e6-804265fdcbd9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:37:59.817781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-528f6f51-029e-41ca-a5e6-804265fdcbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:37:59.963098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3769/7571] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:37:59.966892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7388111-0319-46f9-ae57-51a51501cb67 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:37:59.967501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7388111-0319-46f9-ae57-51a51501cb67 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:37:59.967885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7388111-0319-46f9-ae57-51a51501cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.015668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f7388111-0319-46f9-ae57-51a51501cb67 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:00.017344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f7388111-0319-46f9-ae57-51a51501cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:00.038721 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3803/7572] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:00.042899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f6f51-029e-41ca-a5e6-804265fdcbd9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:00.053489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f6f51-029e-41ca-a5e6-804265fdcbd9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:00.059252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:00.061187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.061187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.061187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.061716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:00.062119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:00.063811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:00.086479 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3770/7573] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:00.087961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7388111-0319-46f9-ae57-51a51501cb67 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:00.103049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7388111-0319-46f9-ae57-51a51501cb67 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:00.114364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:00.117427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.118936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.119408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.120162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:00.123900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:00.174445 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3804/7574] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:00 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:00.175698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:00.194051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07092939-d6eb-4a47-b81b-81a63781b682 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:00.305521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:00.306118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.306393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.306661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.307456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:00.309725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:00.344887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3771/7575] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:00 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:00.348241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:00.359371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b33b-04cb-4714-bce0-6ebdd45b0733 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:00.372380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:00.373015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.373316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.373586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.374235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:00.376228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:00.401367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:00.401914 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3805/7576] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:00.422717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9b0f-5959-4701-81ce-d152131fab6d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:00.430414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34ba3-3fcf-47b6-a0b1-2b1d9de41198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:00.431275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34ba3-3fcf-47b6-a0b1-2b1d9de41198 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.431742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34ba3-3fcf-47b6-a0b1-2b1d9de41198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.432416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34ba3-3fcf-47b6-a0b1-2b1d9de41198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.436961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34ba3-3fcf-47b6-a0b1-2b1d9de41198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:00.439331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34ba3-3fcf-47b6-a0b1-2b1d9de41198 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:00.455020 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3772/7577] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:00.459505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:00.509468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc2730-51e8-4093-9262-e5a867edf580 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:00.532873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:00.533870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.534424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.535052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] PATH_INFO: `/v3/projects/c077007f5c3f4e749ff69678a505f28d/users/86918b069e5d42ca9b71d1bf61f9adca/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.607569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c077007f5c3f4e749ff69678a505f28d, user_id=86918b069e5d42ca9b71d1bf61f9adca, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:00.610337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:00.649049 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3806/7578] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:00 2022] PUT /identity/v3/projects/c077007f5c3f4e749ff69678a505f28d/users/86918b069e5d42ca9b71d1bf61f9adca/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:00.661039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab7cd-5617-487f-a684-769387ee98bb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.661414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab7cd-5617-487f-a684-769387ee98bb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.661709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab7cd-5617-487f-a684-769387ee98bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.707331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-166ab7cd-5617-487f-a684-769387ee98bb None None] MFA Rules not processed for user `86918b069e5d42ca9b71d1bf61f9adca`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:00.709347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-166ab7cd-5617-487f-a684-769387ee98bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:00.768673 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:00.822330 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3773/7579] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:00.826454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:00.976019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0148378-905a-4e05-95c3-7441d62648ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:00.993794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:00.996020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:00.996308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:00.997437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:00.998263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:01.000903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:01.055134 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:01.078886 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3807/7580] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:00 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:01.082842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab7cd-5617-487f-a684-769387ee98bb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:01.129787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab7cd-5617-487f-a684-769387ee98bb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:01.239179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:01.240795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:01.241376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:01.241666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:01.242477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:01.245699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:01.284662 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3774/7581] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:01 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:01.292624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:01.320781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de36747-e6bc-4d89-b1fa-958c9a72af57 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:01.346981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:01.349785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:01.351456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:01.351903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:01.353745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:01.359660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:01.386278 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3808/7582] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:01.392666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:01.418142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef9242-c71b-414a-be89-7c3646e723ab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:01.424539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:01.425643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:01.425937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:01.426213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] PATH_INFO: `/v3/projects/a3009d77d3b146158a48ac86c5db36cc/users/27c2a3eb09cf42b89d155a3c37d766f9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:01.467182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3009d77d3b146158a48ac86c5db36cc, user_id=27c2a3eb09cf42b89d155a3c37d766f9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:01.470007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:01.497624 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3775/7583] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:01 2022] PUT /identity/v3/projects/a3009d77d3b146158a48ac86c5db36cc/users/27c2a3eb09cf42b89d155a3c37d766f9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:01.503065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:01.529036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4acf7-35ff-4e1e-b4c3-666f940b5f6b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:01.646933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ecbd1-6a73-4d85-bd6c-9fa4ef615e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:01.647640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ecbd1-6a73-4d85-bd6c-9fa4ef615e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:01.648080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ecbd1-6a73-4d85-bd6c-9fa4ef615e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:01.648422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ecbd1-6a73-4d85-bd6c-9fa4ef615e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:01.650526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ecbd1-6a73-4d85-bd6c-9fa4ef615e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:01.654159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ecbd1-6a73-4d85-bd6c-9fa4ef615e33 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:01.692219 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3809/7584] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:01.710374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:01.727814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b6ea5-51b3-4beb-b747-b40abff2613e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:01.741414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:01.742110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:01.744039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:01.744039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] PATH_INFO: `/v3/projects/a3009d77d3b146158a48ac86c5db36cc/users/27c2a3eb09cf42b89d155a3c37d766f9/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:01.748098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3009d77d3b146158a48ac86c5db36cc, user_id=27c2a3eb09cf42b89d155a3c37d766f9, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:01.756344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:01.780858 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3776/7585] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:01 2022] PUT /identity/v3/projects/a3009d77d3b146158a48ac86c5db36cc/users/27c2a3eb09cf42b89d155a3c37d766f9/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:01.791438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:01.791770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:01.792055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:01.857621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] MFA Rules not processed for user `27c2a3eb09cf42b89d155a3c37d766f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:01.860780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:02.018409 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3810/7586] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:02.030383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:02.032458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:02.126721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d0ea-8e9c-4121-8c68-782da1ce42c1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:02.130926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7796d9-e574-447c-a96f-5f7353ef2677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:02.131669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7796d9-e574-447c-a96f-5f7353ef2677 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:02.132794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7796d9-e574-447c-a96f-5f7353ef2677 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:02.133101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7796d9-e574-447c-a96f-5f7353ef2677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:02.201322 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:02.220798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7796d9-e574-447c-a96f-5f7353ef2677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:02.222307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7796d9-e574-447c-a96f-5f7353ef2677 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:02.232989 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3777/7587] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:02.529367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:02.530836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:02.644194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a141a77-2405-460c-94e4-ec5e83802689 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:02.651463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:02.651784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:02.652071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:02.652344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] PATH_INFO: `/v3/users/6ee8e201bb7a402ca37610e6908dc2f2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:02.653961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee8e201bb7a402ca37610e6908dc2f2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:02.656023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:02.686165 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:02.780719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee8e201bb7a402ca37610e6908dc2f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:02.781454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee8e201bb7a402ca37610e6908dc2f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:02.782366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee8e201bb7a402ca37610e6908dc2f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:02.826329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee8e201bb7a402ca37610e6908dc2f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:02.837411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee8e201bb7a402ca37610e6908dc2f2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:02.862755 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3811/7588] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:02 2022] DELETE /identity/v3/users/6ee8e201bb7a402ca37610e6908dc2f2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:02.864469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:02.865009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:02.865251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:02.891597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:02.892847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:02.966032 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3778/7589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:02.976191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:02.984696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:03.073852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d1e54-2cce-4b36-bdf1-24b35e934cbd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:03.078160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a0a5e-07a9-47e5-bd2d-95a64a234e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:03.078877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0a5e-07a9-47e5-bd2d-95a64a234e2e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.079340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0a5e-07a9-47e5-bd2d-95a64a234e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.079694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0a5e-07a9-47e5-bd2d-95a64a234e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.091735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a0a5e-07a9-47e5-bd2d-95a64a234e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:03.093355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a0a5e-07a9-47e5-bd2d-95a64a234e2e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:03.105672 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3812/7590] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:03.316101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:03.319127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:03.342832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d08c88-8f03-44d3-aa0a-a5bba0a18a4c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:03.352609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:03.353958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.354556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.357553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] PATH_INFO: `/v3/projects/a66be3bfaee34c1aa1eacc48bcbcee46` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.359325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66be3bfaee34c1aa1eacc48bcbcee46)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:03.362196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:03.445381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66be3bfaee34c1aa1eacc48bcbcee46', 'request_id': 'req-cd320db2-78e5-4744-9c23-1a151f098d1c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:03.454131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66be3bfaee34c1aa1eacc48bcbcee46', 'request_id': 'req-cd320db2-78e5-4744-9c23-1a151f098d1c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:03.465454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66be3bfaee34c1aa1eacc48bcbcee46', 'request_id': 'req-cd320db2-78e5-4744-9c23-1a151f098d1c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:03.481149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] The token cache is being invalidate because project a66be3bfaee34c1aa1eacc48bcbcee46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:03.481575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:03.482340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cd320db2-78e5-4744-9c23-1a151f098d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:03.490358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0c6c-716d-48a0-8eaf-017f60941bf2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.491042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0c6c-716d-48a0-8eaf-017f60941bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.491422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0c6c-716d-48a0-8eaf-017f60941bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.494256 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3779/7591] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:03 2022] DELETE /identity/v3/projects/a66be3bfaee34c1aa1eacc48bcbcee46 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:03.542432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-840c0c6c-716d-48a0-8eaf-017f60941bf2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:03.543783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-840c0c6c-716d-48a0-8eaf-017f60941bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:03.617718 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3813/7592] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:03.625723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cdd94-50df-4627-b207-32d29665469a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.626252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cdd94-50df-4627-b207-32d29665469a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.626698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cdd94-50df-4627-b207-32d29665469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.648078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0d8cdd94-50df-4627-b207-32d29665469a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:03.649366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0d8cdd94-50df-4627-b207-32d29665469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:03.657945 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3780/7593] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:03.662935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c0c6c-716d-48a0-8eaf-017f60941bf2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:03.673241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c0c6c-716d-48a0-8eaf-017f60941bf2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:03.678348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:03.679060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.679439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.679810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.680565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:03.680956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:03.682686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:03.695496 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3814/7594] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:38:03.699952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cdd94-50df-4627-b207-32d29665469a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:03.712088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cdd94-50df-4627-b207-32d29665469a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:03.717693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:03.718324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.719479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.719843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.720586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:03.725475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:03.760563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3781/7595] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:03 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:03.764199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:03.779775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e187c10-c3a2-46fb-b5f8-b4b1be27782f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:03.794832 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:03.948841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:03.949945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:03.950479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:03.950978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:03.952153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:03.954610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:03.984116 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3815/7596] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:03 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:03.987923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:04.001173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a227a-0fe1-48dc-ac82-54d0af00f10f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:04.020528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:04.023150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:04.023751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:04.026027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:04.027321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:04.032033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:04.051087 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3782/7597] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:04.057310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:04.071158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8ff1-054d-4912-afab-3fb7155d966c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:04.077905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50392cf0-3421-4945-8c8f-f399300f1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:04.078628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392cf0-3421-4945-8c8f-f399300f1497 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:04.079002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392cf0-3421-4945-8c8f-f399300f1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:04.079301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50392cf0-3421-4945-8c8f-f399300f1497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:04.080167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392cf0-3421-4945-8c8f-f399300f1497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:04.082041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50392cf0-3421-4945-8c8f-f399300f1497 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:04.101123 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3816/7598] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:04.102328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:04.113884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501411a-80c7-44b5-9de2-6d2d58272eec admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:04.123154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:04.124066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:04.124547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:04.124828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] PATH_INFO: `/v3/projects/7fc0884a43c546c1b9c820ce53965a4c/users/2c6845b4d178485b9d5c81d9eaa508c9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:04.142014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc0884a43c546c1b9c820ce53965a4c, user_id=2c6845b4d178485b9d5c81d9eaa508c9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:04.144716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:04.161531 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3783/7599] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:04 2022] PUT /identity/v3/projects/7fc0884a43c546c1b9c820ce53965a4c/users/2c6845b4d178485b9d5c81d9eaa508c9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:04.172789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:04.173104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:04.173381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:04.203662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] MFA Rules not processed for user `2c6845b4d178485b9d5c81d9eaa508c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:04.204899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:04.289125 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3817/7600] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:04.300127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:04.302361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:04.309787 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:04.371541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f84885-249d-4191-aaa8-89b2d62521cc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:04.375461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:04.376194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:04.376576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:04.376946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:04.386990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:04.388542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:04.399852 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3784/7601] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:07.391794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:07.393876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:07.532002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845450c-2300-46b4-afb8-cf147da35cba None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:07.537334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:07.538137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:07.538491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:07.538954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:07.541591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:07.584168 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:07.622761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:07.624866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:07.640428 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3818/7602] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:10.352761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:10.355776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:10.372596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9205a4b-bedb-4c4f-8246-a45c116ddc05 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:10.378570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6132462-6998-4f0d-96bf-7b947b1a1f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:10.379767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6132462-6998-4f0d-96bf-7b947b1a1f81 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:10.380181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6132462-6998-4f0d-96bf-7b947b1a1f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:10.380181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6132462-6998-4f0d-96bf-7b947b1a1f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:10.382411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a6132462-6998-4f0d-96bf-7b947b1a1f81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:10.460342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6132462-6998-4f0d-96bf-7b947b1a1f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:10.461960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6132462-6998-4f0d-96bf-7b947b1a1f81 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:10.485237 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3785/7603] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:13.518905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:13.600657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae98ff-416b-434a-a7ce-3b3a5e08a9a9 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:13.605555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:13.606220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:13.606712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:13.607126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] PATH_INFO: `/v3/users/2c6845b4d178485b9d5c81d9eaa508c9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:13.609222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6845b4d178485b9d5c81d9eaa508c9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:13.612808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:13.674603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6845b4d178485b9d5c81d9eaa508c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:13.675431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6845b4d178485b9d5c81d9eaa508c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:13.676290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6845b4d178485b9d5c81d9eaa508c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:13.691744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6845b4d178485b9d5c81d9eaa508c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:13.700886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6845b4d178485b9d5c81d9eaa508c9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:13.716799 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3819/7604] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:13 2022] DELETE /identity/v3/users/2c6845b4d178485b9d5c81d9eaa508c9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:13.721605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:13.722277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:13.722556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:13.747751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:13.748972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:13.828591 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3786/7605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:13.838586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:13.839777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:13.903947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0a10-767b-42e1-b82f-f3fec49290b5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:13.907993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8671-bb84-4016-b705-3966cba4e834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:13.908732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8671-bb84-4016-b705-3966cba4e834 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:13.909011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8671-bb84-4016-b705-3966cba4e834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:13.909322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8671-bb84-4016-b705-3966cba4e834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:13.916359 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:13.920932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8671-bb84-4016-b705-3966cba4e834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:13.922735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce8671-bb84-4016-b705-3966cba4e834 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:13.949134 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3820/7606] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:14.170957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:14.172681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:14.194240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5ef26-6e1d-4732-b49e-fa7a2fcc9142 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:14.199803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:14.200533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.200721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.201001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] PATH_INFO: `/v3/projects/7fc0884a43c546c1b9c820ce53965a4c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.202305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc0884a43c546c1b9c820ce53965a4c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:14.204215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:14.248800 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:14.263653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc0884a43c546c1b9c820ce53965a4c', 'request_id': 'req-354a6321-97d1-4fd5-a0cf-4f57b56fe214'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:14.271768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc0884a43c546c1b9c820ce53965a4c', 'request_id': 'req-354a6321-97d1-4fd5-a0cf-4f57b56fe214'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:14.282744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc0884a43c546c1b9c820ce53965a4c', 'request_id': 'req-354a6321-97d1-4fd5-a0cf-4f57b56fe214'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:14.295723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] The token cache is being invalidate because project 7fc0884a43c546c1b9c820ce53965a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:14.296016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:14.296732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-354a6321-97d1-4fd5-a0cf-4f57b56fe214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:14.301554 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3787/7607] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:14 2022] DELETE /identity/v3/projects/7fc0884a43c546c1b9c820ce53965a4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:14.303221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45f4d-26d9-446e-8ade-96fb2bcca6a7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.303511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45f4d-26d9-446e-8ade-96fb2bcca6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.303808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45f4d-26d9-446e-8ade-96fb2bcca6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.325955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a6e45f4d-26d9-446e-8ade-96fb2bcca6a7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:14.327273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a6e45f4d-26d9-446e-8ade-96fb2bcca6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:14.425870 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3821/7608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:14.427733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059606-134c-49ea-998a-e10bfd723745 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.428022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059606-134c-49ea-998a-e10bfd723745 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.428295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059606-134c-49ea-998a-e10bfd723745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.452047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c4059606-134c-49ea-998a-e10bfd723745 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:14.453339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c4059606-134c-49ea-998a-e10bfd723745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:14.463531 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3788/7609] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:14.467908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45f4d-26d9-446e-8ade-96fb2bcca6a7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:14.478196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45f4d-26d9-446e-8ade-96fb2bcca6a7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:14.483178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:14.483857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.484201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.484821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.485560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:14.485948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:14.487603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:14.499820 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3822/7610] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:14.504411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4059606-134c-49ea-998a-e10bfd723745 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:14.518201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4059606-134c-49ea-998a-e10bfd723745 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:14.527744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:14.528792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.529353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.529864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.530755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:14.533243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:14.579559 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3789/7611] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:14 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:14.579802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:14.595938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec27ca9-887e-4e15-a8bd-cbdf3e24c183 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:14.680348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:14.681477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.681971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.682437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.683306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:14.685315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:14.713303 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3823/7612] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:14 2022] POST /identity/v3/users => generated 280 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:14.714645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:14.727462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2705-25f5-4e5b-88ce-bf1947d7754d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:14.734696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:14.735718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.736012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.736412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.737409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:14.739748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:14.752119 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3790/7613] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:14.756716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:14.770965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c084eaf-d662-416e-93a2-57c4fb7120df admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:14.776677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa651-4a74-449e-a28e-c3b088bdd656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:14.778207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa651-4a74-449e-a28e-c3b088bdd656 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.778750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa651-4a74-449e-a28e-c3b088bdd656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.779375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa651-4a74-449e-a28e-c3b088bdd656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.780444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffa651-4a74-449e-a28e-c3b088bdd656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:14.782505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffa651-4a74-449e-a28e-c3b088bdd656 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:14.797498 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3824/7614] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:14.801823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:14.812390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc41c-aca4-42b0-997a-68f669b6b98b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:14.817461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:14.818140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.818856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.819325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] PATH_INFO: `/v3/projects/2a5c50b2138a409c987804fb43ef2113/users/15a4ff84fac844bbb6770baf8c433e29/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.841549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5c50b2138a409c987804fb43ef2113, user_id=15a4ff84fac844bbb6770baf8c433e29, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:14.844641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:14.865817 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3791/7615] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:14 2022] PUT /identity/v3/projects/2a5c50b2138a409c987804fb43ef2113/users/15a4ff84fac844bbb6770baf8c433e29/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:14.874826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe4e3-fa3e-47d5-a2d1-6214b980c681 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:14.875175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe4e3-fa3e-47d5-a2d1-6214b980c681 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:14.875441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efe4e3-fa3e-47d5-a2d1-6214b980c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:14.924868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-44efe4e3-fa3e-47d5-a2d1-6214b980c681 None None] MFA Rules not processed for user `15a4ff84fac844bbb6770baf8c433e29`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:14.926825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-44efe4e3-fa3e-47d5-a2d1-6214b980c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:15.052551 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:15.086433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3825/7616] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:15.096457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:15.098824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:15.170632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230ae3-8f32-4372-9205-13e8cb247db1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:15.176193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bf2d3-06fb-4b48-b4fe-91f6e9fdd8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:15.177486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf2d3-06fb-4b48-b4fe-91f6e9fdd8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:15.177779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf2d3-06fb-4b48-b4fe-91f6e9fdd8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:15.178056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bf2d3-06fb-4b48-b4fe-91f6e9fdd8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:15.187294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bf2d3-06fb-4b48-b4fe-91f6e9fdd8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:15.188738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bf2d3-06fb-4b48-b4fe-91f6e9fdd8a1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:15.199695 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3792/7617] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:25.082985 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:25.194211 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:25.335494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe4e3-fa3e-47d5-a2d1-6214b980c681 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:25.422818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efe4e3-fa3e-47d5-a2d1-6214b980c681 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:25.432896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:25.433650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:25.434029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:25.434442 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] PATH_INFO: `/v3/users/15a4ff84fac844bbb6770baf8c433e29` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:25.435620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a4ff84fac844bbb6770baf8c433e29)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:25.437709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:25.504984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a4ff84fac844bbb6770baf8c433e29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:25.505730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a4ff84fac844bbb6770baf8c433e29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:25.506340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a4ff84fac844bbb6770baf8c433e29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:25.519487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a4ff84fac844bbb6770baf8c433e29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:25.532217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a4ff84fac844bbb6770baf8c433e29'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:25.565855 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3826/7618] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:25 2022] DELETE /identity/v3/users/15a4ff84fac844bbb6770baf8c433e29 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:25.570925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:25.571188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:25.571463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:25.594915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:25.596090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:25.659933 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3793/7619] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:25.672053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:25.677876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:25.767434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa02f8-643d-4604-9357-d15697fd035f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:25.774123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926a3dc-459e-41d0-806a-920d4cd88b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:25.775595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a3dc-459e-41d0-806a-920d4cd88b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:25.776268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a3dc-459e-41d0-806a-920d4cd88b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:25.776444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a3dc-459e-41d0-806a-920d4cd88b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:25.808181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926a3dc-459e-41d0-806a-920d4cd88b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:25.809604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926a3dc-459e-41d0-806a-920d4cd88b21 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:25.823006 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3827/7620] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:26.154880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.157178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:26.185290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0a24-e8f3-43d5-b0f8-d54eaeda5500 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:26.196935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:26.197506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.197868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.198307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] PATH_INFO: `/v3/projects/2a5c50b2138a409c987804fb43ef2113` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.199703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5c50b2138a409c987804fb43ef2113)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:26.201759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:26.273472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5c50b2138a409c987804fb43ef2113', 'request_id': 'req-09055cdf-011f-483a-bc1c-9cb9efaa40e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:26.280970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5c50b2138a409c987804fb43ef2113', 'request_id': 'req-09055cdf-011f-483a-bc1c-9cb9efaa40e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:26.291570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5c50b2138a409c987804fb43ef2113', 'request_id': 'req-09055cdf-011f-483a-bc1c-9cb9efaa40e9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:26.304560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] The token cache is being invalidate because project 2a5c50b2138a409c987804fb43ef2113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:26.304922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:26.305675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-09055cdf-011f-483a-bc1c-9cb9efaa40e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:26.307176 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3794/7621] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:26 2022] DELETE /identity/v3/projects/2a5c50b2138a409c987804fb43ef2113 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:26.313141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334019e6-b2a7-4795-9ba5-20b3e096c98b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.313707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334019e6-b2a7-4795-9ba5-20b3e096c98b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.313992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334019e6-b2a7-4795-9ba5-20b3e096c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.335618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-334019e6-b2a7-4795-9ba5-20b3e096c98b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:26.337017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-334019e6-b2a7-4795-9ba5-20b3e096c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:26.356969 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:26.411984 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3828/7622] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:26.420834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4737-196f-41b6-87f3-33fcc69e8769 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.421160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4737-196f-41b6-87f3-33fcc69e8769 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.421428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4737-196f-41b6-87f3-33fcc69e8769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.443847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-869f4737-196f-41b6-87f3-33fcc69e8769 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:26.445386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-869f4737-196f-41b6-87f3-33fcc69e8769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:26.453906 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3795/7623] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:38:26.458386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334019e6-b2a7-4795-9ba5-20b3e096c98b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.469317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334019e6-b2a7-4795-9ba5-20b3e096c98b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:26.482825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:26.483805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.483925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.484242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.484990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:26.485627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:26.487856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:26.502044 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3829/7624] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:26.506094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4737-196f-41b6-87f3-33fcc69e8769 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.518883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4737-196f-41b6-87f3-33fcc69e8769 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:26.525892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:26.526704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.527080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.527721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.528780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:26.531161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:26.569523 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3796/7625] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:26 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:26.571087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.585039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52e9b0-066c-4642-9d5b-24b4ecabebc0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:26.657202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:26.657941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.658283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.658621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.659327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:26.662125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:26.684992 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3830/7626] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:26 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:26.689030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.702313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8fb1-a414-422d-a1d9-dfac04eff390 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:26.709393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:26.710937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.711223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.711488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.712141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:26.714099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:26.726268 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3797/7627] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:26.730488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.742906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac4a9-170e-4786-8deb-22f542cb8194 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:26.747694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6ef41-dafc-4b69-9715-63b8387dc6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:26.748294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6ef41-dafc-4b69-9715-63b8387dc6fc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.748573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6ef41-dafc-4b69-9715-63b8387dc6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.748843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6ef41-dafc-4b69-9715-63b8387dc6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.749515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6ef41-dafc-4b69-9715-63b8387dc6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:26.751143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6ef41-dafc-4b69-9715-63b8387dc6fc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:26.762773 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3831/7628] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:26.767016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.779038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90207-3bdf-4733-8b73-20af7b32f159 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:26.784268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:26.784934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.785570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.785857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] PATH_INFO: `/v3/projects/ec43a1dd907241889415a0b129c0a4a2/users/91c3db42c556417e9ce28c3b34d84f2b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.803295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec43a1dd907241889415a0b129c0a4a2, user_id=91c3db42c556417e9ce28c3b34d84f2b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:26.806049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:26.833295 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3798/7629] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:26 2022] PUT /identity/v3/projects/ec43a1dd907241889415a0b129c0a4a2/users/91c3db42c556417e9ce28c3b34d84f2b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:26.843797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a966-0209-4e4c-b4e0-40a0d2d47fd8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:26.844083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a966-0209-4e4c-b4e0-40a0d2d47fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:26.844355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a966-0209-4e4c-b4e0-40a0d2d47fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:26.875990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a090a966-0209-4e4c-b4e0-40a0d2d47fd8 None None] MFA Rules not processed for user `91c3db42c556417e9ce28c3b34d84f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:26.877628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a090a966-0209-4e4c-b4e0-40a0d2d47fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:26.964066 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3832/7630] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:26.968036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:26.993668 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:27.051279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72dcaa-9b6b-4a20-886c-2ab9a8ec8e85 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:27.056525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:27.057194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.057485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.058022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.058557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:27.060737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:27.098366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3799/7631] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:26 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:27.102587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a966-0209-4e4c-b4e0-40a0d2d47fd8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:27.115921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a966-0209-4e4c-b4e0-40a0d2d47fd8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:27.131118 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:27.201893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:27.202529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.202926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.203254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.203996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:27.214250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:27.268466 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3833/7632] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:27 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:27.268625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:27.298499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2bbd-315b-45cb-a5b4-8e46f2c94683 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:27.313829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:27.314464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.314745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.315043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.315693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:27.318468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:27.332042 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3800/7633] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:27.336051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:27.346769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f621681-90ae-4888-9ef9-9fabeeb892a5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:27.359928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:27.360621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.360909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.361543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] PATH_INFO: `/v3/projects/476aee7f0ced41ff9e973aa572f0b724/users/0f7d5af3f53141ab918f0a07f18d562e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.384027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476aee7f0ced41ff9e973aa572f0b724, user_id=0f7d5af3f53141ab918f0a07f18d562e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:27.403727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:27.447478 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3834/7634] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:27 2022] PUT /identity/v3/projects/476aee7f0ced41ff9e973aa572f0b724/users/0f7d5af3f53141ab918f0a07f18d562e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:27.451548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:27.467643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e0c64-3064-4fed-8122-876681f7b4e6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:27.586993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f209-a845-4284-91d5-b62f0c2b3899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:27.587618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f209-a845-4284-91d5-b62f0c2b3899 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.587899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f209-a845-4284-91d5-b62f0c2b3899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.588167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f209-a845-4284-91d5-b62f0c2b3899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.588811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f209-a845-4284-91d5-b62f0c2b3899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:27.590465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f209-a845-4284-91d5-b62f0c2b3899 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:27.603500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3801/7635] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:27.607270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:27.619811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829c83-2b0b-4409-835e-6584037f0843 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:27.625869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:27.626833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.627343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.627854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] PATH_INFO: `/v3/projects/476aee7f0ced41ff9e973aa572f0b724/users/0f7d5af3f53141ab918f0a07f18d562e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.631146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476aee7f0ced41ff9e973aa572f0b724, user_id=0f7d5af3f53141ab918f0a07f18d562e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:27.634456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:27.653905 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3835/7636] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:27 2022] PUT /identity/v3/projects/476aee7f0ced41ff9e973aa572f0b724/users/0f7d5af3f53141ab918f0a07f18d562e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:27.665453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922702b-a197-4fda-9a70-b4bc33d8146d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.665721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922702b-a197-4fda-9a70-b4bc33d8146d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.666002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922702b-a197-4fda-9a70-b4bc33d8146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.714103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7922702b-a197-4fda-9a70-b4bc33d8146d None None] MFA Rules not processed for user `0f7d5af3f53141ab918f0a07f18d562e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:27.715523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7922702b-a197-4fda-9a70-b4bc33d8146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:27.806694 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3802/7637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:27.828361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:27.831061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:27.925093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0af7f-accd-4021-a699-958baa885b75 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:27.929844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:27.930489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:27.930773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:27.931050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:27.949016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:27.950490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:27.961884 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3836/7638] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:28.454334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922702b-a197-4fda-9a70-b4bc33d8146d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:28.467584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922702b-a197-4fda-9a70-b4bc33d8146d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:28.473446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7d5af3f53141ab918f0a07f18d562e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476aee7f0ced41ff9e973aa572f0b724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:28.474099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:28.474461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:28.474889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:28.475918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:28.476299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:28.478141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:28.493130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3803/7639] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:28.497525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:28.510339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0fd7d-366e-4188-9ccf-fed8677838ce service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:28.520139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7d5af3f53141ab918f0a07f18d562e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476aee7f0ced41ff9e973aa572f0b724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:28.521254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:28.522406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:28.522919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:28.523799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:28.526297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:28.568754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:28.575001 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:28.580179 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3837/7640] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:28 2022] POST /identity/v3/projects => generated 354 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:28.581092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e298c-5ba8-4665-83b1-db37eedc49bb tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:28.664745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7d5af3f53141ab918f0a07f18d562e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476aee7f0ced41ff9e973aa572f0b724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:28.665441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:28.665727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:28.666005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:28.666766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:28.667048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:28.668752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:28.685846 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3804/7641] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:28.730059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:28.743986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2dbc-08fe-4f34-a40a-f1fc5c38416f tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:28.750314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7d5af3f53141ab918f0a07f18d562e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '476aee7f0ced41ff9e973aa572f0b724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:28.751239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:28.751959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:28.752452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] PATH_INFO: `/v3/projects/4598398bef244ad096615ef6b9c2cd6c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:28.754573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4598398bef244ad096615ef6b9c2cd6c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:28.756952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:28.864262 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:28.877767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4598398bef244ad096615ef6b9c2cd6c', 'request_id': 'req-ed771ec8-f176-4bf1-a382-a6ccf738031a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:28.892855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4598398bef244ad096615ef6b9c2cd6c', 'request_id': 'req-ed771ec8-f176-4bf1-a382-a6ccf738031a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:28.903193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4598398bef244ad096615ef6b9c2cd6c', 'request_id': 'req-ed771ec8-f176-4bf1-a382-a6ccf738031a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:28.921538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] The token cache is being invalidate because project 4598398bef244ad096615ef6b9c2cd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:28.922086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:28.922841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ed771ec8-f176-4bf1-a382-a6ccf738031a tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:28.925105 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3838/7642] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:28 2022] DELETE /identity/v3/projects/4598398bef244ad096615ef6b9c2cd6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:29.190490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:29.193331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:29.299551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d73604-32d5-4821-9689-5c8938c6c388 tempest-VolumeQuotaClassesTest-37921421 tempest-VolumeQuotaClassesTest-37921421-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:29.363297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:29.364208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:29.364493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:29.364767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] PATH_INFO: `/v3/users/91c3db42c556417e9ce28c3b34d84f2b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:29.366116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c3db42c556417e9ce28c3b34d84f2b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:29.368086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:29.440293 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:29.444002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c3db42c556417e9ce28c3b34d84f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:29.445198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c3db42c556417e9ce28c3b34d84f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:29.446428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c3db42c556417e9ce28c3b34d84f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:29.456170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c3db42c556417e9ce28c3b34d84f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:29.481623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c3db42c556417e9ce28c3b34d84f2b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:29.497688 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3805/7643] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:29 2022] DELETE /identity/v3/users/91c3db42c556417e9ce28c3b34d84f2b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:29.502168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:29.503071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:29.503361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:29.524875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:29.526133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:29.621621 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3839/7644] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:29.642844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:29.645153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:29.721146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd528416-309a-482b-98b6-c0cc97cad9ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:29.725636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:29.726426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:29.726770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:29.727551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:29.741425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:29.741425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:29.762604 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3806/7645] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:30.182525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:30.184023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:30.198207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251fbef-31f3-41ca-a9fa-0e3598ae16e9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:30.214692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:30.215368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:30.215652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:30.215930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] PATH_INFO: `/v3/projects/ec43a1dd907241889415a0b129c0a4a2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:30.219918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec43a1dd907241889415a0b129c0a4a2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:30.224824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:30.296224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec43a1dd907241889415a0b129c0a4a2', 'request_id': 'req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.302899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec43a1dd907241889415a0b129c0a4a2', 'request_id': 'req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.309956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec43a1dd907241889415a0b129c0a4a2', 'request_id': 'req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.326884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] The token cache is being invalidate because project ec43a1dd907241889415a0b129c0a4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:30.327334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.328042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.333300 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3840/7646] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:30 2022] DELETE /identity/v3/projects/ec43a1dd907241889415a0b129c0a4a2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:30.333991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:30.345323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28cc2b-b47e-445c-88f2-ae477cb1bbb5 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:30.429836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:30.430482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:30.430973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:30.431421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] PATH_INFO: `/v3/users/0f7d5af3f53141ab918f0a07f18d562e` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:30.433854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7d5af3f53141ab918f0a07f18d562e)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:30.435990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:30.514453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7d5af3f53141ab918f0a07f18d562e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.516374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7d5af3f53141ab918f0a07f18d562e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.517438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7d5af3f53141ab918f0a07f18d562e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.531555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7d5af3f53141ab918f0a07f18d562e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.546424 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:30.550757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb456d19-ae43-4314-84ff-7b5b32492b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7d5af3f53141ab918f0a07f18d562e'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:30.587635 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3807/7647] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:30 2022] DELETE /identity/v3/users/0f7d5af3f53141ab918f0a07f18d562e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:31.001041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:31.002660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:31.039871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb92c17-9374-4b18-99d3-9c3495d9fd4f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:31.118456 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:31.127867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:31.128585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:31.129095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:31.129979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] PATH_INFO: `/v3/projects/476aee7f0ced41ff9e973aa572f0b724` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:31.131985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] RBAC: Authorizing `identity:delete_project(project_id=476aee7f0ced41ff9e973aa572f0b724)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:31.134783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:31.252071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476aee7f0ced41ff9e973aa572f0b724', 'request_id': 'req-8c8800b3-87a0-4026-b019-5fde53f151da'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:31.307340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476aee7f0ced41ff9e973aa572f0b724', 'request_id': 'req-8c8800b3-87a0-4026-b019-5fde53f151da'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:31.320700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476aee7f0ced41ff9e973aa572f0b724', 'request_id': 'req-8c8800b3-87a0-4026-b019-5fde53f151da'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:31.344642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] The token cache is being invalidate because project 476aee7f0ced41ff9e973aa572f0b724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:31.345142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:31.346210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:31.349566 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3841/7648] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:30 2022] DELETE /identity/v3/projects/476aee7f0ced41ff9e973aa572f0b724 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:31.354792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398764-4e92-40e3-9ef1-32685d8a2605 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:31.355077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398764-4e92-40e3-9ef1-32685d8a2605 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:31.355881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398764-4e92-40e3-9ef1-32685d8a2605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:31.378768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-23398764-4e92-40e3-9ef1-32685d8a2605 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:31.380094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-23398764-4e92-40e3-9ef1-32685d8a2605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:31.536474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:31.540042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:31.639889 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3808/7649] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:31.650077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a56cb6-d7c6-4b79-ad4b-feac2ccfafc5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:31.650724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a56cb6-d7c6-4b79-ad4b-feac2ccfafc5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:31.651749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a56cb6-d7c6-4b79-ad4b-feac2ccfafc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:31.727704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-59a56cb6-d7c6-4b79-ad4b-feac2ccfafc5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:31.729110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-59a56cb6-d7c6-4b79-ad4b-feac2ccfafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:31.755477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8800b3-87a0-4026-b019-5fde53f151da admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:31.763463 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3809/7650] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:31.767973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a56cb6-d7c6-4b79-ad4b-feac2ccfafc5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:31.777014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:31.779817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:31.780335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:31.780811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:31.786131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:31.788781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a56cb6-d7c6-4b79-ad4b-feac2ccfafc5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:31.803439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:31.804398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:31.805873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:31.806372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:31.809707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:31.810296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:31.812550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:31.888635 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3810/7651] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:38:31.894271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:31.915505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217da0-6b64-4ba9-a75b-99193912e20e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:31.935029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:31.935029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:31.935029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:31.935029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:31.937746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:31.937746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:32.003010 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3811/7652] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:31 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:32.008429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:32.025023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:32.027066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:32.055016 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3842/7653] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:32.173413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbef2aa-5f8b-4511-af37-c3694a768520 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:32.188978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:32.189650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:32.191828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:32.192095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:32.192770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:32.194760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:32.256820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3812/7654] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:32 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:32.260904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:32.291637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4ace6-3157-435e-9600-22d40c3484d8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:32.297712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:32.298627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:32.299119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:32.299594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:32.300639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:32.302887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:32.317145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3843/7655] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:32.321817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:32.339572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f11a-7d41-4461-be18-31de4c32109e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:32.376535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459e58-4d12-40bb-b6e8-8359157682a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:32.377370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459e58-4d12-40bb-b6e8-8359157682a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:32.377659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459e58-4d12-40bb-b6e8-8359157682a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:32.377939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459e58-4d12-40bb-b6e8-8359157682a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:32.378600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459e58-4d12-40bb-b6e8-8359157682a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:32.381218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459e58-4d12-40bb-b6e8-8359157682a1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:32.406008 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3813/7656] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:32.407119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:32.424550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e993bf6-8ba8-4dec-917b-c32973186bcf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:32.451179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:32.455952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:32.455952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:32.455952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] PATH_INFO: `/v3/projects/6016d17444ed40f09db826184762e924/users/df2c728cb88f46efbb197c60a187d1d2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:32.471392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6016d17444ed40f09db826184762e924, user_id=df2c728cb88f46efbb197c60a187d1d2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:32.476036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:32.479059 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:32.538617 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3844/7657] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:32 2022] PUT /identity/v3/projects/6016d17444ed40f09db826184762e924/users/df2c728cb88f46efbb197c60a187d1d2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:32.549486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308fdb6-1aec-41b2-9bb5-8aca089c9859 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:32.549683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308fdb6-1aec-41b2-9bb5-8aca089c9859 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:32.549863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308fdb6-1aec-41b2-9bb5-8aca089c9859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:32.585664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3308fdb6-1aec-41b2-9bb5-8aca089c9859 None None] MFA Rules not processed for user `df2c728cb88f46efbb197c60a187d1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:32.587136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3308fdb6-1aec-41b2-9bb5-8aca089c9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:32.598176 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:32.715792 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3814/7658] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:32.716832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:32.813245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab891c4-0e10-4eab-b9a3-2a2945a37a7c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:32.830537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:32.831714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:32.831714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:32.833462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:32.833462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:32.835456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:32.896638 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3845/7659] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:32 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:32.898091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308fdb6-1aec-41b2-9bb5-8aca089c9859 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:32.912556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308fdb6-1aec-41b2-9bb5-8aca089c9859 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:33.018871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:33.020460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.021327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.021679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.022417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:33.024439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:33.057778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3815/7660] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:32 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:33.061734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:33.073304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc8e4-6d4a-4845-80c3-dddc994a839e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:33.081151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:33.082464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.083160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.083641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.084924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:33.087290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:33.102843 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3846/7661] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:33.103990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:33.114475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689b402-1480-4c99-8cf2-934e7fcb8c70 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:33.119230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b031c7b-57f9-47d9-af91-95e3c78e90c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:33.119841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031c7b-57f9-47d9-af91-95e3c78e90c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.120116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031c7b-57f9-47d9-af91-95e3c78e90c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.120386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031c7b-57f9-47d9-af91-95e3c78e90c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.121038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b031c7b-57f9-47d9-af91-95e3c78e90c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:33.122684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b031c7b-57f9-47d9-af91-95e3c78e90c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:33.134257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3816/7662] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:33.138541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:33.151480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649662d-01ee-4cf1-87f5-8261e42946b8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:33.157648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:33.158395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.158686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.159229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] PATH_INFO: `/v3/projects/8d74a24a4a66494fbbfd28beec145e44/users/d9b1bd076eb946c4a31dec43ee1f126f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.192075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d74a24a4a66494fbbfd28beec145e44, user_id=d9b1bd076eb946c4a31dec43ee1f126f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:33.195006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:33.214212 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3847/7663] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:33 2022] PUT /identity/v3/projects/8d74a24a4a66494fbbfd28beec145e44/users/d9b1bd076eb946c4a31dec43ee1f126f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:33.334407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adae4ad-d1bd-48b1-bfb4-7fcb017e62f3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.334632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adae4ad-d1bd-48b1-bfb4-7fcb017e62f3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.334934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adae4ad-d1bd-48b1-bfb4-7fcb017e62f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.408869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:33.412860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9adae4ad-d1bd-48b1-bfb4-7fcb017e62f3 None None] MFA Rules not processed for user `d9b1bd076eb946c4a31dec43ee1f126f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:33.414466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9adae4ad-d1bd-48b1-bfb4-7fcb017e62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:33.478370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9464fa-8af5-457f-914c-ec091676a79d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:33.483344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:33.484259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.484838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.485345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.487413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:33.556855 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3817/7664] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:33.556855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adae4ad-d1bd-48b1-bfb4-7fcb017e62f3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:33.601685 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:33.647081 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:33.679365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:33.680819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:33.705548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adae4ad-d1bd-48b1-bfb4-7fcb017e62f3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:33.711372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:33.712184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.712662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.713136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.714073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:33.715278 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3848/7665] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:38:33.717323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:33.790051 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3818/7666] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:33 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:33.790793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:33.807415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb366-7c27-4340-b687-3c237f6d9f81 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:33.979729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:33.985256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:33.985702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:33.986099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:33.986859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:33.989444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:34.022949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:34.030688 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3849/7667] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:33 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:34.036440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4faf82-3041-4a7f-a124-97a47877bd8c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:34.041535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:34.042488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:34.042874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:34.043316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:34.044076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:34.045826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:34.063288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:34.076480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91147769-f5db-43ba-89ee-404500c57a58 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:34.077189 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3819/7668] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:34.082423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:34.083264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:34.083719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:34.084274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] PATH_INFO: `/v3/projects/7e5ba7691bce4e41853f74487ee1dbb7/users/e97d7102b4e449189461c6af32333ecf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:34.103638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5ba7691bce4e41853f74487ee1dbb7, user_id=e97d7102b4e449189461c6af32333ecf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:34.107086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:34.147507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:34.148191 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3850/7669] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:34 2022] PUT /identity/v3/projects/7e5ba7691bce4e41853f74487ee1dbb7/users/e97d7102b4e449189461c6af32333ecf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:34.161808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6325-06cd-42ed-80fe-747ba5ab5c00 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:34.273869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03249f5-aacd-400c-ab62-3223e6fd61a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:34.277921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03249f5-aacd-400c-ab62-3223e6fd61a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:34.287826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03249f5-aacd-400c-ab62-3223e6fd61a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:34.288849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03249f5-aacd-400c-ab62-3223e6fd61a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:34.289852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03249f5-aacd-400c-ab62-3223e6fd61a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:34.308560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03249f5-aacd-400c-ab62-3223e6fd61a4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:34.344503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:34.344925 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3820/7670] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:34.356486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddd7e7-894b-4e38-a4af-1613a775d14a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:34.361706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:34.362882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:34.363940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:34.364575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] PATH_INFO: `/v3/projects/7e5ba7691bce4e41853f74487ee1dbb7/users/e97d7102b4e449189461c6af32333ecf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:34.367024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5ba7691bce4e41853f74487ee1dbb7, user_id=e97d7102b4e449189461c6af32333ecf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:34.369962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:34.382898 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3851/7671] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:34 2022] PUT /identity/v3/projects/7e5ba7691bce4e41853f74487ee1dbb7/users/e97d7102b4e449189461c6af32333ecf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:34.393652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:34.394182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:34.395202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:34.475909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] MFA Rules not processed for user `e97d7102b4e449189461c6af32333ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:34.477168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:34.645315 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3821/7672] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:34.674788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:34.679327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:34.804073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1c037-f54e-402f-8d78-a5cfc5ad9a61 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:34.808786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:34.809723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:34.810105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:34.810480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:34.821994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:34.824191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:34.849435 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3852/7673] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:34.949227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:34.950794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:34.978252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139a607-e0bb-46ca-94c9-ac6380b83d6f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:34.982587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73483395-3527-407b-a057-92f7afa1dd01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:34.983228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483395-3527-407b-a057-92f7afa1dd01 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:34.983555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483395-3527-407b-a057-92f7afa1dd01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:34.984041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483395-3527-407b-a057-92f7afa1dd01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:35.018176 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:35.131627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73483395-3527-407b-a057-92f7afa1dd01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:35.133564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73483395-3527-407b-a057-92f7afa1dd01 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:35.161867 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3822/7674] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:35.734015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:35.735614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:35.827897 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:35.868368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08893077-d05c-49aa-b724-fe0fc26770a9 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:35.873891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:35.875356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:35.875925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:35.876547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] PATH_INFO: `/v3/users/86918b069e5d42ca9b71d1bf61f9adca` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:35.878621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86918b069e5d42ca9b71d1bf61f9adca)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:35.881516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:35.978104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86918b069e5d42ca9b71d1bf61f9adca'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:35.979245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86918b069e5d42ca9b71d1bf61f9adca'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:35.980542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86918b069e5d42ca9b71d1bf61f9adca'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:35.996181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86918b069e5d42ca9b71d1bf61f9adca'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:36.004067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86918b069e5d42ca9b71d1bf61f9adca'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:36.018721 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3853/7675] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:35 2022] DELETE /identity/v3/users/86918b069e5d42ca9b71d1bf61f9adca => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:36.023972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:36.024494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:36.024650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:36.047808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:36.049446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:36.165817 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3823/7676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:36.176971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:36.178843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:36.318224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1694-903e-406b-b653-9434ad052948 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:36.322965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:36.323785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:36.324276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:36.324707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:36.336676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:36.338448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:36.349942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3854/7677] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:36.788468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:36.789974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:36.810925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885ca8-83af-4f45-a8d9-76d1a29c0966 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:36.820185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:36.820779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:36.821084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:36.821441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] PATH_INFO: `/v3/projects/c077007f5c3f4e749ff69678a505f28d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:36.823149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c077007f5c3f4e749ff69678a505f28d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:36.825088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:36.931809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c077007f5c3f4e749ff69678a505f28d', 'request_id': 'req-7704720f-3424-4b6b-9c3c-36df252655ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:36.946810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c077007f5c3f4e749ff69678a505f28d', 'request_id': 'req-7704720f-3424-4b6b-9c3c-36df252655ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:36.961852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c077007f5c3f4e749ff69678a505f28d', 'request_id': 'req-7704720f-3424-4b6b-9c3c-36df252655ae'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:36.987519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] The token cache is being invalidate because project c077007f5c3f4e749ff69678a505f28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:36.987995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:36.988937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:36.991549 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3824/7678] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:36 2022] DELETE /identity/v3/projects/c077007f5c3f4e749ff69678a505f28d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:36.995015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:37.041466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d41d65-e581-48f9-ad92-9d47b588fb1a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:37.136661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:37.137786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:37.138744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:37.138744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] PATH_INFO: `/v3/users/27c2a3eb09cf42b89d155a3c37d766f9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:37.140788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c2a3eb09cf42b89d155a3c37d766f9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:37.142780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:37.156099 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:37.278275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c2a3eb09cf42b89d155a3c37d766f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.279067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c2a3eb09cf42b89d155a3c37d766f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.279756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c2a3eb09cf42b89d155a3c37d766f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.297505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c2a3eb09cf42b89d155a3c37d766f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.313328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6fc57a74-b36f-4cd0-86a1-78568b45742d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c2a3eb09cf42b89d155a3c37d766f9'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.329632 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3855/7679] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:36 2022] DELETE /identity/v3/users/27c2a3eb09cf42b89d155a3c37d766f9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:37.673491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:37.674953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:37.698949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704720f-3424-4b6b-9c3c-36df252655ae admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:37.773449 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:37.795088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:37.795720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:37.796171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:37.796456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] PATH_INFO: `/v3/projects/a3009d77d3b146158a48ac86c5db36cc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:37.797597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3009d77d3b146158a48ac86c5db36cc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:37.799692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:37.852925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3009d77d3b146158a48ac86c5db36cc', 'request_id': 'req-81873a60-e43c-4901-9e32-2de4da43f744'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.871112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3009d77d3b146158a48ac86c5db36cc', 'request_id': 'req-81873a60-e43c-4901-9e32-2de4da43f744'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.882690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3009d77d3b146158a48ac86c5db36cc', 'request_id': 'req-81873a60-e43c-4901-9e32-2de4da43f744'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.894157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] The token cache is being invalidate because project a3009d77d3b146158a48ac86c5db36cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:37.895151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.895845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-81873a60-e43c-4901-9e32-2de4da43f744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:37.897496 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3825/7680] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:37 2022] DELETE /identity/v3/projects/a3009d77d3b146158a48ac86c5db36cc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:37.902624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611ad5-c791-43b9-9e36-aa86a6c3bcec None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:37.902919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611ad5-c791-43b9-9e36-aa86a6c3bcec None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:37.903194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8611ad5-c791-43b9-9e36-aa86a6c3bcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:37.934639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b8611ad5-c791-43b9-9e36-aa86a6c3bcec None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:37.936163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b8611ad5-c791-43b9-9e36-aa86a6c3bcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:38.044717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16555-e09b-4cd0-88b7-0e5b64b56e32 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.044999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16555-e09b-4cd0-88b7-0e5b64b56e32 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.045416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16555-e09b-4cd0-88b7-0e5b64b56e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.049845 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3856/7681] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:38.075071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-37e16555-e09b-4cd0-88b7-0e5b64b56e32 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:38.076313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-37e16555-e09b-4cd0-88b7-0e5b64b56e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:38.092006 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3826/7682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:38.093434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611ad5-c791-43b9-9e36-aa86a6c3bcec None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.106429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8611ad5-c791-43b9-9e36-aa86a6c3bcec None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:38.112284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:38.115977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.116832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.117317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.118422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:38.119345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:38.121912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:38.153942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3857/7683] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:38.158349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e16555-e09b-4cd0-88b7-0e5b64b56e32 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.168848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e16555-e09b-4cd0-88b7-0e5b64b56e32 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:38.179417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:38.180441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.180860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.181269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.182067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:38.184550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:38.218906 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3827/7684] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:38 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:38.226062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.245240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0dd4e-81a5-40d7-88d1-09ff450edf51 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:38.372070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:38.373130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.373426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.373705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.374600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:38.376577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:38.418173 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:38.432188 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3858/7685] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:38 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:38.437382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.451685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef511cb0-bac1-4d7a-9b5a-4813bf790fcc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:38.456980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:38.457717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.457972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.459069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.459069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:38.460715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:38.493923 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3828/7686] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:38.498406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.514472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22bb2-3318-4235-93da-ffb7a9dd9b07 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:38.521439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625c289-5b0a-4558-a866-ea8f7ee39f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:38.522180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c289-5b0a-4558-a866-ea8f7ee39f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.522385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c289-5b0a-4558-a866-ea8f7ee39f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.522656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c289-5b0a-4558-a866-ea8f7ee39f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.523370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625c289-5b0a-4558-a866-ea8f7ee39f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:38.525699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625c289-5b0a-4558-a866-ea8f7ee39f66 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:38.540750 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3859/7687] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:38.545449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.557803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46b502-3fea-4bff-b83a-e38d5a0b0da2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:38.564762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:38.565905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.566312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.566658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] PATH_INFO: `/v3/projects/4408acaa2c044e26a2c4c210dbf54cbd/users/f08db97f1faf41a688e9348948bd4379/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.592282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4408acaa2c044e26a2c4c210dbf54cbd, user_id=f08db97f1faf41a688e9348948bd4379, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:38.595955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:38.630226 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3829/7688] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:38 2022] PUT /identity/v3/projects/4408acaa2c044e26a2c4c210dbf54cbd/users/f08db97f1faf41a688e9348948bd4379/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:38.641905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3127a64-f880-4b0f-8ad2-959f625cd1e3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.642198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3127a64-f880-4b0f-8ad2-959f625cd1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.642489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3127a64-f880-4b0f-8ad2-959f625cd1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.689460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a3127a64-f880-4b0f-8ad2-959f625cd1e3 None None] MFA Rules not processed for user `f08db97f1faf41a688e9348948bd4379`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:38.690925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3127a64-f880-4b0f-8ad2-959f625cd1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:38.771864 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3860/7689] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:38.776359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.872552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6378-767a-4187-82dc-1889a53fc440 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:38.878398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:38.879780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:38.880255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:38.880726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:38.881917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:38.884171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:38.897593 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:38.927944 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3830/7690] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:38 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:38.932048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3127a64-f880-4b0f-8ad2-959f625cd1e3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:38.946912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3127a64-f880-4b0f-8ad2-959f625cd1e3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:39.024169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:39.024905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.025289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.025640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.026348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:39.028962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:39.059606 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3861/7691] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:38 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:39.064000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:39.081666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a4b7-b0c9-45ce-aa0b-72a07d16cb34 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:39.091764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:39.092366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.092663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.092925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.093642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:39.095245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:39.120701 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3831/7692] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:39.125091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:39.140113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c233-fd63-41a7-a2db-d9e497af1160 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:39.146162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:39.146966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.147357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.147831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] PATH_INFO: `/v3/projects/9ce0397ac04d45a78d7c45d7c9a92026/users/3562b9587d5b42c29864506a08eff575/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.173694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce0397ac04d45a78d7c45d7c9a92026, user_id=3562b9587d5b42c29864506a08eff575, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:39.177267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:39.196459 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3862/7693] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:39 2022] PUT /identity/v3/projects/9ce0397ac04d45a78d7c45d7c9a92026/users/3562b9587d5b42c29864506a08eff575/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:39.200717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:39.213615 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520632ff-2c77-47ec-808e-99413519b3b8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:39.295054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e6b17-2405-4f4b-a63e-530c7e428c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:39.295968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e6b17-2405-4f4b-a63e-530c7e428c06 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.296353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e6b17-2405-4f4b-a63e-530c7e428c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.296728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e6b17-2405-4f4b-a63e-530c7e428c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.297512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e6b17-2405-4f4b-a63e-530c7e428c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:39.299257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e6b17-2405-4f4b-a63e-530c7e428c06 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:39.313004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3832/7694] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:39.317455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:39.328312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1301d7-1969-487e-b212-ff56090c9384 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:39.333486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:39.334156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.334438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.334716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] PATH_INFO: `/v3/projects/9ce0397ac04d45a78d7c45d7c9a92026/users/3562b9587d5b42c29864506a08eff575/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.336681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce0397ac04d45a78d7c45d7c9a92026, user_id=3562b9587d5b42c29864506a08eff575, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:39.339375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:39.351740 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3863/7695] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:39 2022] PUT /identity/v3/projects/9ce0397ac04d45a78d7c45d7c9a92026/users/3562b9587d5b42c29864506a08eff575/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:39.362251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f8105-90f7-4635-99f6-877dd793acb1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.362745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f8105-90f7-4635-99f6-877dd793acb1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.363652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f8105-90f7-4635-99f6-877dd793acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.402044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d57f8105-90f7-4635-99f6-877dd793acb1 None None] MFA Rules not processed for user `3562b9587d5b42c29864506a08eff575`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:39.403674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d57f8105-90f7-4635-99f6-877dd793acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:39.493331 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3833/7696] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:39.501625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:39.503514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:39.545863 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:39.583083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803e8fc-4b4a-4294-9ca8-382daaa66fba admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:39.587096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848ae36-fc6e-47d8-ab1e-78811525733f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:39.587995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848ae36-fc6e-47d8-ab1e-78811525733f service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.588384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848ae36-fc6e-47d8-ab1e-78811525733f service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.588851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848ae36-fc6e-47d8-ab1e-78811525733f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.599874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848ae36-fc6e-47d8-ab1e-78811525733f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:39.601600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848ae36-fc6e-47d8-ab1e-78811525733f service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:39.624089 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3864/7697] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:39.702224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f8105-90f7-4635-99f6-877dd793acb1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:39.811274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f8105-90f7-4635-99f6-877dd793acb1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:39.818449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:39.819694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.820766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.821250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] PATH_INFO: `/v3/users/f08db97f1faf41a688e9348948bd4379` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.822661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08db97f1faf41a688e9348948bd4379)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:39.824762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:39.826929 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:39.897760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08db97f1faf41a688e9348948bd4379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:39.898518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08db97f1faf41a688e9348948bd4379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:39.899198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08db97f1faf41a688e9348948bd4379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:39.909119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08db97f1faf41a688e9348948bd4379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:39.923174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08db97f1faf41a688e9348948bd4379'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:39.938506 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3834/7698] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:39 2022] DELETE /identity/v3/users/f08db97f1faf41a688e9348948bd4379 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:39.943817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:39.944103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:39.944377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:39.989747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:39.991178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:40.061850 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3865/7699] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:40.073346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:40.074859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:40.144072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f58109-79e5-46b2-8167-8496489e658f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:40.157103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:40.157742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:40.158023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:40.158294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:40.176864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:40.178949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:40.207503 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3835/7700] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:40.575004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:40.576576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:40.593592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8474-7fc6-4f22-babc-6d3aea4e439b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:40.599655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:40.600506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:40.600958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:40.601505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] PATH_INFO: `/v3/projects/4408acaa2c044e26a2c4c210dbf54cbd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:40.602897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4408acaa2c044e26a2c4c210dbf54cbd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:40.605951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:40.667198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4408acaa2c044e26a2c4c210dbf54cbd', 'request_id': 'req-7ac5885f-7ea1-421a-ba95-2d7d77d22353'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.673995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4408acaa2c044e26a2c4c210dbf54cbd', 'request_id': 'req-7ac5885f-7ea1-421a-ba95-2d7d77d22353'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.683555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4408acaa2c044e26a2c4c210dbf54cbd', 'request_id': 'req-7ac5885f-7ea1-421a-ba95-2d7d77d22353'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.701168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] The token cache is being invalidate because project 4408acaa2c044e26a2c4c210dbf54cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:40.701864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.702961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.707986 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3866/7701] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:40 2022] DELETE /identity/v3/projects/4408acaa2c044e26a2c4c210dbf54cbd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:40.708945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:40.719716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e85cc-7ee1-4989-a08b-29903c011f98 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:40.853194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:40.855318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:40.856534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:40.857268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] PATH_INFO: `/v3/users/3562b9587d5b42c29864506a08eff575` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:40.861330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3562b9587d5b42c29864506a08eff575)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:40.864066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:40.904001 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:40.948750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3562b9587d5b42c29864506a08eff575'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.949740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3562b9587d5b42c29864506a08eff575'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.951419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3562b9587d5b42c29864506a08eff575'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.964727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3562b9587d5b42c29864506a08eff575'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:40.979806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48dc330d-a290-447c-b454-c5ce5e20ea4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3562b9587d5b42c29864506a08eff575'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:41.002394 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3836/7702] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:40 2022] DELETE /identity/v3/users/3562b9587d5b42c29864506a08eff575 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:41.381120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:41.383602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:41.408103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5885f-7ea1-421a-ba95-2d7d77d22353 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:41.479046 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:41.487781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:41.489532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:41.490303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:41.490876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] PATH_INFO: `/v3/projects/9ce0397ac04d45a78d7c45d7c9a92026` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:41.493548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce0397ac04d45a78d7c45d7c9a92026)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:41.495919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:41.561974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce0397ac04d45a78d7c45d7c9a92026', 'request_id': 'req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:41.569756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce0397ac04d45a78d7c45d7c9a92026', 'request_id': 'req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:41.577220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce0397ac04d45a78d7c45d7c9a92026', 'request_id': 'req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:41.593415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] The token cache is being invalidate because project 9ce0397ac04d45a78d7c45d7c9a92026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:41.593794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:41.594572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c3eb92d7-c94d-40f8-82ba-2de1f3f52051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:41.600983 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3867/7703] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:41 2022] DELETE /identity/v3/projects/9ce0397ac04d45a78d7c45d7c9a92026 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:41.602203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a6c4-f876-4efd-8c3d-ff06ecf93232 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:41.602562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a6c4-f876-4efd-8c3d-ff06ecf93232 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:41.602905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a6c4-f876-4efd-8c3d-ff06ecf93232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:41.623883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7d44a6c4-f876-4efd-8c3d-ff06ecf93232 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:41.625684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7d44a6c4-f876-4efd-8c3d-ff06ecf93232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:41.712173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3837/7704] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:41.725254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3bed-9c84-4706-8811-e1b6afffa386 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:41.728990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3bed-9c84-4706-8811-e1b6afffa386 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:41.731083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3bed-9c84-4706-8811-e1b6afffa386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:41.765199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9edb3bed-9c84-4706-8811-e1b6afffa386 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:41.766418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9edb3bed-9c84-4706-8811-e1b6afffa386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:41.778655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3868/7705] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:41.779976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44a6c4-f876-4efd-8c3d-ff06ecf93232 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:41.803349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44a6c4-f876-4efd-8c3d-ff06ecf93232 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:41.810704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:41.811740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:41.812453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:41.812945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:41.814163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:41.814696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:41.817611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:41.840403 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3838/7706] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:38:41.841457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3bed-9c84-4706-8811-e1b6afffa386 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:41.851904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3bed-9c84-4706-8811-e1b6afffa386 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:41.856783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:41.857440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:41.857735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:41.858009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:41.858629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:41.860545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:41.899743 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3869/7707] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:41 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:41.904102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:41.916411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974e47-0ce3-4597-aabb-bf28f9dcd1e7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:41.943940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:41.946383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:42.012835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.013515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.013856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.014188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.014910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.017507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.054205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3839/7708] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:41 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:42.056157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.067128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d8a7-3495-46a7-8a8f-f404d0c10c94 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.070045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceada1-75d3-4690-93c7-066030d7e1e8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.072782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.073458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.073741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.074017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] PATH_INFO: `/v3/users/df2c728cb88f46efbb197c60a187d1d2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.075397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2c728cb88f46efbb197c60a187d1d2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.076188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.076857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.077265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.077413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.077661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.078370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.081208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.095917 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3840/7709] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:42.100424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.114157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1be3-6004-47f4-9def-e0922ba0d89b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.121121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.121965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.122448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.122736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.123622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.127555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.130944 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:42.150007 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3841/7710] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:42.155942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.162198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2c728cb88f46efbb197c60a187d1d2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:42.164030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2c728cb88f46efbb197c60a187d1d2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:42.165121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2c728cb88f46efbb197c60a187d1d2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:42.174497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708b70b-02e1-44c3-bc95-4ea3bdb3407e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.181920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac163b6-c9d4-4970-b79b-112b393741c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.182730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac163b6-c9d4-4970-b79b-112b393741c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.183218 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:42.191608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac163b6-c9d4-4970-b79b-112b393741c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.192191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac163b6-c9d4-4970-b79b-112b393741c1 admin admin] PATH_INFO: `/v3/projects/956e51126f4348c1bc4562bcd9bcc9f7/users/cd0ad85ab46c48ec813d1c2d07ba7713/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.202470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2c728cb88f46efbb197c60a187d1d2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:42.220588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac163b6-c9d4-4970-b79b-112b393741c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956e51126f4348c1bc4562bcd9bcc9f7, user_id=cd0ad85ab46c48ec813d1c2d07ba7713, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.220859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-56922562-45ab-4932-9f98-fd9d378b1765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2c728cb88f46efbb197c60a187d1d2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:42.225496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac163b6-c9d4-4970-b79b-112b393741c1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.246764 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3870/7711] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:41 2022] DELETE /identity/v3/users/df2c728cb88f46efbb197c60a187d1d2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:42.248414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.248876 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3842/7712] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:42 2022] PUT /identity/v3/projects/956e51126f4348c1bc4562bcd9bcc9f7/users/cd0ad85ab46c48ec813d1c2d07ba7713/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:42.249087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.249575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.260896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.261214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.261462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.293748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:42.296759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:42.303970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] MFA Rules not processed for user `cd0ad85ab46c48ec813d1c2d07ba7713`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:42.305285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:42.398041 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3843/7713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:42.399630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.401088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:42.473594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3871/7714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:42.484462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.488859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:42.489023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7fd0-180b-434c-a3e6-924237260c03 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.494782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.495638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.496003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.496287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.497037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.499344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.554217 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3844/7715] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:42 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:42.555654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.597462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c6aab-242f-46cd-9090-4d501cd5b388 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.628615 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:42.679495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b7386-4aeb-4c59-8ffb-b4a5f8cb1896 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.686589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.687252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.687762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.688298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.689404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.695436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.717787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.719248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.719706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.720490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.726904 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3845/7716] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:42 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:42.732738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.742537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.745239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.749295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd059c-4598-45be-ab12-f2fa35d03f5f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.756469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.757348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.757765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.758048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.758719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.759911 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3872/7717] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:42.760656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.777130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3846/7718] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:42.780621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.792805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a557b1-0037-4e5a-8b22-12cce2512d0e service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.798177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06163e-b690-498e-809e-e6df299c179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.799118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06163e-b690-498e-809e-e6df299c179a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.799494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06163e-b690-498e-809e-e6df299c179a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.799978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06163e-b690-498e-809e-e6df299c179a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.800930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06163e-b690-498e-809e-e6df299c179a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.802872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06163e-b690-498e-809e-e6df299c179a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.818978 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3873/7719] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:42.819711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:42.842765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf81b51-813e-4fcb-9665-e7d2f24e7b49 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:42.849855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:42.851384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.851632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.852454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] PATH_INFO: `/v3/projects/9619217ae05b4dd9aa0081618937e07f/users/1eeb0162809b4f7a958507514b041e13/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.874346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9619217ae05b4dd9aa0081618937e07f, user_id=1eeb0162809b4f7a958507514b041e13, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:42.879248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:42.906166 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3847/7720] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:42 2022] PUT /identity/v3/projects/9619217ae05b4dd9aa0081618937e07f/users/1eeb0162809b4f7a958507514b041e13/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:42.908884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:42.909537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:42.910579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:42.980434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] MFA Rules not processed for user `1eeb0162809b4f7a958507514b041e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:42.985859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:42.998119 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:43.071918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3874/7721] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:38:43.072966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.157951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.159424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:43.171541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62dbf-f54a-4833-89e0-46eaf055eda3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.178023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.178743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.179152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.179489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.180199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.182289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.186995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f11b9b-c96a-497d-b40a-e075870c7bcb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.205414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.206087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.206405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.206640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] PATH_INFO: `/v3/projects/6016d17444ed40f09db826184762e924` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.208528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6016d17444ed40f09db826184762e924)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.211225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.238500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3848/7722] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:43 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:43.239826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.312172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6016d17444ed40f09db826184762e924', 'request_id': 'req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.319303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6016d17444ed40f09db826184762e924', 'request_id': 'req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.333416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6016d17444ed40f09db826184762e924', 'request_id': 'req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.349172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] The token cache is being invalidate because project 6016d17444ed40f09db826184762e924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:43.349766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.351404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.352033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc4eb-d2bd-45d4-98f0-3c948e86c002 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.357932 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3875/7723] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:43 2022] DELETE /identity/v3/projects/6016d17444ed40f09db826184762e924 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:43.359007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.360674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:43.389678 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:43.426025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.427305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.427711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.427993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.428888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.430832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.438858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd79a1c-969d-42fb-af03-a1d8ccc6fe09 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.445743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.446875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.447377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.447952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] PATH_INFO: `/v3/users/d9b1bd076eb946c4a31dec43ee1f126f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.450436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b1bd076eb946c4a31dec43ee1f126f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.453138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.456561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3849/7724] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:43 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:43.462467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.464086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:43.478909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6312aa-164b-4f49-abb5-a6f2f2b644d4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.485406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.485875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.486366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.486861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.487795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.490399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.508220 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3850/7725] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:43.509196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.515643 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:43.522364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378870d4-b908-4972-aff2-e383cdea6e32 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.529485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.530067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.530350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.530629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] PATH_INFO: `/v3/projects/298a58de7c6949f58b65bec8aea2525c/users/8222e8d24f6443fc9add104ae481bf7f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.542122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b1bd076eb946c4a31dec43ee1f126f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.543216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b1bd076eb946c4a31dec43ee1f126f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.549527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b1bd076eb946c4a31dec43ee1f126f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.558133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] RBAC: Authorizing `identity:create_grant(project_id=298a58de7c6949f58b65bec8aea2525c, user_id=8222e8d24f6443fc9add104ae481bf7f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.561633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.567176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b1bd076eb946c4a31dec43ee1f126f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.580581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b1bd076eb946c4a31dec43ee1f126f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:43.587442 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3851/7726] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:43 2022] PUT /identity/v3/projects/298a58de7c6949f58b65bec8aea2525c/users/8222e8d24f6443fc9add104ae481bf7f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:43.591783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.594101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:43.620147 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3876/7727] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:43 2022] DELETE /identity/v3/users/d9b1bd076eb946c4a31dec43ee1f126f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:43.724336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eedbc-908c-4ee9-bbe6-f7f89ca5878b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.812087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206cb2d-457c-4d7b-aab2-f47264c46079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.813033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206cb2d-457c-4d7b-aab2-f47264c46079 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.813893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206cb2d-457c-4d7b-aab2-f47264c46079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.814344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206cb2d-457c-4d7b-aab2-f47264c46079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.815273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206cb2d-457c-4d7b-aab2-f47264c46079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.818915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206cb2d-457c-4d7b-aab2-f47264c46079 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.836937 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3852/7728] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:43.838130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.851207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847f717-56d0-4a9b-9be0-9485107bf828 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:43.856538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:43.857480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.857943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.858500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] PATH_INFO: `/v3/projects/298a58de7c6949f58b65bec8aea2525c/users/8222e8d24f6443fc9add104ae481bf7f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.860710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298a58de7c6949f58b65bec8aea2525c, user_id=8222e8d24f6443fc9add104ae481bf7f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:43.864269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:43.877686 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3877/7729] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:43 2022] PUT /identity/v3/projects/298a58de7c6949f58b65bec8aea2525c/users/8222e8d24f6443fc9add104ae481bf7f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:43.889189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:43.889536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:43.889877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:43.920452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] MFA Rules not processed for user `8222e8d24f6443fc9add104ae481bf7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:43.922074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:43.942886 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:43.976986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:43.979368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:44.061778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3853/7730] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:44.073981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:44.075579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:44.096380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be935-ca23-431d-88b7-5a26dd8cb895 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:44.102235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:44.102992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:44.103333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:44.103672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] PATH_INFO: `/v3/projects/8d74a24a4a66494fbbfd28beec145e44` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:44.104926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d74a24a4a66494fbbfd28beec145e44)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:44.107323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:44.163172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b4a3-7797-4bd1-8459-94a453892d7d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:44.167677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:44.168538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:44.169018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:44.169520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:44.180796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:44.182651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:44.192082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d74a24a4a66494fbbfd28beec145e44', 'request_id': 'req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.194639 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3854/7731] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:38:44.201137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d74a24a4a66494fbbfd28beec145e44', 'request_id': 'req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.209330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d74a24a4a66494fbbfd28beec145e44', 'request_id': 'req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.227760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] The token cache is being invalidate because project 8d74a24a4a66494fbbfd28beec145e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:44.228675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.229847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.231961 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3878/7732] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:43 2022] DELETE /identity/v3/projects/8d74a24a4a66494fbbfd28beec145e44 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:44.236006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:44.252299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227816b3-4f2a-4233-812d-229334e85f01 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:44.339573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:44.340366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:44.340728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:44.341088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] PATH_INFO: `/v3/users/e97d7102b4e449189461c6af32333ecf` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:44.342350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97d7102b4e449189461c6af32333ecf)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:44.344347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:44.407148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97d7102b4e449189461c6af32333ecf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.407956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97d7102b4e449189461c6af32333ecf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.408697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97d7102b4e449189461c6af32333ecf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.417579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97d7102b4e449189461c6af32333ecf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.422680 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:44.434358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97d7102b4e449189461c6af32333ecf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:44.452855 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3855/7733] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:44 2022] DELETE /identity/v3/users/e97d7102b4e449189461c6af32333ecf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:44.831177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:44.833320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:44.857774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b859-3e13-4cec-ae4e-4dd9fdf4acc7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:44.892464 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:44.921218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:44.922692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:44.931214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:44.932045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:44.932427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:44.932801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] PATH_INFO: `/v3/projects/7e5ba7691bce4e41853f74487ee1dbb7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:44.934085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5ba7691bce4e41853f74487ee1dbb7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:44.936141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:44.997589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5ba7691bce4e41853f74487ee1dbb7', 'request_id': 'req-22a9a08f-8853-4934-a837-c0cf35d6d000'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:45.016637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0a03-0822-43e2-b586-c98119766e78 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.018762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5ba7691bce4e41853f74487ee1dbb7', 'request_id': 'req-22a9a08f-8853-4934-a837-c0cf35d6d000'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:45.034534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5ba7691bce4e41853f74487ee1dbb7', 'request_id': 'req-22a9a08f-8853-4934-a837-c0cf35d6d000'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:45.058183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] The token cache is being invalidate because project 7e5ba7691bce4e41853f74487ee1dbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:45.058466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:45.059318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-22a9a08f-8853-4934-a837-c0cf35d6d000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:45.061701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3879/7734] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:44 2022] DELETE /identity/v3/projects/7e5ba7691bce4e41853f74487ee1dbb7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:45.068370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe8a0c-7018-4c4a-8d02-5ea6235e91f1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.068735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe8a0c-7018-4c4a-8d02-5ea6235e91f1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.069107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe8a0c-7018-4c4a-8d02-5ea6235e91f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.089601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.090359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.090645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.090914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.091341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-acfe8a0c-7018-4c4a-8d02-5ea6235e91f1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:45.092617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-acfe8a0c-7018-4c4a-8d02-5ea6235e91f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:45.092827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:45.172387 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3880/7735] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:38:45.172619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.173330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.174726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911a0bd-1954-4ea8-8a6d-677395af20d0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.175082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911a0bd-1954-4ea8-8a6d-677395af20d0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.175449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911a0bd-1954-4ea8-8a6d-677395af20d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.183430 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3856/7736] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:38:45.202028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f911a0bd-1954-4ea8-8a6d-677395af20d0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:45.203377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f911a0bd-1954-4ea8-8a6d-677395af20d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:45.215838 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3881/7737] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:45.217115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.230802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0c8be-7389-4235-920b-8b84c4a24336 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.236559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.237414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.238445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.238829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.239612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:45.240022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.241809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.263759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3857/7738] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:45.265676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911a0bd-1954-4ea8-8a6d-677395af20d0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.291116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911a0bd-1954-4ea8-8a6d-677395af20d0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.304003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.304744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.305147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.305628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.306492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.308949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.357226 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3882/7739] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:45 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:45.358778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.369886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57149419-2bd7-4fc4-912d-22c21f025480 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.405573 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:45.434078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.434692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.435091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.435341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.435936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.437993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.465170 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3858/7740] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:45 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:45.468895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.487797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9da3-b183-4b97-856b-92da266ab235 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.496855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.497619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.497993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.498407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.499323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.500961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.516293 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3883/7741] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:45.520566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.540332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369165d-87e4-451d-927a-72f4ebe94c6a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.545607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e6416-3e31-4004-85ce-c4ef498e8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.546150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6416-3e31-4004-85ce-c4ef498e8ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.546403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6416-3e31-4004-85ce-c4ef498e8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.546685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6416-3e31-4004-85ce-c4ef498e8ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.547331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e6416-3e31-4004-85ce-c4ef498e8ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.548907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e6416-3e31-4004-85ce-c4ef498e8ae2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.564151 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3859/7742] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:45.565645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.578732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acaff9-b481-440e-b4a8-858a7f009c08 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.584730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.585529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.585939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.586392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] PATH_INFO: `/v3/projects/fcac8c565d9d42638dd1072dde60698c/users/ccd4270ab542491d9c1039f58ba11d7a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.602062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcac8c565d9d42638dd1072dde60698c, user_id=ccd4270ab542491d9c1039f58ba11d7a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.605245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.615448 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:45.620439 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3884/7743] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:45 2022] PUT /identity/v3/projects/fcac8c565d9d42638dd1072dde60698c/users/ccd4270ab542491d9c1039f58ba11d7a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:45.632551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d2bc4-9302-49bf-a1a9-76279fb0b156 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.632965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d2bc4-9302-49bf-a1a9-76279fb0b156 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.633384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d2bc4-9302-49bf-a1a9-76279fb0b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.666705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-801d2bc4-9302-49bf-a1a9-76279fb0b156 None None] MFA Rules not processed for user `ccd4270ab542491d9c1039f58ba11d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:45.668101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-801d2bc4-9302-49bf-a1a9-76279fb0b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:45.747124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3860/7744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:38:45.751235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.845077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc3c6-d1b7-4ef8-8925-28e1abf07a1c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.850747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.851366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.851645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.890810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.890810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.890810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:45.908431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3885/7745] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:45 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:45.912610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d2bc4-9302-49bf-a1a9-76279fb0b156 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:45.923786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d2bc4-9302-49bf-a1a9-76279fb0b156 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:45.984223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:45.984880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:45.985190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:45.985461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:45.986085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:45.988012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:46.013416 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3861/7746] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:45 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:46.015004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:46.026268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116ba0e-38fe-4288-8edf-2cf0575526fd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:46.031272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:46.031872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:46.032149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:46.032420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:46.033052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:46.034658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:46.050744 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3886/7747] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:46.052150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:46.068941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b1557-1763-43c5-8d11-7efe606ad06b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:46.074738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:46.075465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:46.075807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:46.076229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] PATH_INFO: `/v3/projects/a2fd078b843546588a7fa61cd13a87ce/users/0c498ec0f61f446ebaa0831c304ac229/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:46.093356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fd078b843546588a7fa61cd13a87ce, user_id=0c498ec0f61f446ebaa0831c304ac229, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:46.096346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:46.116593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3862/7748] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:46 2022] PUT /identity/v3/projects/a2fd078b843546588a7fa61cd13a87ce/users/0c498ec0f61f446ebaa0831c304ac229/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:46.117947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:46.130819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e198d-cf98-4cec-be77-d9cd82cb0c27 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:46.199683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d199d-ea1a-41f0-9d7b-1e0a58ef2a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:46.200461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d199d-ea1a-41f0-9d7b-1e0a58ef2a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:46.200834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d199d-ea1a-41f0-9d7b-1e0a58ef2a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:46.201238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d199d-ea1a-41f0-9d7b-1e0a58ef2a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:46.202044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d199d-ea1a-41f0-9d7b-1e0a58ef2a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:46.204032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d199d-ea1a-41f0-9d7b-1e0a58ef2a28 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:46.217184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3887/7749] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:46.220183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:46.236111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1b1cd-c4c0-48e3-aa40-47a122d447bf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:46.242992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:46.243926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:46.244210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:46.244484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] PATH_INFO: `/v3/projects/a2fd078b843546588a7fa61cd13a87ce/users/0c498ec0f61f446ebaa0831c304ac229/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:46.253427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fd078b843546588a7fa61cd13a87ce, user_id=0c498ec0f61f446ebaa0831c304ac229, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:46.256792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:46.263902 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:46.275103 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3863/7750] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:46 2022] PUT /identity/v3/projects/a2fd078b843546588a7fa61cd13a87ce/users/0c498ec0f61f446ebaa0831c304ac229/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:46.286045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:46.286339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:46.286614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:46.319089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] MFA Rules not processed for user `0c498ec0f61f446ebaa0831c304ac229`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:46.320311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:46.437251 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:46.457726 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3888/7751] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:46.463679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:46.471501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:46.507377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:46.508511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:46.581351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ce3c-d5f8-41f7-8e79-ca0ff4d7c05a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:46.591465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:46.592100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:46.592383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:46.592658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:46.609998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:46.612112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:46.629464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3864/7752] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:46.684862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee3696-4a23-4feb-9ae1-55e9dc5a1169 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:46.692893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8fe1-9b25-4cea-9f38-0a98ad6a3a16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:46.693729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8fe1-9b25-4cea-9f38-0a98ad6a3a16 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:46.694110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8fe1-9b25-4cea-9f38-0a98ad6a3a16 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:46.694389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8fe1-9b25-4cea-9f38-0a98ad6a3a16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:46.696522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a24a8fe1-9b25-4cea-9f38-0a98ad6a3a16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:46.879268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8fe1-9b25-4cea-9f38-0a98ad6a3a16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:46.880885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8fe1-9b25-4cea-9f38-0a98ad6a3a16 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:46.911607 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3889/7753] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:38:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:38:47.645006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:47.774111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41464115-5ae5-4b7a-ba69-98e9c67e6ebb service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:47.780176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:47.781150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:47.781629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:47.782095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] PATH_INFO: `/v3/users/ccd4270ab542491d9c1039f58ba11d7a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:47.784424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd4270ab542491d9c1039f58ba11d7a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:47.790511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:47.862622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd4270ab542491d9c1039f58ba11d7a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:47.864245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd4270ab542491d9c1039f58ba11d7a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:47.865258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd4270ab542491d9c1039f58ba11d7a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:47.875755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd4270ab542491d9c1039f58ba11d7a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:47.891999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd4270ab542491d9c1039f58ba11d7a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:47.916813 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3865/7754] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:47 2022] DELETE /identity/v3/users/ccd4270ab542491d9c1039f58ba11d7a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:47.921127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:47.921569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:47.921777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:47.948949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:47.953258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:48.045750 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3890/7755] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:48.056789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:48.058597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:48.112399 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:48.180067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed49512-41d0-47ca-8df7-a0c45c5c2775 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:48.188354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:48.189267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:48.189828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:48.190301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:48.212883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:48.215851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:48.231278 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3866/7756] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:48.707641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:48.713216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:48.751871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2fcd2-987b-4dc4-b7de-8ed479690a78 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:48.763031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:48.764731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:48.765205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:48.765796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] PATH_INFO: `/v3/projects/fcac8c565d9d42638dd1072dde60698c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:48.768465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcac8c565d9d42638dd1072dde60698c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:48.771010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:48.801592 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:48.851626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcac8c565d9d42638dd1072dde60698c', 'request_id': 'req-53757b3c-7541-4659-89ee-9af76e9606e1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:48.869029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcac8c565d9d42638dd1072dde60698c', 'request_id': 'req-53757b3c-7541-4659-89ee-9af76e9606e1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:48.885350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcac8c565d9d42638dd1072dde60698c', 'request_id': 'req-53757b3c-7541-4659-89ee-9af76e9606e1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:48.933913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] The token cache is being invalidate because project fcac8c565d9d42638dd1072dde60698c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:48.934729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:48.935079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:48.939714 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3891/7757] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:48 2022] DELETE /identity/v3/projects/fcac8c565d9d42638dd1072dde60698c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:48.941806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:48.955109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ea570-8021-46ba-845e-84fe07085e8a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:49.079706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:49.080440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:49.080957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:49.081349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] PATH_INFO: `/v3/users/0c498ec0f61f446ebaa0831c304ac229` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:49.083280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c498ec0f61f446ebaa0831c304ac229)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:49.127202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:49.239281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c498ec0f61f446ebaa0831c304ac229'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:49.240200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c498ec0f61f446ebaa0831c304ac229'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:49.241275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c498ec0f61f446ebaa0831c304ac229'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:49.255812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c498ec0f61f446ebaa0831c304ac229'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:49.283626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bbd25994-4066-4826-93ff-db32d146ea4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c498ec0f61f446ebaa0831c304ac229'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:49.318198 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3867/7758] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:48 2022] DELETE /identity/v3/users/0c498ec0f61f446ebaa0831c304ac229 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:49.818969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:49.821413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:49.865707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53757b3c-7541-4659-89ee-9af76e9606e1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:49.994738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:49.996565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:49.997122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:49.997615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] PATH_INFO: `/v3/projects/a2fd078b843546588a7fa61cd13a87ce` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:49.999122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fd078b843546588a7fa61cd13a87ce)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:50.001958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:50.111271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fd078b843546588a7fa61cd13a87ce', 'request_id': 'req-975d4a57-dd66-43fb-a106-93839b108d2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:50.130175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fd078b843546588a7fa61cd13a87ce', 'request_id': 'req-975d4a57-dd66-43fb-a106-93839b108d2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:50.137154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fd078b843546588a7fa61cd13a87ce', 'request_id': 'req-975d4a57-dd66-43fb-a106-93839b108d2f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:50.156254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] The token cache is being invalidate because project a2fd078b843546588a7fa61cd13a87ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:50.156771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:50.177871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-975d4a57-dd66-43fb-a106-93839b108d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:50.183394 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3892/7759] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:49 2022] DELETE /identity/v3/projects/a2fd078b843546588a7fa61cd13a87ce => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:50.185518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a972-8186-43b5-81b1-b6bdd696b370 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.185929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a972-8186-43b5-81b1-b6bdd696b370 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.186009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a972-8186-43b5-81b1-b6bdd696b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:50.226464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ca27a972-8186-43b5-81b1-b6bdd696b370 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:50.227918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca27a972-8186-43b5-81b1-b6bdd696b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:50.303950 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:50.373906 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3868/7760] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:50.383420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b0d1-50b1-42ca-a710-22167d3ebf81 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.383939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b0d1-50b1-42ca-a710-22167d3ebf81 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.384354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b0d1-50b1-42ca-a710-22167d3ebf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:50.426055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2e33b0d1-50b1-42ca-a710-22167d3ebf81 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:50.428496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2e33b0d1-50b1-42ca-a710-22167d3ebf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:50.439106 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3893/7761] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:50.443665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a972-8186-43b5-81b1-b6bdd696b370 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:50.456541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a972-8186-43b5-81b1-b6bdd696b370 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:50.464136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:50.465203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.466152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.466627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:50.467514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:50.468020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:50.477381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:50.497160 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3869/7762] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:50.501619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b0d1-50b1-42ca-a710-22167d3ebf81 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:50.538016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b0d1-50b1-42ca-a710-22167d3ebf81 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:50.557507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:50.558209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.558570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.559597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:50.560317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:50.565095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:50.636429 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3894/7763] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:50 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:50.640036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:50.655407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0f9e6-49d5-4b64-bcca-463dd57a389f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:50.775094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:50.776009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.776508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.777262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:50.778559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:50.780993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:50.841492 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3870/7764] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:50 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:50.844762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:50.858685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a1418-0dc1-41aa-964f-11ddbb9efa95 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:50.874391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:50.875039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.875325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.875791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:50.876592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:50.878418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:50.880141 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:50.906048 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3895/7765] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:50.906948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:50.921047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983ccd-8c67-4aba-8fdb-daaad0a2f2b4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:50.931421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1124c-5bf1-499d-9a33-b5aef2c54545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:50.932041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1124c-5bf1-499d-9a33-b5aef2c54545 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.932318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1124c-5bf1-499d-9a33-b5aef2c54545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.932591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1124c-5bf1-499d-9a33-b5aef2c54545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:50.933262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1124c-5bf1-499d-9a33-b5aef2c54545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:50.934855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1124c-5bf1-499d-9a33-b5aef2c54545 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:50.964130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3871/7766] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:50.968265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:50.979105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2de7-3fd6-433d-b693-fc604f8ff5e1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:50.984202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:50.985162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:50.985648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:50.986120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] PATH_INFO: `/v3/projects/9a790ba79dec4dd9957b10e61b36c2bc/users/13cbc39b27f1473684d76879affc738c/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:51.002764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a790ba79dec4dd9957b10e61b36c2bc, user_id=13cbc39b27f1473684d76879affc738c, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:51.006381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:51.031210 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3896/7767] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:50 2022] PUT /identity/v3/projects/9a790ba79dec4dd9957b10e61b36c2bc/users/13cbc39b27f1473684d76879affc738c/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:51.042431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97c71-df0e-4ce8-93c1-7446c0aff9a1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:51.042949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97c71-df0e-4ce8-93c1-7446c0aff9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:51.043389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97c71-df0e-4ce8-93c1-7446c0aff9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:51.102161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ebb97c71-df0e-4ce8-93c1-7446c0aff9a1 None None] MFA Rules not processed for user `13cbc39b27f1473684d76879affc738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:51.103489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ebb97c71-df0e-4ce8-93c1-7446c0aff9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:51.251421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:51.251951 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3872/7768] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:51.371887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605df15-fde1-4a3f-82e5-2a8201426dbc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:51.377491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:51.378270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:51.380056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:51.380454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:51.381317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:51.384228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:51.453696 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3897/7769] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:51 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:51.455091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97c71-df0e-4ce8-93c1-7446c0aff9a1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:51.468889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97c71-df0e-4ce8-93c1-7446c0aff9a1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:51.516097 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:51.551338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:51.551832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:51.552131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:51.552401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:51.553048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:51.557859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:51.610884 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3873/7770] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:51 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:51.615546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:51.672557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3db6df-9c3d-4c3a-9486-48f70ff5e932 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:51.684593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:51.686490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:51.686807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:51.689846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:51.690420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:51.694817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:51.730327 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3898/7771] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:51.731677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:51.749481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93d578-2f9e-47ad-b00d-6083becbd93a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:51.760342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:51.761293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:51.761584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:51.762012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] PATH_INFO: `/v3/projects/22b5b9dd8a5d4a3bab486bffb98e4112/users/bd9119385cf44117bfb37c294d259011/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:51.822330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b5b9dd8a5d4a3bab486bffb98e4112, user_id=bd9119385cf44117bfb37c294d259011, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:51.825048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:51.865570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3874/7772] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:51 2022] PUT /identity/v3/projects/22b5b9dd8a5d4a3bab486bffb98e4112/users/bd9119385cf44117bfb37c294d259011/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:51.866832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:51.884373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f14ce-42b9-4ee9-a900-757eb81caf1c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:52.038656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aefab2-d7c8-414f-9937-94d087db567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:52.039284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aefab2-d7c8-414f-9937-94d087db567f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:52.039541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aefab2-d7c8-414f-9937-94d087db567f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:52.039812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aefab2-d7c8-414f-9937-94d087db567f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:52.040461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aefab2-d7c8-414f-9937-94d087db567f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:52.042098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aefab2-d7c8-414f-9937-94d087db567f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:52.054277 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3899/7773] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:52.058205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:52.076035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad8485-1e49-4679-bbe5-1c304bdfab79 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:52.082298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:52.083074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:52.083413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:52.083741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] PATH_INFO: `/v3/projects/22b5b9dd8a5d4a3bab486bffb98e4112/users/bd9119385cf44117bfb37c294d259011/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:52.087518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b5b9dd8a5d4a3bab486bffb98e4112, user_id=bd9119385cf44117bfb37c294d259011, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:52.091008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:52.128989 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3875/7774] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:52 2022] PUT /identity/v3/projects/22b5b9dd8a5d4a3bab486bffb98e4112/users/bd9119385cf44117bfb37c294d259011/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:52.139947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dc56-e043-405d-b0ef-f238d5b1ac81 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:52.140416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dc56-e043-405d-b0ef-f238d5b1ac81 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:52.140891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dc56-e043-405d-b0ef-f238d5b1ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:52.199657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-84a2dc56-e043-405d-b0ef-f238d5b1ac81 None None] MFA Rules not processed for user `bd9119385cf44117bfb37c294d259011`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:52.201141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84a2dc56-e043-405d-b0ef-f238d5b1ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:52.241465 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:52.300998 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3900/7775] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:38:52.313371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:52.315155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:52.393718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fe24a-fbd1-476d-b0bb-acae8d89bd0d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:52.398071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:52.398699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:52.398956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:52.399233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:52.414684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:52.417159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:52.446299 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3876/7776] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:52.557208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dc56-e043-405d-b0ef-f238d5b1ac81 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:52.569935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dc56-e043-405d-b0ef-f238d5b1ac81 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:52.574560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:52.575167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:52.575448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:52.575723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:52.639055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:52.640638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:52.650371 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3901/7777] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:52.945345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:53.038645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051064c-f257-42d7-aedb-1bb48f54826e service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:53.045406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:53.046457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:53.046911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:53.047534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] PATH_INFO: `/v3/users/13cbc39b27f1473684d76879affc738c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:53.048957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cbc39b27f1473684d76879affc738c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:53.051817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:53.100224 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:53.108101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:53.124804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cbc39b27f1473684d76879affc738c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:53.125151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00843a1e-6bc2-42c6-9036-a505c70ec087 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:53.125846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cbc39b27f1473684d76879affc738c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:53.126587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cbc39b27f1473684d76879affc738c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:53.130887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:53.132032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:53.132543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:53.132978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:53.136858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:53.139304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cbc39b27f1473684d76879affc738c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:53.164652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-dba4383f-8a1f-4aa0-9fef-52d8893308a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cbc39b27f1473684d76879affc738c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:53.183960 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3877/7778] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:52 2022] DELETE /identity/v3/users/13cbc39b27f1473684d76879affc738c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:53.188492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:53.188916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:53.189246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:53.212181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:53.213904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:53.232057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:53.234033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:53.273291 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3902/7779] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:53.305572 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3878/7780] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:53.312298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:53.313798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:53.402850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051839-9cf5-4fab-92b5-f2011fc72702 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:53.427488 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:53.472630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:53.473878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:53.474158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:53.474487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:53.490019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:53.491894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:53.508621 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3903/7781] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:53.834593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:53.836187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:53.856579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61626-8002-4f91-9834-2111eb19d1d9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:53.874099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:53.874989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:53.875370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:53.875704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] PATH_INFO: `/v3/projects/9a790ba79dec4dd9957b10e61b36c2bc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:53.879556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a790ba79dec4dd9957b10e61b36c2bc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:53.882928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:53.976293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a790ba79dec4dd9957b10e61b36c2bc', 'request_id': 'req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:53.984198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a790ba79dec4dd9957b10e61b36c2bc', 'request_id': 'req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.000252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a790ba79dec4dd9957b10e61b36c2bc', 'request_id': 'req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.027761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] The token cache is being invalidate because project 9a790ba79dec4dd9957b10e61b36c2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:54.028385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.029579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.032616 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3879/7782] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:53 2022] DELETE /identity/v3/projects/9a790ba79dec4dd9957b10e61b36c2bc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:54.036293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:54.048871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a5736-251d-4cab-9e18-e1e5f16618e5 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:54.119020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:54.119796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:54.120140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:54.120469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] PATH_INFO: `/v3/users/bd9119385cf44117bfb37c294d259011` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:54.121668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9119385cf44117bfb37c294d259011)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:54.123609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:54.200405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9119385cf44117bfb37c294d259011'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.202204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9119385cf44117bfb37c294d259011'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.203380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9119385cf44117bfb37c294d259011'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.223441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9119385cf44117bfb37c294d259011'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.233708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c7481fa8-3c6c-498a-979a-754e63e565e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9119385cf44117bfb37c294d259011'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.267253 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3904/7783] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:54 2022] DELETE /identity/v3/users/bd9119385cf44117bfb37c294d259011 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:54.686550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:54.689355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:54.720534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28a0c4-eecf-4a2c-8345-f607d0f3e4f3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:54.761933 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:54.796072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:54.796706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:54.796980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:54.797284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] PATH_INFO: `/v3/projects/22b5b9dd8a5d4a3bab486bffb98e4112` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:54.798438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b5b9dd8a5d4a3bab486bffb98e4112)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:54.800373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:54.850616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b5b9dd8a5d4a3bab486bffb98e4112', 'request_id': 'req-440d9365-28ba-4004-aaab-66d11f0946f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.857735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b5b9dd8a5d4a3bab486bffb98e4112', 'request_id': 'req-440d9365-28ba-4004-aaab-66d11f0946f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.866030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b5b9dd8a5d4a3bab486bffb98e4112', 'request_id': 'req-440d9365-28ba-4004-aaab-66d11f0946f3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.878886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] The token cache is being invalidate because project 22b5b9dd8a5d4a3bab486bffb98e4112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:54.879269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.879904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-440d9365-28ba-4004-aaab-66d11f0946f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:54.881730 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3880/7784] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:54 2022] DELETE /identity/v3/projects/22b5b9dd8a5d4a3bab486bffb98e4112 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:54.886418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674abee-356d-4f63-9c93-a8116b393199 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:54.886702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674abee-356d-4f63-9c93-a8116b393199 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:54.886971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674abee-356d-4f63-9c93-a8116b393199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:54.908129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d674abee-356d-4f63-9c93-a8116b393199 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:54.910037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d674abee-356d-4f63-9c93-a8116b393199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:54.949456 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:54.971415 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3905/7785] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:54.979604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77abb-2c41-496e-88bb-fcf216ce9a44 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:54.979905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77abb-2c41-496e-88bb-fcf216ce9a44 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:54.980346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77abb-2c41-496e-88bb-fcf216ce9a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.003872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-81c77abb-2c41-496e-88bb-fcf216ce9a44 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:55.005162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-81c77abb-2c41-496e-88bb-fcf216ce9a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:55.013841 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3881/7786] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:55.018045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674abee-356d-4f63-9c93-a8116b393199 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.028472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674abee-356d-4f63-9c93-a8116b393199 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.033335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.033957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.034232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.035352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.036280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:38:55.036588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.038225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.051583 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3906/7787] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:38:55.056187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c77abb-2c41-496e-88bb-fcf216ce9a44 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.066873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c77abb-2c41-496e-88bb-fcf216ce9a44 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.072948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.073617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.073892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.074159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.074907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.076822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.105098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3882/7788] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:55 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:55.109202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.119670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe305-b801-4c20-a64d-4e97556405b2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.184168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.184785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.185266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.185540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.186174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.188114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.214878 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3907/7789] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:55 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:38:55.219243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.232206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c38ba-4573-4b32-abfa-ffa1d702ab8f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.238947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.239488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.239850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.240199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.240976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.243175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.255611 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3883/7790] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:55.259585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.271149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510f6cc-d1a1-4330-a00f-de64f86cc488 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.276039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e4d2d-da79-4c5b-ab3c-e05f815fd26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.276758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e4d2d-da79-4c5b-ab3c-e05f815fd26b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.282174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e4d2d-da79-4c5b-ab3c-e05f815fd26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.282174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e4d2d-da79-4c5b-ab3c-e05f815fd26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.282174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e4d2d-da79-4c5b-ab3c-e05f815fd26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.282174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e4d2d-da79-4c5b-ab3c-e05f815fd26b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.300056 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3908/7791] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:55.306354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.321107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9992f-38fe-4965-8171-1f0ed3e6ae72 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.326513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.328289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.328795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.329286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] PATH_INFO: `/v3/projects/3407904de86b4630b089adc1bc45046b/users/27556273a2e84605acb6c72d24ef2b41/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.349832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3407904de86b4630b089adc1bc45046b, user_id=27556273a2e84605acb6c72d24ef2b41, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.353033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.372853 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3884/7792] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:55 2022] PUT /identity/v3/projects/3407904de86b4630b089adc1bc45046b/users/27556273a2e84605acb6c72d24ef2b41/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:55.387639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e04c-922a-455c-8cf8-c22757f984db None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.387932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e04c-922a-455c-8cf8-c22757f984db None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.388277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548e04c-922a-455c-8cf8-c22757f984db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.425609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8548e04c-922a-455c-8cf8-c22757f984db None None] MFA Rules not processed for user `27556273a2e84605acb6c72d24ef2b41`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:55.427070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8548e04c-922a-455c-8cf8-c22757f984db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:55.519587 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3909/7793] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:55.534393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.613724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc458a-e0bb-47c9-9539-fc868724cc86 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.619944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.620173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.620374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.620572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.623083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.623989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.631501 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:55.667831 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3885/7794] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:38:55 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:55.672202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e04c-922a-455c-8cf8-c22757f984db None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.702686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548e04c-922a-455c-8cf8-c22757f984db None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.767381 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:55.802358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.802881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.803223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.803560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.804275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.807735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.848992 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3910/7795] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:38:55 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:38:55.852746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.864505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3f01e-5ab6-447f-8dc3-463935704aae admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.869456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.870263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.870363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.870601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.871241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.872899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.888970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.889985 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3886/7796] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:38:55.900407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f0e2-cbd3-45c3-a0e1-bf1ae2124401 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:55.905776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:55.906576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:55.906858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:55.907131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] PATH_INFO: `/v3/projects/6d80fa7f71714cd9a3559f2e3707241c/users/8e399c15c637462c83594fb1b405efbf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:55.924297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d80fa7f71714cd9a3559f2e3707241c, user_id=8e399c15c637462c83594fb1b405efbf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:55.927198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:55.944589 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3911/7797] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:55 2022] PUT /identity/v3/projects/6d80fa7f71714cd9a3559f2e3707241c/users/8e399c15c637462c83594fb1b405efbf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:38:55.948452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:55.959764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78079-bcaf-4111-becf-3ed77dee93bd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:56.020507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d9330-8bff-454f-b516-f5dd1de47b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:56.021232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d9330-8bff-454f-b516-f5dd1de47b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:56.021611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d9330-8bff-454f-b516-f5dd1de47b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:56.021709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d9330-8bff-454f-b516-f5dd1de47b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:56.022339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d9330-8bff-454f-b516-f5dd1de47b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:56.023936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d9330-8bff-454f-b516-f5dd1de47b38 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:56.035442 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3887/7798] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:38:56.039396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:56.050665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4bf40-5835-4114-8e5e-75cc5a4cb511 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:56.055545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:56.056274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:56.056618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:56.056960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] PATH_INFO: `/v3/projects/6d80fa7f71714cd9a3559f2e3707241c/users/8e399c15c637462c83594fb1b405efbf/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:56.059111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d80fa7f71714cd9a3559f2e3707241c, user_id=8e399c15c637462c83594fb1b405efbf, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:56.061853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:56.086370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:56.086712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:56.087065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:56.089892 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3912/7799] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:38:56 2022] PUT /identity/v3/projects/6d80fa7f71714cd9a3559f2e3707241c/users/8e399c15c637462c83594fb1b405efbf/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:56.117990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] MFA Rules not processed for user `8e399c15c637462c83594fb1b405efbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:56.119295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:56.208274 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3888/7800] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:56.218510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:56.220223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:56.335407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46c635-14fa-4817-a06e-d46c0b8cd76f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:56.342807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b928b30-c6f4-4d57-85e0-d7f10ae80fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:56.343436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928b30-c6f4-4d57-85e0-d7f10ae80fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:56.343713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928b30-c6f4-4d57-85e0-d7f10ae80fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:56.344015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928b30-c6f4-4d57-85e0-d7f10ae80fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:56.426689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b928b30-c6f4-4d57-85e0-d7f10ae80fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:56.428160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b928b30-c6f4-4d57-85e0-d7f10ae80fd1 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:56.439225 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3913/7801] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:38:58.227315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:58.228808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:58.293098 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:58.299146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04ea4-87eb-4079-8427-a724e10cd8fc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:58.306167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:58.306886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:58.307238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:58.307579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] PATH_INFO: `/v3/users/cd0ad85ab46c48ec813d1c2d07ba7713` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:58.308788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0ad85ab46c48ec813d1c2d07ba7713)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:58.310793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:58.365456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0ad85ab46c48ec813d1c2d07ba7713'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:58.366245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0ad85ab46c48ec813d1c2d07ba7713'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:58.366921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0ad85ab46c48ec813d1c2d07ba7713'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:58.384852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0ad85ab46c48ec813d1c2d07ba7713'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:58.414859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0ad85ab46c48ec813d1c2d07ba7713'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:58.442798 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3889/7802] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:58 2022] DELETE /identity/v3/users/cd0ad85ab46c48ec813d1c2d07ba7713 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:58.447556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:58.448032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:58.448136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:58.477249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:38:58.478617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:58.529807 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:58.559703 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3914/7803] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:38:58.574928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:58.576387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:58.652842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704adc4b-f5f5-4a6d-a3f2-33ba8b51edcb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:58.657223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:58.657975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:58.658378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:58.658747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:58.669710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:58.671297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:58.684697 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3890/7804] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:38:58.973795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:58.975354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:59.000406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2721e9-f785-4983-8fc1-2ed036e3c734 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:59.023533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:59.024188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.024465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.024737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] PATH_INFO: `/v3/projects/956e51126f4348c1bc4562bcd9bcc9f7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.026268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956e51126f4348c1bc4562bcd9bcc9f7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:59.029200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:59.086724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956e51126f4348c1bc4562bcd9bcc9f7', 'request_id': 'req-030024bf-2f26-42c9-be4d-f77e423200c0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.094075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956e51126f4348c1bc4562bcd9bcc9f7', 'request_id': 'req-030024bf-2f26-42c9-be4d-f77e423200c0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.101446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956e51126f4348c1bc4562bcd9bcc9f7', 'request_id': 'req-030024bf-2f26-42c9-be4d-f77e423200c0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.121126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] The token cache is being invalidate because project 956e51126f4348c1bc4562bcd9bcc9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:38:59.121126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.121126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.121892 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3915/7805] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:58 2022] DELETE /identity/v3/projects/956e51126f4348c1bc4562bcd9bcc9f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:59.135338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:59.148536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c86687-bcaf-4170-bd5a-c575c1fb54de service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:59.245366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:59.246145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.247468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.247932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] PATH_INFO: `/v3/users/1eeb0162809b4f7a958507514b041e13` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.249266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eeb0162809b4f7a958507514b041e13)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:59.251560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:38:59.294830 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:38:59.336029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eeb0162809b4f7a958507514b041e13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.337699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eeb0162809b4f7a958507514b041e13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.338444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eeb0162809b4f7a958507514b041e13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.349054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eeb0162809b4f7a958507514b041e13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.363944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eeb0162809b4f7a958507514b041e13'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:38:59.393147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3891/7806] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:38:59 2022] DELETE /identity/v3/users/1eeb0162809b4f7a958507514b041e13 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:38:59.806228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:38:59.808270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:38:59.843353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030024bf-2f26-42c9-be4d-f77e423200c0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:38:59.931872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:38:59.932813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:38:59.933283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:38:59.933668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] PATH_INFO: `/v3/projects/9619217ae05b4dd9aa0081618937e07f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:38:59.935037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9619217ae05b4dd9aa0081618937e07f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:38:59.937383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.004143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9619217ae05b4dd9aa0081618937e07f', 'request_id': 'req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.011578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9619217ae05b4dd9aa0081618937e07f', 'request_id': 'req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.019731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9619217ae05b4dd9aa0081618937e07f', 'request_id': 'req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.037878 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:00.043944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] The token cache is being invalidate because project 9619217ae05b4dd9aa0081618937e07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:00.044316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.045081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.047246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3916/7807] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:38:59 2022] DELETE /identity/v3/projects/9619217ae05b4dd9aa0081618937e07f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:00.051530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.052926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:00.071747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475190fa-e61d-4f91-a5c9-1010e4aaceb2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.135508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.136057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.136340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.136619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] PATH_INFO: `/v3/users/8222e8d24f6443fc9add104ae481bf7f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.137920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8222e8d24f6443fc9add104ae481bf7f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.139864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.197769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8222e8d24f6443fc9add104ae481bf7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.198565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8222e8d24f6443fc9add104ae481bf7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.199196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8222e8d24f6443fc9add104ae481bf7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.207106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8222e8d24f6443fc9add104ae481bf7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.221175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4a00de75-b68d-473d-889c-96c660d5ee13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8222e8d24f6443fc9add104ae481bf7f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.241685 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3892/7808] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:00 2022] DELETE /identity/v3/users/8222e8d24f6443fc9add104ae481bf7f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:00.667819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:00.669618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:00.711094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e31691-e3f0-4fa2-a1f0-ab9fe8cbe98e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:00.802799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:00.803467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.803745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.804072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] PATH_INFO: `/v3/projects/298a58de7c6949f58b65bec8aea2525c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.805687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298a58de7c6949f58b65bec8aea2525c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:00.808231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:00.879269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298a58de7c6949f58b65bec8aea2525c', 'request_id': 'req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.885477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298a58de7c6949f58b65bec8aea2525c', 'request_id': 'req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.893150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298a58de7c6949f58b65bec8aea2525c', 'request_id': 'req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.911221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] The token cache is being invalidate because project 298a58de7c6949f58b65bec8aea2525c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:00.911510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.912137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e6b4ec31-85e6-4901-bd0e-d38d108a21b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:00.913768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3917/7809] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:00 2022] DELETE /identity/v3/projects/298a58de7c6949f58b65bec8aea2525c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:00.919895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef92e-7476-4fec-ab03-e483f3bbe23e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:00.920334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef92e-7476-4fec-ab03-e483f3bbe23e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:00.920523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ef92e-7476-4fec-ab03-e483f3bbe23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:00.946663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2b4ef92e-7476-4fec-ab03-e483f3bbe23e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:00.947787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2b4ef92e-7476-4fec-ab03-e483f3bbe23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:00.959218 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:01.015042 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3893/7810] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:01.023618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bedbe-9548-4dd5-9457-12ea545237f8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.023915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bedbe-9548-4dd5-9457-12ea545237f8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.024181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bedbe-9548-4dd5-9457-12ea545237f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.045035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3c6bedbe-9548-4dd5-9457-12ea545237f8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:01.046250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3c6bedbe-9548-4dd5-9457-12ea545237f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:01.055100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3918/7811] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:01.059243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ef92e-7476-4fec-ab03-e483f3bbe23e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.070268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ef92e-7476-4fec-ab03-e483f3bbe23e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.075650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.076406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.076778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.077187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.077927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:01.078328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.080114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.097385 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3894/7812] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:01.101048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bedbe-9548-4dd5-9457-12ea545237f8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.110724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bedbe-9548-4dd5-9457-12ea545237f8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.116049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.116655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.116924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.117253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.117874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.119781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.149919 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3919/7813] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:01 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:01.154491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.165929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc023d0-509a-40f3-8c8c-f1ca6849765f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.227231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.227992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.228371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.228809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.229578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.231616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.260356 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3895/7814] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:01 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:39:01.262436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.275874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390adcf-4a42-482b-8ffd-4ded0cd1bfb0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.281516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.282122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.282402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.282696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.283358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.285043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.295803 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3920/7815] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:01.299740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.310857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a9bd-df5d-48ee-894c-19b165d5d541 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.315498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee8e5-ecbc-47ba-9d0b-5225bbd0bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.316298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee8e5-ecbc-47ba-9d0b-5225bbd0bcef admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.316568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee8e5-ecbc-47ba-9d0b-5225bbd0bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.316836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee8e5-ecbc-47ba-9d0b-5225bbd0bcef admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.317520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee8e5-ecbc-47ba-9d0b-5225bbd0bcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.319167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee8e5-ecbc-47ba-9d0b-5225bbd0bcef admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.330315 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3896/7816] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:01.334968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.345416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7926-3215-46fa-9559-151a2600062f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.351207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.351862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.352346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.352627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] PATH_INFO: `/v3/projects/5796cb934d8a4ddcaa9a432256f09e18/users/8a5fa33e2acb49d58e0349ffa94b2f4b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.367878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5796cb934d8a4ddcaa9a432256f09e18, user_id=8a5fa33e2acb49d58e0349ffa94b2f4b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.370641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.385861 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3921/7817] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:01 2022] PUT /identity/v3/projects/5796cb934d8a4ddcaa9a432256f09e18/users/8a5fa33e2acb49d58e0349ffa94b2f4b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:01.497130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41872a2-0bb1-4471-9d7e-b62d8483ea7d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.497856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41872a2-0bb1-4471-9d7e-b62d8483ea7d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.498239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41872a2-0bb1-4471-9d7e-b62d8483ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.539337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a41872a2-0bb1-4471-9d7e-b62d8483ea7d None None] MFA Rules not processed for user `8a5fa33e2acb49d58e0349ffa94b2f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:01.540702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a41872a2-0bb1-4471-9d7e-b62d8483ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:01.632171 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3897/7818] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:01.633430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.664374 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:01.711055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd4cb-0b3a-48a9-b031-53de4b1b083a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.716138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.716801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.717466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.717753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.718387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.720604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.756782 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3922/7819] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:01 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:01.760424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41872a2-0bb1-4471-9d7e-b62d8483ea7d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.774163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41872a2-0bb1-4471-9d7e-b62d8483ea7d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.786777 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:01.854736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.855487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.855774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.856038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.856694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.859467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.886342 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3898/7820] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:01 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:01.890369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.905344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887e7ad-4611-4560-8a01-d2855dee1b8c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.911676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.912296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.912576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.912871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.913542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.915332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:01.932174 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3923/7821] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:01.938380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:01.953777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad627186-f752-4a75-897b-8b5433131be9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:01.960626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:01.969113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:01.969113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:01.969113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] PATH_INFO: `/v3/projects/acdea87ccac74aad9109afbb67837640/users/bca50c693df14a2d99a7f82199ac992a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:01.989455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdea87ccac74aad9109afbb67837640, user_id=bca50c693df14a2d99a7f82199ac992a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:01.993146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:02.011792 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3899/7822] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:01 2022] PUT /identity/v3/projects/acdea87ccac74aad9109afbb67837640/users/bca50c693df14a2d99a7f82199ac992a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:02.015741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:02.026325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803c267-5479-4bfe-99f5-f5436f0907eb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:02.118461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2896f-8131-41db-9095-c08c19720b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:02.119552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2896f-8131-41db-9095-c08c19720b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:02.122774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2896f-8131-41db-9095-c08c19720b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:02.122774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2896f-8131-41db-9095-c08c19720b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:02.122774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2896f-8131-41db-9095-c08c19720b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:02.124422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2896f-8131-41db-9095-c08c19720b38 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:02.139927 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3924/7823] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:02.146858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:02.182414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264d9f-589b-4a52-9754-d028d9d15a30 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:02.187481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:02.188150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:02.188438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:02.188739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] PATH_INFO: `/v3/projects/acdea87ccac74aad9109afbb67837640/users/bca50c693df14a2d99a7f82199ac992a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:02.191681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdea87ccac74aad9109afbb67837640, user_id=bca50c693df14a2d99a7f82199ac992a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:02.196917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:02.212578 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3900/7824] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:02 2022] PUT /identity/v3/projects/acdea87ccac74aad9109afbb67837640/users/bca50c693df14a2d99a7f82199ac992a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:02.223595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329ea6-cf52-4dae-8009-4539f1dad939 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:02.223896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329ea6-cf52-4dae-8009-4539f1dad939 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:02.224436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329ea6-cf52-4dae-8009-4539f1dad939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:02.257043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a3329ea6-cf52-4dae-8009-4539f1dad939 None None] MFA Rules not processed for user `bca50c693df14a2d99a7f82199ac992a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:02.258543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3329ea6-cf52-4dae-8009-4539f1dad939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:02.387177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3925/7825] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:02.399294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:02.401043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:02.485482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd18276-3f84-4ec1-bfd4-17ffb992fd21 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:02.491189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a2746-ae66-4fe8-be1c-cd7142e39631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:02.492038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a2746-ae66-4fe8-be1c-cd7142e39631 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:02.492396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a2746-ae66-4fe8-be1c-cd7142e39631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:02.492790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a2746-ae66-4fe8-be1c-cd7142e39631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:02.505329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a2746-ae66-4fe8-be1c-cd7142e39631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:02.507118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a2746-ae66-4fe8-be1c-cd7142e39631 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:02.523507 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3901/7826] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:02.678370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3329ea6-cf52-4dae-8009-4539f1dad939 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:02.704459 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:02.765299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3329ea6-cf52-4dae-8009-4539f1dad939 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:02.774578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:02.775267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:02.775553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:02.775825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] PATH_INFO: `/v3/users/8a5fa33e2acb49d58e0349ffa94b2f4b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:02.777152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5fa33e2acb49d58e0349ffa94b2f4b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:02.779922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:02.835983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5fa33e2acb49d58e0349ffa94b2f4b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:02.836659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5fa33e2acb49d58e0349ffa94b2f4b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:02.837306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5fa33e2acb49d58e0349ffa94b2f4b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:02.852192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5fa33e2acb49d58e0349ffa94b2f4b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:02.861008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5fa33e2acb49d58e0349ffa94b2f4b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:02.881345 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3926/7827] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:02 2022] DELETE /identity/v3/users/8a5fa33e2acb49d58e0349ffa94b2f4b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:02.883259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:02.883625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:02.883969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:02.904932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:02.906283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:02.967787 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3902/7828] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:02.978131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:02.979576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:03.045909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c3c6-1fe8-49b6-bdef-3a7ce3103df0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:03.049703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:03.051439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:03.051723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:03.051996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:03.061933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:03.063365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:03.076619 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3927/7829] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:03.470717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:03.473101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:03.487581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc920b23-9ed0-44d9-88ea-e7532bd7377f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:03.513904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:03.514775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:03.515222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:03.515638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] PATH_INFO: `/v3/projects/5796cb934d8a4ddcaa9a432256f09e18` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:03.517136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5796cb934d8a4ddcaa9a432256f09e18)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:03.519906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:03.521836 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:03.576016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5796cb934d8a4ddcaa9a432256f09e18', 'request_id': 'req-7193a265-4eb0-42db-b70c-400a004f7b6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.583469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5796cb934d8a4ddcaa9a432256f09e18', 'request_id': 'req-7193a265-4eb0-42db-b70c-400a004f7b6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.591584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5796cb934d8a4ddcaa9a432256f09e18', 'request_id': 'req-7193a265-4eb0-42db-b70c-400a004f7b6a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.604494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] The token cache is being invalidate because project 5796cb934d8a4ddcaa9a432256f09e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:03.604987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.605661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.607355 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3903/7830] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:03 2022] DELETE /identity/v3/projects/5796cb934d8a4ddcaa9a432256f09e18 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:03.611276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:03.621555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff95d3a-2a64-4a3f-8066-093caf3d9f75 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:03.665845 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:03.686550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:03.687495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:03.687876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:03.688308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] PATH_INFO: `/v3/users/bca50c693df14a2d99a7f82199ac992a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:03.689601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca50c693df14a2d99a7f82199ac992a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:03.692451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:03.745099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca50c693df14a2d99a7f82199ac992a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.745893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca50c693df14a2d99a7f82199ac992a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.746713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca50c693df14a2d99a7f82199ac992a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.761770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca50c693df14a2d99a7f82199ac992a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.769406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ece0419d-bf31-4b52-b988-a8c35d9bd17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca50c693df14a2d99a7f82199ac992a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:03.786153 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3928/7831] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:03 2022] DELETE /identity/v3/users/bca50c693df14a2d99a7f82199ac992a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:04.102228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.103893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:04.123263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a265-4eb0-42db-b70c-400a004f7b6a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.201586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.202216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.202489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.202751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] PATH_INFO: `/v3/projects/acdea87ccac74aad9109afbb67837640` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.203887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdea87ccac74aad9109afbb67837640)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.205861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.273145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdea87ccac74aad9109afbb67837640', 'request_id': 'req-4aa28425-181d-4452-9095-2c2395672e0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:04.281677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdea87ccac74aad9109afbb67837640', 'request_id': 'req-4aa28425-181d-4452-9095-2c2395672e0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:04.291683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdea87ccac74aad9109afbb67837640', 'request_id': 'req-4aa28425-181d-4452-9095-2c2395672e0f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:04.304976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] The token cache is being invalidate because project acdea87ccac74aad9109afbb67837640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:04.305307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:04.306128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4aa28425-181d-4452-9095-2c2395672e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:04.308050 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3904/7832] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:04 2022] DELETE /identity/v3/projects/acdea87ccac74aad9109afbb67837640 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:04.322708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7100a4-bad6-4068-a91d-66de3c3d6f9c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.323803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7100a4-bad6-4068-a91d-66de3c3d6f9c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.324082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7100a4-bad6-4068-a91d-66de3c3d6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.344963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9d7100a4-bad6-4068-a91d-66de3c3d6f9c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:04.346267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d7100a4-bad6-4068-a91d-66de3c3d6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:04.415298 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3929/7833] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:04.423736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7bf8-a51f-4543-b087-aab225dcf893 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.424025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7bf8-a51f-4543-b087-aab225dcf893 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.424460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7bf8-a51f-4543-b087-aab225dcf893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.447538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4b4d7bf8-a51f-4543-b087-aab225dcf893 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:04.448879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b4d7bf8-a51f-4543-b087-aab225dcf893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:04.490354 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3905/7834] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:04.491750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7100a4-bad6-4068-a91d-66de3c3d6f9c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.505957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7100a4-bad6-4068-a91d-66de3c3d6f9c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.513574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.514511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.514885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.515379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.516214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:04.516613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.518298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.541449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7bf8-a51f-4543-b087-aab225dcf893 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.546344 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3930/7835] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:04.552746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7bf8-a51f-4543-b087-aab225dcf893 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.562002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.562689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.563038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.563381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.564082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.566887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.584642 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:04.629589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3906/7836] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:04 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:04.634167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.644250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.646607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099b7a0-41b8-4e81-b3d3-774e732cb16f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.647009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:04.699677 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:04.723382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.724190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.724556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.724864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.725705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.729677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.737714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c717fc-1518-4859-9064-ee9a4d98518e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.742123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.743145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.743431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.743804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.746022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:04.763375 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3931/7837] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:04 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:39:04.768419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.783920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b57cb-09bd-4e5d-bd65-d86c812a7231 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.792308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.792907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.793218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.793490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.794251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.795951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.807849 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3932/7838] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:04.811520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.822828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3eb3-f625-4811-844b-db307e9ec74b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.824864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.826933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.827644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e363f5c-ce0c-44f6-94d5-00c63e1c556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.828248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e363f5c-ce0c-44f6-94d5-00c63e1c556e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.828536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e363f5c-ce0c-44f6-94d5-00c63e1c556e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.828785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e363f5c-ce0c-44f6-94d5-00c63e1c556e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.829589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e363f5c-ce0c-44f6-94d5-00c63e1c556e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.831567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e363f5c-ce0c-44f6-94d5-00c63e1c556e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.838581 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3907/7839] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:39:04.847178 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3933/7840] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:04.848026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:04.862793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288db3f4-c7a5-4706-9b29-36645f586ae6 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:04.867751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:04.868407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.868681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.868951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] PATH_INFO: `/v3/projects/c147be98ee3c43fc92e2b96a12826253/users/1d4ed4f0d0fd4609bdfe04cbf3b93d48/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.886876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c147be98ee3c43fc92e2b96a12826253, user_id=1d4ed4f0d0fd4609bdfe04cbf3b93d48, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:04.889817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:04.911625 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3908/7841] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:04 2022] PUT /identity/v3/projects/c147be98ee3c43fc92e2b96a12826253/users/1d4ed4f0d0fd4609bdfe04cbf3b93d48/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:39:04.931917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c213-be53-471c-af39-8291cc9d7129 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:04.932636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c213-be53-471c-af39-8291cc9d7129 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:04.933160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c213-be53-471c-af39-8291cc9d7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:04.974894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e1e8c213-be53-471c-af39-8291cc9d7129 None None] MFA Rules not processed for user `1d4ed4f0d0fd4609bdfe04cbf3b93d48`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:04.976103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e1e8c213-be53-471c-af39-8291cc9d7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:05.070480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3934/7842] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:05.087060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:05.088807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:05.192564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04514-9de4-4581-a995-b14d364de0e8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:05.198267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ddc1e-38a4-4057-8343-8f163a0017d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:05.199095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ddc1e-38a4-4057-8343-8f163a0017d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:05.199557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ddc1e-38a4-4057-8343-8f163a0017d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:05.200565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ddc1e-38a4-4057-8343-8f163a0017d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:05.215105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ddc1e-38a4-4057-8343-8f163a0017d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:05.216745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ddc1e-38a4-4057-8343-8f163a0017d3 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:05.229174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3909/7843] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:39:15.062354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:15.223040 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:16.656205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8c213-be53-471c-af39-8291cc9d7129 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:16.773566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8c213-be53-471c-af39-8291cc9d7129 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:16.785114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:16.785821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:16.786104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:16.786378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] PATH_INFO: `/v3/users/1d4ed4f0d0fd4609bdfe04cbf3b93d48` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:16.790365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4ed4f0d0fd4609bdfe04cbf3b93d48)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:16.794773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:16.911985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4ed4f0d0fd4609bdfe04cbf3b93d48'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:16.913769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4ed4f0d0fd4609bdfe04cbf3b93d48'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:16.914598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4ed4f0d0fd4609bdfe04cbf3b93d48'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:16.932433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4ed4f0d0fd4609bdfe04cbf3b93d48'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:16.940396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4ed4f0d0fd4609bdfe04cbf3b93d48'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:16.957326 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3935/7844] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:16 2022] DELETE /identity/v3/users/1d4ed4f0d0fd4609bdfe04cbf3b93d48 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:16.961489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:16.961951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:16.962067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:17.015052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:17.016582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:17.130994 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3910/7845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:17.141422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:17.143019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:17.244914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd703fe-040a-40ad-b384-5470c8bcfdbe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:17.258500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd4036-6f17-47a7-a7a5-6e91a90096ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:17.259264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd4036-6f17-47a7-a7a5-6e91a90096ac service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:17.259827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd4036-6f17-47a7-a7a5-6e91a90096ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:17.260201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd4036-6f17-47a7-a7a5-6e91a90096ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:17.279170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd4036-6f17-47a7-a7a5-6e91a90096ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:17.280793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd4036-6f17-47a7-a7a5-6e91a90096ac service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:17.301729 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3936/7846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:17.762306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:17.763841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:17.788822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a487a72-fd1c-4629-9847-7911f563e5fb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:17.793870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:17.794509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:17.794783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:17.795049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] PATH_INFO: `/v3/projects/c147be98ee3c43fc92e2b96a12826253` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:17.808060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c147be98ee3c43fc92e2b96a12826253)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:17.810648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:17.903482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c147be98ee3c43fc92e2b96a12826253', 'request_id': 'req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:17.912134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c147be98ee3c43fc92e2b96a12826253', 'request_id': 'req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:17.920928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c147be98ee3c43fc92e2b96a12826253', 'request_id': 'req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:17.936453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] The token cache is being invalidate because project c147be98ee3c43fc92e2b96a12826253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:17.936911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:17.937954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:17.939754 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3911/7847] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:17 2022] DELETE /identity/v3/projects/c147be98ee3c43fc92e2b96a12826253 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:17.945560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59875568-e425-4dd8-8705-1ad5a41bfb70 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:17.946020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59875568-e425-4dd8-8705-1ad5a41bfb70 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:17.946194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59875568-e425-4dd8-8705-1ad5a41bfb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:17.952120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:17.953663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:17.984935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-59875568-e425-4dd8-8705-1ad5a41bfb70 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:17.986224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59875568-e425-4dd8-8705-1ad5a41bfb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:18.011721 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:18.057510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901364-b7c4-4e0c-8ce7-280fbc1358f1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.068130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.068907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.069085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.069373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] PATH_INFO: `/v3/users/27556273a2e84605acb6c72d24ef2b41` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.070730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27556273a2e84605acb6c72d24ef2b41)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.078541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.080927 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3937/7848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:18.089732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318ed9-3d7f-4861-85b8-502328935873 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.090198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318ed9-3d7f-4861-85b8-502328935873 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.091508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318ed9-3d7f-4861-85b8-502328935873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.137396 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:18.140938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-32318ed9-3d7f-4861-85b8-502328935873 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:18.142518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-32318ed9-3d7f-4861-85b8-502328935873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:18.151951 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3938/7849] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:18.156261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318ed9-3d7f-4861-85b8-502328935873 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:18.165696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27556273a2e84605acb6c72d24ef2b41'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:18.167089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27556273a2e84605acb6c72d24ef2b41'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:18.167845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27556273a2e84605acb6c72d24ef2b41'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:18.172421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32318ed9-3d7f-4861-85b8-502328935873 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.176960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27556273a2e84605acb6c72d24ef2b41'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:18.179151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.179936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.180366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.180787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.181903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:18.182520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.184984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.191264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-378bcf23-9112-4ae1-b4ec-216157204a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27556273a2e84605acb6c72d24ef2b41'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:18.200050 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3939/7850] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:39:18.204970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:18.208172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:18.217739 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3912/7851] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:17 2022] DELETE /identity/v3/users/27556273a2e84605acb6c72d24ef2b41 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:18.223741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.224028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.224314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.226889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b4ce1-d66e-4a44-9964-5d43c43c17d4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.247049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:18.248354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:18.311542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.313262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.313753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.314323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.316089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.318745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.332293 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3913/7852] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:18.333491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:18.335289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:18.363572 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3940/7853] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:18 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:18.367425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:18.412159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79152-3701-4b1b-885a-389e71a8a685 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.452903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f846ea-0c48-4dc8-9e70-36570364baad admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.459643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.460690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.460979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.461284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.461921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.463893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.503707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.504344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.504621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.504893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.517108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3941/7854] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:18 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:39:18.517366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.521657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:18.521794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.533998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9a6f2-8a46-4ce2-bc9a-60349bb48806 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.539518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.541424 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3914/7855] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:18.550866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.555694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.555984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.556929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.560491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.589138 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3942/7856] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:18.593873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:18.606174 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:18.617913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9df63-11a4-42c8-acbf-5d09a2fc9b4c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.624804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2bcaf-9326-46c3-9f8a-a33af0a1358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.625473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2bcaf-9326-46c3-9f8a-a33af0a1358a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.625837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2bcaf-9326-46c3-9f8a-a33af0a1358a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.626225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2bcaf-9326-46c3-9f8a-a33af0a1358a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.626998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2bcaf-9326-46c3-9f8a-a33af0a1358a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.631256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2bcaf-9326-46c3-9f8a-a33af0a1358a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.650194 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3915/7857] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:18.651283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:18.665328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9d003-f72f-4a5c-8873-b42782573697 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:18.680751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:18.681500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.681786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.682067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] PATH_INFO: `/v3/projects/2ff7d264773e475d9a9248fba1e86eb0/users/8ada7e878a34469b91f4295465a7045d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.686086 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:18.714998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff7d264773e475d9a9248fba1e86eb0, user_id=8ada7e878a34469b91f4295465a7045d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:18.720986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:18.751409 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3943/7858] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:18 2022] PUT /identity/v3/projects/2ff7d264773e475d9a9248fba1e86eb0/users/8ada7e878a34469b91f4295465a7045d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:18.763208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:18.763517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:18.763795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:18.807194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] MFA Rules not processed for user `8ada7e878a34469b91f4295465a7045d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:18.812738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:18.941907 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3916/7859] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:18.946277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.059773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e459ad-5613-4979-95d3-c41e01f4944b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.067844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.068550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.069477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.069477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.070028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.072576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.084122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.085921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.110944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f64e-093a-42d9-b100-307b3d901a24 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.114826 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3944/7860] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:18 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:19.115345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.189343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.190256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.191618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.191899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] PATH_INFO: `/v3/projects/3407904de86b4630b089adc1bc45046b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.193381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3407904de86b4630b089adc1bc45046b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.196122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.207138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99540b6-2a22-49c7-84d9-297c3993cb9b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.213735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.214493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.214968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.215347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.216169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.218523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.258942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3945/7861] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:19 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:19.262484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.275862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3822b-d7b2-4191-b12b-cabcf38a0db3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.282683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3407904de86b4630b089adc1bc45046b', 'request_id': 'req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.293042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3407904de86b4630b089adc1bc45046b', 'request_id': 'req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.305766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3407904de86b4630b089adc1bc45046b', 'request_id': 'req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.334457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] The token cache is being invalidate because project 3407904de86b4630b089adc1bc45046b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:19.336698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.337830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.341382 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3917/7862] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:19 2022] DELETE /identity/v3/projects/3407904de86b4630b089adc1bc45046b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:39:19.344224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.345859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.359097 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:19.368771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.371047 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:19.371261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.371565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.372096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.372752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.374440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.389441 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3946/7863] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:39:19.394535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.396683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.414760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4932-d2eb-4922-971f-9a914b8d17f9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.422083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.423011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.423670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.424112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] PATH_INFO: `/v3/projects/f6aacb14d91f4b4ab3c569301b982371/users/67bd51d71931411a9558b79d82cf05b6/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.448134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6aacb14d91f4b4ab3c569301b982371, user_id=67bd51d71931411a9558b79d82cf05b6, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.451313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.453971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b758f-9f13-4f7b-92ed-a2f28bea20d8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.460793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.461617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.462000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.462376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] PATH_INFO: `/v3/users/8e399c15c637462c83594fb1b405efbf` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.463708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e399c15c637462c83594fb1b405efbf)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.465958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.475203 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3947/7864] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:19 2022] PUT /identity/v3/projects/f6aacb14d91f4b4ab3c569301b982371/users/67bd51d71931411a9558b79d82cf05b6/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:19.480788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.526676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e399c15c637462c83594fb1b405efbf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.527771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e399c15c637462c83594fb1b405efbf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.528534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e399c15c637462c83594fb1b405efbf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.537323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e399c15c637462c83594fb1b405efbf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.554734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e399c15c637462c83594fb1b405efbf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:19.579040 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3918/7865] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:19 2022] DELETE /identity/v3/users/8e399c15c637462c83594fb1b405efbf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:19.584633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a4538-4157-4d20-aaca-d03e92b34b04 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.666575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.667178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.667489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.667763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.668470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.670227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.697599 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3948/7866] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:19.702017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.703600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.726857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b8e95-65dd-4725-b22b-9de56c80b918 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.743896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31051d-7598-4cc0-b5e9-6fe04bda10d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.744689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31051d-7598-4cc0-b5e9-6fe04bda10d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.745007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31051d-7598-4cc0-b5e9-6fe04bda10d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.745318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31051d-7598-4cc0-b5e9-6fe04bda10d0 admin admin] PATH_INFO: `/v3/projects/f6aacb14d91f4b4ab3c569301b982371/users/67bd51d71931411a9558b79d82cf05b6/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.748370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31051d-7598-4cc0-b5e9-6fe04bda10d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6aacb14d91f4b4ab3c569301b982371, user_id=67bd51d71931411a9558b79d82cf05b6, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:19.753963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31051d-7598-4cc0-b5e9-6fe04bda10d0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:19.773535 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3919/7867] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:19 2022] PUT /identity/v3/projects/f6aacb14d91f4b4ab3c569301b982371/users/67bd51d71931411a9558b79d82cf05b6/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:39:19.778346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.780599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.782487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.782776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.783145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.844331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] MFA Rules not processed for user `67bd51d71931411a9558b79d82cf05b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:19.847676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.890511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82513a-bf86-47c2-8222-f431bda92672 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:19.928230 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:19.958567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3920/7868] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:19.972153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:19.973858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:19.974333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.975503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:19.975980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:19.976581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:19.979147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:19.979946 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:20.003462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:20.006027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:20.023424 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3949/7869] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:20.024808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:20.026251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:20.083984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8976ad-b2ba-42f1-b056-462aa0c50cf3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:20.089280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1500bf0-76c2-4621-9df7-ed6e5b648b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:20.091179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1500bf0-76c2-4621-9df7-ed6e5b648b23 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.092015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1500bf0-76c2-4621-9df7-ed6e5b648b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.092966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1500bf0-76c2-4621-9df7-ed6e5b648b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.095610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a1500bf0-76c2-4621-9df7-ed6e5b648b23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:20.123141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8ea13-ece0-45e1-b952-80272fe9434b service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:20.138272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:20.139112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.139511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.141654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] PATH_INFO: `/v3/projects/6d80fa7f71714cd9a3559f2e3707241c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.144071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d80fa7f71714cd9a3559f2e3707241c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:20.148150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:20.219186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d80fa7f71714cd9a3559f2e3707241c', 'request_id': 'req-5a91b868-dca2-4846-9f98-3bed2df540f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:20.225777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d80fa7f71714cd9a3559f2e3707241c', 'request_id': 'req-5a91b868-dca2-4846-9f98-3bed2df540f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:20.233122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d80fa7f71714cd9a3559f2e3707241c', 'request_id': 'req-5a91b868-dca2-4846-9f98-3bed2df540f0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:20.234837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1500bf0-76c2-4621-9df7-ed6e5b648b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:20.236585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1500bf0-76c2-4621-9df7-ed6e5b648b23 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:20.250759 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3921/7870] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:20.265480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] The token cache is being invalidate because project 6d80fa7f71714cd9a3559f2e3707241c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:20.265793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:20.266519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a91b868-dca2-4846-9f98-3bed2df540f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:20.269815 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3950/7871] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:20 2022] DELETE /identity/v3/projects/6d80fa7f71714cd9a3559f2e3707241c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:20.275560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a510-bd41-48fc-b0c0-9e46aa291e11 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.275849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a510-bd41-48fc-b0c0-9e46aa291e11 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.276135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a510-bd41-48fc-b0c0-9e46aa291e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.333407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a2c6a510-bd41-48fc-b0c0-9e46aa291e11 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:20.340586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a2c6a510-bd41-48fc-b0c0-9e46aa291e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:20.432546 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3922/7872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:20.434814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c0b7-ccd9-4197-ae9f-13f0e720af14 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.435240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c0b7-ccd9-4197-ae9f-13f0e720af14 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.435752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c0b7-ccd9-4197-ae9f-13f0e720af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.459404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3d49c0b7-ccd9-4197-ae9f-13f0e720af14 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:20.460986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d49c0b7-ccd9-4197-ae9f-13f0e720af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:20.473177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3951/7873] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:20.485971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a510-bd41-48fc-b0c0-9e46aa291e11 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:20.502081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a510-bd41-48fc-b0c0-9e46aa291e11 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:20.537903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:20.538625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.538909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.539224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.539871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:20.540204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:20.542230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:20.562329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c0b7-ccd9-4197-ae9f-13f0e720af14 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:20.567639 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3923/7874] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:20.574835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c0b7-ccd9-4197-ae9f-13f0e720af14 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:20.612508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:20.614946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.614946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.614946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.614946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:20.616371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:20.692962 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3952/7875] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:20 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:20.694202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:20.713332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c026-4d89-445e-bc5e-bce689bd5c04 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:20.813778 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:20.845631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:20.849430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.849796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.850280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.851017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:20.856817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:20.897914 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3924/7876] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:20 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:20.901776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:20.934454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee53601-c7f7-4a39-b367-5c7265d45d7f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:20.957765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:20.958555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:20.959808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:20.960093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:20.960755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:20.963031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:20.974367 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3953/7877] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:20.978816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:21.003146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda44d5-2144-4041-afdc-b7cd15c91492 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:21.017132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d03e39-06fe-4c98-bf9d-0068687ec740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:21.017887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03e39-06fe-4c98-bf9d-0068687ec740 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:21.018371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03e39-06fe-4c98-bf9d-0068687ec740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:21.018850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03e39-06fe-4c98-bf9d-0068687ec740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:21.020845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d03e39-06fe-4c98-bf9d-0068687ec740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:21.022819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d03e39-06fe-4c98-bf9d-0068687ec740 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:21.038246 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3925/7878] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:39:21.042585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:21.061180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a6db-cba4-40db-af6a-f0ec5d0a1673 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:21.067625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:21.068297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:21.068570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:21.068843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] PATH_INFO: `/v3/projects/6c936af97f414c30bc802107ccbaf2cf/users/300c6d3fa08044289d6de5d370014e19/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:21.087602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c936af97f414c30bc802107ccbaf2cf, user_id=300c6d3fa08044289d6de5d370014e19, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:21.090343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:21.119038 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:21.138397 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3954/7879] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:21 2022] PUT /identity/v3/projects/6c936af97f414c30bc802107ccbaf2cf/users/300c6d3fa08044289d6de5d370014e19/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:39:21.139713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:21.140177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:21.140319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:21.180231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] MFA Rules not processed for user `300c6d3fa08044289d6de5d370014e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:21.182491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:21.299174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3926/7880] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:21.307697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:21.309935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:21.406599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bae8c3-547e-4fbc-a31c-9937fb793ca6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:21.410479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a9046-9be5-4e7c-accf-4fa809a4629f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:21.411098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a9046-9be5-4e7c-accf-4fa809a4629f service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:21.411628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a9046-9be5-4e7c-accf-4fa809a4629f service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:21.411909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a9046-9be5-4e7c-accf-4fa809a4629f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:21.421243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a9046-9be5-4e7c-accf-4fa809a4629f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:21.422698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a9046-9be5-4e7c-accf-4fa809a4629f service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:21.433905 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3955/7881] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:26.479219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:26.483505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:26.613230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f9ba-d870-478a-8ead-bee2e3ba0289 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:26.630922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:26.631850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:26.632493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:26.632913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] PATH_INFO: `/v3/users/8ada7e878a34469b91f4295465a7045d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:26.636863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ada7e878a34469b91f4295465a7045d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:26.639717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:26.730025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ada7e878a34469b91f4295465a7045d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:26.731002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ada7e878a34469b91f4295465a7045d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:26.731732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ada7e878a34469b91f4295465a7045d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:26.744485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ada7e878a34469b91f4295465a7045d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:26.749676 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:26.768966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ada7e878a34469b91f4295465a7045d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:26.798220 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3927/7882] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:26 2022] DELETE /identity/v3/users/8ada7e878a34469b91f4295465a7045d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:26.803924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:26.804448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:26.804448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:26.841181 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:26.846317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:26.969233 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3956/7883] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:26.978208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:26.979592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:27.068205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6674a4-3b4c-4d7a-9417-ccf988ec3f93 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:27.075980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:27.076678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:27.077018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:27.077397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:27.097905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:27.099460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:27.116011 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3928/7884] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:27.448688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:27.450247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:27.480326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f7c88-ef7f-440a-b1c0-0f5fc6dafb4d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:27.490305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:27.491037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:27.491321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:27.491601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] PATH_INFO: `/v3/projects/2ff7d264773e475d9a9248fba1e86eb0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:27.493039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff7d264773e475d9a9248fba1e86eb0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:27.495162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:27.579851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff7d264773e475d9a9248fba1e86eb0', 'request_id': 'req-d1073a86-3e24-44b0-8774-708dc8d18528'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.588020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff7d264773e475d9a9248fba1e86eb0', 'request_id': 'req-d1073a86-3e24-44b0-8774-708dc8d18528'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.595415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff7d264773e475d9a9248fba1e86eb0', 'request_id': 'req-d1073a86-3e24-44b0-8774-708dc8d18528'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.611249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] The token cache is being invalidate because project 2ff7d264773e475d9a9248fba1e86eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:27.613071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.613895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.615557 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3957/7885] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:27 2022] DELETE /identity/v3/projects/2ff7d264773e475d9a9248fba1e86eb0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:27.619701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:27.633275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3e88c-521d-4e54-a4c8-1cc24354a03f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:27.716496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:27.717640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:27.720713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:27.722074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] PATH_INFO: `/v3/users/67bd51d71931411a9558b79d82cf05b6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:27.725866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bd51d71931411a9558b79d82cf05b6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:27.728318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:27.801753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bd51d71931411a9558b79d82cf05b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.803579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bd51d71931411a9558b79d82cf05b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.804712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bd51d71931411a9558b79d82cf05b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.817629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bd51d71931411a9558b79d82cf05b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.831597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-77f8691a-44c7-4725-b3c9-cdb45d088ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bd51d71931411a9558b79d82cf05b6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:27.850334 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:27.871401 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3929/7886] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:27 2022] DELETE /identity/v3/users/67bd51d71931411a9558b79d82cf05b6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:28.278498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:28.280199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:28.312621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1073a86-3e24-44b0-8774-708dc8d18528 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:28.354840 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:28.480858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:28.485618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:28.486515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:28.491754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] PATH_INFO: `/v3/projects/f6aacb14d91f4b4ab3c569301b982371` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:28.493530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6aacb14d91f4b4ab3c569301b982371)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:28.496582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:28.605843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6aacb14d91f4b4ab3c569301b982371', 'request_id': 'req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:28.612447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6aacb14d91f4b4ab3c569301b982371', 'request_id': 'req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:28.638254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6aacb14d91f4b4ab3c569301b982371', 'request_id': 'req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:28.678744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] The token cache is being invalidate because project f6aacb14d91f4b4ab3c569301b982371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:28.679167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:28.680195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b4ee5c02-76f0-4cb2-bafa-7b45f775436f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:28.682091 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3958/7887] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:28 2022] DELETE /identity/v3/projects/f6aacb14d91f4b4ab3c569301b982371 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:28.688446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd12e0-ec4c-43c8-b5cd-358d592ac5ff None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:28.688951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd12e0-ec4c-43c8-b5cd-358d592ac5ff None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:28.689050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd12e0-ec4c-43c8-b5cd-358d592ac5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:28.716306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-28bd12e0-ec4c-43c8-b5cd-358d592ac5ff None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:28.722048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28bd12e0-ec4c-43c8-b5cd-358d592ac5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:28.793183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3930/7888] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:28.802252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38357e1-4b20-4ed1-86dc-64c75905347e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:28.802543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38357e1-4b20-4ed1-86dc-64c75905347e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:28.802878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38357e1-4b20-4ed1-86dc-64c75905347e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:28.827105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b38357e1-4b20-4ed1-86dc-64c75905347e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:28.828448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b38357e1-4b20-4ed1-86dc-64c75905347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:28.838966 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3959/7889] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:28.842917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd12e0-ec4c-43c8-b5cd-358d592ac5ff None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:28.853858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd12e0-ec4c-43c8-b5cd-358d592ac5ff None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:28.859196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:28.859979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:28.860487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:28.860866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:28.861690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:28.862786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:28.864482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:28.881134 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3931/7890] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:28.885431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38357e1-4b20-4ed1-86dc-64c75905347e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:28.896754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38357e1-4b20-4ed1-86dc-64c75905347e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:28.902087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:28.903051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:28.903402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:28.903749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:28.904647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:28.906666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:28.956679 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3960/7891] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:28 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:28.962663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:28.979378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868f377-9ce2-48b0-aded-641f8875ae1a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.048471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.049875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.050179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.050480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.051123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.053319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.089196 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3932/7892] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:28 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:29.091909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:29.116106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093d4a-e6e3-4032-9f91-4c129971b04f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.122761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.123547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.123832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.124108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.124804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.126515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.158402 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3961/7893] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:29.163367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:29.176063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576e1ae-4dbe-49a0-a0dc-f7e3de16a669 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.181290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce9b1-4253-4ce5-af51-1f3eb6b0643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.181907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce9b1-4253-4ce5-af51-1f3eb6b0643a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.182188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce9b1-4253-4ce5-af51-1f3eb6b0643a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.182457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce9b1-4253-4ce5-af51-1f3eb6b0643a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.183241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abce9b1-4253-4ce5-af51-1f3eb6b0643a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.185137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abce9b1-4253-4ce5-af51-1f3eb6b0643a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.198261 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3933/7894] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:39:29.202374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:29.221706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8e9e-b914-4adb-bf50-8cc1f07c4216 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.228020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.228813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.229290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.229595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] PATH_INFO: `/v3/projects/6c92c8d6a310457eaa89bb1e8640b203/users/c8a84135f49b463295ac35f506e57d0d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.248006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c92c8d6a310457eaa89bb1e8640b203, user_id=c8a84135f49b463295ac35f506e57d0d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.251039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.269436 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3962/7895] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:29 2022] PUT /identity/v3/projects/6c92c8d6a310457eaa89bb1e8640b203/users/c8a84135f49b463295ac35f506e57d0d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:29.279675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b6a-e611-4b6f-8f1d-9814c025b824 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.279959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b6a-e611-4b6f-8f1d-9814c025b824 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.280233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1b6a-e611-4b6f-8f1d-9814c025b824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.372235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-391e1b6a-e611-4b6f-8f1d-9814c025b824 None None] MFA Rules not processed for user `c8a84135f49b463295ac35f506e57d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:29.372235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-391e1b6a-e611-4b6f-8f1d-9814c025b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:29.428277 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:29.454773 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3934/7896] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:29.455075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:29.542527 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:29.558182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad9f2f-4940-4fc2-946f-87a1efcfeca4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.564537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.565645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.566644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.567031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.567928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.570158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.609815 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3963/7897] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:29 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:39:29.614540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1b6a-e611-4b6f-8f1d-9814c025b824 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:29.641351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1b6a-e611-4b6f-8f1d-9814c025b824 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.719934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.721157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.721670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.721670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.722847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.724888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.754473 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3935/7898] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:29 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:29.758403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:29.770899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83df2-a755-4abb-8ab6-f7d23202fdbc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.776620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275efe1-d456-46c0-a61e-896c8514eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.777385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275efe1-d456-46c0-a61e-896c8514eded admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.778019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275efe1-d456-46c0-a61e-896c8514eded admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.778431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275efe1-d456-46c0-a61e-896c8514eded admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.779303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275efe1-d456-46c0-a61e-896c8514eded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.781087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275efe1-d456-46c0-a61e-896c8514eded admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.802569 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3964/7899] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:39:29.803596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:29.829884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181001a-ef40-4759-b1af-832fa9eccc68 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:29.841762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:29.842699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.843052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.843334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] PATH_INFO: `/v3/projects/6001e765cae64130967b39c66bff726f/users/c470e297ffb34e3384400ea634be83dc/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.864690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6001e765cae64130967b39c66bff726f, user_id=c470e297ffb34e3384400ea634be83dc, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:29.867795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:29.887254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3936/7900] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:29 2022] PUT /identity/v3/projects/6001e765cae64130967b39c66bff726f/users/c470e297ffb34e3384400ea634be83dc/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:29.898068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057142-d7df-4e50-ab92-e8da1128436e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:29.898389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057142-d7df-4e50-ab92-e8da1128436e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:29.898671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d057142-d7df-4e50-ab92-e8da1128436e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:29.936424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0d057142-d7df-4e50-ab92-e8da1128436e None None] MFA Rules not processed for user `c470e297ffb34e3384400ea634be83dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:29.937973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d057142-d7df-4e50-ab92-e8da1128436e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:30.057251 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3965/7901] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:30.086803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:30.088602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:30.219790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9055798-cb19-4536-b63c-a28a6cba0771 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:30.226945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1ee74-8ae8-46e5-a64d-f5aacb97178a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:30.227866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ee74-8ae8-46e5-a64d-f5aacb97178a service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:30.228150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ee74-8ae8-46e5-a64d-f5aacb97178a service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:30.228424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1ee74-8ae8-46e5-a64d-f5aacb97178a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:30.238498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1ee74-8ae8-46e5-a64d-f5aacb97178a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:30.240345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1ee74-8ae8-46e5-a64d-f5aacb97178a service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:30.255942 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3937/7902] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 676 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:39:31.245671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d057142-d7df-4e50-ab92-e8da1128436e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:31.356496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d057142-d7df-4e50-ab92-e8da1128436e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:31.362376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:31.363030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:31.363311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:31.363590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] PATH_INFO: `/v3/users/c8a84135f49b463295ac35f506e57d0d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:31.364765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a84135f49b463295ac35f506e57d0d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:31.366753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:31.433354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a84135f49b463295ac35f506e57d0d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:31.434814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a84135f49b463295ac35f506e57d0d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:31.435666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a84135f49b463295ac35f506e57d0d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:31.461426 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:31.468375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a84135f49b463295ac35f506e57d0d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:31.476292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a84135f49b463295ac35f506e57d0d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:31.491889 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3966/7903] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:31 2022] DELETE /identity/v3/users/c8a84135f49b463295ac35f506e57d0d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:31.496673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:31.498040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:31.498040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:31.544096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:31.561121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:31.597273 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:31.634453 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3938/7904] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:31.642623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:31.644265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:31.740973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2a67a-7344-4d77-993d-34e098d7dfa9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:31.745491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:31.746174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:31.746563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:31.747311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:31.774610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:31.776353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:31.798824 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3967/7905] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:32.290855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:32.292677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:32.314269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ac790-a4b0-479e-94bd-e1b4d936243a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:32.334798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:32.335409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:32.335695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:32.335995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] PATH_INFO: `/v3/projects/6c92c8d6a310457eaa89bb1e8640b203` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:32.337337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c92c8d6a310457eaa89bb1e8640b203)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:32.339248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:32.419558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c92c8d6a310457eaa89bb1e8640b203', 'request_id': 'req-42fa0adb-754c-42a7-ae28-cfe9822945c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.429938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c92c8d6a310457eaa89bb1e8640b203', 'request_id': 'req-42fa0adb-754c-42a7-ae28-cfe9822945c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.440292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c92c8d6a310457eaa89bb1e8640b203', 'request_id': 'req-42fa0adb-754c-42a7-ae28-cfe9822945c2'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.456519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] The token cache is being invalidate because project 6c92c8d6a310457eaa89bb1e8640b203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:32.457143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.458382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.460862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3939/7906] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:32 2022] DELETE /identity/v3/projects/6c92c8d6a310457eaa89bb1e8640b203 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:32.464606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:32.480664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5608792-3c45-4fb2-af08-cb872568b8e2 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:32.564537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:32.565407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:32.565695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:32.565968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] PATH_INFO: `/v3/users/c470e297ffb34e3384400ea634be83dc` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:32.567170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c470e297ffb34e3384400ea634be83dc)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:32.569173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:32.624975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c470e297ffb34e3384400ea634be83dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.625574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c470e297ffb34e3384400ea634be83dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.626235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c470e297ffb34e3384400ea634be83dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.650688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c470e297ffb34e3384400ea634be83dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.661897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-843b880f-6707-48b5-93b7-e0a1379eac51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c470e297ffb34e3384400ea634be83dc'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:32.668389 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:32.685819 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3968/7907] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:32 2022] DELETE /identity/v3/users/c470e297ffb34e3384400ea634be83dc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:33.048390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:33.053474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:33.092942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa0adb-754c-42a7-ae28-cfe9822945c2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:33.171628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:33.172632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.173409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.173893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] PATH_INFO: `/v3/projects/6001e765cae64130967b39c66bff726f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.175728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6001e765cae64130967b39c66bff726f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:33.178799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:33.240625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6001e765cae64130967b39c66bff726f', 'request_id': 'req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:33.256505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6001e765cae64130967b39c66bff726f', 'request_id': 'req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:33.270585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6001e765cae64130967b39c66bff726f', 'request_id': 'req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:33.280745 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:33.297381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] The token cache is being invalidate because project 6001e765cae64130967b39c66bff726f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:33.298054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:33.303482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5a5a5444-a5a2-4a66-84c6-d9c4cd1c7ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:33.307016 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3940/7908] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:33 2022] DELETE /identity/v3/projects/6001e765cae64130967b39c66bff726f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:33.316186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89de29-8faf-4653-aaa3-4c80cd030e91 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.316514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89de29-8faf-4653-aaa3-4c80cd030e91 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.316793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89de29-8faf-4653-aaa3-4c80cd030e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.351289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ca89de29-8faf-4653-aaa3-4c80cd030e91 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:33.353119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ca89de29-8faf-4653-aaa3-4c80cd030e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:33.467126 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3969/7909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:33.475314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49fb1d-a8ac-4029-911b-988081721a63 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.475603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49fb1d-a8ac-4029-911b-988081721a63 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.475882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49fb1d-a8ac-4029-911b-988081721a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.512024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9d49fb1d-a8ac-4029-911b-988081721a63 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:33.513263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d49fb1d-a8ac-4029-911b-988081721a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:33.522456 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3941/7910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:33.526403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89de29-8faf-4653-aaa3-4c80cd030e91 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:33.537889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89de29-8faf-4653-aaa3-4c80cd030e91 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:33.542579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:33.543186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.543460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.543730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.544407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:33.544706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:33.546334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:33.561440 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3970/7911] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:39:33.566134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49fb1d-a8ac-4029-911b-988081721a63 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:33.585719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49fb1d-a8ac-4029-911b-988081721a63 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:33.598244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:33.599013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.599530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.599996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.600870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:33.602895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:33.645668 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3942/7912] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:33 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:39:33.650116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:33.664705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8fa34-a361-4ed3-a6ff-31bfa8d21db2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:33.752130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:33.752925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.753314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.753715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.754638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:33.757965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:33.782767 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3971/7913] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:33 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:33.787091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:33.799159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464fdc9-689a-4846-a0bf-3bd246f43277 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:33.805107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:33.805899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.806338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.806715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.807489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:33.810286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:33.850664 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3943/7914] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:33.860896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:33.877009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330f7c-0bc9-457d-86d9-f42e0fac87bb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:33.892556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d26f7-974b-413a-b0d8-462ee4b58958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:33.893849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d26f7-974b-413a-b0d8-462ee4b58958 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.894338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d26f7-974b-413a-b0d8-462ee4b58958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.894773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d26f7-974b-413a-b0d8-462ee4b58958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.895583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d26f7-974b-413a-b0d8-462ee4b58958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:33.897495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d26f7-974b-413a-b0d8-462ee4b58958 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:33.912363 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3972/7915] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:33.916272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:33.936282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5230a9-551e-4054-9f1f-8a12e882c2ee admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:33.941459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:33.942136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.942424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.942754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] PATH_INFO: `/v3/projects/0e615fe9aa6d4bc4ba21e86fa91132f7/users/cdcd4c00974245b2b38fb6f57c2007dd/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:33.961947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e615fe9aa6d4bc4ba21e86fa91132f7, user_id=cdcd4c00974245b2b38fb6f57c2007dd, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:33.965412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:33.983162 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3944/7916] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:33 2022] PUT /identity/v3/projects/0e615fe9aa6d4bc4ba21e86fa91132f7/users/cdcd4c00974245b2b38fb6f57c2007dd/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:33.989173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264856-a21e-4300-b560-7e0b7660b26e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:33.989752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264856-a21e-4300-b560-7e0b7660b26e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:33.990108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264856-a21e-4300-b560-7e0b7660b26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:34.025569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-65264856-a21e-4300-b560-7e0b7660b26e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:34.026926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-65264856-a21e-4300-b560-7e0b7660b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:34.150647 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3973/7917] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:34.159597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:34.162777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:34.321385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64607b-18d4-4258-805e-e2cf474efb5c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:34.326982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af67b6-030f-45de-8750-87479116216d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:34.327817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af67b6-030f-45de-8750-87479116216d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:34.328473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af67b6-030f-45de-8750-87479116216d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:34.328931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af67b6-030f-45de-8750-87479116216d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:34.360900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af67b6-030f-45de-8750-87479116216d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:34.363317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af67b6-030f-45de-8750-87479116216d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:34.387391 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3945/7918] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:38.285428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d811b-879e-4c22-9b81-e95d378864a2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:38.286044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d811b-879e-4c22-9b81-e95d378864a2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:38.286044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d811b-879e-4c22-9b81-e95d378864a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:38.300270 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:38.306567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a42d811b-879e-4c22-9b81-e95d378864a2 None None] MFA Rules not processed for user `ea477d27693440a9a41d0aa12db57a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:38.307795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a42d811b-879e-4c22-9b81-e95d378864a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:38.372975 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3974/7919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:39:42.290348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8adad0-51a8-41d7-961a-361cb6b15e34 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:42.290849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8adad0-51a8-41d7-961a-361cb6b15e34 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:42.290939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8adad0-51a8-41d7-961a-361cb6b15e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:42.346453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5f8adad0-51a8-41d7-961a-361cb6b15e34 None None] MFA Rules not processed for user `cdcd4c00974245b2b38fb6f57c2007dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:42.347741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5f8adad0-51a8-41d7-961a-361cb6b15e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:42.465024 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3946/7920] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:42.469771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d811b-879e-4c22-9b81-e95d378864a2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:42.493936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d811b-879e-4c22-9b81-e95d378864a2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:42.500741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:42.501714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:42.502766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:42.503252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:42.504108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:42.506319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:42.566261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3975/7921] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:42 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:42.567237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8adad0-51a8-41d7-961a-361cb6b15e34 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:42.586465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8adad0-51a8-41d7-961a-361cb6b15e34 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:42.610216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455caae2-4a07-4e98-8385-8942daf802d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:42.614150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455caae2-4a07-4e98-8385-8942daf802d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:42.615891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455caae2-4a07-4e98-8385-8942daf802d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:42.616177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455caae2-4a07-4e98-8385-8942daf802d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:42.616858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455caae2-4a07-4e98-8385-8942daf802d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:42.624685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455caae2-4a07-4e98-8385-8942daf802d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:42.659777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:42.667660 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3947/7922] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:39:42.680992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d8dbf-f1ee-4448-a2a7-24b983145075 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:42.697241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:42.698389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:42.698890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:42.699393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] PATH_INFO: `/v3/system/users/d3a3e43068c84da8b6366a4a6e680549/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:42.725826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d3a3e43068c84da8b6366a4a6e680549, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:42.727745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:42.747985 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3976/7923] 10.222.0.16 () {60 vars in 1378 bytes} [Sun Sep 11 01:39:42 2022] PUT /identity/v3/system/users/d3a3e43068c84da8b6366a4a6e680549/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:39:42.761668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e647c1-8d37-49a2-82b1-2093115d4689 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:42.762212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e647c1-8d37-49a2-82b1-2093115d4689 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:42.762635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e647c1-8d37-49a2-82b1-2093115d4689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:42.849660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f0e647c1-8d37-49a2-82b1-2093115d4689 None None] MFA Rules not processed for user `d3a3e43068c84da8b6366a4a6e680549`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:42.850882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f0e647c1-8d37-49a2-82b1-2093115d4689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:42.854617 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:43.100732 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3948/7924] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:42 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 01:39:43.104775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:43.358275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7aefa-b288-41e5-b253-4e28650c5330 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:43.417446 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:43.494918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a3e43068c84da8b6366a4a6e680549', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:43.495731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:43.496969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:43.497511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:43.498640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:43.500341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:43.523099 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3977/7925] 10.222.0.16 () {58 vars in 1110 bytes} [Sun Sep 11 01:39:43 2022] GET /identity/v3/services => generated 2191 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:43.536760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e647c1-8d37-49a2-82b1-2093115d4689 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:43.713191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e647c1-8d37-49a2-82b1-2093115d4689 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:43.795583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a3e43068c84da8b6366a4a6e680549', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:43.796223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:43.796506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:43.796784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] PATH_INFO: `/v3/limits` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:43.797550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:43.799584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:43.807366 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Sep 11 01:39:43.900443 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.NoLimitReference Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 11 01:39:43.901659 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:39:43.906626 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3949/7926] 10.222.0.16 () {60 vars in 1126 bytes} [Sun Sep 11 01:39:43 2022] POST /identity/v3/limits => generated 124 bytes in 380 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 11 01:39:43.907714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:44.155754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d453d-9d4b-4780-8a44-8b158005546e None tempest-ImageQuotaTest-1141527265-system-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:44.243025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a3e43068c84da8b6366a4a6e680549', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:44.244274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:44.248441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:44.249436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:44.250754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:44.254976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:44.277706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:44.278847 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3978/7927] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 11 01:39:43 2022] GET /identity/v3/registered_limits => generated 129 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:44.595077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26fbc0-520b-443c-a7ce-54456729d2cc None tempest-ImageQuotaTest-1141527265-system-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:44.701298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe0acf-496c-442a-9ce4-315741420f9a None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a3e43068c84da8b6366a4a6e680549', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:44.702069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0acf-496c-442a-9ce4-315741420f9a None tempest-ImageQuotaTest-1141527265-system-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:44.702283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0acf-496c-442a-9ce4-315741420f9a None tempest-ImageQuotaTest-1141527265-system-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:44.702559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0acf-496c-442a-9ce4-315741420f9a None tempest-ImageQuotaTest-1141527265-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:44.703183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe0acf-496c-442a-9ce4-315741420f9a None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:44.704279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe0acf-496c-442a-9ce4-315741420f9a None tempest-ImageQuotaTest-1141527265-system-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:44.720140 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3950/7928] 10.222.0.16 () {58 vars in 1137 bytes} [Sun Sep 11 01:39:44 2022] GET /identity/v3/registered_limits => generated 129 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:45.617989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:45.619846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:45.652147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064200b4-e5ca-447a-ae47-25271ba4835a None tempest-ImageQuotaTest-1141527265-system-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:45.674680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:45.675405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:45.675704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:45.675963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] PATH_INFO: `/v3/users/300c6d3fa08044289d6de5d370014e19` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:45.685967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] RBAC: Authorizing `identity:delete_user(user_id=300c6d3fa08044289d6de5d370014e19)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:45.688166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:45.790283 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:45.793339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300c6d3fa08044289d6de5d370014e19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:45.795915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300c6d3fa08044289d6de5d370014e19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:45.799953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300c6d3fa08044289d6de5d370014e19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:45.827024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300c6d3fa08044289d6de5d370014e19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:45.854497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300c6d3fa08044289d6de5d370014e19'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:45.891731 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3979/7929] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:45 2022] DELETE /identity/v3/users/300c6d3fa08044289d6de5d370014e19 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:45.901463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:45.901929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:45.902192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:45.946604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:45.947943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:46.032803 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:46.050152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3951/7930] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:46.127453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:46.129389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:46.244548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65e145-a584-47e3-8f95-bc5763f9934f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:46.248484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce0172-929c-4b25-b33e-718445adfabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:46.249199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce0172-929c-4b25-b33e-718445adfabc service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:46.249477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce0172-929c-4b25-b33e-718445adfabc service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:46.249750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce0172-929c-4b25-b33e-718445adfabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:46.261978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce0172-929c-4b25-b33e-718445adfabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:46.263558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce0172-929c-4b25-b33e-718445adfabc service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:46.276559 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3980/7931] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:46.712111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:46.713869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:46.735507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f97f4a-8de7-4cec-af13-5f97fd5bc7ed None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:46.746444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:46.747099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:46.747674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:46.748068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] PATH_INFO: `/v3/projects/6c936af97f414c30bc802107ccbaf2cf` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:46.761638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c936af97f414c30bc802107ccbaf2cf)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:46.765327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:46.850726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c936af97f414c30bc802107ccbaf2cf', 'request_id': 'req-f53798c6-b763-420b-a965-6bb8865c923f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:46.858765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c936af97f414c30bc802107ccbaf2cf', 'request_id': 'req-f53798c6-b763-420b-a965-6bb8865c923f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:46.873765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c936af97f414c30bc802107ccbaf2cf', 'request_id': 'req-f53798c6-b763-420b-a965-6bb8865c923f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:46.906553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] The token cache is being invalidate because project 6c936af97f414c30bc802107ccbaf2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:46.907198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:46.907872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f53798c6-b763-420b-a965-6bb8865c923f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:46.911360 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3952/7932] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:46 2022] DELETE /identity/v3/projects/6c936af97f414c30bc802107ccbaf2cf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:46.916678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbafdf-7e59-4474-9832-5d413d06b207 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:46.917244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbafdf-7e59-4474-9832-5d413d06b207 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:46.917244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbafdf-7e59-4474-9832-5d413d06b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:46.959910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f3cbafdf-7e59-4474-9832-5d413d06b207 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:46.964900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f3cbafdf-7e59-4474-9832-5d413d06b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:47.052640 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3981/7933] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:47.060667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217db933-6328-4914-a461-edee3126f66b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.065539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217db933-6328-4914-a461-edee3126f66b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.065962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217db933-6328-4914-a461-edee3126f66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.105220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-217db933-6328-4914-a461-edee3126f66b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:47.106480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-217db933-6328-4914-a461-edee3126f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:47.134834 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3953/7934] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:47.139208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbafdf-7e59-4474-9832-5d413d06b207 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:47.149845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbafdf-7e59-4474-9832-5d413d06b207 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:47.163984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:47.164647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.164922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.165227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.165877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:39:47.166180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:47.167814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:47.183991 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3982/7935] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:39:47.188159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217db933-6328-4914-a461-edee3126f66b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:47.201498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217db933-6328-4914-a461-edee3126f66b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:47.207228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:47.207983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.208358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.208724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.209516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:47.211812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:47.255925 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3954/7936] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:39:47 2022] POST /identity/v3/projects => generated 397 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:39:47.256288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:47.271128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5ecb6-da12-4b9c-92ea-c6f9c42e4042 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:47.369223 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:47.381995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:47.384281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.384281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.384281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.384281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:47.387410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:47.434118 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3983/7937] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:39:47 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:39:47.437838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:47.452893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca0d53-67fd-40fb-afd2-ec529abb25fe admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:47.459579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:47.461379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.461854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.463403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.464264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:47.465899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:47.489243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3955/7938] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:47.490494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:47.502247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9226-1c8d-4505-a83f-9b49d8e68c89 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:47.510586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f326bcf-a130-4745-acbd-f33ae2d65189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:47.511224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f326bcf-a130-4745-acbd-f33ae2d65189 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.511509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f326bcf-a130-4745-acbd-f33ae2d65189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.511784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f326bcf-a130-4745-acbd-f33ae2d65189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.512440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f326bcf-a130-4745-acbd-f33ae2d65189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:47.514276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f326bcf-a130-4745-acbd-f33ae2d65189 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:47.527866 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3984/7939] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:39:47.532199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:47.543324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306b277-03ae-46bf-b053-d8347f54bf5a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:47.548893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:47.549960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.550307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.550653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] PATH_INFO: `/v3/projects/d011b56a4b5d4b028e3bea585ddf18e2/users/675dbd5694a242cab1cd5b7b51eef7d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.569109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d011b56a4b5d4b028e3bea585ddf18e2, user_id=675dbd5694a242cab1cd5b7b51eef7d4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:47.573211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:47.592259 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3956/7940] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:39:47 2022] PUT /identity/v3/projects/d011b56a4b5d4b028e3bea585ddf18e2/users/675dbd5694a242cab1cd5b7b51eef7d4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:39:47.603821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.604103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.604374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.653892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] MFA Rules not processed for user `675dbd5694a242cab1cd5b7b51eef7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:47.655116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:47.760725 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3985/7941] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:47.768612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:47.770522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:47.871859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c36185-bb63-4504-bfaa-d1e8d3987574 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:47.878881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:47.879595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:47.880065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:47.880347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:47.902682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:47.904566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:47.929317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3957/7942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:50.804687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:50.806819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:50.955247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:50.956692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:50.997205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4146d0-58ca-47a2-bf22-212559d6520e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:51.009972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:51.010591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:51.011016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:51.011297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:51.017541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:51.049099 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:51.069719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:51.071472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:51.129431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3986/7943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:51.213649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8d359-46af-4c64-b6c8-1c97908a2ff4 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:51.218519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:51.220185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:51.220984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:51.221686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] PATH_INFO: `/v3/users/cdcd4c00974245b2b38fb6f57c2007dd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:51.222781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcd4c00974245b2b38fb6f57c2007dd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:51.225460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:51.305908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcd4c00974245b2b38fb6f57c2007dd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.306753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcd4c00974245b2b38fb6f57c2007dd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.307482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcd4c00974245b2b38fb6f57c2007dd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.318887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcd4c00974245b2b38fb6f57c2007dd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.350677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcd4c00974245b2b38fb6f57c2007dd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.369932 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3958/7944] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:50 2022] DELETE /identity/v3/users/cdcd4c00974245b2b38fb6f57c2007dd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:51.581752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:51.599225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093864e8-e094-4ed3-af13-fb34266b4036 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:51.695207 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:51.696641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:51.699194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:51.719510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:51.720365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:51.720826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:51.721489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] PATH_INFO: `/v3/projects/0e615fe9aa6d4bc4ba21e86fa91132f7` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:51.723626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e615fe9aa6d4bc4ba21e86fa91132f7)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:51.725202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:51.797578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e615fe9aa6d4bc4ba21e86fa91132f7', 'request_id': 'req-86470af6-530c-450d-b41c-14f17600bd4d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.806170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e615fe9aa6d4bc4ba21e86fa91132f7', 'request_id': 'req-86470af6-530c-450d-b41c-14f17600bd4d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.819108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e615fe9aa6d4bc4ba21e86fa91132f7', 'request_id': 'req-86470af6-530c-450d-b41c-14f17600bd4d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.838837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] The token cache is being invalidate because project 0e615fe9aa6d4bc4ba21e86fa91132f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:39:51.839482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.840958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:51.845901 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3987/7945] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:51 2022] DELETE /identity/v3/projects/0e615fe9aa6d4bc4ba21e86fa91132f7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:51.847658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:51.849243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:51.850044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06a2d-3cc2-4c24-b1dd-e9e533940f6f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:51.890344 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:51.926159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86470af6-530c-450d-b41c-14f17600bd4d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:51.932139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:51.932498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:51.932795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:51.933087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] PATH_INFO: `/v3/users/d3a3e43068c84da8b6366a4a6e680549` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:51.934558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a3e43068c84da8b6366a4a6e680549)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:51.936478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:51.942450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:51.943809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:51.945539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:51.945820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:51.948038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:51.972294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:51.975084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:51.992574 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3959/7946] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:39:52.026609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a3e43068c84da8b6366a4a6e680549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:52.027295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a3e43068c84da8b6366a4a6e680549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:52.028177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a3e43068c84da8b6366a4a6e680549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:52.045364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a3e43068c84da8b6366a4a6e680549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:52.052746 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:52.056476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a3e43068c84da8b6366a4a6e680549'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:52.073518 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3988/7947] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:51 2022] DELETE /identity/v3/users/d3a3e43068c84da8b6366a4a6e680549 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:53.287242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:53.288806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:53.357756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8860-81d8-4b99-946e-79e3419ce478 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:53.420720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4777-1c59-4dd6-b355-b018c9d71715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:53.421294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4777-1c59-4dd6-b355-b018c9d71715 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:53.421568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4777-1c59-4dd6-b355-b018c9d71715 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:53.421836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4777-1c59-4dd6-b355-b018c9d71715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:53.423631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-841f4777-1c59-4dd6-b355-b018c9d71715 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:53.489795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f4777-1c59-4dd6-b355-b018c9d71715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:53.491572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f4777-1c59-4dd6-b355-b018c9d71715 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:53.502821 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3960/7948] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:55.706968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:55.709278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:55.890953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6457b0d-3eec-4323-8500-b1d1d0454cef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:55.906558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:55.907199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:55.908255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:55.908528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:55.916838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:55.946793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:55.951786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:55.990578 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3989/7949] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:57.231448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:57.232002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:57.232130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:57.254474 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] MFA Rules not processed for user `ea477d27693440a9a41d0aa12db57a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:57.255698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:57.297966 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:57.336690 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3961/7950] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:58.440368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:58.442631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:58.563360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc9a7c-e35e-4713-acee-aca0450fb19e service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:58.570233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e187a-4568-4a8c-8435-8d6b30759198 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:58.573809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e187a-4568-4a8c-8435-8d6b30759198 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:58.574326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e187a-4568-4a8c-8435-8d6b30759198 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:58.574747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e187a-4568-4a8c-8435-8d6b30759198 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:58.577413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b69e187a-4568-4a8c-8435-8d6b30759198 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:58.601208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e187a-4568-4a8c-8435-8d6b30759198 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:58.603346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e187a-4568-4a8c-8435-8d6b30759198 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:58.640154 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3990/7951] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:58.848159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:58.850438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:58.943001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226d22e-43c6-423b-865a-65e267d1ba65 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:58.948387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:58.949047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:58.949359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:58.949634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] PATH_INFO: `/v3/users/675dbd5694a242cab1cd5b7b51eef7d4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:58.950838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=675dbd5694a242cab1cd5b7b51eef7d4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:58.952928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:59.024279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675dbd5694a242cab1cd5b7b51eef7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:59.025005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675dbd5694a242cab1cd5b7b51eef7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:59.025882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675dbd5694a242cab1cd5b7b51eef7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:59.039035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675dbd5694a242cab1cd5b7b51eef7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:59.055249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675dbd5694a242cab1cd5b7b51eef7d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:59.076302 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3962/7952] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:39:58 2022] DELETE /identity/v3/users/675dbd5694a242cab1cd5b7b51eef7d4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:39:59.082420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:59.082706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:59.083170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:59.111551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:39:59.113448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:59.223317 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3991/7953] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:39:59.234663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:59.237485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:59.369655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83186211-de24-4548-8b35-affbea2a1fcf admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:59.380318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b51fe1-be37-422e-ae53-f9ae74e6bd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:59.389133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51fe1-be37-422e-ae53-f9ae74e6bd66 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:59.389901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51fe1-be37-422e-ae53-f9ae74e6bd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:59.390368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b51fe1-be37-422e-ae53-f9ae74e6bd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:59.411180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b51fe1-be37-422e-ae53-f9ae74e6bd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:59.412967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b51fe1-be37-422e-ae53-f9ae74e6bd66 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:59.433561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3963/7954] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:39:59.855842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:39:59.857773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:39:59.873316 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:39:59.878865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8966ac-c45b-4f27-b9d3-21887a1f7cc3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:39:59.901995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:39:59.902867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:39:59.903149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:39:59.903426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] PATH_INFO: `/v3/projects/d011b56a4b5d4b028e3bea585ddf18e2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:39:59.904902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d011b56a4b5d4b028e3bea585ddf18e2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:39:59.909810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:39:59.979320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd011b56a4b5d4b028e3bea585ddf18e2', 'request_id': 'req-1886cd60-6d08-4ab7-b224-b91f28114ac8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:59.987607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd011b56a4b5d4b028e3bea585ddf18e2', 'request_id': 'req-1886cd60-6d08-4ab7-b224-b91f28114ac8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:39:59.998683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd011b56a4b5d4b028e3bea585ddf18e2', 'request_id': 'req-1886cd60-6d08-4ab7-b224-b91f28114ac8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:00.042528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] The token cache is being invalidate because project d011b56a4b5d4b028e3bea585ddf18e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:40:00.042875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:00.043558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1886cd60-6d08-4ab7-b224-b91f28114ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:00.045458 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3992/7955] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:39:59 2022] DELETE /identity/v3/projects/d011b56a4b5d4b028e3bea585ddf18e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:00.051269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf343b-5a86-408a-88ea-32c0789f72f3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.051718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf343b-5a86-408a-88ea-32c0789f72f3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.051841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf343b-5a86-408a-88ea-32c0789f72f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.062437 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:00.079392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bacf343b-5a86-408a-88ea-32c0789f72f3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:00.084126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bacf343b-5a86-408a-88ea-32c0789f72f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:00.181323 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3964/7956] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:00.189786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487b616-bcc0-4c7c-938f-6950f345b883 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.190305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487b616-bcc0-4c7c-938f-6950f345b883 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.190774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487b616-bcc0-4c7c-938f-6950f345b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.213902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1487b616-bcc0-4c7c-938f-6950f345b883 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:00.215684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1487b616-bcc0-4c7c-938f-6950f345b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:00.225967 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3993/7957] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:00.229832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf343b-5a86-408a-88ea-32c0789f72f3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:00.240340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf343b-5a86-408a-88ea-32c0789f72f3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:00.245073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:00.245700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.246111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.246383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.247188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:40:00.247490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:00.249092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:00.264145 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3965/7958] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:40:00.269615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487b616-bcc0-4c7c-938f-6950f345b883 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:00.280487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487b616-bcc0-4c7c-938f-6950f345b883 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:00.286776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:00.287509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.287890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.288379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.289153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:00.291327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:00.324834 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3994/7959] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:00 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:00.326481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:00.337534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f5c2-7ca4-4dc6-8dde-6fb039fd3263 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:00.411232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:00.411913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.412424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.412723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.413507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:00.415486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:00.440275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3966/7960] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:00 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:00.444419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:00.456501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9f5a-9bec-42cd-b8aa-16367606e6e1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:00.462461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:00.463233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.463611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.464345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.465043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:00.466865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:00.480876 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3995/7961] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:00.482396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:00.493835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2a84f-2cb7-4398-b519-9fdfa12193ca admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:00.500625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0f277-54f7-40c2-8823-31490d33fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:00.501333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0f277-54f7-40c2-8823-31490d33fa3d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.502338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0f277-54f7-40c2-8823-31490d33fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.502662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0f277-54f7-40c2-8823-31490d33fa3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.503509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0f277-54f7-40c2-8823-31490d33fa3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:00.505098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0f277-54f7-40c2-8823-31490d33fa3d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:00.541506 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3967/7962] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:00.542745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:00.561732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb547d40-11fc-4a18-a2ca-c276ffebb550 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:00.569406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:00.570096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.570380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.570663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] PATH_INFO: `/v3/projects/6e12b5d6b11442ae972d2025f7bb181f/users/43f3337f99504775ad4a1648a27e238e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.590099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e12b5d6b11442ae972d2025f7bb181f, user_id=43f3337f99504775ad4a1648a27e238e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:00.599202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:00.627823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3996/7963] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:00 2022] PUT /identity/v3/projects/6e12b5d6b11442ae972d2025f7bb181f/users/43f3337f99504775ad4a1648a27e238e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:00.638182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a375-0e66-4e32-933d-0a50c5b1218e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:00.638466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a375-0e66-4e32-933d-0a50c5b1218e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:00.638790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a375-0e66-4e32-933d-0a50c5b1218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:00.695989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3dc5a375-0e66-4e32-933d-0a50c5b1218e None None] MFA Rules not processed for user `43f3337f99504775ad4a1648a27e238e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:00.697255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3dc5a375-0e66-4e32-933d-0a50c5b1218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:00.855467 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:00.867379 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3968/7964] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:00.872484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:01.038858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723688-f510-4cbd-a598-568124c94756 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:01.043718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:01.044486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.044771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.045048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.045918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:01.048548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:01.106881 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3997/7965] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:00 2022] POST /identity/v3/projects => generated 389 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:01.110781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5a375-0e66-4e32-933d-0a50c5b1218e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:01.124891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5a375-0e66-4e32-933d-0a50c5b1218e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:01.210093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:01.210725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.211008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.211340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.212001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:01.214154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:01.249620 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3969/7966] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:01 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:01.252491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:01.277929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e369f9-2d19-4e7d-bc8e-47e898e9011c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:01.295721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:01.301429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.302189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.302528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.304269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:01.309317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:01.317791 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:01.344277 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3998/7967] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:01.349433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:01.363120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a0c79-7aa6-4010-adab-eefc381fdf1e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:01.370660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d7bd9-c989-4099-a86d-81f257559d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:01.371501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d7bd9-c989-4099-a86d-81f257559d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.371762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d7bd9-c989-4099-a86d-81f257559d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.372128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d7bd9-c989-4099-a86d-81f257559d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.372791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d7bd9-c989-4099-a86d-81f257559d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:01.376355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d7bd9-c989-4099-a86d-81f257559d45 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:01.584836 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3970/7968] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:01.587786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:01.587786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4007-0089-4847-81bd-16bf7829e161 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:01.587786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:01.587786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.588933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.588933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] PATH_INFO: `/v3/projects/6e390d042ec24d32891e9fc28e17dccc/users/354a4031884b40a2b6350cbbd20ddab4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.588933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e390d042ec24d32891e9fc28e17dccc, user_id=354a4031884b40a2b6350cbbd20ddab4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:01.588933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:01.588933 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 3999/7969] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:01 2022] PUT /identity/v3/projects/6e390d042ec24d32891e9fc28e17dccc/users/354a4031884b40a2b6350cbbd20ddab4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:01.589768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a448a2-32f6-475e-a0fb-6ea78e9f2008 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.589768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a448a2-32f6-475e-a0fb-6ea78e9f2008 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.589768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a448a2-32f6-475e-a0fb-6ea78e9f2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.589768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b6a448a2-32f6-475e-a0fb-6ea78e9f2008 None None] MFA Rules not processed for user `354a4031884b40a2b6350cbbd20ddab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:01.589768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b6a448a2-32f6-475e-a0fb-6ea78e9f2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:01.697123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3971/7970] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:01.701311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:01.786671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753125c5-44e6-4928-93a3-d77af39b8548 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:01.797663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:01.799698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.800252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.800728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.802240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:01.806247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:01.858004 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4000/7971] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:01 2022] POST /identity/v3/projects => generated 389 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:40:01.859446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a448a2-32f6-475e-a0fb-6ea78e9f2008 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:01.875169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a448a2-32f6-475e-a0fb-6ea78e9f2008 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:01.957139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:01.957763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:01.958044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:01.958316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:01.959441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:01.961826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:01.977449 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:02.004595 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3972/7972] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:01 2022] POST /identity/v3/users => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:02.006605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:02.026665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2262e7-330c-42be-b31e-19d5ce3a1c78 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:02.046371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:02.047118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:02.047441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:02.047804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:02.049042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:02.051485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:02.074301 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4001/7973] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:02.078073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:02.107177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baba531-aeff-4362-9b99-3e51e6d4cfa2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:02.118884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:02.120215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:02.120757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:02.121281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] PATH_INFO: `/v3/projects/3afba4d2141544659193e4003083a5c6/users/bebfb877435649a1abe823a2e0882844/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:02.167565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afba4d2141544659193e4003083a5c6, user_id=bebfb877435649a1abe823a2e0882844, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:02.170629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:02.203108 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3973/7974] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:02 2022] PUT /identity/v3/projects/3afba4d2141544659193e4003083a5c6/users/bebfb877435649a1abe823a2e0882844/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:02.207826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:02.219956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90e6d9-57ff-4a6b-be6f-3d60e9dae157 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:02.318960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea416e-cc06-4ad4-9fbf-542782f66d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:02.319799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea416e-cc06-4ad4-9fbf-542782f66d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:02.320270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea416e-cc06-4ad4-9fbf-542782f66d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:02.320618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea416e-cc06-4ad4-9fbf-542782f66d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:02.321393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea416e-cc06-4ad4-9fbf-542782f66d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:02.323625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea416e-cc06-4ad4-9fbf-542782f66d12 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:02.348042 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4002/7975] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:02.348713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:02.368230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58bea-6c4d-4891-be45-12edb410a3a8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:02.375686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:02.377033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:02.377341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:02.377687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] PATH_INFO: `/v3/projects/3afba4d2141544659193e4003083a5c6/users/bebfb877435649a1abe823a2e0882844/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:02.379641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afba4d2141544659193e4003083a5c6, user_id=bebfb877435649a1abe823a2e0882844, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:02.382457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:02.395734 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3974/7976] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:02 2022] PUT /identity/v3/projects/3afba4d2141544659193e4003083a5c6/users/bebfb877435649a1abe823a2e0882844/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:40:02.407651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:02.408045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:02.408395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:02.442698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] MFA Rules not processed for user `bebfb877435649a1abe823a2e0882844`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:02.444015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:02.487764 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:02.544202 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4003/7977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:02.558626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:02.560617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:02.669829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74380980-2475-48c2-b876-665f54a9ac1c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:02.687829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:02.689078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:02.690493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:02.690493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:02.765653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:02.769167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:02.782812 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3975/7978] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:06.865653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:06.868075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:06.940886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e944d3-e02c-4ea9-9e26-18c5b3dc8013 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:06.944471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2cec7-6fe9-4306-afdf-bb298a0a4b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:06.945047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2cec7-6fe9-4306-afdf-bb298a0a4b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:06.945347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2cec7-6fe9-4306-afdf-bb298a0a4b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:06.945615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2cec7-6fe9-4306-afdf-bb298a0a4b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:06.957145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2cec7-6fe9-4306-afdf-bb298a0a4b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:06.958581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2cec7-6fe9-4306-afdf-bb298a0a4b96 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:06.973355 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4004/7979] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:08.868925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:08.870250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:08.963591 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:08.972051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078ca7-c924-4ed2-9766-266ae38c59f0 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:08.986043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:08.986804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:08.989279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:08.989681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] PATH_INFO: `/v3/users/5cf2268e677f436ea33a2791f2ca78a7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:08.993438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf2268e677f436ea33a2791f2ca78a7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:08.995455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:09.059169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf2268e677f436ea33a2791f2ca78a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:09.060134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf2268e677f436ea33a2791f2ca78a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:09.061017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf2268e677f436ea33a2791f2ca78a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:09.071591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf2268e677f436ea33a2791f2ca78a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:09.087157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf2268e677f436ea33a2791f2ca78a7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:09.106286 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3976/7980] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:40:08 2022] DELETE /identity/v3/users/5cf2268e677f436ea33a2791f2ca78a7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:09.118965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:09.118965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:09.118965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:09.137840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:09.139249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:09.232070 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4005/7981] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:09.242201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:09.243650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:09.324448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1520e5-00bc-45b6-8658-bd26d7ae961c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:09.328541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:09.329881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:09.330296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:09.330726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:09.343358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:09.356336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:09.401804 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3977/7982] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:10.480218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:10.483983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:10.503318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eba2fd-aa2b-4c8f-992e-c2071820e7fa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:10.519903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:10.534372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:10.534739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:10.541384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] PATH_INFO: `/v3/projects/e6a5d824d7084c248b4f4f0b96992d35` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:10.557780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a5d824d7084c248b4f4f0b96992d35)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:10.569445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:10.659413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a5d824d7084c248b4f4f0b96992d35', 'request_id': 'req-aae31d26-e568-4310-b1a2-48f4138737f6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.666443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a5d824d7084c248b4f4f0b96992d35', 'request_id': 'req-aae31d26-e568-4310-b1a2-48f4138737f6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.677867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a5d824d7084c248b4f4f0b96992d35', 'request_id': 'req-aae31d26-e568-4310-b1a2-48f4138737f6'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.684156 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:10.722468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] The token cache is being invalidate because project e6a5d824d7084c248b4f4f0b96992d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:40:10.722769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.723566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.725783 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4006/7983] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:40:10 2022] DELETE /identity/v3/projects/e6a5d824d7084c248b4f4f0b96992d35 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:10.730220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:10.741857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96df9f-1786-4e40-9799-04b789c08f0f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:10.869619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:10.870399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:10.870716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:10.871020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] PATH_INFO: `/v3/users/e85b9bc4c77a4dbfbabaa3ea0b4d4f00` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:10.872386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85b9bc4c77a4dbfbabaa3ea0b4d4f00)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:10.874350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:10.905450 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:10.973393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85b9bc4c77a4dbfbabaa3ea0b4d4f00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.974095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85b9bc4c77a4dbfbabaa3ea0b4d4f00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.975301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85b9bc4c77a4dbfbabaa3ea0b4d4f00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:10.987171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85b9bc4c77a4dbfbabaa3ea0b4d4f00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:11.033669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0caa07da-940c-4101-bee3-f46672d051c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85b9bc4c77a4dbfbabaa3ea0b4d4f00'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:11.061567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3978/7984] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:40:10 2022] DELETE /identity/v3/users/e85b9bc4c77a4dbfbabaa3ea0b4d4f00 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:11.912408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:11.914704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:11.949383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae31d26-e568-4310-b1a2-48f4138737f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:12.087891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:12.088895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:12.089421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:12.089883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] PATH_INFO: `/v3/projects/53f9203fd4ec41f5accd5458d8ce950c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:12.091509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f9203fd4ec41f5accd5458d8ce950c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:12.094146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:12.187243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f9203fd4ec41f5accd5458d8ce950c', 'request_id': 'req-8aff2125-93d3-49d7-8d61-9804e2ea8d64'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:12.198597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f9203fd4ec41f5accd5458d8ce950c', 'request_id': 'req-8aff2125-93d3-49d7-8d61-9804e2ea8d64'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:12.209176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f9203fd4ec41f5accd5458d8ce950c', 'request_id': 'req-8aff2125-93d3-49d7-8d61-9804e2ea8d64'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:12.258618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] The token cache is being invalidate because project 53f9203fd4ec41f5accd5458d8ce950c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:40:12.258928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:12.259690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8aff2125-93d3-49d7-8d61-9804e2ea8d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:12.264747 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4007/7985] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:40:11 2022] DELETE /identity/v3/projects/53f9203fd4ec41f5accd5458d8ce950c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:12.266550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa69eab-41a7-499d-a20d-1958e264bd50 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:12.268260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa69eab-41a7-499d-a20d-1958e264bd50 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:12.268995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa69eab-41a7-499d-a20d-1958e264bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:12.337043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6fa69eab-41a7-499d-a20d-1958e264bd50 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:12.338030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6fa69eab-41a7-499d-a20d-1958e264bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:12.442217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213650-c785-48fb-8766-8ab0731541fc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:12.442504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213650-c785-48fb-8766-8ab0731541fc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:12.442831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213650-c785-48fb-8766-8ab0731541fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:12.448495 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3979/7986] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:40:12.475606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6c213650-c785-48fb-8766-8ab0731541fc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:12.477459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6c213650-c785-48fb-8766-8ab0731541fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:12.495260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa69eab-41a7-499d-a20d-1958e264bd50 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:12.504090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4008/7987] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:12.510572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa69eab-41a7-499d-a20d-1958e264bd50 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:12.537297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:12.537935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:12.538212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:12.538481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:12.539141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:40:12.539441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:12.541055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:12.570606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3980/7988] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:40:12.571931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213650-c785-48fb-8766-8ab0731541fc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:12.601994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213650-c785-48fb-8766-8ab0731541fc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:12.617309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:12.618277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:12.618493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:12.618822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:12.619612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:12.625884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:12.700463 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4009/7989] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:12 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:12.705440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:12.720705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda5d73-f6d3-4a3b-84c6-869c5cda239e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:12.913118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5238d9-b97e-4c02-9700-6fea3d2042e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:12.917419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5238d9-b97e-4c02-9700-6fea3d2042e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:12.917986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5238d9-b97e-4c02-9700-6fea3d2042e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:12.918686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5238d9-b97e-4c02-9700-6fea3d2042e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:12.919540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5238d9-b97e-4c02-9700-6fea3d2042e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:12.924235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5238d9-b97e-4c02-9700-6fea3d2042e3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:12.982554 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3981/7990] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:12 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:12.984116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:13.012426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d8d99-05f6-4471-ab8b-4e286c25b611 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:13.037711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:13.037711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:13.037711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:13.037711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:13.038078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:13.038927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:13.039033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175005-c2df-4cf3-a894-ba56a5025bf4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:13.039306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175005-c2df-4cf3-a894-ba56a5025bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:13.039745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175005-c2df-4cf3-a894-ba56a5025bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:13.061817 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4010/7991] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:13.066288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:13.076624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0e175005-c2df-4cf3-a894-ba56a5025bf4 None None] MFA Rules not processed for user `43f3337f99504775ad4a1648a27e238e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:13.079047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0e175005-c2df-4cf3-a894-ba56a5025bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:13.090379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa27e1-8412-443f-ba02-e9ffe39f44bd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:13.104555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:13.104827 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:13.105570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:13.105956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:13.106638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:13.107536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:13.111833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:13.140894 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4011/7992] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:13.142246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:13.181234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b67a5-756e-4fc2-bed1-65e657f1625e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:13.190165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:13.191141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:13.191577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:13.192133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] PATH_INFO: `/v3/projects/4edb186e664c42d0ae2e82c72b9403c9/users/7dba9042092f4efd8125033544ce842d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:13.224897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edb186e664c42d0ae2e82c72b9403c9, user_id=7dba9042092f4efd8125033544ce842d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:13.239348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:13.247830 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3982/7993] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:13.261637 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4012/7994] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:13 2022] PUT /identity/v3/projects/4edb186e664c42d0ae2e82c72b9403c9/users/7dba9042092f4efd8125033544ce842d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:13.280798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:13.281323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:13.281428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:13.371805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] MFA Rules not processed for user `7dba9042092f4efd8125033544ce842d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:13.373477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:13.549263 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3983/7995] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:13.556970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:13.573838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:13.607010 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:13.746005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14c2b-fe9d-4882-8685-40fb8cd6a555 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:13.752635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:13.753956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:13.754541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:13.754927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:13.766655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:13.768851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:13.794632 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4013/7996] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:18.729980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:18.734315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:18.874202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa731f2-b414-4a2b-bba9-0239e2b1500f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:18.893010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b09fc-a4fa-490f-a448-12d85c3466c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:18.896391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b09fc-a4fa-490f-a448-12d85c3466c9 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:18.897453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b09fc-a4fa-490f-a448-12d85c3466c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:18.897793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b09fc-a4fa-490f-a448-12d85c3466c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:18.901106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-791b09fc-a4fa-490f-a448-12d85c3466c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:18.942626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b09fc-a4fa-490f-a448-12d85c3466c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:18.944580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b09fc-a4fa-490f-a448-12d85c3466c9 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:18.993468 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3984/7997] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:20.727119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:20.837791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d67e4-dfac-49a4-a7bc-01f0957de57f service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:20.842995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:20.843888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:20.844267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:20.845319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] PATH_INFO: `/v3/users/7dba9042092f4efd8125033544ce842d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:20.846753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dba9042092f4efd8125033544ce842d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:20.848917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:20.941118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dba9042092f4efd8125033544ce842d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:20.949881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dba9042092f4efd8125033544ce842d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:20.951313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dba9042092f4efd8125033544ce842d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:20.983330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dba9042092f4efd8125033544ce842d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:20.993036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dba9042092f4efd8125033544ce842d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:21.017851 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4014/7998] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:40:20 2022] DELETE /identity/v3/users/7dba9042092f4efd8125033544ce842d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:21.019094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:21.019577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:21.019661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:21.047103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:21.049959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:21.090539 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:21.150590 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3985/7999] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:21.161963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:21.163423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:21.204469 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:21.233894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3256-8fcd-4dd8-9d6a-b6496375304d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:21.238472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451a366-dcf0-4463-9e4d-e08133b4e656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:21.239078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a366-dcf0-4463-9e4d-e08133b4e656 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:21.239357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a366-dcf0-4463-9e4d-e08133b4e656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:21.239632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a366-dcf0-4463-9e4d-e08133b4e656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:21.249327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451a366-dcf0-4463-9e4d-e08133b4e656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:21.251598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451a366-dcf0-4463-9e4d-e08133b4e656 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:21.261640 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4015/8000] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:21.717882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:21.719448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:21.733473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4964d-9435-4c14-a05b-a116eeb3a9e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:21.738809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:21.741114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:21.741492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:21.741829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] PATH_INFO: `/v3/projects/4edb186e664c42d0ae2e82c72b9403c9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:21.743109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edb186e664c42d0ae2e82c72b9403c9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:21.745620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:21.858126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edb186e664c42d0ae2e82c72b9403c9', 'request_id': 'req-eea7760a-5ca5-4d06-8bfe-faaa78662d39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:21.871044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edb186e664c42d0ae2e82c72b9403c9', 'request_id': 'req-eea7760a-5ca5-4d06-8bfe-faaa78662d39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:21.893484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edb186e664c42d0ae2e82c72b9403c9', 'request_id': 'req-eea7760a-5ca5-4d06-8bfe-faaa78662d39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:21.912008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] The token cache is being invalidate because project 4edb186e664c42d0ae2e82c72b9403c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:40:21.912301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:21.913016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-eea7760a-5ca5-4d06-8bfe-faaa78662d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:21.915193 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3986/8001] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:40:21 2022] DELETE /identity/v3/projects/4edb186e664c42d0ae2e82c72b9403c9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:21.920174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef8fb-8a3a-4d52-8a21-63d9aadeb817 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:21.920675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef8fb-8a3a-4d52-8a21-63d9aadeb817 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:21.920872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef8fb-8a3a-4d52-8a21-63d9aadeb817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:21.950426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3edef8fb-8a3a-4d52-8a21-63d9aadeb817 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:21.953364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3edef8fb-8a3a-4d52-8a21-63d9aadeb817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:22.097362 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4016/8002] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:22.106351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f166f5-4235-41de-8942-783ad8577571 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.107442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f166f5-4235-41de-8942-783ad8577571 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.107919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f166f5-4235-41de-8942-783ad8577571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.144259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-30f166f5-4235-41de-8942-783ad8577571 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:22.154022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-30f166f5-4235-41de-8942-783ad8577571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:22.171188 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3987/8003] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:22.174824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef8fb-8a3a-4d52-8a21-63d9aadeb817 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:22.188383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef8fb-8a3a-4d52-8a21-63d9aadeb817 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:22.197352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:22.197981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.198257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.199323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.200467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:40:22.200778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:22.203038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:22.226523 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4017/8004] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:40:22.228511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f166f5-4235-41de-8942-783ad8577571 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:22.240340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f166f5-4235-41de-8942-783ad8577571 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:22.246668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:22.248691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.249166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.249596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.251524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:22.256564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:22.310671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:22.336998 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3988/8005] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:22 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:22.337420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08e2d3-38b1-4def-93dd-f1d56202e643 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:22.435488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:22.437161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.437717 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.438269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.440400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:22.442679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:22.494905 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4018/8006] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:22 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:22.499832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:22.533275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de053-5e8d-4a6a-a514-a85af2b55753 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:22.547440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:22.548946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.549375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.549710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.550427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:22.552335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:22.570186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:22.581012 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3989/8007] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:22.584562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a1fa-7d01-4b32-ab2d-4ece124907bc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:22.590072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d3ab7-0a06-4773-94ea-6e720fdf689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:22.590832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3ab7-0a06-4773-94ea-6e720fdf689b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.591178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3ab7-0a06-4773-94ea-6e720fdf689b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.591514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3ab7-0a06-4773-94ea-6e720fdf689b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.593171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d3ab7-0a06-4773-94ea-6e720fdf689b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:22.595848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d3ab7-0a06-4773-94ea-6e720fdf689b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:22.617629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4019/8008] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:22.619607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:22.630717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b384d4-c304-4939-bc14-22cc606d07c9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:22.636272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a8772-f392-4ffa-8f2d-5b02095c9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:22.636953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8772-f392-4ffa-8f2d-5b02095c9e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.637422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8772-f392-4ffa-8f2d-5b02095c9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.638018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a8772-f392-4ffa-8f2d-5b02095c9e1e admin admin] PATH_INFO: `/v3/projects/bd6f9164f1e3467f9fab48959844fd6c/users/b7b63912921342deb7c364a0716233a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.685976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a8772-f392-4ffa-8f2d-5b02095c9e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6f9164f1e3467f9fab48959844fd6c, user_id=b7b63912921342deb7c364a0716233a8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:22.690450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a8772-f392-4ffa-8f2d-5b02095c9e1e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:22.738092 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3990/8009] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:22 2022] PUT /identity/v3/projects/bd6f9164f1e3467f9fab48959844fd6c/users/b7b63912921342deb7c364a0716233a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:22.745127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc128b-c524-407d-b2e4-f26636de1db8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.746117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc128b-c524-407d-b2e4-f26636de1db8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.747008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc128b-c524-407d-b2e4-f26636de1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.813886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-03dc128b-c524-407d-b2e4-f26636de1db8 None None] MFA Rules not processed for user `b7b63912921342deb7c364a0716233a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:22.814956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-03dc128b-c524-407d-b2e4-f26636de1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:22.874810 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:22.920897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa69f5d-90da-4add-9446-cd1f14179aa8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:22.921769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa69f5d-90da-4add-9446-cd1f14179aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:22.922167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa69f5d-90da-4add-9446-cd1f14179aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:22.947628 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4020/8010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:22.951830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc128b-c524-407d-b2e4-f26636de1db8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:22.981861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7aa69f5d-90da-4add-9446-cd1f14179aa8 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:22.983497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7aa69f5d-90da-4add-9446-cd1f14179aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:23.011845 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:23.033765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc128b-c524-407d-b2e4-f26636de1db8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.038793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.039408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.039697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.039972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.040611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.042635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.047507 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3991/8011] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:40:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:23.080903 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4021/8012] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:22 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:23.085078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa69f5d-90da-4add-9446-cd1f14179aa8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.100784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa69f5d-90da-4add-9446-cd1f14179aa8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.113462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.115195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:23.164511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.165721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.165721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.165721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.166385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.168370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.194077 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3992/8013] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:23 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:40:23.198175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.210677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e37f0-42ee-4d60-89ae-404a51afb7f5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.211497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b408fc-7f02-4981-8c2b-0b801f02b923 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.215458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.216169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.216447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.216719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.217391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.218921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98c687-dbdc-4604-98eb-94dd26fe6a1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.219058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.220947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98c687-dbdc-4604-98eb-94dd26fe6a1a service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.221335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98c687-dbdc-4604-98eb-94dd26fe6a1a service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.221753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98c687-dbdc-4604-98eb-94dd26fe6a1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.230389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3993/8014] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:40:23.234003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.243902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108a0c-af13-44f7-a01a-5bbc2aa54d5b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.248834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.249552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.249897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.250242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.250977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.252622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.265225 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3994/8015] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:40:23.268371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.279035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f716-ca2d-4c43-bacb-fa5ee08ff712 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.284135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.284855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.285232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.285680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] PATH_INFO: `/v3/projects/e32130c4c0ee4ce69d54fb268b11f387/users/18ef0cbaac15443aa733f9680c905380/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.291710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98c687-dbdc-4604-98eb-94dd26fe6a1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.293424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98c687-dbdc-4604-98eb-94dd26fe6a1a service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.298062 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:23.304252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32130c4c0ee4ce69d54fb268b11f387, user_id=18ef0cbaac15443aa733f9680c905380, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.306643 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4022/8016] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:40:23.310219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.337755 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3995/8017] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:23 2022] PUT /identity/v3/projects/e32130c4c0ee4ce69d54fb268b11f387/users/18ef0cbaac15443aa733f9680c905380/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:23.339945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f238b-e33c-4c1e-8b55-d3da85489807 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.340226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f238b-e33c-4c1e-8b55-d3da85489807 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.340497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f238b-e33c-4c1e-8b55-d3da85489807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.374301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9e1f238b-e33c-4c1e-8b55-d3da85489807 None None] MFA Rules not processed for user `18ef0cbaac15443aa733f9680c905380`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:23.375475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9e1f238b-e33c-4c1e-8b55-d3da85489807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:23.468011 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4023/8018] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:23.473177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.559237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbdd45-da16-475a-9611-0a727e05fb65 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.565330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.565991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.566134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.567146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.568416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.571141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.622373 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3996/8019] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:23 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:40:23.627936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f238b-e33c-4c1e-8b55-d3da85489807 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.657732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f238b-e33c-4c1e-8b55-d3da85489807 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.785429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.786059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.786343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.787387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.788790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.790770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.859725 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4024/8020] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:23 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:23.862041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.868693 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:23.877854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bf1c9-22d5-41e6-8582-814b3db2bb13 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.892243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.896251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.896646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.897651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:23.898498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:23.900472 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:23.917038 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3997/8021] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:23.918428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:23.940780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938cbbf-46d2-4ab5-93e1-86f6fc333628 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:23.947908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:23.948724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:23.949145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:23.950178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] PATH_INFO: `/v3/projects/524e780f7aec4cf1964dcf967d77c296/users/9499dcd52e314923a41938eb8d07a52a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:24.010136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524e780f7aec4cf1964dcf967d77c296, user_id=9499dcd52e314923a41938eb8d07a52a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:24.018341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:24.056238 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4025/8022] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:23 2022] PUT /identity/v3/projects/524e780f7aec4cf1964dcf967d77c296/users/9499dcd52e314923a41938eb8d07a52a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:24.060628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:24.114002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a543a8-6570-4b69-ae5c-552d6dce6e0b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:24.230623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defddeb7-f2ca-4430-9ed4-a7fb55c6d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:24.231286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defddeb7-f2ca-4430-9ed4-a7fb55c6d7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:24.231470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defddeb7-f2ca-4430-9ed4-a7fb55c6d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:24.231717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defddeb7-f2ca-4430-9ed4-a7fb55c6d7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:24.232437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defddeb7-f2ca-4430-9ed4-a7fb55c6d7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:24.247272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defddeb7-f2ca-4430-9ed4-a7fb55c6d7ba admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:24.295089 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3998/8023] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:24.300332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:24.316160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf8df3-85ad-4eff-974d-4c80403b8178 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:24.323383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:24.324876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:24.325501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:24.326089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] PATH_INFO: `/v3/projects/524e780f7aec4cf1964dcf967d77c296/users/9499dcd52e314923a41938eb8d07a52a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:24.328381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524e780f7aec4cf1964dcf967d77c296, user_id=9499dcd52e314923a41938eb8d07a52a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:24.332452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:24.376383 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4026/8024] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:24 2022] PUT /identity/v3/projects/524e780f7aec4cf1964dcf967d77c296/users/9499dcd52e314923a41938eb8d07a52a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:24.376718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:24.377005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:24.377309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:24.425662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] MFA Rules not processed for user `9499dcd52e314923a41938eb8d07a52a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:24.427270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:24.520739 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 3999/8025] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:24.534160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:24.538345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:24.601949 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:24.625944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8ecf-27d7-4c84-a30e-06d1b2be0fe0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:24.632923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:24.633896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:24.634309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:24.634731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:24.749427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:24.756049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:24.772090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4027/8026] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:25.876272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:25.878187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:25.993679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e31765-e871-4a65-97a6-20c249a5d0b7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:25.999993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:26.002557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:26.003024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:26.003470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:26.005510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:26.025999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:26.027872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:26.040010 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4000/8027] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:27.772062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:27.785098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707015-5ea0-4768-9839-c16f99caa3b5 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:27.788473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:27.789182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:27.789568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:27.789956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:27.857416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:27.858874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:27.886698 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4028/8028] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:28.734781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:28.737229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:28.758494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca0d6-6908-4b95-a408-b0ab65cc407a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:28.764228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23005a3b-3e17-402c-a747-9b140dc4319e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:28.765249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005a3b-3e17-402c-a747-9b140dc4319e service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:28.765789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005a3b-3e17-402c-a747-9b140dc4319e service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:28.766977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005a3b-3e17-402c-a747-9b140dc4319e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:28.789726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005a3b-3e17-402c-a747-9b140dc4319e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:28.791503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005a3b-3e17-402c-a747-9b140dc4319e service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:28.813310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4001/8029] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:37.865704 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=58 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:38.799485 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:39.047836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:39.119683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038bc7-bd53-40b9-acfc-901086066494 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:39.126225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:39.127133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:39.127555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:39.127996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] PATH_INFO: `/v3/users/b7b63912921342deb7c364a0716233a8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:39.129304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b63912921342deb7c364a0716233a8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:39.132362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:39.198497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b63912921342deb7c364a0716233a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.200134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b63912921342deb7c364a0716233a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.201420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b63912921342deb7c364a0716233a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.225748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b63912921342deb7c364a0716233a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.237819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b63912921342deb7c364a0716233a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.260440 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4029/8030] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:40:39 2022] DELETE /identity/v3/users/b7b63912921342deb7c364a0716233a8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:39.261982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:39.262341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:39.262690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:39.284629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:39.286226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:39.359673 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4002/8031] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:39.370485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:39.371847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:39.455368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa0474-d19d-4c6a-a9e8-9801efce6813 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:39.460060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:39.461036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:39.461569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:39.462072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:39.474131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:39.475587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:39.493166 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4030/8032] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:39.811795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:39.814157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:39.838488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146f5b-1be5-4cc3-bda2-181fd80ec6a3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:39.851965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:39.852617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:39.852899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:39.853208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] PATH_INFO: `/v3/projects/bd6f9164f1e3467f9fab48959844fd6c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:39.854599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6f9164f1e3467f9fab48959844fd6c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:39.856764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:39.915530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6f9164f1e3467f9fab48959844fd6c', 'request_id': 'req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.923367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6f9164f1e3467f9fab48959844fd6c', 'request_id': 'req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.932310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6f9164f1e3467f9fab48959844fd6c', 'request_id': 'req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.944279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] The token cache is being invalidate because project bd6f9164f1e3467f9fab48959844fd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:40:39.944580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.948005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:39.952500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4003/8033] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:40:39 2022] DELETE /identity/v3/projects/bd6f9164f1e3467f9fab48959844fd6c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:39.954378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:39.977728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15719e3c-eb53-436a-91e7-e4cfd52cf6de service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:40.017142 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:40.071603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:40.072278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:40.072532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:40.073012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] PATH_INFO: `/v3/users/18ef0cbaac15443aa733f9680c905380` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:40.074242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ef0cbaac15443aa733f9680c905380)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:40.076200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:40.127669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ef0cbaac15443aa733f9680c905380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.128402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ef0cbaac15443aa733f9680c905380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.129158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ef0cbaac15443aa733f9680c905380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.142738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ef0cbaac15443aa733f9680c905380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.150218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ef0cbaac15443aa733f9680c905380'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.165632 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4031/8034] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:40:39 2022] DELETE /identity/v3/users/18ef0cbaac15443aa733f9680c905380 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:40.465551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:40.467642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:40.481184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c833d-d3fc-4eb9-85e3-4a5391d9beb3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:40.550659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:40.551302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:40.551581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:40.551848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] PATH_INFO: `/v3/projects/e32130c4c0ee4ce69d54fb268b11f387` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:40.552972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32130c4c0ee4ce69d54fb268b11f387)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:40.554920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:40.585403 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:40.605370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32130c4c0ee4ce69d54fb268b11f387', 'request_id': 'req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.612461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32130c4c0ee4ce69d54fb268b11f387', 'request_id': 'req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.620118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32130c4c0ee4ce69d54fb268b11f387', 'request_id': 'req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.631898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] The token cache is being invalidate because project e32130c4c0ee4ce69d54fb268b11f387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:40:40.632188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.632883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.634471 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4004/8035] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:40:40 2022] DELETE /identity/v3/projects/e32130c4c0ee4ce69d54fb268b11f387 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:40.638701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:40.640223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:40.653974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbf63f-1ff3-4f12-99b7-72a4ab853512 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:40.711881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:40.712534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:40.712807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:40.713101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] PATH_INFO: `/v3/users/9499dcd52e314923a41938eb8d07a52a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:40.714258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9499dcd52e314923a41938eb8d07a52a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:40.716483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:40.769587 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:40.772476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9499dcd52e314923a41938eb8d07a52a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.773634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9499dcd52e314923a41938eb8d07a52a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.774558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9499dcd52e314923a41938eb8d07a52a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.788933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9499dcd52e314923a41938eb8d07a52a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.796661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4dae2bf4-e758-4594-a635-efcd0b182b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9499dcd52e314923a41938eb8d07a52a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:40.816727 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4032/8036] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:40:40 2022] DELETE /identity/v3/users/9499dcd52e314923a41938eb8d07a52a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:41.102861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:41.104428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:41.140302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b9f3-58a4-4d42-b5cf-e7bcce8f346c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:41.222859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:41.223748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.224098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.224401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] PATH_INFO: `/v3/projects/524e780f7aec4cf1964dcf967d77c296` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.226269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524e780f7aec4cf1964dcf967d77c296)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:41.228197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:41.297542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524e780f7aec4cf1964dcf967d77c296', 'request_id': 'req-38808142-5157-475f-b24d-3edc68e00ce0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:41.304285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524e780f7aec4cf1964dcf967d77c296', 'request_id': 'req-38808142-5157-475f-b24d-3edc68e00ce0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:41.314521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524e780f7aec4cf1964dcf967d77c296', 'request_id': 'req-38808142-5157-475f-b24d-3edc68e00ce0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:41.330632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] The token cache is being invalidate because project 524e780f7aec4cf1964dcf967d77c296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:40:41.331174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:41.331981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-38808142-5157-475f-b24d-3edc68e00ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:40:41.333538 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4005/8037] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:40:41 2022] DELETE /identity/v3/projects/524e780f7aec4cf1964dcf967d77c296 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:41.339213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe234663-28c6-4fa4-829e-bb1cb85dbada None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.340194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe234663-28c6-4fa4-829e-bb1cb85dbada None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.340478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe234663-28c6-4fa4-829e-bb1cb85dbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.363960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fe234663-28c6-4fa4-829e-bb1cb85dbada None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:41.365281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fe234663-28c6-4fa4-829e-bb1cb85dbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:41.437283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4033/8038] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:41.447538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e86703-2f2d-4684-b956-805a5f0142dd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.448029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e86703-2f2d-4684-b956-805a5f0142dd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.448367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e86703-2f2d-4684-b956-805a5f0142dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.471748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a9e86703-2f2d-4684-b956-805a5f0142dd None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:41.473024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a9e86703-2f2d-4684-b956-805a5f0142dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:41.481556 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4006/8039] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:40:41.485797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe234663-28c6-4fa4-829e-bb1cb85dbada None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:41.495631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe234663-28c6-4fa4-829e-bb1cb85dbada None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:41.500926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:41.501760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.502035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.502301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.502945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:40:41.503227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:41.504929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:41.534102 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4034/8040] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:40:41.536539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e86703-2f2d-4684-b956-805a5f0142dd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:41.551504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e86703-2f2d-4684-b956-805a5f0142dd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:41.556277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:41.556967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.557347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.557686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.558394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:41.560350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:41.603585 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4007/8041] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:40:41 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:41.604821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:41.616013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2bb16-937a-4584-81f0-f04e55c97ea3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:41.681071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:41.681707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.681987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.682258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.682885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:41.684831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:41.720368 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4035/8042] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:40:41 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:40:41.721637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:41.732271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563df25a-1ca1-48ea-a40f-7f15a9c290ff admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:41.737395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:41.738263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.738552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.738824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.739632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:41.741324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:41.742812 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:41.758162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:41.758586 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4008/8043] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:41.778074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f856e-7775-42f2-a624-bdf97e354803 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:41.792358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7825f7c-f3e9-469e-9bec-cdd8ef738f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:41.792989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7825f7c-f3e9-469e-9bec-cdd8ef738f45 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.793295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7825f7c-f3e9-469e-9bec-cdd8ef738f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.793562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7825f7c-f3e9-469e-9bec-cdd8ef738f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.794183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7825f7c-f3e9-469e-9bec-cdd8ef738f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:41.795803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7825f7c-f3e9-469e-9bec-cdd8ef738f45 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:41.809100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4036/8044] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:40:41.811426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:41.868226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875be4-ecc5-496a-a56c-2977895459a3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:41.874163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:41.874909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.875859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.876204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] PATH_INFO: `/v3/projects/c96aa740f9bd4608bf806b8b8667062a/users/544bbabf0c964569980c48b3582dd4a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.891748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96aa740f9bd4608bf806b8b8667062a, user_id=544bbabf0c964569980c48b3582dd4a8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:41.894469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:41.908714 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4009/8045] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:40:41 2022] PUT /identity/v3/projects/c96aa740f9bd4608bf806b8b8667062a/users/544bbabf0c964569980c48b3582dd4a8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:40:41.918979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5719eb9-8bd2-468c-9363-c704f787a01c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:41.919261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5719eb9-8bd2-468c-9363-c704f787a01c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:41.919552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5719eb9-8bd2-468c-9363-c704f787a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:41.946659 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:41.950361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d5719eb9-8bd2-468c-9363-c704f787a01c None None] MFA Rules not processed for user `544bbabf0c964569980c48b3582dd4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:40:41.952722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d5719eb9-8bd2-468c-9363-c704f787a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:42.022924 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4037/8046] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:40:42.035631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:40:42.037337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:40:42.119899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac05320-b8dc-4bc4-a5d4-5a975487e27b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:40:42.123694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:40:42.124296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:40:42.124568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:40:42.124835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:40:42.134138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:40:42.135552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:40:42.144763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4010/8047] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:40:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:40:52.022191 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=26 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:40:52.141315 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:01.651700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:01.652204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:01.652320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:01.678723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:01.679996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:01.785363 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4038/8048] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:41:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:01.801881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:01.803376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:01.902402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a53e8-e8bf-4c5b-9176-acb83f22ecbe service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:01.909135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:01.909810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:01.910086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:01.910351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:01.920071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:01.923026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:01.932539 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4011/8049] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:41:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:41:03.053199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:03.054830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:03.204106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8c91e-4633-4ea6-86cc-f87bac5abb97 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:03.215882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:03.217014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:03.217472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:03.217904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:03.220652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:03.254616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:03.256240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:03.275640 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4039/8050] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:05.550274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:05.567613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284257d7-899a-469e-9767-47a7c9b8f3a9 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:05.573307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:05.574437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:05.574437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:05.574779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:05.577305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:05.678326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:05.679924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:05.690117 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4012/8051] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:41:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:41:13.267719 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=64 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:15.689472 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=66 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:18.812080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:18.814637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:18.895916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54fb9c-155c-4707-8219-508cd454120b service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:18.899684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:18.900367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:18.900742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:18.901096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:18.903247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:18.998327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:19.000463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:19.013760 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4040/8052] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:23.254195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:23.256120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:23.288611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30445a-5052-455c-8144-7bb88a9ca38b service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:23.294363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:23.295082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:23.295677 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:23.297144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] PATH_INFO: `/v3/users/ea477d27693440a9a41d0aa12db57a9b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:23.298373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea477d27693440a9a41d0aa12db57a9b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:23.300458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:23.368326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea477d27693440a9a41d0aa12db57a9b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.369042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea477d27693440a9a41d0aa12db57a9b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.369796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea477d27693440a9a41d0aa12db57a9b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.383210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea477d27693440a9a41d0aa12db57a9b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.410370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72e1db03-9f8f-47aa-8559-8185a72a263e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea477d27693440a9a41d0aa12db57a9b'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.426364 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4013/8053] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:41:23 2022] DELETE /identity/v3/users/ea477d27693440a9a41d0aa12db57a9b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:41:23.649886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:23.662776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a916-fd03-455f-a3fe-8d488c3aadb8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:23.783161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:23.784162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:23.785151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:23.785151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] PATH_INFO: `/v3/projects/18531961a43f499fbc80225398a26996` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:23.786479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18531961a43f499fbc80225398a26996)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:23.788633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:23.823058 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:23.879690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18531961a43f499fbc80225398a26996', 'request_id': 'req-1956b326-1eee-468d-82a6-8fe087805157'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.888830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18531961a43f499fbc80225398a26996', 'request_id': 'req-1956b326-1eee-468d-82a6-8fe087805157'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.896610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18531961a43f499fbc80225398a26996', 'request_id': 'req-1956b326-1eee-468d-82a6-8fe087805157'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.914004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] The token cache is being invalidate because project 18531961a43f499fbc80225398a26996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:41:23.914004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.914004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:23.915692 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4041/8054] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:41:23 2022] DELETE /identity/v3/projects/18531961a43f499fbc80225398a26996 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:41:23.920614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2bfda-ad14-457e-99d3-ad2eaefbbab7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:23.921888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2bfda-ad14-457e-99d3-ad2eaefbbab7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:23.922218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2bfda-ad14-457e-99d3-ad2eaefbbab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:23.993399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7da2bfda-ad14-457e-99d3-ad2eaefbbab7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:23.994727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7da2bfda-ad14-457e-99d3-ad2eaefbbab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:24.037004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.039023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:24.082541 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4014/8055] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:24.094331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252a4a2-c836-4f45-957c-3edc86934280 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.094954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252a4a2-c836-4f45-957c-3edc86934280 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.095434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252a4a2-c836-4f45-957c-3edc86934280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.128402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f252a4a2-c836-4f45-957c-3edc86934280 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:24.130011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f252a4a2-c836-4f45-957c-3edc86934280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:24.140806 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4015/8056] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:24.145761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252a4a2-c836-4f45-957c-3edc86934280 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.158822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252a4a2-c836-4f45-957c-3edc86934280 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:24.166918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956b326-1eee-468d-82a6-8fe087805157 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:24.168229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:24.168938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.169251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.169611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.170304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:41:24.172403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:24.172963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:24.174585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:24.175307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.175768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.176973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.178341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:24.196152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4016/8057] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:41:24.197306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.200494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:24.203455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:24.220646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188670-5e6b-49ef-8f2f-841975084bee admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:24.232185 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4042/8058] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:41:24.238300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:24.239509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.243576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.243939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.249827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:24.251762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:24.299859 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:24.324123 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4017/8059] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:41:24 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:41:24.329770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.343895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19145284-3a7b-408d-9d47-bbd1435f58e8 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:24.458314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:24.459196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.459645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.460230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.460778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:24.462830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:24.489100 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4043/8060] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:41:24 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:41:24.492163 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.503417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f52ab-a720-435e-9c95-e54ea6f79c26 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:24.509101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:24.509728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.510314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.510314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.511018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:24.512897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:24.533649 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4018/8061] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:41:24.534773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.549640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfae0a2-7c07-47ad-9edc-c442d5151234 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:24.558143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5dc1b-0ad6-4a6e-a6da-9d80fb1987b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:24.558696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dc1b-0ad6-4a6e-a6da-9d80fb1987b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.558927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dc1b-0ad6-4a6e-a6da-9d80fb1987b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.559329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dc1b-0ad6-4a6e-a6da-9d80fb1987b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.560454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5dc1b-0ad6-4a6e-a6da-9d80fb1987b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:24.561948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5dc1b-0ad6-4a6e-a6da-9d80fb1987b4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:24.583554 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4044/8062] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:41:24.591175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.605630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff1632-a835-4408-a462-8f4b73c77010 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:24.630870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca7a0-ec6f-4cb0-a73a-cf17dd18e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:24.631811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca7a0-ec6f-4cb0-a73a-cf17dd18e82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.632417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca7a0-ec6f-4cb0-a73a-cf17dd18e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.632417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca7a0-ec6f-4cb0-a73a-cf17dd18e82d admin admin] PATH_INFO: `/v3/projects/bf72a67bd34449d6b1cb75b429acb254/users/7994fe80a7264539af73bcdf0164406e/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.649560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca7a0-ec6f-4cb0-a73a-cf17dd18e82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf72a67bd34449d6b1cb75b429acb254, user_id=7994fe80a7264539af73bcdf0164406e, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:24.653083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca7a0-ec6f-4cb0-a73a-cf17dd18e82d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:24.681108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.681942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.682380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.685280 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4019/8063] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:41:24 2022] PUT /identity/v3/projects/bf72a67bd34449d6b1cb75b429acb254/users/7994fe80a7264539af73bcdf0164406e/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:41:24.698684 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:24.739448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] MFA Rules not processed for user `7994fe80a7264539af73bcdf0164406e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:24.741845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:24.821527 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4045/8064] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:24.833650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1cb95-8262-43f4-947e-fafd6e232a43 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:24.834192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1cb95-8262-43f4-947e-fafd6e232a43 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:24.834641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1cb95-8262-43f4-947e-fafd6e232a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:24.856882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6ea1cb95-8262-43f4-947e-fafd6e232a43 None None] MFA Rules not processed for user `7994fe80a7264539af73bcdf0164406e`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:24.858110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6ea1cb95-8262-43f4-947e-fafd6e232a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:24.866743 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4020/8065] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:24.879570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:24.881054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:24.983136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a780dc-f41c-44a8-8366-43d268e16c98 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:25.001379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:25.002029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:25.002435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:25.002710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:25.023929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:25.026231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:25.040175 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4046/8066] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:25.990534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1cb95-8262-43f4-947e-fafd6e232a43 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:26.065002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1cb95-8262-43f4-947e-fafd6e232a43 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:26.070186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c154a-3811-4a03-8506-8df952579191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:26.070820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c154a-3811-4a03-8506-8df952579191 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:26.071095 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c154a-3811-4a03-8506-8df952579191 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:26.071361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c154a-3811-4a03-8506-8df952579191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:26.073364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-452c154a-3811-4a03-8506-8df952579191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:26.089416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c154a-3811-4a03-8506-8df952579191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:26.091011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c154a-3811-4a03-8506-8df952579191 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:26.105808 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4021/8067] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:35.034615 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=63 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:36.099698 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:37.593235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:37.728204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727dbf5-2169-47e1-a108-257ce8d1d99e service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:37.743359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:37.752245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:37.754645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:37.755198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] PATH_INFO: `/v3/users/7994fe80a7264539af73bcdf0164406e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:37.762035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7994fe80a7264539af73bcdf0164406e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:37.780194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:37.908602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7994fe80a7264539af73bcdf0164406e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:37.909273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7994fe80a7264539af73bcdf0164406e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:37.909895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7994fe80a7264539af73bcdf0164406e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:37.924345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7994fe80a7264539af73bcdf0164406e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:37.933761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7994fe80a7264539af73bcdf0164406e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:37.958335 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4047/8068] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:41:37 2022] DELETE /identity/v3/users/7994fe80a7264539af73bcdf0164406e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:41:37.965628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:37.973400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:37.974178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:38.009844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:38.011177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:38.018610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:38.020084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:38.153999 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4022/8069] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:38.161924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa265b-89d3-4bbe-a113-0cfcd8476fc5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:38.163321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:38.165098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:38.187497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:38.190037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:38.190338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:38.190631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] PATH_INFO: `/v3/users/544bbabf0c964569980c48b3582dd4a8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:38.192574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=544bbabf0c964569980c48b3582dd4a8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:38.194627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:38.227960 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:38.275630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6cb7-46a5-49ab-b93b-06ac1fc3e039 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:38.288015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:38.289051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:38.289634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:38.290475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:38.294430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544bbabf0c964569980c48b3582dd4a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:38.295168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544bbabf0c964569980c48b3582dd4a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:38.296748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544bbabf0c964569980c48b3582dd4a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:38.314243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544bbabf0c964569980c48b3582dd4a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:38.323440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b68e49df-8b08-4ddb-bbfc-6f8c6e140b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544bbabf0c964569980c48b3582dd4a8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:38.335097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:38.337046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:38.352895 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4048/8070] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:41:38 2022] DELETE /identity/v3/users/544bbabf0c964569980c48b3582dd4a8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:41:38.359404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:38.359404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:38.359708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:38.365293 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4023/8071] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:41:38.387051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:38.388317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:38.493456 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4049/8072] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:38.570001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:38.572537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:38.598246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce57c0-8f2d-499d-af36-4a306873c035 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:38.735235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bba3f-4d91-41ec-918c-f60554f24975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:38.736682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bba3f-4d91-41ec-918c-f60554f24975 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:38.736963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bba3f-4d91-41ec-918c-f60554f24975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:38.737265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bba3f-4d91-41ec-918c-f60554f24975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:38.754273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bba3f-4d91-41ec-918c-f60554f24975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:38.755236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bba3f-4d91-41ec-918c-f60554f24975 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:38.806845 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4024/8073] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:38.819069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:38.820757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:38.844918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecec33c-4b35-4679-a2c6-4a0cd1531d5b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:38.855324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:38.857411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:38.857707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:38.859607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] PATH_INFO: `/v3/projects/bf72a67bd34449d6b1cb75b429acb254` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:38.862169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf72a67bd34449d6b1cb75b429acb254)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:38.867335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:38.965234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf72a67bd34449d6b1cb75b429acb254', 'request_id': 'req-4bb3fdb8-4798-4314-a457-f00f96fbe531'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:38.973839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf72a67bd34449d6b1cb75b429acb254', 'request_id': 'req-4bb3fdb8-4798-4314-a457-f00f96fbe531'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:38.982262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf72a67bd34449d6b1cb75b429acb254', 'request_id': 'req-4bb3fdb8-4798-4314-a457-f00f96fbe531'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.027378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] The token cache is being invalidate because project bf72a67bd34449d6b1cb75b429acb254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:41:39.028443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.029246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4bb3fdb8-4798-4314-a457-f00f96fbe531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.036982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4050/8074] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:41:38 2022] DELETE /identity/v3/projects/bf72a67bd34449d6b1cb75b429acb254 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:41:39.038867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c394b-5190-47fd-9fb0-23857bce2aaa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.039327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c394b-5190-47fd-9fb0-23857bce2aaa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.039626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c394b-5190-47fd-9fb0-23857bce2aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.069675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-429c394b-5190-47fd-9fb0-23857bce2aaa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:39.071012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-429c394b-5190-47fd-9fb0-23857bce2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:39.147367 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:39.188386 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4025/8075] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:39.195886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c23f0-2762-441a-b11f-74b25f08cbc3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.196169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c23f0-2762-441a-b11f-74b25f08cbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.196449 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c23f0-2762-441a-b11f-74b25f08cbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.217851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f51c23f0-2762-441a-b11f-74b25f08cbc3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:39.219076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f51c23f0-2762-441a-b11f-74b25f08cbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:39.240761 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4051/8076] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:39.241595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c394b-5190-47fd-9fb0-23857bce2aaa None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.254854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c394b-5190-47fd-9fb0-23857bce2aaa None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.265637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.266515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.266652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.266862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.267588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:41:39.267896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.269584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.285238 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4026/8077] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:41:39.289383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c23f0-2762-441a-b11f-74b25f08cbc3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.300582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c23f0-2762-441a-b11f-74b25f08cbc3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.306049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.306631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.307027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.307404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.308138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.310503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.327936 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:39.369206 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4052/8078] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:41:39.369985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.382269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d5089-6db5-4a44-ae4d-c4534deafbb2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.476406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.477249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.477531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.477803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.481820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.484157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.509600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.518444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:39.524193 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4027/8079] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:41:39.528557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.535618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65f9f0-3b47-497b-86ec-cdf463ed44ed admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.541718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.542579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.543024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.543459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] PATH_INFO: `/v3/projects/c96aa740f9bd4608bf806b8b8667062a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.544805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96aa740f9bd4608bf806b8b8667062a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.547574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.608703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd078-b339-4d2a-bedb-b0d645360051 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.627378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96aa740f9bd4608bf806b8b8667062a', 'request_id': 'req-30d48a59-1d8d-47f4-829e-43810120841a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.640842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96aa740f9bd4608bf806b8b8667062a', 'request_id': 'req-30d48a59-1d8d-47f4-829e-43810120841a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.652856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96aa740f9bd4608bf806b8b8667062a', 'request_id': 'req-30d48a59-1d8d-47f4-829e-43810120841a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.687620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] The token cache is being invalidate because project c96aa740f9bd4608bf806b8b8667062a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:41:39.688040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.688715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-30d48a59-1d8d-47f4-829e-43810120841a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:41:39.690667 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4053/8080] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:41:39 2022] DELETE /identity/v3/projects/c96aa740f9bd4608bf806b8b8667062a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:41:39.696990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.696990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.698245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.717764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3421847-a65c-431d-b35e-6e2cdec0401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.718372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3421847-a65c-431d-b35e-6e2cdec0401a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.718652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3421847-a65c-431d-b35e-6e2cdec0401a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.719075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3421847-a65c-431d-b35e-6e2cdec0401a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.719716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3421847-a65c-431d-b35e-6e2cdec0401a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.720221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:39.721605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:39.721699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3421847-a65c-431d-b35e-6e2cdec0401a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.733475 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4054/8081] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:41:39.735778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4028/8082] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:41:39.740260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.744802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:39.751065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4455-6c02-4716-a636-3f639e5daad2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.751952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4455-6c02-4716-a636-3f639e5daad2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.752398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4455-6c02-4716-a636-3f639e5daad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.758107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710991ba-ebd8-4efc-9d41-2db228d85c9b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.763457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.764678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.764983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.765324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.766040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.767784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.780163 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4055/8083] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:41:39.782530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7ece4455-6c02-4716-a636-3f639e5daad2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:39.784055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7ece4455-6c02-4716-a636-3f639e5daad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:39.785121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.796014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be963a9-2c98-48bd-a3ca-40306700b74b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.796934 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4029/8084] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:39.801110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4455-6c02-4716-a636-3f639e5daad2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.805351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739104f-2215-411c-ad6b-d3a16bd67c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.805990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739104f-2215-411c-ad6b-d3a16bd67c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.806393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739104f-2215-411c-ad6b-d3a16bd67c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.806773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739104f-2215-411c-ad6b-d3a16bd67c23 admin admin] PATH_INFO: `/v3/projects/a1bc0be88ad346a4992dc6672bd8e119/users/bbeccce8ac1b44cab511548e48a8d860/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.823616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4455-6c02-4716-a636-3f639e5daad2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.834727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:39.835818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.837146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.837534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.838335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:41:39.838747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.840453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.846915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739104f-2215-411c-ad6b-d3a16bd67c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bc0be88ad346a4992dc6672bd8e119, user_id=bbeccce8ac1b44cab511548e48a8d860, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:39.853861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739104f-2215-411c-ad6b-d3a16bd67c23 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:39.872062 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4056/8085] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:41:39 2022] PUT /identity/v3/projects/a1bc0be88ad346a4992dc6672bd8e119/users/bbeccce8ac1b44cab511548e48a8d860/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:41:39.878890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:39.879187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:39.879446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:39.890519 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4030/8086] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:41:39.890519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:39.902969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca109a08-8ef2-4b6b-bf21-46100a535ed6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:39.908803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:39.910055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:39.976056 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:40.000950 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4057/8087] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:40.010854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:40.012491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:40.014357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:40.015045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.015435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.015718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.016366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:40.018341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:40.073746 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:40.090267 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4031/8088] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:41:39 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:41:40.091245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:40.109375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd087e6-accf-4024-9b2a-f617b0969053 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:40.180264 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:40.181155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.181657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.182010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.215752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e64c-66ce-4b12-9a13-3e067cafdb79 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:40.222675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:40.223421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.223799 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.224200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.225089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:40.227893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:40.260345 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4032/8089] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:41:40 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:41:40.264761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:40.274057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:40.275712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:40.276958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a3c8-8919-46fe-9337-ca2817dd4568 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:40.283602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:40.284716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.284998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.285319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.286573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:40.288809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:40.289776 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4058/8090] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:41:40.319280 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4033/8091] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:41:40.323304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:40.341604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9f6a-58dc-4e77-8943-6bd536a74aae service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:40.348035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dbb28-3902-4329-aec3-fd4f18325831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:40.348853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dbb28-3902-4329-aec3-fd4f18325831 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.349283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dbb28-3902-4329-aec3-fd4f18325831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.349624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dbb28-3902-4329-aec3-fd4f18325831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.350331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dbb28-3902-4329-aec3-fd4f18325831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:40.356938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dbb28-3902-4329-aec3-fd4f18325831 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:40.375683 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4059/8092] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:41:40.376624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:40.392775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc6a7b-6884-4334-9d41-c61e57124f6b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:40.403511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:40.404204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.404488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.404810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] PATH_INFO: `/v3/projects/2a23295d630e4c9da1396039e7c1cc96/users/d4f95a2d84e846188c6936a8798fbd39/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.445964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a23295d630e4c9da1396039e7c1cc96, user_id=d4f95a2d84e846188c6936a8798fbd39, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:40.448693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:40.475913 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4034/8093] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:41:40 2022] PUT /identity/v3/projects/2a23295d630e4c9da1396039e7c1cc96/users/d4f95a2d84e846188c6936a8798fbd39/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:41:40.487539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05d01-557d-4019-ad1e-4960ec1e758d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.487809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05d01-557d-4019-ad1e-4960ec1e758d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.488077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05d01-557d-4019-ad1e-4960ec1e758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.541816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c7b05d01-557d-4019-ad1e-4960ec1e758d None None] MFA Rules not processed for user `d4f95a2d84e846188c6936a8798fbd39`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:40.544235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c7b05d01-557d-4019-ad1e-4960ec1e758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:40.723984 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4060/8094] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:40.736940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:40.738972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:40.890035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156af7c-58b2-45f6-8977-488e346da756 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:40.899398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:40.901204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:40.901706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:40.901989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:40.939023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:40.941048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:40.966230 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4035/8095] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:47.007253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9228b-7a9e-4c44-bf58-ecc89627137f None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:47.007806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9228b-7a9e-4c44-bf58-ecc89627137f None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:47.007806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9228b-7a9e-4c44-bf58-ecc89627137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:47.036603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c8a9228b-7a9e-4c44-bf58-ecc89627137f None None] MFA Rules not processed for user `43f3337f99504775ad4a1648a27e238e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:47.037839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c8a9228b-7a9e-4c44-bf58-ecc89627137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:47.056595 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:47.112339 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4061/8096] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:47.796553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:47.799025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:47.851529 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:41:47.975033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb344453-b952-4b15-8c75-283279b26258 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:47.981236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de1b75-4acd-44e1-834c-a2ba31b2dcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:47.981916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de1b75-4acd-44e1-834c-a2ba31b2dcee service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:47.982198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de1b75-4acd-44e1-834c-a2ba31b2dcee service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:47.983062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de1b75-4acd-44e1-834c-a2ba31b2dcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:47.986949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c2de1b75-4acd-44e1-834c-a2ba31b2dcee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:48.009988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de1b75-4acd-44e1-834c-a2ba31b2dcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:48.011939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de1b75-4acd-44e1-834c-a2ba31b2dcee service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:48.052137 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4036/8097] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:49.658767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:49.661351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:49.661801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:49.732296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] MFA Rules not processed for user `bbeccce8ac1b44cab511548e48a8d860`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:49.734130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:49.944985 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4062/8098] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:49.959193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445abfa-fa88-457d-8b61-3517eee14860 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:49.960246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445abfa-fa88-457d-8b61-3517eee14860 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:49.961364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445abfa-fa88-457d-8b61-3517eee14860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:50.020584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8445abfa-fa88-457d-8b61-3517eee14860 None None] MFA Rules not processed for user `bbeccce8ac1b44cab511548e48a8d860`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:50.021900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8445abfa-fa88-457d-8b61-3517eee14860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:50.039009 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4037/8099] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:41:50.050940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:41:50.052510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:50.267304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3209f3-1596-4728-b0b4-3dcb3b39aa45 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:41:50.275669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:41:50.276689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:50.277179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:50.277896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:50.288964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:41:50.291588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:41:50.327184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4063/8100] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:41:51.628789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:41:51.629654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:41:51.630112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:41:51.697497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] MFA Rules not processed for user `bbeccce8ac1b44cab511548e48a8d860`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:41:51.699000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:41:51.751887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4038/8101] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:41:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:00.299405 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:01.672001 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=27 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:14.119305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:14.122060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:14.227476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285f32-e75f-4b01-a975-4b2a5ba87689 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:14.235796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0bd59-e9f4-4996-a8cd-e2a201762e8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:14.236476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0bd59-e9f4-4996-a8cd-e2a201762e8c service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:14.236798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0bd59-e9f4-4996-a8cd-e2a201762e8c service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:14.237098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0bd59-e9f4-4996-a8cd-e2a201762e8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:14.238950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-64d0bd59-e9f4-4996-a8cd-e2a201762e8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:14.257644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0bd59-e9f4-4996-a8cd-e2a201762e8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:14.259351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0bd59-e9f4-4996-a8cd-e2a201762e8c service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:14.283371 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4064/8102] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:14.820951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:14.823430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:14.914058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59a44f-0396-4992-a9b6-68a330e9589c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:14.918815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:14.920041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:14.920325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:14.920599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] PATH_INFO: `/v3/users/57400bc0eac94d5687ae29f9a19bf2d4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:14.921781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57400bc0eac94d5687ae29f9a19bf2d4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:14.924203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:14.996673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57400bc0eac94d5687ae29f9a19bf2d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:14.998017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57400bc0eac94d5687ae29f9a19bf2d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:14.998625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57400bc0eac94d5687ae29f9a19bf2d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.008241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57400bc0eac94d5687ae29f9a19bf2d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.035073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57400bc0eac94d5687ae29f9a19bf2d4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.054308 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4039/8103] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:42:14 2022] DELETE /identity/v3/users/57400bc0eac94d5687ae29f9a19bf2d4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:15.058896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:15.058896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:15.059233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:15.083749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:15.085160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:15.158583 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4065/8104] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:15.168040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:15.170567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:15.261102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ab44-d41d-4f4c-91f0-38ce0fc63820 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:15.265360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0988eb-71a1-41b5-b233-5f488a9cbda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:15.265983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0988eb-71a1-41b5-b233-5f488a9cbda8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:15.266312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0988eb-71a1-41b5-b233-5f488a9cbda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:15.266670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0988eb-71a1-41b5-b233-5f488a9cbda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:15.280345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0988eb-71a1-41b5-b233-5f488a9cbda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:15.282315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0988eb-71a1-41b5-b233-5f488a9cbda8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:15.296132 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4040/8105] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:15.505025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:15.506505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:15.546658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342434d-7d79-4e1c-9031-1948ee1b6fe0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:15.553848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:15.554744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:15.555157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:15.555574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] PATH_INFO: `/v3/projects/f3c0f6dabf3f4f03ab49c3fb7d313e36` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:15.558388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c0f6dabf3f4f03ab49c3fb7d313e36)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:15.562954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:15.630921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c0f6dabf3f4f03ab49c3fb7d313e36', 'request_id': 'req-4a0a93b3-5eea-473d-a98c-fbae93cd476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.637215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c0f6dabf3f4f03ab49c3fb7d313e36', 'request_id': 'req-4a0a93b3-5eea-473d-a98c-fbae93cd476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.646571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c0f6dabf3f4f03ab49c3fb7d313e36', 'request_id': 'req-4a0a93b3-5eea-473d-a98c-fbae93cd476b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.662399 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] The token cache is being invalidate because project f3c0f6dabf3f4f03ab49c3fb7d313e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:42:15.662603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.663235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4a0a93b3-5eea-473d-a98c-fbae93cd476b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:15.665244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4066/8106] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:42:15 2022] DELETE /identity/v3/projects/f3c0f6dabf3f4f03ab49c3fb7d313e36 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:15.670203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad45af-d390-4688-af93-9740f6b58dc8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:15.671535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad45af-d390-4688-af93-9740f6b58dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:15.672728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad45af-d390-4688-af93-9740f6b58dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:15.680526 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:15.695155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6dad45af-d390-4688-af93-9740f6b58dc8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:15.699526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6dad45af-d390-4688-af93-9740f6b58dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:15.771763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4041/8107] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:15.782453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541177-1ec3-4940-9400-e7e9b7faf942 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:15.782758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541177-1ec3-4940-9400-e7e9b7faf942 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:15.783082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46541177-1ec3-4940-9400-e7e9b7faf942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:15.815212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-46541177-1ec3-4940-9400-e7e9b7faf942 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:15.816426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-46541177-1ec3-4940-9400-e7e9b7faf942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:15.829811 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4067/8108] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:15.845106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad45af-d390-4688-af93-9740f6b58dc8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:15.857075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad45af-d390-4688-af93-9740f6b58dc8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:15.862997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:15.863604 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:15.863882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:15.864150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:15.864800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:42:15.865130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:15.866712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:15.879793 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4042/8109] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:42:15.884197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541177-1ec3-4940-9400-e7e9b7faf942 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:15.894366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46541177-1ec3-4940-9400-e7e9b7faf942 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:15.900318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:15.900770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:15.901046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:15.901376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:15.901980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:15.904364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:15.909364 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:15.955622 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4068/8110] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:42:15 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:42:15.959841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:15.970947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95095021-2337-4842-b2c1-82d9e69e084a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:16.052205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:16.053020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:16.053509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:16.054065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:16.054880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:16.057111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:16.085830 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4043/8111] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:42:15 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:42:16.088313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:16.101896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34478cd0-8134-4fdb-8c5e-250b3e04e5f7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:16.110634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:16.111592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:16.112141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:16.112889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:16.113806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:16.116275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:16.136033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:16.141341 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4069/8112] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:42:16.148344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdded1c1-0e9d-41ad-acdf-29a8ca1a4c6a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:16.155797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112a55-6b8f-49b3-a695-39c30e6efecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:16.156711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112a55-6b8f-49b3-a695-39c30e6efecf admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:16.157235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112a55-6b8f-49b3-a695-39c30e6efecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:16.157760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112a55-6b8f-49b3-a695-39c30e6efecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:16.158482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112a55-6b8f-49b3-a695-39c30e6efecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:16.160338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112a55-6b8f-49b3-a695-39c30e6efecf admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:16.174830 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4044/8113] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:42:16.177837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:16.190044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d690e41-c54b-4a28-af47-5e8645b09301 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:16.195487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:16.196209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:16.196956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:16.197119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] PATH_INFO: `/v3/projects/0b422b3be68b41559cb26bfa2eb79d28/users/2b065f3fbd5f4358a8118a61d7f73550/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:16.214721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b422b3be68b41559cb26bfa2eb79d28, user_id=2b065f3fbd5f4358a8118a61d7f73550, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:16.218186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:16.234145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4070/8114] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:42:16 2022] PUT /identity/v3/projects/0b422b3be68b41559cb26bfa2eb79d28/users/2b065f3fbd5f4358a8118a61d7f73550/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:16.239587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd94f5-d746-4a03-9060-1a014e3d54ae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:16.240035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd94f5-d746-4a03-9060-1a014e3d54ae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:16.240309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd94f5-d746-4a03-9060-1a014e3d54ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:16.264995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6ccd94f5-d746-4a03-9060-1a014e3d54ae None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:16.266205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6ccd94f5-d746-4a03-9060-1a014e3d54ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:16.345990 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4045/8115] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:16.360791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:16.363240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:16.457713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c554-24aa-4969-974f-4748b47a8de5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:16.461109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:16.461109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:16.461109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:16.461109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:16.472670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:16.474155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:16.485983 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4071/8116] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:22.429870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d01c-161b-48d0-b9c8-d17f1c86f323 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:22.430405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d01c-161b-48d0-b9c8-d17f1c86f323 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:22.430493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d01c-161b-48d0-b9c8-d17f1c86f323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:22.456810 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:22.490507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2847d01c-161b-48d0-b9c8-d17f1c86f323 None None] MFA Rules not processed for user `2b065f3fbd5f4358a8118a61d7f73550`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:22.491789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2847d01c-161b-48d0-b9c8-d17f1c86f323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:22.603619 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4046/8117] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:22.608127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:22.626805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1933fd-0e45-464f-9c9a-9f4890850e9b service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:22.634773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:22.635392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:22.635847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:22.636273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:22.637101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:22.639546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:22.680101 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4072/8118] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:42:22 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:42:22.684122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847d01c-161b-48d0-b9c8-d17f1c86f323 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:22.702055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847d01c-161b-48d0-b9c8-d17f1c86f323 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:22.802592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:22.803231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:22.803647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:22.803927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:22.804569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:22.808808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:22.865651 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4047/8119] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:42:22 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:42:22.869789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:22.901868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ed3db-1cc6-413f-8ae0-4542ced9b971 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:22.919451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:22.920521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:22.920964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:22.921419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:22.922226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:22.924178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:22.958999 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4073/8120] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:22.960237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:22.975657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427deb9-11c9-4a82-b28b-0d407fea0f98 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:22.988414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:22.989335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:22.989648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:22.990447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] PATH_INFO: `/v3/projects/a22dc5ac6d99475b905f2bb65e64f5b9/users/289304d7003c408fa5ecd4f44af6c22f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:23.032932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22dc5ac6d99475b905f2bb65e64f5b9, user_id=289304d7003c408fa5ecd4f44af6c22f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:23.040682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:23.073956 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4048/8121] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:42:22 2022] PUT /identity/v3/projects/a22dc5ac6d99475b905f2bb65e64f5b9/users/289304d7003c408fa5ecd4f44af6c22f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:23.076038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:23.094434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ed8d6-889a-4fff-b1f6-10b0bf9c7ee6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:23.246156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:23.246911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:23.247792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:23.249871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:23.251734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:23.255221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:23.281387 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4074/8122] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:23.285340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:23.297135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf53b6-e28b-4cf7-8fa2-73e15afe58a3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:23.319334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9339f-1fa8-4f9d-ac90-55fdb5b2ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:23.320097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9339f-1fa8-4f9d-ac90-55fdb5b2ba8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:23.320444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9339f-1fa8-4f9d-ac90-55fdb5b2ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:23.322426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9339f-1fa8-4f9d-ac90-55fdb5b2ba8f admin admin] PATH_INFO: `/v3/projects/a22dc5ac6d99475b905f2bb65e64f5b9/users/289304d7003c408fa5ecd4f44af6c22f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:23.335437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9339f-1fa8-4f9d-ac90-55fdb5b2ba8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22dc5ac6d99475b905f2bb65e64f5b9, user_id=289304d7003c408fa5ecd4f44af6c22f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:23.338394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9339f-1fa8-4f9d-ac90-55fdb5b2ba8f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:23.391478 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4049/8123] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:42:23 2022] PUT /identity/v3/projects/a22dc5ac6d99475b905f2bb65e64f5b9/users/289304d7003c408fa5ecd4f44af6c22f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:26.709974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:26.713388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:26.736666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307ca3-eb68-4cc0-92c3-6fc98d63fd0c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:26.785518 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:26.901855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:26.902522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:26.903104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:26.903371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] PATH_INFO: `/v3/users/43f3337f99504775ad4a1648a27e238e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:26.905832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f3337f99504775ad4a1648a27e238e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:26.911389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:27.023544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f3337f99504775ad4a1648a27e238e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:27.024831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f3337f99504775ad4a1648a27e238e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:27.029632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f3337f99504775ad4a1648a27e238e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:27.063134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f3337f99504775ad4a1648a27e238e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:27.086837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f3337f99504775ad4a1648a27e238e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:27.115832 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4075/8124] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:42:26 2022] DELETE /identity/v3/users/43f3337f99504775ad4a1648a27e238e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:27.121090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:27.121625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:27.121625 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:27.166269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:27.167564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:27.237532 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:27.264575 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4050/8125] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:27.286210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:27.287892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:27.405837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a9d6-ea88-404a-94b3-b9ec856e2d39 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:27.417612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:27.420058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:27.421104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:27.422126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:27.451028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:27.457163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:27.489657 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4076/8126] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:27.789299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:27.791202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:27.815840 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dd3e5-8f16-4ad4-a738-8a038ae8c2e1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:27.832927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:27.834100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:27.834598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:27.835089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] PATH_INFO: `/v3/projects/6e12b5d6b11442ae972d2025f7bb181f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:27.837922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e12b5d6b11442ae972d2025f7bb181f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:27.841165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:27.955342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e12b5d6b11442ae972d2025f7bb181f', 'request_id': 'req-83996ef4-7d8a-43ad-b489-0ac72aed3246'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:27.971438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e12b5d6b11442ae972d2025f7bb181f', 'request_id': 'req-83996ef4-7d8a-43ad-b489-0ac72aed3246'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:27.985407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e12b5d6b11442ae972d2025f7bb181f', 'request_id': 'req-83996ef4-7d8a-43ad-b489-0ac72aed3246'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.017001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] The token cache is being invalidate because project 6e12b5d6b11442ae972d2025f7bb181f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:42:28.017427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.019109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.022648 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4051/8127] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:42:27 2022] DELETE /identity/v3/projects/6e12b5d6b11442ae972d2025f7bb181f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:28.026807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:28.045835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bdace-feea-4347-83f5-bcff3f4209eb service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:28.093422 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:28.136651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:28.137352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:28.137727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:28.138081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] PATH_INFO: `/v3/users/354a4031884b40a2b6350cbbd20ddab4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:28.139381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=354a4031884b40a2b6350cbbd20ddab4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:28.142566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:28.298072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354a4031884b40a2b6350cbbd20ddab4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.298923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354a4031884b40a2b6350cbbd20ddab4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.299783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354a4031884b40a2b6350cbbd20ddab4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.324906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354a4031884b40a2b6350cbbd20ddab4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.334599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354a4031884b40a2b6350cbbd20ddab4'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:28.354470 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4077/8128] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:42:28 2022] DELETE /identity/v3/users/354a4031884b40a2b6350cbbd20ddab4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:28.788669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:28.790214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:28.828134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996ef4-7d8a-43ad-b489-0ac72aed3246 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:28.934607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:28.937585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:28.937585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:28.937585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] PATH_INFO: `/v3/projects/6e390d042ec24d32891e9fc28e17dccc` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:28.937585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e390d042ec24d32891e9fc28e17dccc)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:28.939573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:29.039144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e390d042ec24d32891e9fc28e17dccc', 'request_id': 'req-72b11445-4850-4d5f-958f-11eab300c699'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.055793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e390d042ec24d32891e9fc28e17dccc', 'request_id': 'req-72b11445-4850-4d5f-958f-11eab300c699'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.083027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e390d042ec24d32891e9fc28e17dccc', 'request_id': 'req-72b11445-4850-4d5f-958f-11eab300c699'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.110577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] The token cache is being invalidate because project 6e390d042ec24d32891e9fc28e17dccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:42:29.111284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.112488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.119208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:29.120728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:29.133814 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4052/8129] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:42:28 2022] DELETE /identity/v3/projects/6e390d042ec24d32891e9fc28e17dccc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:29.155781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba200bb-6b93-426e-8433-f5dc221715ea admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:29.306652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:29.307493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:29.307862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:29.308198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] PATH_INFO: `/v3/users/bebfb877435649a1abe823a2e0882844` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:29.310475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bebfb877435649a1abe823a2e0882844)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:29.315091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:29.426249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bebfb877435649a1abe823a2e0882844'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.427965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bebfb877435649a1abe823a2e0882844'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.428888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bebfb877435649a1abe823a2e0882844'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.455441 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:29.467900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bebfb877435649a1abe823a2e0882844'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.492020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a3cdf898-0895-4e1a-9f2b-2ef87725f75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bebfb877435649a1abe823a2e0882844'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:29.515190 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4078/8130] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:42:29 2022] DELETE /identity/v3/users/bebfb877435649a1abe823a2e0882844 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:42:29.828575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:29.830497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:29.868611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b11445-4850-4d5f-958f-11eab300c699 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:29.877819 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:30.065680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:30.066352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:30.066638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:30.067065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] PATH_INFO: `/v3/projects/3afba4d2141544659193e4003083a5c6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:30.069398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afba4d2141544659193e4003083a5c6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:30.071354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:30.187710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afba4d2141544659193e4003083a5c6', 'request_id': 'req-258f1315-bc81-4029-aefd-7037b61e83ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:30.196649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afba4d2141544659193e4003083a5c6', 'request_id': 'req-258f1315-bc81-4029-aefd-7037b61e83ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:30.211900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afba4d2141544659193e4003083a5c6', 'request_id': 'req-258f1315-bc81-4029-aefd-7037b61e83ed'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:30.251150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] The token cache is being invalidate because project 3afba4d2141544659193e4003083a5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:42:30.251514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:30.253253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:30.267262 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4053/8131] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:42:29 2022] DELETE /identity/v3/projects/3afba4d2141544659193e4003083a5c6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:31.979145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:31.979689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:31.979689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:32.017800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] MFA Rules not processed for user `289304d7003c408fa5ecd4f44af6c22f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:32.019829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:32.108747 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4079/8132] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:32.123037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:32.125100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:32.222081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f1315-bc81-4029-aefd-7037b61e83ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:32.228233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:32.228847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:32.229153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:32.232064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:32.241947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:32.243756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:32.257283 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4054/8133] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:32.543541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:32.546036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:32.670108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d378a70-d9a3-4878-bf17-270d89d9150b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:32.675698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:32.676408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:32.676877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:32.677315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:32.679127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:32.694846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:32.696572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:32.709549 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4080/8134] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:41.718986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:41.721203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:41.749911 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:41.794141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6a15f-f42d-4e44-aa45-76a012810c6e service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:41.799158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:41.799796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:41.800075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:41.800347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] PATH_INFO: `/v3/users/2b065f3fbd5f4358a8118a61d7f73550` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:41.801519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b065f3fbd5f4358a8118a61d7f73550)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:41.803467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:41.856498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b065f3fbd5f4358a8118a61d7f73550'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:41.857191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b065f3fbd5f4358a8118a61d7f73550'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:41.857803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b065f3fbd5f4358a8118a61d7f73550'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:41.864896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b065f3fbd5f4358a8118a61d7f73550'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:41.877322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b065f3fbd5f4358a8118a61d7f73550'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:41.891366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4055/8135] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:42:41 2022] DELETE /identity/v3/users/2b065f3fbd5f4358a8118a61d7f73550 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:42.093933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:42.114414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9180e3-1cbd-4832-b5df-6232cfa356f6 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:42.181590 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:42.194022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:42.195045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:42.195596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:42.196327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] PATH_INFO: `/v3/projects/0b422b3be68b41559cb26bfa2eb79d28` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:42.197535 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b422b3be68b41559cb26bfa2eb79d28)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:42.199457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:42.256308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b422b3be68b41559cb26bfa2eb79d28', 'request_id': 'req-4f55af67-2dda-4fe5-afbe-1080aa6968d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.262076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b422b3be68b41559cb26bfa2eb79d28', 'request_id': 'req-4f55af67-2dda-4fe5-afbe-1080aa6968d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.271543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b422b3be68b41559cb26bfa2eb79d28', 'request_id': 'req-4f55af67-2dda-4fe5-afbe-1080aa6968d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.288142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] The token cache is being invalidate because project 0b422b3be68b41559cb26bfa2eb79d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:42:42.288822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.289674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.291367 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4081/8136] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:42:42 2022] DELETE /identity/v3/projects/0b422b3be68b41559cb26bfa2eb79d28 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:42.295562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:42.297227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:42.320242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffad8d-576f-4971-843d-5a84c2286c58 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:42.394139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:42.394760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:42.395088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:42.395371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] PATH_INFO: `/v3/users/289304d7003c408fa5ecd4f44af6c22f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:42.396809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=289304d7003c408fa5ecd4f44af6c22f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:42.399179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:42.462138 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:42.467170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289304d7003c408fa5ecd4f44af6c22f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.467970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289304d7003c408fa5ecd4f44af6c22f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.468611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289304d7003c408fa5ecd4f44af6c22f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.477983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289304d7003c408fa5ecd4f44af6c22f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.490906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ded785ce-a347-42e6-b4bf-1d52e1305f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289304d7003c408fa5ecd4f44af6c22f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.504664 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4056/8137] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:42:42 2022] DELETE /identity/v3/users/289304d7003c408fa5ecd4f44af6c22f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:42.724359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:42.726211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:42.744505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55af67-2dda-4fe5-afbe-1080aa6968d0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:42.820530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:42.821219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:42.821498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:42.821766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] PATH_INFO: `/v3/projects/a22dc5ac6d99475b905f2bb65e64f5b9` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:42.822945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22dc5ac6d99475b905f2bb65e64f5b9)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:42.825625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:42.874572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22dc5ac6d99475b905f2bb65e64f5b9', 'request_id': 'req-ca527443-edae-4e71-b5aa-3efa679635db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.880464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22dc5ac6d99475b905f2bb65e64f5b9', 'request_id': 'req-ca527443-edae-4e71-b5aa-3efa679635db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.888084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22dc5ac6d99475b905f2bb65e64f5b9', 'request_id': 'req-ca527443-edae-4e71-b5aa-3efa679635db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.901190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] The token cache is being invalidate because project a22dc5ac6d99475b905f2bb65e64f5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:42:42.901473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.902098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ca527443-edae-4e71-b5aa-3efa679635db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:42.903933 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4082/8138] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:42:42 2022] DELETE /identity/v3/projects/a22dc5ac6d99475b905f2bb65e64f5b9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:42.909876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc4963-4d42-434a-bcac-51a26a1d9594 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:42.910253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc4963-4d42-434a-bcac-51a26a1d9594 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:42.910253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc4963-4d42-434a-bcac-51a26a1d9594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:42.929901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8dfc4963-4d42-434a-bcac-51a26a1d9594 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:42.931100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8dfc4963-4d42-434a-bcac-51a26a1d9594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:42.991950 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4057/8139] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:43.000681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cc10-ffa6-402b-aca2-6d0669df2bd9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.000913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cc10-ffa6-402b-aca2-6d0669df2bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.001594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96cc10-ffa6-402b-aca2-6d0669df2bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.022053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6e96cc10-ffa6-402b-aca2-6d0669df2bd9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:43.023270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6e96cc10-ffa6-402b-aca2-6d0669df2bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:43.031661 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4083/8140] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:43.036123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc4963-4d42-434a-bcac-51a26a1d9594 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.046266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc4963-4d42-434a-bcac-51a26a1d9594 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.050884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.051479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.051754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.052021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.052652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:42:43.052948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.054545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.068662 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4058/8141] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:42:43.073229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96cc10-ffa6-402b-aca2-6d0669df2bd9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.080084 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:43.086668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96cc10-ffa6-402b-aca2-6d0669df2bd9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.092827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.093810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.094193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.094744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.095237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.097609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.126850 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4084/8142] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:42:43 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:42:43.130982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.141390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec2f5-8b79-484e-83b7-9239f2af47b8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.201232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.201751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.202026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.202298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.202942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.204836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.227393 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4059/8143] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:42:43 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:42:43.232184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.242445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd6fa5-9f51-4953-a559-371a39bb8bad admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.247121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.247720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.247997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.248266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.248900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.250509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.260385 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4085/8144] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:43.264497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.275083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa294aa-1fae-459f-ada2-6b8aeb53294e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.280590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fea5bf-495b-4ffd-bdaf-c9688beab793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.281228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fea5bf-495b-4ffd-bdaf-c9688beab793 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.281503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fea5bf-495b-4ffd-bdaf-c9688beab793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.281769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fea5bf-495b-4ffd-bdaf-c9688beab793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.282407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fea5bf-495b-4ffd-bdaf-c9688beab793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.283972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fea5bf-495b-4ffd-bdaf-c9688beab793 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.295496 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4060/8145] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:43.299759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.310057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df5358-230b-432a-9d6c-bb8e28262ccc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.314627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.315278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.315543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.315810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] PATH_INFO: `/v3/projects/13aea811223a421885d0b296cad99768/users/5b62f2cd5736454c8f95c80ab8ecc6a2/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.330734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aea811223a421885d0b296cad99768, user_id=5b62f2cd5736454c8f95c80ab8ecc6a2, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.333379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.347631 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4086/8146] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:42:43 2022] PUT /identity/v3/projects/13aea811223a421885d0b296cad99768/users/5b62f2cd5736454c8f95c80ab8ecc6a2/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:43.358360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6287a39-a346-4819-a9db-bceec64305f3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.358643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6287a39-a346-4819-a9db-bceec64305f3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.358911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6287a39-a346-4819-a9db-bceec64305f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.390669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b6287a39-a346-4819-a9db-bceec64305f3 None None] MFA Rules not processed for user `5b62f2cd5736454c8f95c80ab8ecc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:43.391941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b6287a39-a346-4819-a9db-bceec64305f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:43.407035 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:43.467981 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4061/8147] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:42:43.472432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.544805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e490e96-c018-4e85-97d0-05fe269d9402 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.549985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.550659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.551001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.551335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.552040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.554078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.583688 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4087/8148] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:42:43 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:42:43.587749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6287a39-a346-4819-a9db-bceec64305f3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.599893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6287a39-a346-4819-a9db-bceec64305f3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.659012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.659638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.659918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.660182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.660796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.662769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.684140 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4062/8149] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:42:43 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:42:43.688517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.698790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d048b-793f-4f45-baaa-56fab0fe34c4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.704280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.704870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.705186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.705439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.706066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.707639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.719305 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4088/8150] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:43.723364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.733611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7054cc-c331-4b0a-8fcf-41f911099796 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.738167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.738814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.739091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.739358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] PATH_INFO: `/v3/projects/0a383752fb5d4dd29cc392f439a00634/users/3b8f84836e0a4cf08b2a84b3b9c82356/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.754303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a383752fb5d4dd29cc392f439a00634, user_id=3b8f84836e0a4cf08b2a84b3b9c82356, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.756960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.790627 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4063/8151] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:42:43 2022] PUT /identity/v3/projects/0a383752fb5d4dd29cc392f439a00634/users/3b8f84836e0a4cf08b2a84b3b9c82356/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:43.796844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.808722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bb0a1-007d-4815-aa2e-92e9f1eda282 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.874547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca23a0-4c98-4cdd-8a96-6c5350809084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.875261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca23a0-4c98-4cdd-8a96-6c5350809084 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.875647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca23a0-4c98-4cdd-8a96-6c5350809084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.876003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca23a0-4c98-4cdd-8a96-6c5350809084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.877185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca23a0-4c98-4cdd-8a96-6c5350809084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.878483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca23a0-4c98-4cdd-8a96-6c5350809084 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.889762 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4089/8152] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:43.894568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:43.907774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605d2b-5642-4fe9-9346-cc1dd574bd14 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:43.913260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:43.914331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.914747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.915025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] PATH_INFO: `/v3/projects/0a383752fb5d4dd29cc392f439a00634/users/3b8f84836e0a4cf08b2a84b3b9c82356/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.917039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a383752fb5d4dd29cc392f439a00634, user_id=3b8f84836e0a4cf08b2a84b3b9c82356, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:43.920731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:43.935637 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4064/8153] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:42:43 2022] PUT /identity/v3/projects/0a383752fb5d4dd29cc392f439a00634/users/3b8f84836e0a4cf08b2a84b3b9c82356/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:42:43.947721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:43.948518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:43.948871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:43.986366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] MFA Rules not processed for user `3b8f84836e0a4cf08b2a84b3b9c82356`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:43.987628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:43.995121 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:44.068431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4090/8154] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:42:44.083226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:44.085034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:44.167781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c291-e58f-4abd-91c3-d06403a45cc6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:44.173826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4dd32-5d12-4c0f-b2b5-525b7f1cb0c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:44.174432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4dd32-5d12-4c0f-b2b5-525b7f1cb0c9 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:44.175339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4dd32-5d12-4c0f-b2b5-525b7f1cb0c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:44.175619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4dd32-5d12-4c0f-b2b5-525b7f1cb0c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:44.179855 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:44.235134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4dd32-5d12-4c0f-b2b5-525b7f1cb0c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:44.236689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4dd32-5d12-4c0f-b2b5-525b7f1cb0c9 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:44.245963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4065/8155] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:47.741076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:47.743227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:47.858353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61826c9-fd2b-4280-82cd-1be1670ceb3c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:47.863099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:47.863792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:47.864054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:47.864292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:47.877646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:47.885625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:47.904833 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4091/8156] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:51.670678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:51.671158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:51.671241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:51.691701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] MFA Rules not processed for user `5b62f2cd5736454c8f95c80ab8ecc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:51.693048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:51.721505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4066/8157] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:52.409920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:52.436119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55ce2-b1c1-4f57-a333-0073d348ff53 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:52.440288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a98d8-6c05-42a7-b42c-6a3fd73c4d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:52.441397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a98d8-6c05-42a7-b42c-6a3fd73c4d43 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:52.441935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a98d8-6c05-42a7-b42c-6a3fd73c4d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:52.442889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a98d8-6c05-42a7-b42c-6a3fd73c4d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:52.447409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-376a98d8-6c05-42a7-b42c-6a3fd73c4d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:52.479936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a98d8-6c05-42a7-b42c-6a3fd73c4d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:52.490814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a98d8-6c05-42a7-b42c-6a3fd73c4d43 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:52.541302 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4092/8158] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:42:58.469330 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:58.470836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:58.556274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e716c-9a35-4e3f-8962-1fbad0d55b17 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:58.561812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:58.562715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:58.562999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:58.563276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] PATH_INFO: `/v3/users/d4f95a2d84e846188c6936a8798fbd39` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:58.564909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f95a2d84e846188c6936a8798fbd39)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:58.566874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:58.630161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f95a2d84e846188c6936a8798fbd39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:58.641818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f95a2d84e846188c6936a8798fbd39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:58.644253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f95a2d84e846188c6936a8798fbd39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:58.652370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f95a2d84e846188c6936a8798fbd39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:58.666006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f95a2d84e846188c6936a8798fbd39'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:58.679645 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4067/8159] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:42:58 2022] DELETE /identity/v3/users/d4f95a2d84e846188c6936a8798fbd39 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:58.684546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:58.685000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:58.685154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:58.705550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:58.706661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:58.772296 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4093/8160] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:58.783581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:58.785301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:58.809141 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:58.851955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e49a62-4491-4095-a3ea-3e7d7ef0f3ff admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:58.856938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f4a42-6f39-470f-8f1b-978126eaaf9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:58.857128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4a42-6f39-470f-8f1b-978126eaaf9d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:58.857321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4a42-6f39-470f-8f1b-978126eaaf9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:58.857607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f4a42-6f39-470f-8f1b-978126eaaf9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:58.866624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f4a42-6f39-470f-8f1b-978126eaaf9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:58.868073 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f4a42-6f39-470f-8f1b-978126eaaf9d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:58.878075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4068/8161] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:42:59.339431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:59.341532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:59.354921 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea18c58-61ff-4418-b4f7-fe1b87bea5c5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:59.360741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:59.361430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.361793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.361964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] PATH_INFO: `/v3/projects/2a23295d630e4c9da1396039e7c1cc96` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.363493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a23295d630e4c9da1396039e7c1cc96)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:59.365088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:59.405513 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:42:59.422475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a23295d630e4c9da1396039e7c1cc96', 'request_id': 'req-3877bf6c-f5f4-4481-a3c4-200e4d79badd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:59.428257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a23295d630e4c9da1396039e7c1cc96', 'request_id': 'req-3877bf6c-f5f4-4481-a3c4-200e4d79badd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:59.435131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a23295d630e4c9da1396039e7c1cc96', 'request_id': 'req-3877bf6c-f5f4-4481-a3c4-200e4d79badd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:59.448180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] The token cache is being invalidate because project 2a23295d630e4c9da1396039e7c1cc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:42:59.448467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:59.449653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3877bf6c-f5f4-4481-a3c4-200e4d79badd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:42:59.451573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4094/8162] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:42:59 2022] DELETE /identity/v3/projects/2a23295d630e4c9da1396039e7c1cc96 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:59.456223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3fe5-1d79-49d8-be8e-7d692409377b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.456505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3fe5-1d79-49d8-be8e-7d692409377b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.456783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3fe5-1d79-49d8-be8e-7d692409377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.476841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-115d3fe5-1d79-49d8-be8e-7d692409377b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:59.478091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-115d3fe5-1d79-49d8-be8e-7d692409377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:59.550142 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4069/8163] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:59.558019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d95af-6c57-45b5-b72c-03e71832eec7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.558325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d95af-6c57-45b5-b72c-03e71832eec7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.558653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d95af-6c57-45b5-b72c-03e71832eec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.581420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-312d95af-6c57-45b5-b72c-03e71832eec7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:59.582749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-312d95af-6c57-45b5-b72c-03e71832eec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:59.591875 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4095/8164] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:42:59.597373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d3fe5-1d79-49d8-be8e-7d692409377b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:59.607389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d3fe5-1d79-49d8-be8e-7d692409377b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:59.611990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:59.612589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.612885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.613188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.613828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:42:59.614125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:59.615687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:59.628389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4070/8165] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:42:59.633214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d95af-6c57-45b5-b72c-03e71832eec7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:59.644308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d95af-6c57-45b5-b72c-03e71832eec7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:59.649453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:59.650069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.650381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.650767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.651415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:59.654117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:59.682585 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4096/8166] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:42:59 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:42:59.688199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:59.698395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bf328-816d-4478-ab66-9e6d14e81e69 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:59.758652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:59.759289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.759567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.759836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.760499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:59.763166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:59.788827 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4071/8167] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:42:59 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:42:59.790622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:59.802026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369983c5-5490-4768-ab46-d3bbd1d22088 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:59.806749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:59.807408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.807628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.807904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.809143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:59.810880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:59.824258 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4097/8168] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:59.826326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:59.836640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e38e-6f05-4741-a148-48ee0261bb46 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:59.842135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550050b-0f7c-4a5b-8f83-7c659ae84f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:59.842730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550050b-0f7c-4a5b-8f83-7c659ae84f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.843009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550050b-0f7c-4a5b-8f83-7c659ae84f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.843287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550050b-0f7c-4a5b-8f83-7c659ae84f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.843924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550050b-0f7c-4a5b-8f83-7c659ae84f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:59.845599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550050b-0f7c-4a5b-8f83-7c659ae84f42 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:59.857814 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4072/8169] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:42:59.863329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:42:59.874160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbcce0-f6ad-4169-b628-6884f79ea543 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:42:59.878933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:42:59.879622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.879903 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.880173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] PATH_INFO: `/v3/projects/73a7f4af2e924c479b02d913ca95929a/users/b192f3bf844348a1816ad292ca873030/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.897386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a7f4af2e924c479b02d913ca95929a, user_id=b192f3bf844348a1816ad292ca873030, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:42:59.900016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:42:59.913480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4098/8170] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:42:59 2022] PUT /identity/v3/projects/73a7f4af2e924c479b02d913ca95929a/users/b192f3bf844348a1816ad292ca873030/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:42:59.923785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b8659-0c39-471a-8713-79729a05297b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:42:59.924068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b8659-0c39-471a-8713-79729a05297b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:42:59.924354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b8659-0c39-471a-8713-79729a05297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:42:59.952588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a73b8659-0c39-471a-8713-79729a05297b None None] MFA Rules not processed for user `b192f3bf844348a1816ad292ca873030`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:42:59.953822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a73b8659-0c39-471a-8713-79729a05297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:42:59.967388 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:00.021540 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4073/8171] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:00.032504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:00.034281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:00.094803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2265-9a2e-4958-b557-36e4a2796582 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:00.098756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77247657-bfaa-43cb-b751-7613cd9cf001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:00.099356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77247657-bfaa-43cb-b751-7613cd9cf001 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:00.099634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77247657-bfaa-43cb-b751-7613cd9cf001 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:00.099910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77247657-bfaa-43cb-b751-7613cd9cf001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:00.109381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77247657-bfaa-43cb-b751-7613cd9cf001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:00.110802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77247657-bfaa-43cb-b751-7613cd9cf001 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:00.119859 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4099/8172] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:10.018488 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=20 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:10.115560 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=67,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:13.521696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b8659-0c39-471a-8713-79729a05297b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:13.597513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b8659-0c39-471a-8713-79729a05297b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:13.602087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:13.602738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:13.603017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:13.603321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] PATH_INFO: `/v3/users/b192f3bf844348a1816ad292ca873030` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:13.604611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b192f3bf844348a1816ad292ca873030)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:13.607716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:13.660805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b192f3bf844348a1816ad292ca873030'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:13.661576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b192f3bf844348a1816ad292ca873030'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:13.662245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b192f3bf844348a1816ad292ca873030'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:13.672195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b192f3bf844348a1816ad292ca873030'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:13.684718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b192f3bf844348a1816ad292ca873030'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:13.698699 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4074/8173] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:43:13 2022] DELETE /identity/v3/users/b192f3bf844348a1816ad292ca873030 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:13.704037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:13.704538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:13.704648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:13.724596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:13.725803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:13.786436 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4100/8174] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:43:13.796680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:13.798249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:13.865053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7638-964c-4b0a-8fa2-1efb95749dd8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:13.869155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b2d59-d9f0-4d5e-8b7b-05569aa1362f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:13.870094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2d59-d9f0-4d5e-8b7b-05569aa1362f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:13.870318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2d59-d9f0-4d5e-8b7b-05569aa1362f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:13.871733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2d59-d9f0-4d5e-8b7b-05569aa1362f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:13.883126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b2d59-d9f0-4d5e-8b7b-05569aa1362f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:13.884678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b2d59-d9f0-4d5e-8b7b-05569aa1362f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:13.895720 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4075/8175] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:14.228876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:14.230603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:14.253001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421cd6-1e58-4576-ba80-e1e0c85f9118 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:14.274641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:14.275461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.275999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.276484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] PATH_INFO: `/v3/projects/73a7f4af2e924c479b02d913ca95929a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.279709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a7f4af2e924c479b02d913ca95929a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:14.281946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:14.342536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a7f4af2e924c479b02d913ca95929a', 'request_id': 'req-3310d439-d3d3-454a-9de6-d9cf74b72da1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:14.349681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a7f4af2e924c479b02d913ca95929a', 'request_id': 'req-3310d439-d3d3-454a-9de6-d9cf74b72da1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:14.357743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a7f4af2e924c479b02d913ca95929a', 'request_id': 'req-3310d439-d3d3-454a-9de6-d9cf74b72da1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:14.371257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] The token cache is being invalidate because project 73a7f4af2e924c479b02d913ca95929a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:43:14.371702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:14.372358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3310d439-d3d3-454a-9de6-d9cf74b72da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:14.374449 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4101/8176] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:43:14 2022] DELETE /identity/v3/projects/73a7f4af2e924c479b02d913ca95929a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:14.381334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb368f5-fd92-4bf2-b704-e6a419aa5d45 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.381619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb368f5-fd92-4bf2-b704-e6a419aa5d45 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.381885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb368f5-fd92-4bf2-b704-e6a419aa5d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.409775 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6fb368f5-fd92-4bf2-b704-e6a419aa5d45 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:14.411633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6fb368f5-fd92-4bf2-b704-e6a419aa5d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:14.435192 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:14.486933 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4076/8177] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:14.494498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00cca6-2388-4c13-a70e-83d59d57ec2a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.494783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00cca6-2388-4c13-a70e-83d59d57ec2a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.495061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00cca6-2388-4c13-a70e-83d59d57ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.524343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dc00cca6-2388-4c13-a70e-83d59d57ec2a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:14.528003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dc00cca6-2388-4c13-a70e-83d59d57ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:14.538277 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4102/8178] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:14.543733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb368f5-fd92-4bf2-b704-e6a419aa5d45 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:14.555067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb368f5-fd92-4bf2-b704-e6a419aa5d45 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:14.561492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:14.562051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.562313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.562583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.563236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:43:14.563552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:14.565171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:14.579552 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4077/8179] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:43:14.583752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00cca6-2388-4c13-a70e-83d59d57ec2a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:14.603640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00cca6-2388-4c13-a70e-83d59d57ec2a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:14.610074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:14.610857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.611273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.611643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.612507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:14.614982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:14.656187 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4103/8180] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:43:14 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:43:14.657605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:14.668847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65eb6a-6e93-4059-9156-2be587a8ea0b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:14.728140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:14.728897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.729224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.729503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.730780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:14.732815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:14.757478 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4078/8181] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:43:14 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:43:14.758675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:14.769369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a75155-4b26-4789-8565-5c6d1cb5bafe admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:14.774556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:14.775167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.775446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.775721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.776365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:14.778973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:14.794733 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4104/8182] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:43:14.796063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:14.806647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b8e8-8646-4c1f-8c78-76f44454df5c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:14.812351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25ca0-9570-4cd4-bb44-64ad6c8f2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:14.812980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25ca0-9570-4cd4-bb44-64ad6c8f2118 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.813257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25ca0-9570-4cd4-bb44-64ad6c8f2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.813531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25ca0-9570-4cd4-bb44-64ad6c8f2118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.814172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb25ca0-9570-4cd4-bb44-64ad6c8f2118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:14.815757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb25ca0-9570-4cd4-bb44-64ad6c8f2118 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:14.827808 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4079/8183] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:43:14.832154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:14.842849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208b3e3-b2cd-4033-95e5-054c573ec642 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:14.847553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:14.849751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.850040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.850400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] PATH_INFO: `/v3/projects/3b0f6e08e05748da86ffb31688293784/users/ccc006e01a2b4acbbcf217eba35abbe0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.865895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0f6e08e05748da86ffb31688293784, user_id=ccc006e01a2b4acbbcf217eba35abbe0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:14.868565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:14.887127 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4105/8184] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:43:14 2022] PUT /identity/v3/projects/3b0f6e08e05748da86ffb31688293784/users/ccc006e01a2b4acbbcf217eba35abbe0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:14.897245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1daaf-5a18-42ad-b27e-5710ee2db45c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:14.897536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1daaf-5a18-42ad-b27e-5710ee2db45c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:14.897817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1daaf-5a18-42ad-b27e-5710ee2db45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:14.929019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d1d1daaf-5a18-42ad-b27e-5710ee2db45c None None] MFA Rules not processed for user `ccc006e01a2b4acbbcf217eba35abbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:14.930334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d1d1daaf-5a18-42ad-b27e-5710ee2db45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:15.001075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4080/8185] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:15.012259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:15.014133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:15.030431 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:15.080578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810e16-c94b-4bc2-a6a1-96d891b6bd8c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:15.084375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726219f-d60d-4a74-8189-a2c4d42a9736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:15.085011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726219f-d60d-4a74-8189-a2c4d42a9736 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:15.085336 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726219f-d60d-4a74-8189-a2c4d42a9736 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:15.085610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726219f-d60d-4a74-8189-a2c4d42a9736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:15.094744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726219f-d60d-4a74-8189-a2c4d42a9736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:15.096218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726219f-d60d-4a74-8189-a2c4d42a9736 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:15.106667 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4106/8186] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:15.269317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:15.269806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:15.270103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:15.292046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] MFA Rules not processed for user `bbeccce8ac1b44cab511548e48a8d860`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:15.293552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:15.306926 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:15.359833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4081/8187] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:16.488275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bee0-a38b-49d1-83fe-9b09fdc1e83c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:16.488833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bee0-a38b-49d1-83fe-9b09fdc1e83c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:16.488833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bee0-a38b-49d1-83fe-9b09fdc1e83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:16.509718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e405bee0-a38b-49d1-83fe-9b09fdc1e83c None None] MFA Rules not processed for user `ccc006e01a2b4acbbcf217eba35abbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:16.511024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e405bee0-a38b-49d1-83fe-9b09fdc1e83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:16.526528 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4107/8188] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:25.352421 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=17 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:26.504129 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=24 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:33.007841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:33.009970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:33.096942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e428cf-82e9-405e-a889-ea95d5ec3fc2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:33.101397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:33.102039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:33.102311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:33.102709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:33.104528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:33.184444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:33.186161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:33.210423 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4082/8189] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:34.453436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e4db-02cb-4e08-86a2-d325d0d3684b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:34.453941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e4db-02cb-4e08-86a2-d325d0d3684b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:34.454048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e4db-02cb-4e08-86a2-d325d0d3684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:34.475864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e254e4db-02cb-4e08-86a2-d325d0d3684b None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:34.477082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e254e4db-02cb-4e08-86a2-d325d0d3684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:34.548660 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4108/8190] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:43:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:34.596057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:34.597554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:34.679323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324beaf-282b-4781-8990-884ca721a987 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:34.684857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:34.685561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:34.685857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:34.686107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:34.694393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:34.695947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:34.704540 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4083/8191] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:43:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:43:35.212800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dd22-fe54-47b0-97a7-aaaa55c445cb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:35.213113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dd22-fe54-47b0-97a7-aaaa55c445cb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:35.213391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3dd22-fe54-47b0-97a7-aaaa55c445cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:35.232389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e5b3dd22-fe54-47b0-97a7-aaaa55c445cb None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:35.233626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e5b3dd22-fe54-47b0-97a7-aaaa55c445cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:35.240937 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4109/8192] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:43:35.253875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:35.270075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352713e-9a83-42d0-9bae-3979684e6449 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:35.275437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:35.276049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:35.276311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:35.276584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:35.285600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:35.287149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:35.291833 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:35.297098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4084/8193] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:43:35.521978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d194d6b-f756-4cd9-bf81-524cee8196c6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:35.522459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d194d6b-f756-4cd9-bf81-524cee8196c6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:35.522555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d194d6b-f756-4cd9-bf81-524cee8196c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:35.548394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7d194d6b-f756-4cd9-bf81-524cee8196c6 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:35.549624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7d194d6b-f756-4cd9-bf81-524cee8196c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:35.556882 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4110/8194] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:35.570661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:35.584493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a404-0a40-458d-879d-20eb35b7516e service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:35.589590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:35.590796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:35.591075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:35.591348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:35.599785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:35.601458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:35.609862 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4085/8195] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:43:35.928577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004538-700e-4aba-ae35-1ff4a93ebd1d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:35.928861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004538-700e-4aba-ae35-1ff4a93ebd1d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:35.929175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004538-700e-4aba-ae35-1ff4a93ebd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:35.948400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5f004538-700e-4aba-ae35-1ff4a93ebd1d None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:35.950220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f004538-700e-4aba-ae35-1ff4a93ebd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:35.957333 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4111/8196] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:35.973632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:35.986694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9541-7372-4c8c-9338-5536109bf0fa service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:35.991938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090c1ca-abd8-4ee4-8e02-3432c85cdd40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:35.992524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090c1ca-abd8-4ee4-8e02-3432c85cdd40 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:35.992802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090c1ca-abd8-4ee4-8e02-3432c85cdd40 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:35.993087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090c1ca-abd8-4ee4-8e02-3432c85cdd40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:36.004035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090c1ca-abd8-4ee4-8e02-3432c85cdd40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:36.005711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090c1ca-abd8-4ee4-8e02-3432c85cdd40 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:36.014789 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4086/8197] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:43:39.166532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004538-700e-4aba-ae35-1ff4a93ebd1d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:39.233545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004538-700e-4aba-ae35-1ff4a93ebd1d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:39.242828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:39.243802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.244316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.244770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] PATH_INFO: `/v3/users/ccc006e01a2b4acbbcf217eba35abbe0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.247270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc006e01a2b4acbbcf217eba35abbe0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:39.248914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:39.297176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc006e01a2b4acbbcf217eba35abbe0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.297890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc006e01a2b4acbbcf217eba35abbe0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.298498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc006e01a2b4acbbcf217eba35abbe0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.310970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc006e01a2b4acbbcf217eba35abbe0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.318139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc006e01a2b4acbbcf217eba35abbe0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.321873 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:39.333355 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4112/8198] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:43:39 2022] DELETE /identity/v3/users/ccc006e01a2b4acbbcf217eba35abbe0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:39.337789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.338241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.338336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.359074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:39.360414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:39.423290 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4087/8199] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:43:39.432799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:39.434759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:39.498066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f8b82-9a7d-4c51-a3dd-ed42ef958215 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:39.502129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6d404-323e-4629-963c-12db11caf3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:39.502829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d404-323e-4629-963c-12db11caf3ef service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.503115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d404-323e-4629-963c-12db11caf3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.503409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d404-323e-4629-963c-12db11caf3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.514401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6d404-323e-4629-963c-12db11caf3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:39.515810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6d404-323e-4629-963c-12db11caf3ef service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:39.530400 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4113/8200] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:39.699399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:39.701157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:39.720423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cad9b0-7e18-4fcf-ae5e-92d56284959d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:39.726032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:39.726793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.727135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.727557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] PATH_INFO: `/v3/projects/3b0f6e08e05748da86ffb31688293784` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.728784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0f6e08e05748da86ffb31688293784)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:39.731501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:39.781033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0f6e08e05748da86ffb31688293784', 'request_id': 'req-6b926589-9802-437d-aae3-dbfaa6c54c53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.787430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0f6e08e05748da86ffb31688293784', 'request_id': 'req-6b926589-9802-437d-aae3-dbfaa6c54c53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.796067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0f6e08e05748da86ffb31688293784', 'request_id': 'req-6b926589-9802-437d-aae3-dbfaa6c54c53'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.807012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] The token cache is being invalidate because project 3b0f6e08e05748da86ffb31688293784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:43:39.807301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.807936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6b926589-9802-437d-aae3-dbfaa6c54c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:43:39.809633 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4088/8201] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:43:39 2022] DELETE /identity/v3/projects/3b0f6e08e05748da86ffb31688293784 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:39.815844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12059d5-6541-4a25-a2bf-5b0d576c7e5d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.816239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12059d5-6541-4a25-a2bf-5b0d576c7e5d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.816605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12059d5-6541-4a25-a2bf-5b0d576c7e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.837293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d12059d5-6541-4a25-a2bf-5b0d576c7e5d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:39.838534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d12059d5-6541-4a25-a2bf-5b0d576c7e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:39.898614 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4114/8202] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:43:39.907356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04445f-bf31-4444-8ae7-31a4ccc86e0c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.907743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04445f-bf31-4444-8ae7-31a4ccc86e0c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.908119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04445f-bf31-4444-8ae7-31a4ccc86e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.928904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1c04445f-bf31-4444-8ae7-31a4ccc86e0c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:39.930126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c04445f-bf31-4444-8ae7-31a4ccc86e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:39.938184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4089/8203] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:39.942482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12059d5-6541-4a25-a2bf-5b0d576c7e5d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:39.952977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12059d5-6541-4a25-a2bf-5b0d576c7e5d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:39.957718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:39.958314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.958591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.958998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.959637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:43:39.959944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:39.961680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:39.973956 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4115/8204] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:43:39.978316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04445f-bf31-4444-8ae7-31a4ccc86e0c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:39.988722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04445f-bf31-4444-8ae7-31a4ccc86e0c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:39.993504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:39.994113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:39.994391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:39.994663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:39.995295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:39.997901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:40.026226 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4090/8205] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:43:39 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:43:40.031561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:40.041595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ea708-c358-4dc0-8cb1-5a501ebbbd2d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:40.102492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:40.103113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:40.103389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:40.103663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:40.104299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:40.106906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:40.135016 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4116/8206] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:43:40 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:43:40.139104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:40.150124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827733a1-4017-41e3-9fa8-d2021c75ff8a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:40.155537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:40.156128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:40.156402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:40.156668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:40.157344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:40.158894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:40.169330 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4091/8207] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:43:40.173426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:40.183638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e490db-3b3e-4441-a3d4-2e36c3aa31ae admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:40.189443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3683-5e4c-469c-a1ce-731a00babb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:40.190041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3683-5e4c-469c-a1ce-731a00babb13 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:40.190316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3683-5e4c-469c-a1ce-731a00babb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:40.190582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3683-5e4c-469c-a1ce-731a00babb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:40.191216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3683-5e4c-469c-a1ce-731a00babb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:40.192828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3683-5e4c-469c-a1ce-731a00babb13 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:40.203956 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4117/8208] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:43:40.208227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:40.219371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136833e-f46b-40a2-9f18-4f7d9cc7b848 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:40.223997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:40.224640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:40.224914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:40.225215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] PATH_INFO: `/v3/projects/a180e4642bc1454295d4228a2600132f/users/26d04f2209314adfb80655d81a8f7639/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:40.240382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a180e4642bc1454295d4228a2600132f, user_id=26d04f2209314adfb80655d81a8f7639, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:40.243035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:40.245430 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:40.257829 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4092/8209] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:43:40 2022] PUT /identity/v3/projects/a180e4642bc1454295d4228a2600132f/users/26d04f2209314adfb80655d81a8f7639/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:40.263054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e3d9-0d17-48c5-a868-9d5f5b0dc69a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:40.263347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e3d9-0d17-48c5-a868-9d5f5b0dc69a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:40.263628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e3d9-0d17-48c5-a868-9d5f5b0dc69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:40.271766 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:40.284591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bbf4e3d9-0d17-48c5-a868-9d5f5b0dc69a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:40.285835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bbf4e3d9-0d17-48c5-a868-9d5f5b0dc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:40.345546 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4118/8210] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:40.355275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:40.357749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:40.416090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759af2e5-a3d8-466c-a4f9-79164299f977 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:40.420248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:40.420843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:40.421166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:40.421440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:40.430547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:40.431937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:40.441164 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4093/8211] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:44.602251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be56f-7ef3-4525-9599-33f976f40bf1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:44.602784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be56f-7ef3-4525-9599-33f976f40bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:44.602784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31be56f-7ef3-4525-9599-33f976f40bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:44.633628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a31be56f-7ef3-4525-9599-33f976f40bf1 None None] MFA Rules not processed for user `26d04f2209314adfb80655d81a8f7639`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:44.634862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a31be56f-7ef3-4525-9599-33f976f40bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:44.711272 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4119/8212] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:44.716041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:44.727090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8317db4-feea-450f-9c6d-662b74e76824 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:44.732326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:44.732937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:44.733279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:44.733553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:44.734194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:44.736097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:44.765477 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4094/8213] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:43:44 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:43:44.769474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be56f-7ef3-4525-9599-33f976f40bf1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:44.781581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31be56f-7ef3-4525-9599-33f976f40bf1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:44.843034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:44.843654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:44.843934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:44.844204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:44.844851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:44.846933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:44.872989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4120/8214] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:43:44 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:43:44.874251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:44.885123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1c05a-82a7-4cfd-9921-876a98c7111d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:44.890169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:44.890787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:44.891106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:44.891377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:44.892019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:44.893637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:44.907241 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4095/8215] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:43:44.911040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:44.922438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978ab28-0ad0-4194-9b4e-2aacc75cdf2a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:44.927402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:44.928071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:44.928356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:44.928631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] PATH_INFO: `/v3/projects/0c8d5c922ebd4a879935aad9a585b462/users/b6e9f439799747c6921883e692ab02fd/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:44.946378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8d5c922ebd4a879935aad9a585b462, user_id=b6e9f439799747c6921883e692ab02fd, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:44.949676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:44.958991 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:44.964224 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4121/8216] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:43:44 2022] PUT /identity/v3/projects/0c8d5c922ebd4a879935aad9a585b462/users/b6e9f439799747c6921883e692ab02fd/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:44.968461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:44.979530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b9397-9d8f-49e5-ab0d-e43a8e192a87 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:45.040439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dc6f6-139b-40b2-a997-0523d89fad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:45.041074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc6f6-139b-40b2-a997-0523d89fad42 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:45.041376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc6f6-139b-40b2-a997-0523d89fad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:45.041660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc6f6-139b-40b2-a997-0523d89fad42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:45.042288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dc6f6-139b-40b2-a997-0523d89fad42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:45.043986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dc6f6-139b-40b2-a997-0523d89fad42 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:45.054213 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4096/8217] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:43:45.058837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:45.071165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc883c3e-cb20-44c8-886c-667a00fc369d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:45.082949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:45.083635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:45.083910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:45.084189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] PATH_INFO: `/v3/projects/0c8d5c922ebd4a879935aad9a585b462/users/b6e9f439799747c6921883e692ab02fd/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:45.086175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8d5c922ebd4a879935aad9a585b462, user_id=b6e9f439799747c6921883e692ab02fd, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:45.088790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:45.106807 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4122/8218] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:43:45 2022] PUT /identity/v3/projects/0c8d5c922ebd4a879935aad9a585b462/users/b6e9f439799747c6921883e692ab02fd/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:43:49.429300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:49.429736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:49.429736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:49.472742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] MFA Rules not processed for user `b6e9f439799747c6921883e692ab02fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:43:49.474391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:49.546909 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:49.580095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4097/8219] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:43:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:43:49.594741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:43:49.596728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:43:49.689610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94821566-8c7b-4f01-9929-11731013a6b5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:43:49.693629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:43:49.694332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:43:49.694687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:43:49.695028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:43:49.780371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:43:49.782594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:43:49.793681 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4123/8220] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:43:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:43:59.576584 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:43:59.788099 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:44:11.718230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:44:11.719669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:44:11.790824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc8b3-f827-4c8b-9e5d-609542c74aaf None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:44:11.797438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:44:11.798040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:44:11.798315 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:44:11.798582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:44:11.806368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:44:11.808774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:44:11.816710 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4098/8221] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:44:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:44:21.780250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:44:21.813553 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=32 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:44:21.839557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ad569-48c9-46e6-9e41-9f317702a5e2 service glance] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:44:21.843238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:44:21.843845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:44:21.844138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:44:21.844582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:44:21.846530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:44:21.928245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:44:21.929759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:44:21.943885 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4124/8222] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:44:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:44:23.311214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:44:23.323873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf584c-f5f6-4b16-a2cc-9a8d677179a9 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:44:23.327543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:44:23.328149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:44:23.328426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:44:23.328697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:44:23.330548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:44:23.343784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:44:23.345245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:44:23.356480 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4099/8223] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:44:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:44:23.481744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:44:23.481744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:44:23.567402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25797a4-c050-4754-aa66-7b949e342999 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:44:23.572599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:44:23.573974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:44:23.574202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:44:23.574469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:44:23.576476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:44:23.592128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:44:23.593751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:44:23.607221 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4125/8224] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:44:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:44:23.798903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:44:23.810540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e7733-70e7-4e5c-a02f-487278769de8 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:44:23.814316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7e07f-2607-420a-8f54-0199558fece3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:44:23.815000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7e07f-2607-420a-8f54-0199558fece3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:44:23.815351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7e07f-2607-420a-8f54-0199558fece3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:44:23.815710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7e07f-2607-420a-8f54-0199558fece3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:44:23.817586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a0b7e07f-2607-420a-8f54-0199558fece3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:44:23.833307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7e07f-2607-420a-8f54-0199558fece3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:44:23.834672 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7e07f-2607-420a-8f54-0199558fece3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:44:23.848337 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4100/8225] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:44:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:44:24.968413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:44:24.983343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371b5fa-eb2a-4900-92b1-edf86d8a2f02 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:44:24.988546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:44:24.989260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:44:24.989538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:44:24.989807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:44:24.992172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:44:25.006757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:44:25.009644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:44:25.022225 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4126/8226] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:44:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:44:33.842053 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=12 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:44:35.015350 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:11.641991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:11.642591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:11.642591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:11.663239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] MFA Rules not processed for user `bbeccce8ac1b44cab511548e48a8d860`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:45:11.664504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:11.722713 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4101/8227] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:45:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:45:16.960822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:16.962766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:16.989712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297f8fd-eda4-4f8b-86bd-5ca8dfa7f59d service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:16.997229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e3269-a84f-478c-8096-0599f84c09d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:16.997856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e3269-a84f-478c-8096-0599f84c09d7 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:16.998166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e3269-a84f-478c-8096-0599f84c09d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:16.998438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e3269-a84f-478c-8096-0599f84c09d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:17.000666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f16e3269-a84f-478c-8096-0599f84c09d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:17.018121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e3269-a84f-478c-8096-0599f84c09d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:17.020305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e3269-a84f-478c-8096-0599f84c09d7 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:17.034955 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4127/8228] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:45:21.715902 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=25 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:26.863328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:26.864834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:26.887817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4798-11d8-4f4e-b783-53c59f314c5d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:26.891747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:26.892372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:26.892650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:26.892922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:26.894688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:26.908130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:26.909752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:26.921118 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4102/8229] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:45:27.026919 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:36.914451 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:40.647326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335a4b9-30be-400e-aa76-8bd584fc2641 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:40.647841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335a4b9-30be-400e-aa76-8bd584fc2641 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:40.647943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335a4b9-30be-400e-aa76-8bd584fc2641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:40.668248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d335a4b9-30be-400e-aa76-8bd584fc2641 None None] MFA Rules not processed for user `26d04f2209314adfb80655d81a8f7639`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:45:40.669549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d335a4b9-30be-400e-aa76-8bd584fc2641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:40.676409 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4128/8230] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:45:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:45:41.453248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:41.454689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:41.476908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676616-6053-4b5e-987f-31997920913a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:41.483713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:41.484406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:41.484802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:41.485131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:41.487040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:41.513292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:41.513292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:41.519365 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4103/8231] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:45:45.503724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335a4b9-30be-400e-aa76-8bd584fc2641 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:45.520579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335a4b9-30be-400e-aa76-8bd584fc2641 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:45.526443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0257e91-3244-49c0-b383-286a6cfa3f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:45.527320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257e91-3244-49c0-b383-286a6cfa3f8a service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:45.527875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257e91-3244-49c0-b383-286a6cfa3f8a service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:45.528306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0257e91-3244-49c0-b383-286a6cfa3f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:45.531026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f0257e91-3244-49c0-b383-286a6cfa3f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:45.552170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0257e91-3244-49c0-b383-286a6cfa3f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:45.553861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0257e91-3244-49c0-b383-286a6cfa3f8a service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:45.569400 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4129/8232] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:45:49.561988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:49.577033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c60890-5e18-4b27-9a10-16a7000235fb service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:49.588392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:49.588835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:49.589280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:49.589567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:49.591372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:49.605976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:49.607632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:49.625910 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4104/8233] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:45:55.561779 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:55.891486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657a882-67dd-4aca-b4f7-bec285f88ac5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:55.891774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657a882-67dd-4aca-b4f7-bec285f88ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:55.892047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657a882-67dd-4aca-b4f7-bec285f88ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:55.913634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e657a882-67dd-4aca-b4f7-bec285f88ac5 None None] MFA Rules not processed for user `5b62f2cd5736454c8f95c80ab8ecc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:45:55.915064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e657a882-67dd-4aca-b4f7-bec285f88ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:55.983447 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4130/8234] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:45:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:45:59.614384 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=12 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:45:59.869872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:45:59.888762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e166a-61f9-494d-9295-16c6fc3ed2a0 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:45:59.894991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:45:59.896111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:45:59.896616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:45:59.908747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:45:59.911458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:45:59.930742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:45:59.933103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:45:59.949442 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4105/8235] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:45:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:02.041198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657a882-67dd-4aca-b4f7-bec285f88ac5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:02.053328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657a882-67dd-4aca-b4f7-bec285f88ac5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:02.057474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:02.058077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:02.058381 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:02.058675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:02.067697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:02.069185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:02.079398 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4131/8236] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:09.941055 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:12.075127 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=31 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:27.057075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:27.075539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4661-10c2-4686-b9ab-084d607e04ac service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:27.080706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:27.081507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:27.081781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:27.082050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:27.083823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:27.104569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:27.106749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:27.124126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4106/8237] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:32.981015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:32.998077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db339522-1bc0-4399-bcd4-656b46416647 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:33.003034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:33.003661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:33.003937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:33.004209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:33.005941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:33.023885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:33.025361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:33.041394 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4132/8238] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:37.116575 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:41.210886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:41.224598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a6730-33b6-4f6e-9d9f-6f1d5e412eb2 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:41.227682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:41.228368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:41.228724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:41.229231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:41.231041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:41.318559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:41.320097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:41.331227 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4107/8239] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:43.034286 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:43.467945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:43.469415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:43.486699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7de87-92e2-45da-8c04-fc61ac313cbc service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:43.491597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:43.492403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:43.492681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:43.492955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] PATH_INFO: `/v3/users/bbeccce8ac1b44cab511548e48a8d860` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:43.494444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbeccce8ac1b44cab511548e48a8d860)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:43.498297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:43.569589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbeccce8ac1b44cab511548e48a8d860'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.572321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbeccce8ac1b44cab511548e48a8d860'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.572939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbeccce8ac1b44cab511548e48a8d860'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.588302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbeccce8ac1b44cab511548e48a8d860'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.596339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a0d0bac8-9c64-4874-b95f-37d9c670de78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbeccce8ac1b44cab511548e48a8d860'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.611590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4133/8240] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:43 2022] DELETE /identity/v3/users/bbeccce8ac1b44cab511548e48a8d860 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:43.809927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:43.824270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11257104-6270-4cff-9c19-ddfa0984142c service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:43.891743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:43.892427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:43.892705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:43.893006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] PATH_INFO: `/v3/projects/a1bc0be88ad346a4992dc6672bd8e119` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:43.894217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bc0be88ad346a4992dc6672bd8e119)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:43.896193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:43.947493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bc0be88ad346a4992dc6672bd8e119', 'request_id': 'req-ad369234-fb25-442e-acaf-6a32bf75a0fb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.954169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bc0be88ad346a4992dc6672bd8e119', 'request_id': 'req-ad369234-fb25-442e-acaf-6a32bf75a0fb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.962692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bc0be88ad346a4992dc6672bd8e119', 'request_id': 'req-ad369234-fb25-442e-acaf-6a32bf75a0fb'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.977182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] The token cache is being invalidate because project a1bc0be88ad346a4992dc6672bd8e119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:43.977485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.978119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ad369234-fb25-442e-acaf-6a32bf75a0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:43.984073 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4108/8241] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:43 2022] DELETE /identity/v3/projects/a1bc0be88ad346a4992dc6672bd8e119 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:43.985523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0bf9-ccc8-410c-af74-7abd3571246e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:43.985818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0bf9-ccc8-410c-af74-7abd3571246e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:43.986104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0bf9-ccc8-410c-af74-7abd3571246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.006434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6d3c0bf9-ccc8-410c-af74-7abd3571246e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:44.007647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6d3c0bf9-ccc8-410c-af74-7abd3571246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:44.070473 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4134/8242] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:46:44.078904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d47f34-748e-4211-b238-2dd583bff572 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.079198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d47f34-748e-4211-b238-2dd583bff572 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.079501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d47f34-748e-4211-b238-2dd583bff572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.100682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a3d47f34-748e-4211-b238-2dd583bff572 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:44.101907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a3d47f34-748e-4211-b238-2dd583bff572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:44.110368 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4109/8243] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:44.114648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0bf9-ccc8-410c-af74-7abd3571246e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.125454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0bf9-ccc8-410c-af74-7abd3571246e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:44.130133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:44.130738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.131017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.131287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.131923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:46:44.132223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:44.133840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:44.150025 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4135/8244] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:46:44.151124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d47f34-748e-4211-b238-2dd583bff572 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.161489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d47f34-748e-4211-b238-2dd583bff572 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:44.166144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:44.166738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.167019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.167284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.167905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:44.169885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:44.186976 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:44.205768 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4110/8245] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:44 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:44.206938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.217039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c539fe-aec3-4c4d-bf4f-d2b8eeb1fb1c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:44.286034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:44.286799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.287184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.287561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.288303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:44.290343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:44.299601 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:44.320448 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4136/8246] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:44 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:44.324218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.335220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fd9e9-38d0-44cb-9349-26b0535f7f48 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:44.339930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:44.340599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.340927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.341334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.342019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:44.344312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:44.357874 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4111/8247] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:46:44.361900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.373143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af34a8e-eab6-4928-bec5-02b4cb52e26f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:44.377966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367132bc-603b-4228-bcf1-49c05b1538f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:44.378588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367132bc-603b-4228-bcf1-49c05b1538f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.378869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367132bc-603b-4228-bcf1-49c05b1538f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.379142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367132bc-603b-4228-bcf1-49c05b1538f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.379783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367132bc-603b-4228-bcf1-49c05b1538f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:44.381424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367132bc-603b-4228-bcf1-49c05b1538f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:44.393985 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4137/8248] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:44.398039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.414669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1b780-715a-49dc-91ea-4b5f07e96c0e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:44.420674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:44.421529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.421928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.422300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] PATH_INFO: `/v3/projects/ab70f702fb0e468c8cc66abdac504948/users/8f163dbbd231466c8ddc3011b39832d6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.440290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab70f702fb0e468c8cc66abdac504948, user_id=8f163dbbd231466c8ddc3011b39832d6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:44.443169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:44.461170 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4112/8249] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:44 2022] PUT /identity/v3/projects/ab70f702fb0e468c8cc66abdac504948/users/8f163dbbd231466c8ddc3011b39832d6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:46:44.554164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5062a3e-906b-479b-b5fa-684c043a16f5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.554607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5062a3e-906b-479b-b5fa-684c043a16f5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.554974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5062a3e-906b-479b-b5fa-684c043a16f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.585026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d5062a3e-906b-479b-b5fa-684c043a16f5 None None] MFA Rules not processed for user `8f163dbbd231466c8ddc3011b39832d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:44.586455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d5062a3e-906b-479b-b5fa-684c043a16f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:44.656386 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4138/8250] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:44.671187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.738888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218c014-2f72-48ec-a028-e33ae8905067 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:44.743960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:44.744612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.744887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.745193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] PATH_INFO: `/v3/users/8f163dbbd231466c8ddc3011b39832d6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.746364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f163dbbd231466c8ddc3011b39832d6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:44.748382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:44.799705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f163dbbd231466c8ddc3011b39832d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:44.800227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f163dbbd231466c8ddc3011b39832d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:44.800825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f163dbbd231466c8ddc3011b39832d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:44.808914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f163dbbd231466c8ddc3011b39832d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:44.822303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f163dbbd231466c8ddc3011b39832d6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:44.835719 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4113/8251] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:44 2022] DELETE /identity/v3/users/8f163dbbd231466c8ddc3011b39832d6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:44.840147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec242-849a-431b-a376-4170e4044df2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:44.840950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec242-849a-431b-a376-4170e4044df2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:44.841252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec242-849a-431b-a376-4170e4044df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:44.861539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-869ec242-849a-431b-a376-4170e4044df2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:44.862751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-869ec242-849a-431b-a376-4170e4044df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:44.923678 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4139/8252] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:44.933831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:44.936239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:44.981764 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:45.000676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbf921-27c2-4993-9cb8-1bf027c53500 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.004735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b72f4-4229-48b9-b2e3-0a1e76281d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.005377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b72f4-4229-48b9-b2e3-0a1e76281d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.005675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b72f4-4229-48b9-b2e3-0a1e76281d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.005940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b72f4-4229-48b9-b2e3-0a1e76281d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.017505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b72f4-4229-48b9-b2e3-0a1e76281d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.018927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b72f4-4229-48b9-b2e3-0a1e76281d6f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.029207 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4114/8253] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:46:45.303532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec242-849a-431b-a376-4170e4044df2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:45.305436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-869ec242-849a-431b-a376-4170e4044df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:45.318377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec242-849a-431b-a376-4170e4044df2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.323797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.324446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.325328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.325766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] PATH_INFO: `/v3/projects/ab70f702fb0e468c8cc66abdac504948` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.327248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab70f702fb0e468c8cc66abdac504948)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.329046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.381607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab70f702fb0e468c8cc66abdac504948', 'request_id': 'req-c186ba46-669d-4737-8f3f-4f80b1d1a167'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:45.387124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab70f702fb0e468c8cc66abdac504948', 'request_id': 'req-c186ba46-669d-4737-8f3f-4f80b1d1a167'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:45.394068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab70f702fb0e468c8cc66abdac504948', 'request_id': 'req-c186ba46-669d-4737-8f3f-4f80b1d1a167'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:45.395719 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=91,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:45.408983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] The token cache is being invalidate because project ab70f702fb0e468c8cc66abdac504948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:45.409546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:45.410352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c186ba46-669d-4737-8f3f-4f80b1d1a167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:45.411985 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4140/8254] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:45 2022] DELETE /identity/v3/projects/ab70f702fb0e468c8cc66abdac504948 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:45.419048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d5e3-5fe9-4e77-8965-ec1a0f3a58ac None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.419425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d5e3-5fe9-4e77-8965-ec1a0f3a58ac None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.419706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d5e3-5fe9-4e77-8965-ec1a0f3a58ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.440307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1074d5e3-5fe9-4e77-8965-ec1a0f3a58ac None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:45.441561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1074d5e3-5fe9-4e77-8965-ec1a0f3a58ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:45.503149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4115/8255] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:45.510739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f829bad-9f94-4685-8922-294d06eacc12 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.511027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f829bad-9f94-4685-8922-294d06eacc12 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.511302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f829bad-9f94-4685-8922-294d06eacc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.532827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1f829bad-9f94-4685-8922-294d06eacc12 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:45.534075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f829bad-9f94-4685-8922-294d06eacc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:45.542052 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4141/8256] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:45.546359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d5e3-5fe9-4e77-8965-ec1a0f3a58ac None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:45.556355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d5e3-5fe9-4e77-8965-ec1a0f3a58ac None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.561778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.562392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.562671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.562962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.563607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:46:45.563904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.565527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.579044 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4116/8257] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:45.583859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f829bad-9f94-4685-8922-294d06eacc12 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:45.593700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f829bad-9f94-4685-8922-294d06eacc12 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.598518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.599146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.599424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.599698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.600492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.602458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.632887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4142/8258] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:45 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:45.637335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:45.647957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a783ed2-6126-4310-b07c-8df2bea44dd3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.711170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.711797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.712203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.712484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.713158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.716144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.742765 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4117/8259] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:45 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:45.746904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:45.758585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0f4fe-7590-4737-9009-2ffc5869e830 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.765133 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.765833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.766116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.766389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.767081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.768753 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.781184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4143/8260] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:46:45.785139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:45.797010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788dc2-5ca8-447f-9f94-672e8aa2d163 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.802506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e3609-2808-4418-8aa7-f386c8c42d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.803116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e3609-2808-4418-8aa7-f386c8c42d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.803521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e3609-2808-4418-8aa7-f386c8c42d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.803805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e3609-2808-4418-8aa7-f386c8c42d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.804494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e3609-2808-4418-8aa7-f386c8c42d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.806124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e3609-2808-4418-8aa7-f386c8c42d56 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.821419 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4118/8261] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:46:45.822597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:45.832866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820db0-3947-42fb-9802-67ff7543cb3a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:45.837628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:45.838282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.838563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.838840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] PATH_INFO: `/v3/projects/62c0ba7928fe4e3ea99ea38479b1e975/users/06d248d10d8a45239581aa7e37effdab/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.854590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c0ba7928fe4e3ea99ea38479b1e975, user_id=06d248d10d8a45239581aa7e37effdab, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:45.857763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:45.870697 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4144/8262] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:45 2022] PUT /identity/v3/projects/62c0ba7928fe4e3ea99ea38479b1e975/users/06d248d10d8a45239581aa7e37effdab/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:45.881391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843098b-5547-4533-a615-195f244b86c1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:45.881895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843098b-5547-4533-a615-195f244b86c1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:45.882024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843098b-5547-4533-a615-195f244b86c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:45.911926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c843098b-5547-4533-a615-195f244b86c1 None None] MFA Rules not processed for user `06d248d10d8a45239581aa7e37effdab`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:45.913042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c843098b-5547-4533-a615-195f244b86c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:45.951762 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:45.994134 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4119/8263] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:46:45.995817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.067315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b54b7-eb59-45db-b531-ab2777058e09 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.072076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.072682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.072963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.073277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.073916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.076517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.108224 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4145/8264] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:45 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:46.110746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843098b-5547-4533-a615-195f244b86c1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.122766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843098b-5547-4533-a615-195f244b86c1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.182845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.183376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.183651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.183918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.185236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.187137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.210415 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4120/8265] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:46 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:46.214559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.225855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f585-2cae-46ac-8113-142144232159 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.230504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.231668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.231955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.232227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.232865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.234497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.247353 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4146/8266] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:46.251551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.261907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01f13a-83bc-4c9c-8724-41e51fa8e51b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.267536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.268177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.268460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.268729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] PATH_INFO: `/v3/projects/afd1661cfada493eb0479f103d565046/users/07fe5d7f4fb047e4b5aa4dcc33e194d1/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.285457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd1661cfada493eb0479f103d565046, user_id=07fe5d7f4fb047e4b5aa4dcc33e194d1, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.288089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.302042 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4121/8267] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:46 2022] PUT /identity/v3/projects/afd1661cfada493eb0479f103d565046/users/07fe5d7f4fb047e4b5aa4dcc33e194d1/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:46.306312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.318034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6e860-d685-4f17-9290-21e64a829441 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.389121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47b4f-5c1f-489b-adee-8419366f9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.389760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47b4f-5c1f-489b-adee-8419366f9b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.390073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47b4f-5c1f-489b-adee-8419366f9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.390345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47b4f-5c1f-489b-adee-8419366f9b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.391080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47b4f-5c1f-489b-adee-8419366f9b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.392681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47b4f-5c1f-489b-adee-8419366f9b15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.395678 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:46.404886 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4147/8268] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:46.409577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.420442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1d1b7-5d58-418e-8abe-ea45746b955a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.426219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.426908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.427333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.427619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] PATH_INFO: `/v3/projects/afd1661cfada493eb0479f103d565046/users/07fe5d7f4fb047e4b5aa4dcc33e194d1/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.429639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd1661cfada493eb0479f103d565046, user_id=07fe5d7f4fb047e4b5aa4dcc33e194d1, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.432835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.445001 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4122/8269] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:46 2022] PUT /identity/v3/projects/afd1661cfada493eb0479f103d565046/users/07fe5d7f4fb047e4b5aa4dcc33e194d1/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:46.457678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510656a5-bacf-4482-8214-393bad18f620 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.457969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510656a5-bacf-4482-8214-393bad18f620 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.458246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510656a5-bacf-4482-8214-393bad18f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.487893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-510656a5-bacf-4482-8214-393bad18f620 None None] MFA Rules not processed for user `07fe5d7f4fb047e4b5aa4dcc33e194d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:46.489222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-510656a5-bacf-4482-8214-393bad18f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:46.563755 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4148/8270] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:46.568298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.579195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90a87a-b708-4e04-a50a-cd69f473cb1d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.583935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.584530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.584816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.585118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.585782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.587398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.608193 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4123/8271] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:46 2022] POST /identity/v3/services => generated 289 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:46.609519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510656a5-bacf-4482-8214-393bad18f620 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.618888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510656a5-bacf-4482-8214-393bad18f620 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.635170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.635776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.636053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.636321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.636969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.638193 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:46.638193 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:46:46.638193 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:46:46.639058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.651279 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4149/8272] 10.222.0.16 () {60 vars in 1213 bytes} [Sun Sep 11 01:46:46 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:46.656581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.667585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fd1d9-fded-480c-9467-12f4dc0316d9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.673846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.674499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.674774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.675081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.675731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.677356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.693100 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4124/8273] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:46 2022] POST /identity/v3/services => generated 289 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:46.697075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.707382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da7cda-6c89-4e71-84a3-5a24c7b3617d tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.722491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.723086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.723369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.723643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.724279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.725896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.735092 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4150/8274] 10.222.0.16 () {60 vars in 1213 bytes} [Sun Sep 11 01:46:46 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:46.739276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.750415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d739f-5284-4822-b838-26731f4bf49e tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.755071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.755669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.755948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.756218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.756823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.757861 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:46.757861 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:46:46.757861 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:46:46.758728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.765575 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4125/8275] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 11 01:46:46 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:46.769728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.781683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edffb8-9b49-46d1-87fd-39d52763cd00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.786404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.787033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.787308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.787581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.788155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=069443c251994b5fbf2fbc0123104b73)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.789174 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:46.789174 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:46:46.789174 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:46:46.790075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.800311 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4151/8276] 10.222.0.16 () {58 vars in 1290 bytes} [Sun Sep 11 01:46:46 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73 => generated 333 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:46.801470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.812820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a189a8-d4b6-404e-8b23-433ee5b15dd6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.817585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.818286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.818629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.818905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.819488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=069443c251994b5fbf2fbc0123104b73)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.820499 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:46.820499 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:46:46.820499 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:46:46.821393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.827282 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4126/8277] 10.222.0.16 () {58 vars in 1291 bytes} [Sun Sep 11 01:46:46 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 11 01:46:46.831691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.842110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b28ff-8f8f-4ff8-be9b-4cee339a5163 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.846900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.847533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.847811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.848092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.848664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=069443c251994b5fbf2fbc0123104b73)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.849704 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:46.849704 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(msg) Sep 11 01:46:46.849704 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:46:46.850610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.861638 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4152/8278] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 11 01:46:46 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:46.865847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.876487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed279e-cd62-4efb-9a10-017da8bca419 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.881454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.882018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.882353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.882584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.883292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.884870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.893226 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4127/8279] 10.222.0.16 () {58 vars in 1191 bytes} [Sun Sep 11 01:46:46 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:46.894400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.905987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972596b-c880-44cf-b640-3382e7721d00 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.910774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.911406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.911688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.911964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.912541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=069443c251994b5fbf2fbc0123104b73)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.914185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Could not find Endpoint Group: 069443c251994b5fbf2fbc0123104b73.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 069443c251994b5fbf2fbc0123104b73. Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Sep 11 01:46:46.934514 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Sep 11 01:46:46.936227 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Sep 11 01:46:46.936227 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Sep 11 01:46:46.936227 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Sep 11 01:46:46.936227 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Sep 11 01:46:46.936227 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 069443c251994b5fbf2fbc0123104b73. Sep 11 01:46:46.936227 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:46.936227 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4153/8280] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 11 01:46:46 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/069443c251994b5fbf2fbc0123104b73 => generated 120 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 11 01:46:46.940565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:46.952586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14629f-42ba-449b-9a43-9467c50ad728 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:46.957602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:46.958327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:46.958609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:46.958881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services/4e2f00cbe0504ce7b44b8d23da3b085d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:46.959468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4e2f00cbe0504ce7b44b8d23da3b085d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:46.961050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:46.984758 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4128/8281] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:46 2022] DELETE /identity/v3/services/4e2f00cbe0504ce7b44b8d23da3b085d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:46.990039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.001625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6088-86f9-4efe-ae78-fea7becf8afb tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.020393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.021111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.021467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.021818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.022536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.024206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.049021 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4154/8282] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:46 2022] POST /identity/v3/services => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:47.050244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.061801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a587fc9-6f21-4724-b7af-46247c3578a3 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.074145 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:47.077583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.078208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.078812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.079153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.079808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.081207 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:47.081207 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:46:47.081207 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:46:47.082335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.093430 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4129/8283] 10.222.0.16 () {60 vars in 1213 bytes} [Sun Sep 11 01:46:47 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:47.097609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.108861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594e6c-bf0b-4342-937d-b46b8ce96c3a tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.113555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.114144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.114431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.114691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.115330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.116897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.131546 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4155/8284] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:47 2022] POST /identity/v3/services => generated 289 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:47.135881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.146047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba65a7-c6ec-492e-8922-e34648a0dd2f tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.161801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.162429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.162712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.162991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/30c6807ed7824366b4866eeda911c3ce` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.163649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=30c6807ed7824366b4866eeda911c3ce)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.164650 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:47.164650 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:46:47.164650 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:46:47.165737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.177423 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4130/8285] 10.222.0.16 () {60 vars in 1313 bytes} [Sun Sep 11 01:46:47 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/30c6807ed7824366b4866eeda911c3ce => generated 335 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:47.181805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.192566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221b3eb-888a-4329-96f4-2953d9bedba6 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.197228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.197876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.198157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.198433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services/113c63c6ddc74468a757cbb07fa4bcda` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.199009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_service(service_id=113c63c6ddc74468a757cbb07fa4bcda)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.200771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.222072 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4156/8286] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:47 2022] DELETE /identity/v3/services/113c63c6ddc74468a757cbb07fa4bcda => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:46:47.226265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.236946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e00a1-8cc8-46be-8ef4-8d67cff7c451 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.251736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.252363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.252646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.252921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/30c6807ed7824366b4866eeda911c3ce` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.253526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=30c6807ed7824366b4866eeda911c3ce)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.254525 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:47.254525 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:46:47.254525 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:46:47.255406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.265641 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4131/8287] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 11 01:46:47 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/30c6807ed7824366b4866eeda911c3ce => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:47.269729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.280994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70343-39d0-40c5-9d8b-88de6e1e32ba tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.285619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.286225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.286501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.286768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services/eb6d2b8a502f4dd3b05bbe5918b63313` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.287339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_service(service_id=eb6d2b8a502f4dd3b05bbe5918b63313)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.288906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.298002 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:47.310662 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4157/8288] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:47 2022] DELETE /identity/v3/services/eb6d2b8a502f4dd3b05bbe5918b63313 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:47.315356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.326087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a15f2-2912-4506-a4a0-d0502b662b8b tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.340949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.341767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.342051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.342327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e706b64adcc94539937c806b55756451` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.342902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e706b64adcc94539937c806b55756451)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.344487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.353850 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4132/8289] 10.222.0.16 () {58 vars in 1293 bytes} [Sun Sep 11 01:46:47 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e706b64adcc94539937c806b55756451 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:47.357865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.368150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb571f-f698-499c-9ddb-cf27deeada84 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.372805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c486f7-6dc4-4540-81c0-3d8de4ebf7c1 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe5d7f4fb047e4b5aa4dcc33e194d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd1661cfada493eb0479f103d565046', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.373443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c486f7-6dc4-4540-81c0-3d8de4ebf7c1 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.373722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c486f7-6dc4-4540-81c0-3d8de4ebf7c1 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.373993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c486f7-6dc4-4540-81c0-3d8de4ebf7c1 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] PATH_INFO: `/v3/services/b4973b21a6a14f75978337f71e2686d6` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.374589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c486f7-6dc4-4540-81c0-3d8de4ebf7c1 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b4973b21a6a14f75978337f71e2686d6)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.376151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c486f7-6dc4-4540-81c0-3d8de4ebf7c1 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.396760 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4158/8290] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:47 2022] DELETE /identity/v3/services/b4973b21a6a14f75978337f71e2686d6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:47.400695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.472583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f5328-becc-479e-985a-7ebf8eff3ba9 tempest-EndPointGroupsTest-737373931 tempest-EndPointGroupsTest-737373931-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.487173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.487795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.488075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.488349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] PATH_INFO: `/v3/users/06d248d10d8a45239581aa7e37effdab` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.489629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d248d10d8a45239581aa7e37effdab)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.491575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.539140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d248d10d8a45239581aa7e37effdab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:47.539818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d248d10d8a45239581aa7e37effdab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:47.540453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d248d10d8a45239581aa7e37effdab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:47.548050 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d248d10d8a45239581aa7e37effdab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:47.561430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d248d10d8a45239581aa7e37effdab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:47.564071 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=13 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:47.576095 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4133/8291] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:47 2022] DELETE /identity/v3/users/06d248d10d8a45239581aa7e37effdab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:47.580579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.580893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.581200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.599838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:47.601047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:47.659973 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4159/8292] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:47.671164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:47.672601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:47.741891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fc652-7a30-4b54-a147-3c3b3505f9a5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:47.745532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:47.746132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:47.746410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:47.747161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:47.756101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:47.757546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:47.767030 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4134/8293] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:48.051095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:48.052562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:48.065446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c8283-2a72-4fea-b153-83ad5e5cb48a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:48.070473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:48.071108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:48.071481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:48.071699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] PATH_INFO: `/v3/projects/62c0ba7928fe4e3ea99ea38479b1e975` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:48.072812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c0ba7928fe4e3ea99ea38479b1e975)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:48.075298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:48.128639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c0ba7928fe4e3ea99ea38479b1e975', 'request_id': 'req-6715061d-9af3-48cd-8fc4-18b5221b979e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.137080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c0ba7928fe4e3ea99ea38479b1e975', 'request_id': 'req-6715061d-9af3-48cd-8fc4-18b5221b979e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.144631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c0ba7928fe4e3ea99ea38479b1e975', 'request_id': 'req-6715061d-9af3-48cd-8fc4-18b5221b979e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.162907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] The token cache is being invalidate because project 62c0ba7928fe4e3ea99ea38479b1e975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:48.163207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.163887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.165455 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4160/8294] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:48 2022] DELETE /identity/v3/projects/62c0ba7928fe4e3ea99ea38479b1e975 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:48.170345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:48.183869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7e38-a1f9-4d9b-ae9c-e3dd6d481cc3 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:48.250858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:48.251739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:48.252077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:48.252412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] PATH_INFO: `/v3/users/07fe5d7f4fb047e4b5aa4dcc33e194d1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:48.253821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fe5d7f4fb047e4b5aa4dcc33e194d1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:48.255976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:48.335753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fe5d7f4fb047e4b5aa4dcc33e194d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.337087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fe5d7f4fb047e4b5aa4dcc33e194d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.337918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fe5d7f4fb047e4b5aa4dcc33e194d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.348489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fe5d7f4fb047e4b5aa4dcc33e194d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.365676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-44694712-6646-4ac0-94b7-d07c030f7cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fe5d7f4fb047e4b5aa4dcc33e194d1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.400963 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4135/8295] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:48 2022] DELETE /identity/v3/users/07fe5d7f4fb047e4b5aa4dcc33e194d1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:46:48.731749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:48.733256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:48.748225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715061d-9af3-48cd-8fc4-18b5221b979e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:48.809100 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:48.820661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:48.822785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:48.823218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:48.823518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] PATH_INFO: `/v3/projects/afd1661cfada493eb0479f103d565046` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:48.824505 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd1661cfada493eb0479f103d565046)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:48.827065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:48.889091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd1661cfada493eb0479f103d565046', 'request_id': 'req-1e42d014-22bb-4215-ae58-7566f1d9143d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.897008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd1661cfada493eb0479f103d565046', 'request_id': 'req-1e42d014-22bb-4215-ae58-7566f1d9143d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.905628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd1661cfada493eb0479f103d565046', 'request_id': 'req-1e42d014-22bb-4215-ae58-7566f1d9143d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.919369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] The token cache is being invalidate because project afd1661cfada493eb0479f103d565046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:48.919969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.920837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1e42d014-22bb-4215-ae58-7566f1d9143d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:48.922801 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4161/8296] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:48 2022] DELETE /identity/v3/projects/afd1661cfada493eb0479f103d565046 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:48.927653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2eedc-8887-4548-8bea-3b0404488245 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:48.928034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2eedc-8887-4548-8bea-3b0404488245 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:48.928449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2eedc-8887-4548-8bea-3b0404488245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:48.945270 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:48.953561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5eb2eedc-8887-4548-8bea-3b0404488245 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:48.956031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5eb2eedc-8887-4548-8bea-3b0404488245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:49.042309 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4136/8297] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:49.043355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a800e1-8db1-454e-9c1a-b477c89c62ba None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.044428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a800e1-8db1-454e-9c1a-b477c89c62ba None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.044978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a800e1-8db1-454e-9c1a-b477c89c62ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.072003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-72a800e1-8db1-454e-9c1a-b477c89c62ba None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:49.073807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-72a800e1-8db1-454e-9c1a-b477c89c62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:49.084623 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4162/8298] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:46:49.089034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2eedc-8887-4548-8bea-3b0404488245 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:49.103874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2eedc-8887-4548-8bea-3b0404488245 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:49.109653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:49.110660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.111040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.111413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.112255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:46:49.112675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:49.114482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:49.129708 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4137/8299] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:46:49.134118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a800e1-8db1-454e-9c1a-b477c89c62ba None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:49.144557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a800e1-8db1-454e-9c1a-b477c89c62ba None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:49.149588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:49.150217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.150489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.150755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.151408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:49.154190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:49.187073 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4163/8300] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:49 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:49.191361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:49.203671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310acf7-915c-47fe-ab4a-16b9439f452b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:49.295947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:49.296687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.297278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.297706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.298456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:49.302976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:49.335897 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4138/8301] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:49 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:49.339854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:49.359169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05556cb-02c2-4abc-8cef-f0f6dfb73adb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:49.372608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:49.373401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.373681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.373950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.374779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:49.376520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:49.391524 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4164/8302] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:49.395259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:49.412257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188597d-e0bc-4152-bfb3-2d4898583866 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:49.423149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade1e0c-35bd-4ff1-a4e2-1368f2cbc9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:49.424044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade1e0c-35bd-4ff1-a4e2-1368f2cbc9de admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.424420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade1e0c-35bd-4ff1-a4e2-1368f2cbc9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.424782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade1e0c-35bd-4ff1-a4e2-1368f2cbc9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.425683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade1e0c-35bd-4ff1-a4e2-1368f2cbc9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:49.427506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade1e0c-35bd-4ff1-a4e2-1368f2cbc9de admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:49.442081 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4139/8303] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:49.445938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:49.459667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357debe1-6c1e-45f5-8008-48d97825085e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:49.468448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:49.469640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.469640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.470191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] PATH_INFO: `/v3/projects/60244f40be5e4761aa2593a3816a478c/users/58f48f5921c2488a83674f7da87013da/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.489728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60244f40be5e4761aa2593a3816a478c, user_id=58f48f5921c2488a83674f7da87013da, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:49.495027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:49.532735 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4165/8304] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:49 2022] PUT /identity/v3/projects/60244f40be5e4761aa2593a3816a478c/users/58f48f5921c2488a83674f7da87013da/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:49.543235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f3bad-3c14-4db5-acd0-311e68c8cb6c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.544935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f3bad-3c14-4db5-acd0-311e68c8cb6c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.545408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f3bad-3c14-4db5-acd0-311e68c8cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.603852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-318f3bad-3c14-4db5-acd0-311e68c8cb6c None None] MFA Rules not processed for user `58f48f5921c2488a83674f7da87013da`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:49.605401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-318f3bad-3c14-4db5-acd0-311e68c8cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:49.863139 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4140/8305] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:49.868023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:49.968259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15453f4-2315-41e1-bf98-f1544b937d23 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:49.973466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:49.974194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:49.974549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:49.974893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:49.975673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:49.978070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.020280 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4166/8306] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:49 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:50.021505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f3bad-3c14-4db5-acd0-311e68c8cb6c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.028688 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:50.036618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f3bad-3c14-4db5-acd0-311e68c8cb6c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.108946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.109914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.110285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.110652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.111402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.113574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.145156 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4141/8307] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:50 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:50.148899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.163269 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:50.169826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9121da-0533-4566-a848-bbc1439b095e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.183294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.184481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.185330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.186323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.188612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.191781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.207280 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4167/8308] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:50.211093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.223835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a845-dc7a-4613-b1de-fd14f164de21 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.229179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.229986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.230364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.230764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] PATH_INFO: `/v3/projects/9efee311f3e045aba50dc9350a28fbd3/users/a3d6355a1aee412993e2c9526ee6749f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.254995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efee311f3e045aba50dc9350a28fbd3, user_id=a3d6355a1aee412993e2c9526ee6749f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.258377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.284152 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4142/8309] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:50 2022] PUT /identity/v3/projects/9efee311f3e045aba50dc9350a28fbd3/users/a3d6355a1aee412993e2c9526ee6749f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:50.288124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.306654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fc2ab-3370-417e-847a-2f6ba5ba1d74 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.384513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ece8df-8467-49d2-a7b0-75823b41d7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.385484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece8df-8467-49d2-a7b0-75823b41d7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.385954 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece8df-8467-49d2-a7b0-75823b41d7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.386384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ece8df-8467-49d2-a7b0-75823b41d7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.387404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece8df-8467-49d2-a7b0-75823b41d7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.390312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ece8df-8467-49d2-a7b0-75823b41d7bb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.402517 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4168/8310] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:46:50.406849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.421901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6d91-8675-4f01-9ee9-c61c4e52be41 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.428198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.429001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.429417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.429875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] PATH_INFO: `/v3/projects/9efee311f3e045aba50dc9350a28fbd3/users/a3d6355a1aee412993e2c9526ee6749f/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.434025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efee311f3e045aba50dc9350a28fbd3, user_id=a3d6355a1aee412993e2c9526ee6749f, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.437844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.456950 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4143/8311] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:50 2022] PUT /identity/v3/projects/9efee311f3e045aba50dc9350a28fbd3/users/a3d6355a1aee412993e2c9526ee6749f/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:50.468692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301442-a119-4eba-8d09-0a5852d4bd80 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.468989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301442-a119-4eba-8d09-0a5852d4bd80 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.469438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301442-a119-4eba-8d09-0a5852d4bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.502477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-87301442-a119-4eba-8d09-0a5852d4bd80 None None] MFA Rules not processed for user `a3d6355a1aee412993e2c9526ee6749f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:50.503763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-87301442-a119-4eba-8d09-0a5852d4bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:50.637160 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4169/8312] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:50.641966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.658225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8ba26-4ac1-43bd-a4dd-d0006226bd6c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.671132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.672053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.672500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.672940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/services` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.674058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.676965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.719671 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4144/8313] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:50 2022] POST /identity/v3/services => generated 289 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:50.723697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301442-a119-4eba-8d09-0a5852d4bd80 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.735155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301442-a119-4eba-8d09-0a5852d4bd80 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.756191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.756824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.757138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.758499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.759283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.760951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: On instance['enabled']: Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: On instance['enabled']: Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: 'False' Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise error Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application 'False' Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:50.768597 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:46:50.770140 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application 'False' Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:50.771177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4170/8314] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:46:50 2022] POST /identity/v3/endpoints => generated 283 bytes in 48 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 11 01:46:50.775402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.793555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801100e-ca5e-432b-bc88-e04c8c3d4338 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.799077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.799930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.800286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.800730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.802177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.804146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: On instance['enabled']: Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: On instance['enabled']: Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: 'True' Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise error Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application 'True' Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:50.818093 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:46:50.819626 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application 'True' Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:50.820705 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4145/8315] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:46:50 2022] POST /identity/v3/endpoints => generated 281 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 11 01:46:50.824206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.837743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e7a86-9f2e-4ea9-8021-f3e2469a46f7 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.844485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.845433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.845960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.846459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.847354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.849718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.876110 n-d-master-1 devstack@keystone.service[81859]: WARNING py.warnings [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1005489091. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:46:50.876110 n-d-master-1 devstack@keystone.service[81859]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:46:50.876110 n-d-master-1 devstack@keystone.service[81859]: Sep 11 01:46:50.918781 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4171/8316] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:46:50 2022] POST /identity/v3/endpoints => generated 361 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:50.922347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.933548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395212c6-b1f3-4ed0-9f9b-420c0a76f6f4 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.952194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.953088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.953524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.953977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/regions/tempest-region-1005489091` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.954732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1005489091)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.956086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:50.958986 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4146/8317] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 11 01:46:50 2022] GET /identity/v3/regions/tempest-region-1005489091 => generated 180 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:50.962757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:50.977234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670408b-0406-425c-b2e0-e6ed0205b84f tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:50.985527 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:50.986451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:50.986784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:50.987176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints/da0b6bf113164b19a9b8e3f3a2db81ee` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:50.994789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=da0b6bf113164b19a9b8e3f3a2db81ee)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:50.997292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: On instance['enabled']: Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: On instance['enabled']: Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: 'False' Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise error Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application 'False' Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:51.005607 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:46:51.007702 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application 'False' Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: ERROR keystone.server.flask.application Sep 11 01:46:51.008815 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4172/8318] 10.222.0.16 () {60 vars in 1255 bytes} [Sun Sep 11 01:46:50 2022] PATCH /identity/v3/endpoints/da0b6bf113164b19a9b8e3f3a2db81ee => generated 283 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 11 01:46:51.012397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.025546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf94b8-38df-476d-8000-d627ba849f57 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.032046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.032643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.032990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.033360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints/da0b6bf113164b19a9b8e3f3a2db81ee` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.034601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=da0b6bf113164b19a9b8e3f3a2db81ee)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.036244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.047126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'da0b6bf113164b19a9b8e3f3a2db81ee', 'request_id': 'req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:51.061653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4147/8319] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:46:51 2022] DELETE /identity/v3/endpoints/da0b6bf113164b19a9b8e3f3a2db81ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:51.063695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.083012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19662afe-a545-4356-9e8c-2b91d53c8721 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.105206 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:51.109934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.111315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.111948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.112443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/regions/tempest-region-1005489091` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.113275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1005489091)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.115398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.151624 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4173/8320] 10.222.0.16 () {58 vars in 1209 bytes} [Sun Sep 11 01:46:51 2022] DELETE /identity/v3/regions/tempest-region-1005489091 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:51.157746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.172736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f52c-2d7f-4a83-a307-ec197fea9a31 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.190263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.190856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.191296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.192010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.193441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.195486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.230076 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-404864237. To ensure interoperability, identifiers should be a valid uuid. Sep 11 01:46:51.230076 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 11 01:46:51.230076 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:46:51.282116 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4148/8321] 10.222.0.16 () {60 vars in 1156 bytes} [Sun Sep 11 01:46:51 2022] POST /identity/v3/endpoints => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:51.286255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.302082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf1cae-5d58-40ec-9cef-6000f9666fef tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.321420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.322221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.322785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.323299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/regions/tempest-region-404864237` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.324320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-404864237)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.326822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.333463 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4174/8322] 10.222.0.16 () {58 vars in 1203 bytes} [Sun Sep 11 01:46:51 2022] GET /identity/v3/regions/tempest-region-404864237 => generated 178 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:51.334435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.349760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594fa85-dcf2-4378-a0a6-6c56cfca15f1 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.357758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.358613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.359117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.359449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints/a25172bcda9c40b2b8da6b7472524a4a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.368632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=a25172bcda9c40b2b8da6b7472524a4a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.369869 n-d-master-1 devstack@keystone.service[81860]: WARNING py.warnings [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:46:51.369869 n-d-master-1 devstack@keystone.service[81860]: warnings.warn(msg) Sep 11 01:46:51.369869 n-d-master-1 devstack@keystone.service[81860]: Sep 11 01:46:51.370999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: On instance['enabled']: Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: On instance['enabled']: Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: 'True' Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise error Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application 'True' Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:51.380421 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 11 01:46:51.381965 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application On instance['enabled']: Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application 'True' Sep 11 01:46:51.383419 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:51.389996 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4149/8323] 10.222.0.16 () {60 vars in 1255 bytes} [Sun Sep 11 01:46:51 2022] PATCH /identity/v3/endpoints/a25172bcda9c40b2b8da6b7472524a4a => generated 281 bytes in 56 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 11 01:46:51.391760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.404855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9077bc-b0ab-49dc-94e8-b81d256634c2 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.411580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.412227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.412510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.412788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/endpoints/a25172bcda9c40b2b8da6b7472524a4a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.414057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a25172bcda9c40b2b8da6b7472524a4a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.415713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.428050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a25172bcda9c40b2b8da6b7472524a4a', 'request_id': 'req-82c7eb01-d866-4725-b813-e629b3421e0e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:51.445626 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4175/8324] 10.222.0.16 () {58 vars in 1236 bytes} [Sun Sep 11 01:46:51 2022] DELETE /identity/v3/endpoints/a25172bcda9c40b2b8da6b7472524a4a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:51.446597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.460777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5343-553d-4132-b6bd-df17334fd382 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.491061 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:51.499653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.500602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.501165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.501844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/regions/tempest-region-404864237` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.503601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-404864237)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.505749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.548360 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4150/8325] 10.222.0.16 () {58 vars in 1206 bytes} [Sun Sep 11 01:46:51 2022] DELETE /identity/v3/regions/tempest-region-404864237 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:46:51.554058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.572648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7eb01-d866-4725-b813-e629b3421e0e tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.603480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e64cf-a724-4d6a-9b60-694a74cdb121 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d6355a1aee412993e2c9526ee6749f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9efee311f3e045aba50dc9350a28fbd3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.604183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e64cf-a724-4d6a-9b60-694a74cdb121 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.604562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e64cf-a724-4d6a-9b60-694a74cdb121 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.604847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e64cf-a724-4d6a-9b60-694a74cdb121 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] PATH_INFO: `/v3/services/7a0c23bf2c42451d98f7d35acd8df0a2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.605468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e64cf-a724-4d6a-9b60-694a74cdb121 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7a0c23bf2c42451d98f7d35acd8df0a2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.607807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e64cf-a724-4d6a-9b60-694a74cdb121 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.633655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4176/8326] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:51 2022] DELETE /identity/v3/services/7a0c23bf2c42451d98f7d35acd8df0a2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:51.637452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:51.756750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e756-3cbe-4586-a1f4-bfad359f64b5 tempest-EndpointsNegativeTestJSON-1190413172 tempest-EndpointsNegativeTestJSON-1190413172-project-admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:51.786167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:51.787193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.787588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.788021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] PATH_INFO: `/v3/users/58f48f5921c2488a83674f7da87013da` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.790349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f48f5921c2488a83674f7da87013da)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:51.792555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:51.867150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f48f5921c2488a83674f7da87013da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:51.867868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f48f5921c2488a83674f7da87013da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:51.868481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f48f5921c2488a83674f7da87013da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:51.877287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f48f5921c2488a83674f7da87013da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:51.891813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f48f5921c2488a83674f7da87013da'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:51.914427 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4151/8327] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:51 2022] DELETE /identity/v3/users/58f48f5921c2488a83674f7da87013da => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:46:51.919144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:51.919632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:51.919900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:51.940360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:51.941975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:52.014518 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4177/8328] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:52.024322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:52.025909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:52.087049 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:52.126548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c50c7d-b144-44fd-94fa-ed51082bc270 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:52.130602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:52.131571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:52.132002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:52.132427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:52.143433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:52.145158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:52.158155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4152/8329] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:52.459970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:52.461476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:52.474519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3d3e9-9813-45ad-b283-c861857993db None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:52.479691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:52.480514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:52.481564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:52.482021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] PATH_INFO: `/v3/projects/60244f40be5e4761aa2593a3816a478c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:52.483345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60244f40be5e4761aa2593a3816a478c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:52.485522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:52.560073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60244f40be5e4761aa2593a3816a478c', 'request_id': 'req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.568724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60244f40be5e4761aa2593a3816a478c', 'request_id': 'req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.577945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60244f40be5e4761aa2593a3816a478c', 'request_id': 'req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.588424 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:52.593931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] The token cache is being invalidate because project 60244f40be5e4761aa2593a3816a478c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:52.594284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.595421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.597565 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4178/8330] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:52 2022] DELETE /identity/v3/projects/60244f40be5e4761aa2593a3816a478c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:52.601530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:52.612420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda25f-bf90-499c-910c-ae3faff8f193 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:52.673444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:52.674075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:52.674351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:52.674627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] PATH_INFO: `/v3/users/a3d6355a1aee412993e2c9526ee6749f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:52.675744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d6355a1aee412993e2c9526ee6749f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:52.677720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:52.740914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d6355a1aee412993e2c9526ee6749f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.742039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d6355a1aee412993e2c9526ee6749f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.742819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d6355a1aee412993e2c9526ee6749f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.752550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d6355a1aee412993e2c9526ee6749f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.767039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7eb3d77a-ef2d-498c-a688-34146dccb0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d6355a1aee412993e2c9526ee6749f'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:52.785830 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4153/8331] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:52 2022] DELETE /identity/v3/users/a3d6355a1aee412993e2c9526ee6749f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:46:53.209578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:53.211120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:53.245440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248cf3-6f2d-4a62-9f9a-d9153f1c18a7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:53.325372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:53.326035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.326318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.326593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] PATH_INFO: `/v3/projects/9efee311f3e045aba50dc9350a28fbd3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.328687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efee311f3e045aba50dc9350a28fbd3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:53.330668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:53.383282 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efee311f3e045aba50dc9350a28fbd3', 'request_id': 'req-fbf5e0d9-a088-48bb-9255-8708048b7531'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:53.390290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efee311f3e045aba50dc9350a28fbd3', 'request_id': 'req-fbf5e0d9-a088-48bb-9255-8708048b7531'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:53.397249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efee311f3e045aba50dc9350a28fbd3', 'request_id': 'req-fbf5e0d9-a088-48bb-9255-8708048b7531'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:53.413463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] The token cache is being invalidate because project 9efee311f3e045aba50dc9350a28fbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:53.413754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:53.414400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fbf5e0d9-a088-48bb-9255-8708048b7531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:53.416105 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4179/8332] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:53 2022] DELETE /identity/v3/projects/9efee311f3e045aba50dc9350a28fbd3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:53.422097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd375-9de0-4b5c-8c8c-7025dc3bf7d8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.422507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd375-9de0-4b5c-8c8c-7025dc3bf7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.423324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd375-9de0-4b5c-8c8c-7025dc3bf7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.444374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7d6dd375-9de0-4b5c-8c8c-7025dc3bf7d8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:53.445904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7d6dd375-9de0-4b5c-8c8c-7025dc3bf7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:53.504174 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:53.540055 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4154/8333] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:53.548951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986d77-5262-4dc9-973e-df85d4af6565 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.549196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986d77-5262-4dc9-973e-df85d4af6565 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.549471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2986d77-5262-4dc9-973e-df85d4af6565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.573033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d2986d77-5262-4dc9-973e-df85d4af6565 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:53.574261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d2986d77-5262-4dc9-973e-df85d4af6565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:53.587640 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4180/8334] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:53.589393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd375-9de0-4b5c-8c8c-7025dc3bf7d8 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:53.601038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd375-9de0-4b5c-8c8c-7025dc3bf7d8 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:53.606838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:53.607448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.608126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.608126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.608769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:46:53.609102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:53.610718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:53.627425 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4155/8335] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:53.628682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2986d77-5262-4dc9-973e-df85d4af6565 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:53.643299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2986d77-5262-4dc9-973e-df85d4af6565 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:53.648813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:53.649712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.650209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.650704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.651410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:53.654270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:53.688553 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4181/8336] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:53 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:53.689838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:53.700783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1c82f-a017-41ff-b5a0-490380e72025 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:53.764417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:53.765331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.765331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.765609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.766246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:53.768159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:53.794569 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4156/8337] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:53 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:53.798669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:53.811184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33e504-3f57-46bb-9bc6-659f76672f80 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:53.817561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:53.818242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.818589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.818927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.819633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:53.821250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:53.832538 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4182/8338] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:53.836666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:53.847024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8294c-c097-4551-874c-7006f59a5618 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:53.852146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2c82d-4e31-45da-8b22-b3138188dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:53.852789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c82d-4e31-45da-8b22-b3138188dbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.853145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c82d-4e31-45da-8b22-b3138188dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.853388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c82d-4e31-45da-8b22-b3138188dbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.854123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2c82d-4e31-45da-8b22-b3138188dbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:53.855706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2c82d-4e31-45da-8b22-b3138188dbd8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:53.868173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4157/8339] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:53.872524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:53.886215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91897c-4a81-48d0-aee7-e4a7b1081466 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:53.892887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:53.893766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.894062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.894404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] PATH_INFO: `/v3/projects/06aa84a74cf544018f1f9b7162859ac9/users/6959be8b117d4bc2852a55f0332b2535/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:53.915446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06aa84a74cf544018f1f9b7162859ac9, user_id=6959be8b117d4bc2852a55f0332b2535, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:53.918671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:53.943243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4183/8340] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:53 2022] PUT /identity/v3/projects/06aa84a74cf544018f1f9b7162859ac9/users/6959be8b117d4bc2852a55f0332b2535/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:46:53.956540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0068c-bf7f-473f-a1ee-1403984e4f79 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:53.956845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0068c-bf7f-473f-a1ee-1403984e4f79 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:53.957130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0068c-bf7f-473f-a1ee-1403984e4f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.004828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e6e0068c-bf7f-473f-a1ee-1403984e4f79 None None] MFA Rules not processed for user `6959be8b117d4bc2852a55f0332b2535`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:54.006221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e6e0068c-bf7f-473f-a1ee-1403984e4f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:54.090065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.097546 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4158/8341] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:54.102773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686defa-7ae5-4a52-a481-de7870885709 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.107986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.108750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.109306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.109691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.110814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:create_application_credential(user_id=6959be8b117d4bc2852a55f0332b2535)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.112216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.140644 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:54.206556 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4184/8342] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 11 01:46:54 2022] POST /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials => generated 920 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:54.211083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0068c-bf7f-473f-a1ee-1403984e4f79 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.220305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0068c-bf7f-473f-a1ee-1403984e4f79 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.224532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.225212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.226153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.227499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules/32edc8fe32eb4e769ed3bfed3c562fda` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.228692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:delete_access_rule(user_id=6959be8b117d4bc2852a55f0332b2535, access_rule_id=32edc8fe32eb4e769ed3bfed3c562fda)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.230074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application session.delete(ref) Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application next(self.gen) Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application yield resource Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application next(self.gen) Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 01:46:54.300509 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise self.value Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application session.commit() Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.session.flush() Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 01:46:54.301901 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application compat.raise_( Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self._synchronize( Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise AssertionError( Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Sep 11 01:46:54.303755 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 01:46:54.305539 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 01:46:54.308195 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Sep 11 01:46:54.308195 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Sep 11 01:46:54.308195 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Sep 11 01:46:54.308195 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 11 01:46:54.308195 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 11 01:46:54.308195 n-d-master-1 devstack@keystone.service[81860]: ERROR keystone.server.flask.application Sep 11 01:46:54.308195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4159/8343] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 11 01:46:54 2022] DELETE /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules/32edc8fe32eb4e769ed3bfed3c562fda => generated 89 bytes in 91 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Sep 11 01:46:54.309437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.315900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83221b5-c7cb-4cbc-87f6-6e8f8b338240 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.320233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.320879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.321196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.321478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials/5b413a34268445c7b3b6e292c3fa4db1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.333957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6959be8b117d4bc2852a55f0332b2535, application_credential_id=5b413a34268445c7b3b6e292c3fa4db1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.335485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.356825 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4185/8344] 10.222.0.16 () {58 vars in 1395 bytes} [Sun Sep 11 01:46:54 2022] DELETE /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials/5b413a34268445c7b3b6e292c3fa4db1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:54.360895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.370515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2df9ff-6de0-4373-b0eb-54329a5bca04 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.375267 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.375889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.376168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.376435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.377630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:list_access_rules(user_id=6959be8b117d4bc2852a55f0332b2535)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.379089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.388069 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4160/8345] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 11 01:46:54 2022] GET /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules => generated 369 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:54.389372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.399350 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab1f6b-9d6c-41e8-8a22-709217f8b022 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.403744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.404386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.404671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.404950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules/32edc8fe32eb4e769ed3bfed3c562fda` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.406432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:delete_access_rule(user_id=6959be8b117d4bc2852a55f0332b2535, access_rule_id=32edc8fe32eb4e769ed3bfed3c562fda)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.407797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.431475 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4186/8346] 10.222.0.16 () {58 vars in 1362 bytes} [Sun Sep 11 01:46:54 2022] DELETE /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules/32edc8fe32eb4e769ed3bfed3c562fda => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:54.436137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.446435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daa74f-91ac-4c13-9f95-8c002b5c7476 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.451510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.452142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.452425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.452703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.454055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:list_access_rules(user_id=6959be8b117d4bc2852a55f0332b2535)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.455518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.461096 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4161/8347] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 11 01:46:54 2022] GET /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules => generated 158 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:54.466083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.476801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff205b-d555-4a04-b349-722f4467b8eb tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.481574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.482230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.482841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.482841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.483426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:create_application_credential(user_id=6959be8b117d4bc2852a55f0332b2535)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.486027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.573108 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4187/8348] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 11 01:46:54 2022] POST /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials => generated 921 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:54.577377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.587857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d23d08-106a-48c4-b255-9ed3efddc1d5 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.593323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.593954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.594243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.594505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.595690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:list_access_rules(user_id=6959be8b117d4bc2852a55f0332b2535)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.597215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.606957 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4162/8349] 10.222.0.16 () {58 vars in 1260 bytes} [Sun Sep 11 01:46:54 2022] GET /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules => generated 369 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:54.609196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.619170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b3cb-1a55-48c8-beeb-7951aa22c5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.623957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.624650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.624951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.625259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.625926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:create_application_credential(user_id=6959be8b117d4bc2852a55f0332b2535)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.627097 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.675607 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=8,keystone:DELETE=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:54.716965 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4188/8350] 10.222.0.16 () {60 vars in 1315 bytes} [Sun Sep 11 01:46:54 2022] POST /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/application_credentials => generated 921 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:54.720901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.730803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed981-76c9-4062-b487-325f27af3f61 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.735966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96b76c-f8e8-40de-b8ac-29999ca2d392 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6959be8b117d4bc2852a55f0332b2535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06aa84a74cf544018f1f9b7162859ac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.736741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96b76c-f8e8-40de-b8ac-29999ca2d392 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.737020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96b76c-f8e8-40de-b8ac-29999ca2d392 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.737347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96b76c-f8e8-40de-b8ac-29999ca2d392 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules/8b22a7b9a5694877abe11fee30a4e97c` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.738506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96b76c-f8e8-40de-b8ac-29999ca2d392 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorizing `identity:get_access_rule(user_id=6959be8b117d4bc2852a55f0332b2535, access_rule_id=8b22a7b9a5694877abe11fee30a4e97c)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.740221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96b76c-f8e8-40de-b8ac-29999ca2d392 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.750542 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4163/8351] 10.222.0.16 () {58 vars in 1359 bytes} [Sun Sep 11 01:46:54 2022] GET /identity/v3/users/6959be8b117d4bc2852a55f0332b2535/access_rules/8b22a7b9a5694877abe11fee30a4e97c => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:46:54.753137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:54.826833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a33a1-ca15-48c1-b026-c26ec209a5b7 tempest-AccessRulesV3Test-1356864747 tempest-AccessRulesV3Test-1356864747-project] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:54.831585 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:54.832218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.832493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.832763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] PATH_INFO: `/v3/users/6959be8b117d4bc2852a55f0332b2535` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.833929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6959be8b117d4bc2852a55f0332b2535)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:54.835871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:54.889545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6959be8b117d4bc2852a55f0332b2535'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:54.890306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6959be8b117d4bc2852a55f0332b2535'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:54.892195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6959be8b117d4bc2852a55f0332b2535'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:54.935730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6959be8b117d4bc2852a55f0332b2535'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:54.945882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6959be8b117d4bc2852a55f0332b2535'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:54.965255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4189/8352] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:54 2022] DELETE /identity/v3/users/6959be8b117d4bc2852a55f0332b2535 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:54.968960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:54.970868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:54.971257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:54.987257 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:55.000340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:55.002025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:55.065676 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4164/8353] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:55.076017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:55.077558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:55.109865 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:55.143159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4676b6-e9d6-434e-8dae-cf6523992989 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:55.146977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ab18f-3316-4c3b-9b3b-d2651017f55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:55.147587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ab18f-3316-4c3b-9b3b-d2651017f55e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:55.147869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ab18f-3316-4c3b-9b3b-d2651017f55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:55.148137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ab18f-3316-4c3b-9b3b-d2651017f55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:55.158313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ab18f-3316-4c3b-9b3b-d2651017f55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:55.159798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ab18f-3316-4c3b-9b3b-d2651017f55e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:55.170989 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4190/8354] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:55.486308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:55.487762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:55.501868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611bba-956a-45f5-a22c-62ce9566fc2a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:55.506741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:55.507574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:55.507857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:55.508131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] PATH_INFO: `/v3/projects/06aa84a74cf544018f1f9b7162859ac9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:55.509341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06aa84a74cf544018f1f9b7162859ac9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:55.517914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:55.577319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06aa84a74cf544018f1f9b7162859ac9', 'request_id': 'req-123b19cc-7c2b-4740-bceb-88a6a7146b1a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:55.583950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06aa84a74cf544018f1f9b7162859ac9', 'request_id': 'req-123b19cc-7c2b-4740-bceb-88a6a7146b1a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:55.595300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06aa84a74cf544018f1f9b7162859ac9', 'request_id': 'req-123b19cc-7c2b-4740-bceb-88a6a7146b1a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:55.610117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] The token cache is being invalidate because project 06aa84a74cf544018f1f9b7162859ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:55.610815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:55.611388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-123b19cc-7c2b-4740-bceb-88a6a7146b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:55.614012 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4165/8355] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:55 2022] DELETE /identity/v3/projects/06aa84a74cf544018f1f9b7162859ac9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:55.618803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234f274-8613-4642-bdb5-eacceb76826d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:55.619298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234f274-8613-4642-bdb5-eacceb76826d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:55.619484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234f274-8613-4642-bdb5-eacceb76826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:55.643355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a234f274-8613-4642-bdb5-eacceb76826d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:55.644470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a234f274-8613-4642-bdb5-eacceb76826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:55.720503 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4191/8356] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:55.728207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded8c25-e354-42a0-a111-ffa8fd99b607 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:55.728496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded8c25-e354-42a0-a111-ffa8fd99b607 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:55.728767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded8c25-e354-42a0-a111-ffa8fd99b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:55.756955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1ded8c25-e354-42a0-a111-ffa8fd99b607 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:55.758302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1ded8c25-e354-42a0-a111-ffa8fd99b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:55.770691 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4166/8357] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:55.775237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234f274-8613-4642-bdb5-eacceb76826d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:55.790389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234f274-8613-4642-bdb5-eacceb76826d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:55.797117 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:55.797837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:55.798738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:55.799082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:55.799815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:46:55.800176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:55.801899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:55.822366 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded8c25-e354-42a0-a111-ffa8fd99b607 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:55.825927 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4192/8358] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:55.833655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded8c25-e354-42a0-a111-ffa8fd99b607 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:55.838613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:55.839318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:55.839660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:55.840706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:55.840706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:55.843447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:55.875973 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4167/8359] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:55 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:55.880396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:55.893310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726b9b-ce77-4519-a796-c34b218cc117 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:55.967279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:55.968028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:55.968414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:55.968791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:55.969589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:55.972062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:56.000527 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4193/8360] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:55 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:56.004644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.016745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a83df-6125-4d45-a99c-4038a5575c56 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.022246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.022884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.023183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.023447 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.024104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:56.025755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:56.039134 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4168/8361] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:56.044292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.062644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d49e2-9f34-4faa-9aba-87d487bde33e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.067672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13213fd-a164-415e-9fa5-a2ce932fb2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.068304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13213fd-a164-415e-9fa5-a2ce932fb2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.068640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13213fd-a164-415e-9fa5-a2ce932fb2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.068915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13213fd-a164-415e-9fa5-a2ce932fb2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.069664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13213fd-a164-415e-9fa5-a2ce932fb2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:56.080016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13213fd-a164-415e-9fa5-a2ce932fb2d3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:56.100179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.101206 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4194/8362] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:46:56.128784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389268-e302-4198-9df1-a64ede88f234 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.135342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.135342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.135678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.135994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] PATH_INFO: `/v3/projects/70334b8f49524253aa095ddb29361acf/users/d766233d10554bc59313ed59f9b66dae/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.160691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70334b8f49524253aa095ddb29361acf, user_id=d766233d10554bc59313ed59f9b66dae, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:56.163787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:56.183738 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4169/8363] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:56 2022] PUT /identity/v3/projects/70334b8f49524253aa095ddb29361acf/users/d766233d10554bc59313ed59f9b66dae/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:56.194457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1022e4-2b52-4eb0-9642-825f820696f4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.194743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1022e4-2b52-4eb0-9642-825f820696f4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.195025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1022e4-2b52-4eb0-9642-825f820696f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.230460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2f1022e4-2b52-4eb0-9642-825f820696f4 None None] MFA Rules not processed for user `d766233d10554bc59313ed59f9b66dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:56.231925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2f1022e4-2b52-4eb0-9642-825f820696f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:56.261856 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:56.308017 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4195/8364] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:56.312934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.324538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e5478-b45f-48b5-a39d-5e04391ddff7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.329470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb21d-8a10-44aa-a44e-8f2c554558db tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd766233d10554bc59313ed59f9b66dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70334b8f49524253aa095ddb29361acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.330062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb21d-8a10-44aa-a44e-8f2c554558db tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.330349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb21d-8a10-44aa-a44e-8f2c554558db tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.330650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb21d-8a10-44aa-a44e-8f2c554558db tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] PATH_INFO: `/v3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.332124 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4170/8365] 10.222.0.16 () {58 vars in 1104 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/v3 => generated 255 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:56.337051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1022e4-2b52-4eb0-9642-825f820696f4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.346729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1022e4-2b52-4eb0-9642-825f820696f4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.351006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac2469-8a58-4580-a96c-df9794bd7f26 tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd766233d10554bc59313ed59f9b66dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70334b8f49524253aa095ddb29361acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.351606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac2469-8a58-4580-a96c-df9794bd7f26 tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.351894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac2469-8a58-4580-a96c-df9794bd7f26 tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.352172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac2469-8a58-4580-a96c-df9794bd7f26 tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] PATH_INFO: `/v3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.353711 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4196/8366] 10.222.0.16 () {58 vars in 1104 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/v3 => generated 255 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:56.358612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb21d-8a10-44aa-a44e-8f2c554558db tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.368963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb21d-8a10-44aa-a44e-8f2c554558db tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.373988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250317-21d5-496f-a462-7d9ae401f54d tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd766233d10554bc59313ed59f9b66dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70334b8f49524253aa095ddb29361acf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.374663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250317-21d5-496f-a462-7d9ae401f54d tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.374945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250317-21d5-496f-a462-7d9ae401f54d tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.375226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250317-21d5-496f-a462-7d9ae401f54d tempest-TestApiDiscovery-367480938 tempest-TestApiDiscovery-367480938-project] PATH_INFO: `/v3` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.376757 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4171/8367] 10.222.0.16 () {58 vars in 1104 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/v3 => generated 255 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:56.381889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70501a6a-30da-4354-8dc4-3f201c79c38c None None] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.382419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70501a6a-30da-4354-8dc4-3f201c79c38c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.382559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70501a6a-30da-4354-8dc4-3f201c79c38c None None] PATH_INFO: `/` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.383926 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4197/8368] 10.222.0.16 () {56 vars in 895 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:46:56.389008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d887-c608-4dac-817e-9c0ebea6e694 None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.389325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d887-c608-4dac-817e-9c0ebea6e694 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.389599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d887-c608-4dac-817e-9c0ebea6e694 None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.390928 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4172/8369] 10.222.0.16 () {56 vars in 895 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:46:56.395554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70501a6a-30da-4354-8dc4-3f201c79c38c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.467428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70501a6a-30da-4354-8dc4-3f201c79c38c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.472410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.473218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.473501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.473778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] PATH_INFO: `/v3/users/d766233d10554bc59313ed59f9b66dae` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.474951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d766233d10554bc59313ed59f9b66dae)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:56.478121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:56.547421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd766233d10554bc59313ed59f9b66dae'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:56.548104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd766233d10554bc59313ed59f9b66dae'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:56.548723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd766233d10554bc59313ed59f9b66dae'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:56.563039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd766233d10554bc59313ed59f9b66dae'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:56.570673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd766233d10554bc59313ed59f9b66dae'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:56.584177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4198/8370] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:56 2022] DELETE /identity/v3/users/d766233d10554bc59313ed59f9b66dae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:56.588521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.588877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.589284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.608743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:56.610012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:56.619346 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:56.673508 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4173/8371] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:56.683315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:56.684743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:56.730274 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:56.748420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646173-df85-4fd2-8794-0445dae8bdca admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:56.752100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f616b-cf87-4a65-89e6-931705e9147a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:56.752706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f616b-cf87-4a65-89e6-931705e9147a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:56.752981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f616b-cf87-4a65-89e6-931705e9147a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:56.753280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f616b-cf87-4a65-89e6-931705e9147a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:56.762632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f616b-cf87-4a65-89e6-931705e9147a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:56.764267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f616b-cf87-4a65-89e6-931705e9147a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:56.779792 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4199/8372] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:57.071326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.073209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:57.089423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b9cb-4c43-450d-ac13-bd14eb166ee4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.095143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.095997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.096459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.097023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] PATH_INFO: `/v3/projects/70334b8f49524253aa095ddb29361acf` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.099565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70334b8f49524253aa095ddb29361acf)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.101540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.165809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70334b8f49524253aa095ddb29361acf', 'request_id': 'req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:57.174228 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70334b8f49524253aa095ddb29361acf', 'request_id': 'req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:57.182801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70334b8f49524253aa095ddb29361acf', 'request_id': 'req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:57.196581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] The token cache is being invalidate because project 70334b8f49524253aa095ddb29361acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:57.196927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:57.197551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-cb09d4b9-2c1a-49a8-91b6-8483c5f825d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:57.199294 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4174/8373] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:57 2022] DELETE /identity/v3/projects/70334b8f49524253aa095ddb29361acf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:57.205763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f3d52-2a9f-4e33-8405-e748256b90d0 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.205992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f3d52-2a9f-4e33-8405-e748256b90d0 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.206222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f3d52-2a9f-4e33-8405-e748256b90d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.233283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3e6f3d52-2a9f-4e33-8405-e748256b90d0 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:57.234504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3e6f3d52-2a9f-4e33-8405-e748256b90d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:57.300594 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4200/8374] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:57.308446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2873-84c8-4666-894a-225d89a7f1e7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.308739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2873-84c8-4666-894a-225d89a7f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.309404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c2873-84c8-4666-894a-225d89a7f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.331291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-862c2873-84c8-4666-894a-225d89a7f1e7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:57.332435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-862c2873-84c8-4666-894a-225d89a7f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:57.341910 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4175/8375] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:46:57.346360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f3d52-2a9f-4e33-8405-e748256b90d0 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.356076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f3d52-2a9f-4e33-8405-e748256b90d0 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.360786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.361412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.361690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.361959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.362595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:46:57.362898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.364471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.377904 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4201/8376] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:46:57.382778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c2873-84c8-4666-894a-225d89a7f1e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.393016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c2873-84c8-4666-894a-225d89a7f1e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.397881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.398536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.398884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.399284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.400019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.402117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.437224 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4176/8377] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:46:57 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:46:57.441622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.455351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814eb41-2c8d-4234-95da-56a3406e6854 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.530521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.531402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.531860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.532134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.533515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.535565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.566670 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4202/8378] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:46:57 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:46:57.567370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.580320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7776d-f16b-42ea-a997-57e8cfb54e6a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.585968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.586585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.586870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.587137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.588434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.590351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.602771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4177/8379] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:46:57.609453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.620200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed207aa4-54f6-49da-80ae-d9a48a41ca02 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.626757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed503db-e968-41c0-8051-4fd265d64a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.627404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed503db-e968-41c0-8051-4fd265d64a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.627685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed503db-e968-41c0-8051-4fd265d64a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.627974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed503db-e968-41c0-8051-4fd265d64a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.628683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed503db-e968-41c0-8051-4fd265d64a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.630380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed503db-e968-41c0-8051-4fd265d64a75 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.648333 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4203/8380] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:46:57.653340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.664038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1899-ed7b-4ebb-9f02-57a4e5df3df0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.668718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.669440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.669791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.670072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] PATH_INFO: `/v3/projects/c62b317efee74656977783ac18ea1b03/users/0535c990aa0d4fbbbd3879f97a735daa/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.685440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62b317efee74656977783ac18ea1b03, user_id=0535c990aa0d4fbbbd3879f97a735daa, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.687933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.702389 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4178/8381] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:46:57 2022] PUT /identity/v3/projects/c62b317efee74656977783ac18ea1b03/users/0535c990aa0d4fbbbd3879f97a735daa/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:57.712286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed4788-dc35-457b-b705-bc86844d63dc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.712778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed4788-dc35-457b-b705-bc86844d63dc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.712901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed4788-dc35-457b-b705-bc86844d63dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.741513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f7ed4788-dc35-457b-b705-bc86844d63dc None None] MFA Rules not processed for user `0535c990aa0d4fbbbd3879f97a735daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:57.742806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f7ed4788-dc35-457b-b705-bc86844d63dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:57.783999 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:57.813237 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4204/8382] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:57.825836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:57.827516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:57.868047 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:57.900716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f203a1-79e2-428b-a6fc-1c03da6691c9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:57.905154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b2521-9b9e-40dc-87a4-c2312e19a9e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:57.905772 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2521-9b9e-40dc-87a4-c2312e19a9e9 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:57.906317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2521-9b9e-40dc-87a4-c2312e19a9e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:57.906584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b2521-9b9e-40dc-87a4-c2312e19a9e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:57.915680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b2521-9b9e-40dc-87a4-c2312e19a9e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:57.917132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b2521-9b9e-40dc-87a4-c2312e19a9e9 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:57.927563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4179/8383] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:58.812969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed4788-dc35-457b-b705-bc86844d63dc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:58.895273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed4788-dc35-457b-b705-bc86844d63dc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:58.899784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:58.900414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:58.900687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:58.900959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] PATH_INFO: `/v3/users/0535c990aa0d4fbbbd3879f97a735daa` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:58.902118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0535c990aa0d4fbbbd3879f97a735daa)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:58.904521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:58.952896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0535c990aa0d4fbbbd3879f97a735daa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:58.953602 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0535c990aa0d4fbbbd3879f97a735daa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:58.954206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0535c990aa0d4fbbbd3879f97a735daa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:58.966730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0535c990aa0d4fbbbd3879f97a735daa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:58.973537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0535c990aa0d4fbbbd3879f97a735daa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:58.987355 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4205/8384] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:46:58 2022] DELETE /identity/v3/users/0535c990aa0d4fbbbd3879f97a735daa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:58.992466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:58.992949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:58.993109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:59.013322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:59.014553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:59.076640 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4180/8385] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:59.085675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:59.087268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:59.151884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0987adc-dfcd-47c7-8df6-2dfa282ccf24 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:59.158956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7b3c-f640-4046-b5c7-8e4d3996f864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:59.160214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7b3c-f640-4046-b5c7-8e4d3996f864 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:59.160214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7b3c-f640-4046-b5c7-8e4d3996f864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:59.160473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7b3c-f640-4046-b5c7-8e4d3996f864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:59.175574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b7b3c-f640-4046-b5c7-8e4d3996f864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:59.177023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b7b3c-f640-4046-b5c7-8e4d3996f864 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:59.182862 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:46:59.189279 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4206/8386] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:46:59.648825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:59.650929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:59.683770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998929e3-b34d-4303-a2b2-ba9a7fd8b1a3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:59.690372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:59.691106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:59.691418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:59.691693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] PATH_INFO: `/v3/projects/c62b317efee74656977783ac18ea1b03` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:59.692882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62b317efee74656977783ac18ea1b03)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:59.694928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:46:59.763068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62b317efee74656977783ac18ea1b03', 'request_id': 'req-0881917d-945b-47e2-96e8-0ab461ed3b89'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:59.771525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62b317efee74656977783ac18ea1b03', 'request_id': 'req-0881917d-945b-47e2-96e8-0ab461ed3b89'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:59.788726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62b317efee74656977783ac18ea1b03', 'request_id': 'req-0881917d-945b-47e2-96e8-0ab461ed3b89'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:59.804942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] The token cache is being invalidate because project c62b317efee74656977783ac18ea1b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:46:59.805393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:59.806505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0881917d-945b-47e2-96e8-0ab461ed3b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:46:59.812570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4181/8387] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:46:59 2022] DELETE /identity/v3/projects/c62b317efee74656977783ac18ea1b03 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:46:59.815880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d586e8-fff2-4cf0-936c-46448e7a87f8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:59.816701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d586e8-fff2-4cf0-936c-46448e7a87f8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:59.817045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d586e8-fff2-4cf0-936c-46448e7a87f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:59.837549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-51d586e8-fff2-4cf0-936c-46448e7a87f8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:59.838834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-51d586e8-fff2-4cf0-936c-46448e7a87f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:59.917312 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4207/8388] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:59.921427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a9da2-a0c5-4dfa-85b8-f896d529f762 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:59.921707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a9da2-a0c5-4dfa-85b8-f896d529f762 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:59.922139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a9da2-a0c5-4dfa-85b8-f896d529f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:59.946983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-a20a9da2-a0c5-4dfa-85b8-f896d529f762 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:46:59.948973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a20a9da2-a0c5-4dfa-85b8-f896d529f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:46:59.963875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d586e8-fff2-4cf0-936c-46448e7a87f8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:46:59.964537 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4182/8389] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:46:59.975437 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d586e8-fff2-4cf0-936c-46448e7a87f8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:46:59.990113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:46:59.990854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:46:59.991223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:46:59.991616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:46:59.992360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:46:59.993853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:46:59.997012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.020351 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4208/8390] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:47:00.025308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a9da2-a0c5-4dfa-85b8-f896d529f762 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.040098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a9da2-a0c5-4dfa-85b8-f896d529f762 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.045282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.045810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.046017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.046450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.047244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.048992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.081104 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4183/8391] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:00 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:00.084915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.095568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90e71-ab86-4522-8bb9-e6a2af24d297 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.132502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.134433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:00.163854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.164532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.164880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.165186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.165811 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.166687 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:00.167718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.189620 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4209/8392] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:00 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:00.193658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.207711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426158-dbd3-4762-85c1-1d5786bd26e6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.212534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.213197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.213480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.213751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] PATH_INFO: `/v3/users/26d04f2209314adfb80655d81a8f7639` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.215016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d04f2209314adfb80655d81a8f7639)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.217523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.220379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83133c2-ed6b-448a-b5c6-931c32f4278d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.225299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.225902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.226178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.226440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.227078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.228674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.239846 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4210/8393] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:00.243706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.254435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e553f2-069d-4493-9db3-524746a4a1ed admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.266075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.266684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.266963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.267238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.267908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.269565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.273800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d04f2209314adfb80655d81a8f7639'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.274464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d04f2209314adfb80655d81a8f7639'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.275098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d04f2209314adfb80655d81a8f7639'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.284595 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4211/8394] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:00.285831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.287204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d04f2209314adfb80655d81a8f7639'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.287575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:00.300335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964dec-6e63-436d-b1f8-82c6e0c00da5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.300651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-91f7f19d-6689-4358-ac89-28bc174375f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d04f2209314adfb80655d81a8f7639'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.305230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.305893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.306152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.306532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] PATH_INFO: `/v3/projects/55f5cc89bb3148df8b211d8a9731bd40/users/5adc2cb288a94a889af2a54cd31c4403/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.315645 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4184/8395] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:00 2022] DELETE /identity/v3/users/26d04f2209314adfb80655d81a8f7639 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:00.322814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f5cc89bb3148df8b211d8a9731bd40, user_id=5adc2cb288a94a889af2a54cd31c4403, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.326072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.340321 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4212/8396] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:00 2022] PUT /identity/v3/projects/55f5cc89bb3148df8b211d8a9731bd40/users/5adc2cb288a94a889af2a54cd31c4403/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:00.351906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.352191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.352462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.381720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] MFA Rules not processed for user `5adc2cb288a94a889af2a54cd31c4403`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:00.382973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:00.459072 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4185/8397] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:00.463525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.499655 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:00.511384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.514215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:00.541780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5680-c66c-4e15-b06c-5b092879f9a4 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.547341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.547962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.548240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.548509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.549179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.551085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.565628 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:00.581634 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4213/8398] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:00 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:00.585860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.600606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3561b1-866d-4b09-9e37-4270ddda65a2 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.648868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99171b05-5adf-40ed-84ca-e1e0a33d6d06 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.653937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.654552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.654935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.655403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.656522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.656893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.657559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.657836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.658105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] PATH_INFO: `/v3/projects/a180e4642bc1454295d4228a2600132f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.659185 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.659321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a180e4642bc1454295d4228a2600132f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.661152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.680669 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4214/8399] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:00 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:00.685170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.695610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334d363-19fe-4766-b431-bb7fd564120f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.709844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a180e4642bc1454295d4228a2600132f', 'request_id': 'req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.716311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a180e4642bc1454295d4228a2600132f', 'request_id': 'req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.724371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a180e4642bc1454295d4228a2600132f', 'request_id': 'req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.735072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] The token cache is being invalidate because project a180e4642bc1454295d4228a2600132f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:00.735367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.736023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.737803 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4186/8400] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:00 2022] DELETE /identity/v3/projects/a180e4642bc1454295d4228a2600132f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:00.741506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.742809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:00.754258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.754804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.755078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.755342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.755972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.757615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.771660 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4215/8401] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:00.772861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.774620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:00.788856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4200-581b-485f-aada-d0eb7413df3b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.794279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.794930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.795211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.795486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] PATH_INFO: `/v3/projects/4f6ae09f37f54561b1494f9c8822cc8f/users/3ba290c3add248d096f388bde948786a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.809795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe6ffc-efff-4f7b-97b7-631ffb8eb5e5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.813574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6ae09f37f54561b1494f9c8822cc8f, user_id=3ba290c3add248d096f388bde948786a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.816231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.816383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.816872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.817185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.817461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] PATH_INFO: `/v3/users/b6e9f439799747c6921883e692ab02fd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.818796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e9f439799747c6921883e692ab02fd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.821826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.836129 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:00.839480 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4216/8402] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:00 2022] PUT /identity/v3/projects/4f6ae09f37f54561b1494f9c8822cc8f/users/3ba290c3add248d096f388bde948786a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:00.844132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.865825 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:00.875790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e9f439799747c6921883e692ab02fd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.876523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e9f439799747c6921883e692ab02fd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.877175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e9f439799747c6921883e692ab02fd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.884427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e9f439799747c6921883e692ab02fd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.896949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e9f439799747c6921883e692ab02fd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:00.912606 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4187/8403] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:00 2022] DELETE /identity/v3/users/b6e9f439799747c6921883e692ab02fd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:00.919706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3f631-aa82-407e-9aa2-4b4528d50930 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:00.977132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a21c8-0492-457a-a965-a31ea972fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:00.977747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a21c8-0492-457a-a965-a31ea972fed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:00.978032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a21c8-0492-457a-a965-a31ea972fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:00.978309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a21c8-0492-457a-a965-a31ea972fed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:00.978952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a21c8-0492-457a-a965-a31ea972fed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:00.980615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a21c8-0492-457a-a965-a31ea972fed4 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:00.994403 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4217/8404] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:00.995868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:00.997588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:01.010934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9559e-6aa6-4853-84d7-4000c22ef7b0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:01.016342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:01.016986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:01.017299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:01.017578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] PATH_INFO: `/v3/projects/4f6ae09f37f54561b1494f9c8822cc8f/users/3ba290c3add248d096f388bde948786a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:01.019541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6ae09f37f54561b1494f9c8822cc8f, user_id=3ba290c3add248d096f388bde948786a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:01.022215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:01.034173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4188/8405] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:00 2022] PUT /identity/v3/projects/4f6ae09f37f54561b1494f9c8822cc8f/users/3ba290c3add248d096f388bde948786a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:01.044902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:01.045233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:01.045509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:01.073695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] MFA Rules not processed for user `3ba290c3add248d096f388bde948786a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:01.075619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:01.094418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:01.096323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:01.160154 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4218/8406] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:01.171862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:01.173303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:01.180960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec4199-4793-4f84-b679-780a1ca8a5f9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:01.188311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:01.189054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:01.189441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:01.189780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] PATH_INFO: `/v3/projects/0c8d5c922ebd4a879935aad9a585b462` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:01.191085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8d5c922ebd4a879935aad9a585b462)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:01.193195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:01.244111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8d5c922ebd4a879935aad9a585b462', 'request_id': 'req-054f39b6-8235-4d10-a715-6b44aedf8690'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:01.247222 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=100 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:01.253845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913e6ef-3fc5-496c-a9df-328e4d7142fd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:01.255489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8d5c922ebd4a879935aad9a585b462', 'request_id': 'req-054f39b6-8235-4d10-a715-6b44aedf8690'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:01.265224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8d5c922ebd4a879935aad9a585b462', 'request_id': 'req-054f39b6-8235-4d10-a715-6b44aedf8690'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:01.278557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] The token cache is being invalidate because project 0c8d5c922ebd4a879935aad9a585b462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:01.278839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:01.279520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:01.281588 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4189/8407] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:01 2022] DELETE /identity/v3/projects/0c8d5c922ebd4a879935aad9a585b462 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:01.319722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:01.320359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:01.320638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:01.320914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:01.322855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:01.393730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:01.395171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:01.405875 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4219/8408] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:47:01.764270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:01.767334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:01.792750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f39b6-8235-4d10-a715-6b44aedf8690 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:01.798079 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f59bcf-5759-4194-80ca-0ae0815ee5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:01.798709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f59bcf-5759-4194-80ca-0ae0815ee5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:01.799039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f59bcf-5759-4194-80ca-0ae0815ee5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:01.799317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f59bcf-5759-4194-80ca-0ae0815ee5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:01.801351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-68f59bcf-5759-4194-80ca-0ae0815ee5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:01.807016 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:01.875869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f59bcf-5759-4194-80ca-0ae0815ee5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:01.877339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f59bcf-5759-4194-80ca-0ae0815ee5e3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:01.887016 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4190/8409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:47:07.969323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:07.971608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:08.040116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0975-4baf-40b7-a026-5e2f3e15d702 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:08.045593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:08.046229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:08.046511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:08.046789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] PATH_INFO: `/v3/users/5adc2cb288a94a889af2a54cd31c4403` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:08.048243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adc2cb288a94a889af2a54cd31c4403)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:08.050227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:08.233690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adc2cb288a94a889af2a54cd31c4403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.234385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adc2cb288a94a889af2a54cd31c4403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.235051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adc2cb288a94a889af2a54cd31c4403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.242865 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:08.248998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adc2cb288a94a889af2a54cd31c4403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.256207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adc2cb288a94a889af2a54cd31c4403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.271821 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4220/8410] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:07 2022] DELETE /identity/v3/users/5adc2cb288a94a889af2a54cd31c4403 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:08.276407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:08.276930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:08.277235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:08.298647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:08.299785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:08.359733 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4191/8411] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:08.369908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:08.371304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:08.431608 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d58e2-91cc-48c9-8f34-522ce7d13ec2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:08.435397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:08.435995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:08.436272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:08.436541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:08.445817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:08.447223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:08.457909 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4221/8412] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:08.630692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:08.632142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:08.646605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dadc85-10e5-4bea-931f-2424b1174517 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:08.652191 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:08.653232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:08.653523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:08.653778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] PATH_INFO: `/v3/projects/55f5cc89bb3148df8b211d8a9731bd40` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:08.655209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f5cc89bb3148df8b211d8a9731bd40)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:08.657450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:08.705700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f5cc89bb3148df8b211d8a9731bd40', 'request_id': 'req-6823647b-f9b4-4797-bc73-54087d9b6d91'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.711812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f5cc89bb3148df8b211d8a9731bd40', 'request_id': 'req-6823647b-f9b4-4797-bc73-54087d9b6d91'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.718936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f5cc89bb3148df8b211d8a9731bd40', 'request_id': 'req-6823647b-f9b4-4797-bc73-54087d9b6d91'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.729434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] The token cache is being invalidate because project 55f5cc89bb3148df8b211d8a9731bd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:08.729721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.730339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.732260 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4192/8413] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:08 2022] DELETE /identity/v3/projects/55f5cc89bb3148df8b211d8a9731bd40 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:08.736222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:08.745836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31eec4-25d9-4a70-a547-d7ab4e068ed9 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:08.802318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:08.802931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:08.803206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:08.803814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] PATH_INFO: `/v3/users/3ba290c3add248d096f388bde948786a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:08.804822 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba290c3add248d096f388bde948786a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:08.806978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:08.855110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba290c3add248d096f388bde948786a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.855775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba290c3add248d096f388bde948786a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.856366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba290c3add248d096f388bde948786a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.870763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba290c3add248d096f388bde948786a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.878222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9f52f01a-76fb-4473-a857-0f4d4874f0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba290c3add248d096f388bde948786a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:08.886368 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:08.893836 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4222/8414] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:08 2022] DELETE /identity/v3/users/3ba290c3add248d096f388bde948786a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:09.069979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.071426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:09.084627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823647b-f9b4-4797-bc73-54087d9b6d91 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.104985 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:09.142932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.143557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.143832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.144100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] PATH_INFO: `/v3/projects/4f6ae09f37f54561b1494f9c8822cc8f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.145235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6ae09f37f54561b1494f9c8822cc8f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.147106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.192593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6ae09f37f54561b1494f9c8822cc8f', 'request_id': 'req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:09.198571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6ae09f37f54561b1494f9c8822cc8f', 'request_id': 'req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:09.206128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6ae09f37f54561b1494f9c8822cc8f', 'request_id': 'req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:09.216457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] The token cache is being invalidate because project 4f6ae09f37f54561b1494f9c8822cc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:09.216747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:09.217368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9efeb8fa-09e4-47ec-a700-6aa8546e52cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:09.218839 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4193/8415] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:09 2022] DELETE /identity/v3/projects/4f6ae09f37f54561b1494f9c8822cc8f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:09.223848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72997-c2d2-4929-978d-c4b1538086fc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.224327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72997-c2d2-4929-978d-c4b1538086fc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.224431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72997-c2d2-4929-978d-c4b1538086fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.244166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-cbb72997-c2d2-4929-978d-c4b1538086fc None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:09.245393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cbb72997-c2d2-4929-978d-c4b1538086fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:09.309118 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4223/8416] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:09.317051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e5749-971a-475a-bfe3-40e98cd40c89 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.317534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e5749-971a-475a-bfe3-40e98cd40c89 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.317651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e5749-971a-475a-bfe3-40e98cd40c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.338113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d59e5749-971a-475a-bfe3-40e98cd40c89 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:09.339345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d59e5749-971a-475a-bfe3-40e98cd40c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:09.347887 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4194/8417] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:09.352260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72997-c2d2-4929-978d-c4b1538086fc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.364773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72997-c2d2-4929-978d-c4b1538086fc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.370046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.370694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.370972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.371244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.372739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:09.373046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.374710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.386268 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4224/8418] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:09.391210 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e5749-971a-475a-bfe3-40e98cd40c89 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.400419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e5749-971a-475a-bfe3-40e98cd40c89 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.405420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.406011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.406540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.406809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.407437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.409339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.439358 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4195/8419] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:09 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:09.440565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.451317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63241c7-80d4-437a-b66e-660116441275 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.506548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.507148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.507424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.507694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.508320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.510242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.537750 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4225/8420] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:09 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:47:09.541814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.552914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f410e-2d6e-4ac4-9232-f2cb72c10884 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.557573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.558166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.558443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.558712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.559525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.561166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.570994 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4196/8421] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:09.574904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.584763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a3a9-9731-4c99-82bc-7e89bb156342 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.589812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5bb07-8b89-4ce4-b695-8d3a3bd50746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.591068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bb07-8b89-4ce4-b695-8d3a3bd50746 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.591372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bb07-8b89-4ce4-b695-8d3a3bd50746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.591640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bb07-8b89-4ce4-b695-8d3a3bd50746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.592293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5bb07-8b89-4ce4-b695-8d3a3bd50746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.593948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5bb07-8b89-4ce4-b695-8d3a3bd50746 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.604043 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4226/8422] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:09.608942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.618955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b2451-3bcc-439b-94b9-6a52127eeb9d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.625118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.625821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.626098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.626368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] PATH_INFO: `/v3/projects/0b38e6db48ad48da876f9f7a61f54d75/users/73b9eca0efef4597ba771f79f0b9b2f9/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.642237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b38e6db48ad48da876f9f7a61f54d75, user_id=73b9eca0efef4597ba771f79f0b9b2f9, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.644900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.658864 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4197/8423] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:09 2022] PUT /identity/v3/projects/0b38e6db48ad48da876f9f7a61f54d75/users/73b9eca0efef4597ba771f79f0b9b2f9/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:09.670792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870c4a-fa64-456e-84dd-8835fb31aa8b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.671073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870c4a-fa64-456e-84dd-8835fb31aa8b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.671345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870c4a-fa64-456e-84dd-8835fb31aa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.699004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-00870c4a-fa64-456e-84dd-8835fb31aa8b None None] MFA Rules not processed for user `73b9eca0efef4597ba771f79f0b9b2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:09.700684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-00870c4a-fa64-456e-84dd-8835fb31aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:09.760530 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:09.772362 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4227/8424] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:09.776915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.829261 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:09.841783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63299249-fc5f-4f57-b3ca-fb564be5286f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.846527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.847164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.847425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.847713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.848349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.850255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.877627 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4198/8425] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:09 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:09.881952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00870c4a-fa64-456e-84dd-8835fb31aa8b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.893302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00870c4a-fa64-456e-84dd-8835fb31aa8b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.950625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.951230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.951510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.951783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.952395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.954389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:09.975090 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4228/8426] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:09 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:09.979153 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:09.990624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a070842-246c-418d-a96c-abf6de047190 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:09.995253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:09.995854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:09.996130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:09.996400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:09.998076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:09.999648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:10.010013 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4199/8427] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:10.014486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:10.024334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4c0a-ea57-41fa-9be4-05455e2b3352 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:10.029144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:10.029787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:10.030069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:10.030339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] PATH_INFO: `/v3/projects/dec9f68463ba455597f55b784686d498/users/fcd0a362e2e848928963d3ddd9ad875a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:10.047139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec9f68463ba455597f55b784686d498, user_id=fcd0a362e2e848928963d3ddd9ad875a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:10.049865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:10.063305 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4229/8428] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:10 2022] PUT /identity/v3/projects/dec9f68463ba455597f55b784686d498/users/fcd0a362e2e848928963d3ddd9ad875a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:10.067306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:10.077488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aecfa-33dc-495e-a4a4-92f35f765332 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:10.134643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6921a1-a800-47ff-a0e4-f5bf9771a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:10.135170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6921a1-a800-47ff-a0e4-f5bf9771a579 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:10.135446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6921a1-a800-47ff-a0e4-f5bf9771a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:10.135717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6921a1-a800-47ff-a0e4-f5bf9771a579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:10.136348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6921a1-a800-47ff-a0e4-f5bf9771a579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:10.138547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6921a1-a800-47ff-a0e4-f5bf9771a579 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:10.148096 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4200/8429] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:10.152180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:10.163475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5247aa-cc1c-4019-a199-3e6d2324823e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:10.168071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:10.169784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:10.170091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:10.170360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] PATH_INFO: `/v3/projects/dec9f68463ba455597f55b784686d498/users/fcd0a362e2e848928963d3ddd9ad875a/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:10.172262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec9f68463ba455597f55b784686d498, user_id=fcd0a362e2e848928963d3ddd9ad875a, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:10.174896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:10.185225 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4230/8430] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:10 2022] PUT /identity/v3/projects/dec9f68463ba455597f55b784686d498/users/fcd0a362e2e848928963d3ddd9ad875a/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:10.195462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c449ed-3291-430c-b2d2-1974d248ec9c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:10.195748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c449ed-3291-430c-b2d2-1974d248ec9c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:10.196026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c449ed-3291-430c-b2d2-1974d248ec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:10.224757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-56c449ed-3291-430c-b2d2-1974d248ec9c None None] MFA Rules not processed for user `fcd0a362e2e848928963d3ddd9ad875a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:10.226010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-56c449ed-3291-430c-b2d2-1974d248ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:10.295581 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4201/8431] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:10.307043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:10.308856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:10.368947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8de6a-7af9-4069-8deb-0f8996db6d78 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:10.373036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e28e96-7a3e-4044-876f-2840f418fad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:10.373657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28e96-7a3e-4044-876f-2840f418fad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:10.373936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28e96-7a3e-4044-876f-2840f418fad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:10.374208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28e96-7a3e-4044-876f-2840f418fad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:10.384820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e28e96-7a3e-4044-876f-2840f418fad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:10.386207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e28e96-7a3e-4044-876f-2840f418fad1 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:10.396152 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4231/8432] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:12.393173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c449ed-3291-430c-b2d2-1974d248ec9c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:12.440476 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:12.456694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c449ed-3291-430c-b2d2-1974d248ec9c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:12.461280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:12.461906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:12.462196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:12.462459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] PATH_INFO: `/v3/users/73b9eca0efef4597ba771f79f0b9b2f9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:12.463595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b9eca0efef4597ba771f79f0b9b2f9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:12.465965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:12.513722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b9eca0efef4597ba771f79f0b9b2f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:12.514391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b9eca0efef4597ba771f79f0b9b2f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:12.515009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b9eca0efef4597ba771f79f0b9b2f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:12.522098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b9eca0efef4597ba771f79f0b9b2f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:12.535678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b9eca0efef4597ba771f79f0b9b2f9'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:12.548555 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4202/8433] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:12 2022] DELETE /identity/v3/users/73b9eca0efef4597ba771f79f0b9b2f9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:12.553115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:12.553577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:12.553726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:12.573007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:12.574242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:12.618534 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:12.635314 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4232/8434] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:12.645646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:12.647053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:12.706329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4052e1-1baa-435a-8c5a-0e029ef9d1e7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:12.710032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:12.710662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:12.710938 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:12.711207 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:12.720290 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:12.721733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:12.731155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4203/8435] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:13.002226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.003710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:13.018169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7a83-934d-48a4-95a6-18f03cc0f5f3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.023964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.024521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.024866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.025010 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] PATH_INFO: `/v3/projects/0b38e6db48ad48da876f9f7a61f54d75` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.026235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b38e6db48ad48da876f9f7a61f54d75)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.028512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.074629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b38e6db48ad48da876f9f7a61f54d75', 'request_id': 'req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.080160 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b38e6db48ad48da876f9f7a61f54d75', 'request_id': 'req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.086173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b38e6db48ad48da876f9f7a61f54d75', 'request_id': 'req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.098076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] The token cache is being invalidate because project 0b38e6db48ad48da876f9f7a61f54d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:13.098360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.099252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.100704 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4233/8436] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:13 2022] DELETE /identity/v3/projects/0b38e6db48ad48da876f9f7a61f54d75 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:13.104855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.114991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4847d-f8c7-4cbc-be27-abd3379dd4b4 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.170748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.171380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.171656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.171924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] PATH_INFO: `/v3/users/fcd0a362e2e848928963d3ddd9ad875a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.173039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd0a362e2e848928963d3ddd9ad875a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.174948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.185631 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:13.222543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd0a362e2e848928963d3ddd9ad875a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.223187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd0a362e2e848928963d3ddd9ad875a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.223786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd0a362e2e848928963d3ddd9ad875a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.230576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd0a362e2e848928963d3ddd9ad875a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.242138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d8cce53e-648b-4e6a-a49a-c537597004ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd0a362e2e848928963d3ddd9ad875a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.256573 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4204/8437] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:13 2022] DELETE /identity/v3/users/fcd0a362e2e848928963d3ddd9ad875a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:13.431434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.432882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:13.452298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00664e0-e6ad-4626-bbf4-1a3fc78e03b2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.508809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.509390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.509664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.509932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] PATH_INFO: `/v3/projects/dec9f68463ba455597f55b784686d498` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.511052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec9f68463ba455597f55b784686d498)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.513154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.558230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec9f68463ba455597f55b784686d498', 'request_id': 'req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.564153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec9f68463ba455597f55b784686d498', 'request_id': 'req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.570411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec9f68463ba455597f55b784686d498', 'request_id': 'req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.582639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] The token cache is being invalidate because project dec9f68463ba455597f55b784686d498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:13.582919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.583528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-be88bbcb-40ed-430b-bfd7-33e4dd41fb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:13.584990 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4234/8438] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:13 2022] DELETE /identity/v3/projects/dec9f68463ba455597f55b784686d498 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:13.589848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f6511-370a-4f8d-b204-002f099e4b45 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.590400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f6511-370a-4f8d-b204-002f099e4b45 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.590511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f6511-370a-4f8d-b204-002f099e4b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.611649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7d7f6511-370a-4f8d-b204-002f099e4b45 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:13.612852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7d7f6511-370a-4f8d-b204-002f099e4b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:13.678801 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4205/8439] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:13.687419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbf99-d9b7-43f0-8c82-3619029f4d8d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.687705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbf99-d9b7-43f0-8c82-3619029f4d8d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.687979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbf99-d9b7-43f0-8c82-3619029f4d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.695592 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:13.710345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-401cbf99-d9b7-43f0-8c82-3619029f4d8d None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:13.711552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-401cbf99-d9b7-43f0-8c82-3619029f4d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:13.720314 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4235/8440] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:13.725379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f6511-370a-4f8d-b204-002f099e4b45 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.735493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f6511-370a-4f8d-b204-002f099e4b45 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.740402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.741002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.741313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.741653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.742229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:13.742531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.744135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.755826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4206/8441] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:47:13.760327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbf99-d9b7-43f0-8c82-3619029f4d8d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.770202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbf99-d9b7-43f0-8c82-3619029f4d8d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.775044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.775638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.775937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.776236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.776889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.779559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.805949 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4236/8442] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:13 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:13.810343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.820444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c529da1-7dca-451b-8be8-15e61ce4112e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.880183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.880783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.881145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.881360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.882027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.883911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.904665 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4207/8443] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:13 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:13.909276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.920661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0662fc-9d7e-45e7-841b-4f4e3d5301a5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.925367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.925964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.926245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.926517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.927150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.928721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.938585 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4237/8444] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:13.942607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.948893 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:13.952999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36353af-baa0-464b-a27a-a6f745b57abb admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.959196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa314f-5640-47bc-8680-6bbab08b95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.959963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa314f-5640-47bc-8680-6bbab08b95d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.960397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa314f-5640-47bc-8680-6bbab08b95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.960725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa314f-5640-47bc-8680-6bbab08b95d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:13.961550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa314f-5640-47bc-8680-6bbab08b95d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:13.963116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa314f-5640-47bc-8680-6bbab08b95d9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:13.974501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4208/8445] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:13.979062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:13.989714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ded0d9-3b12-4fd2-a3a4-a79d25da6193 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:13.994440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:13.995078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:13.995354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:13.995622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] PATH_INFO: `/v3/projects/650daad8c7da4cba88481bdd9dbf233a/users/45371ff6deab48a184f64f2622cb3ab6/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:14.010786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=650daad8c7da4cba88481bdd9dbf233a, user_id=45371ff6deab48a184f64f2622cb3ab6, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:14.013590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:14.026199 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4238/8446] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:13 2022] PUT /identity/v3/projects/650daad8c7da4cba88481bdd9dbf233a/users/45371ff6deab48a184f64f2622cb3ab6/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:14.037959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a98a8-f7a8-43d8-bc07-7d20f42cce0c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:14.038241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a98a8-f7a8-43d8-bc07-7d20f42cce0c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:14.038522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a98a8-f7a8-43d8-bc07-7d20f42cce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:14.066123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5e3a98a8-f7a8-43d8-bc07-7d20f42cce0c None None] MFA Rules not processed for user `45371ff6deab48a184f64f2622cb3ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:14.067318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5e3a98a8-f7a8-43d8-bc07-7d20f42cce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:14.131484 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4209/8447] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:14.142308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:14.144052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:14.204870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704b341-45c0-44a6-b8b2-345bcc5226cb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:14.208653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a7cc4-8cd1-4dfa-a07d-3d6e8ce7dc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:14.209291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7cc4-8cd1-4dfa-a07d-3d6e8ce7dc25 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:14.209567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7cc4-8cd1-4dfa-a07d-3d6e8ce7dc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:14.209833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7cc4-8cd1-4dfa-a07d-3d6e8ce7dc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:14.218375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a7cc4-8cd1-4dfa-a07d-3d6e8ce7dc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:14.219792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a7cc4-8cd1-4dfa-a07d-3d6e8ce7dc25 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:14.228551 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4239/8448] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:14.751114 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a98a8-f7a8-43d8-bc07-7d20f42cce0c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:14.814248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a98a8-f7a8-43d8-bc07-7d20f42cce0c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:14.818785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:14.819435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:14.819712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:14.819982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] PATH_INFO: `/v3/users/45371ff6deab48a184f64f2622cb3ab6` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:14.821137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45371ff6deab48a184f64f2622cb3ab6)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:14.823060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:14.868150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45371ff6deab48a184f64f2622cb3ab6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:14.868822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45371ff6deab48a184f64f2622cb3ab6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:14.869456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45371ff6deab48a184f64f2622cb3ab6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:14.876429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45371ff6deab48a184f64f2622cb3ab6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:14.888296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45371ff6deab48a184f64f2622cb3ab6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:14.901479 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4210/8449] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:14 2022] DELETE /identity/v3/users/45371ff6deab48a184f64f2622cb3ab6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:14.906796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:14.907395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:14.907395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:14.928128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:14.929360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:14.986472 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4240/8450] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:14.996878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:14.998307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:15.003675 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:15.060234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8061e2-8c67-4e7b-9aaa-d636c4029be4 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.063877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877265-a379-4a37-81af-ffc777b45a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.064563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877265-a379-4a37-81af-ffc777b45a11 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.064795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877265-a379-4a37-81af-ffc777b45a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.065077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877265-a379-4a37-81af-ffc777b45a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.074078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d877265-a379-4a37-81af-ffc777b45a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.076010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d877265-a379-4a37-81af-ffc777b45a11 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.085430 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4211/8451] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:15.350997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:15.352421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:15.367095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2172adc-c5c4-414d-b813-77c5b6219220 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.373479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.374082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.374423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.374693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] PATH_INFO: `/v3/projects/650daad8c7da4cba88481bdd9dbf233a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.375744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650daad8c7da4cba88481bdd9dbf233a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.377708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.416504 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:15.426416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650daad8c7da4cba88481bdd9dbf233a', 'request_id': 'req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:15.431924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650daad8c7da4cba88481bdd9dbf233a', 'request_id': 'req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:15.438731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650daad8c7da4cba88481bdd9dbf233a', 'request_id': 'req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:15.452002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] The token cache is being invalidate because project 650daad8c7da4cba88481bdd9dbf233a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:15.452305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:15.453026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b1c8e249-c985-46d0-b3d1-a5fb9f6362e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:15.454513 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4241/8452] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:15 2022] DELETE /identity/v3/projects/650daad8c7da4cba88481bdd9dbf233a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:15.459355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee86d-29e5-4ae7-afac-01cb31ee46f4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.459643 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee86d-29e5-4ae7-afac-01cb31ee46f4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.459918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee86d-29e5-4ae7-afac-01cb31ee46f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.479781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f14ee86d-29e5-4ae7-afac-01cb31ee46f4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:15.480993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f14ee86d-29e5-4ae7-afac-01cb31ee46f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:15.541264 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4212/8453] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:15.549215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3896-8ad6-4fbe-bbfd-347807fe18c2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.549499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3896-8ad6-4fbe-bbfd-347807fe18c2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.549773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3896-8ad6-4fbe-bbfd-347807fe18c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.573012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9d6d3896-8ad6-4fbe-bbfd-347807fe18c2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:15.574240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d6d3896-8ad6-4fbe-bbfd-347807fe18c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:15.583009 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4242/8454] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:15.587246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ee86d-29e5-4ae7-afac-01cb31ee46f4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:15.597434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ee86d-29e5-4ae7-afac-01cb31ee46f4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.602274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.602878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.603161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.603435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.604081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:15.604416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.606037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.617629 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4213/8455] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 01:47:15.622409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3896-8ad6-4fbe-bbfd-347807fe18c2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:15.631904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3896-8ad6-4fbe-bbfd-347807fe18c2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.636511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.637164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.637979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.638279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.638900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.640751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.667238 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4243/8456] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:15.672002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:15.682118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfadc81-1694-462a-8694-8144312d1efc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.745043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.745683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.745966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.746238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.747530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.749503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.771736 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4214/8457] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:15 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:15.775977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:15.786897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470f741-c52d-4649-9129-4f09097240ab admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.791525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.792121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.792401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.792711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.793915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.795541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.807591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4244/8458] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:15.810891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:15.821157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc46057-c329-42ff-978b-ef895ff196de admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.826243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5820cd-8778-4e12-a462-2786e07183a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.826838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5820cd-8778-4e12-a462-2786e07183a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.827116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5820cd-8778-4e12-a462-2786e07183a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.827387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5820cd-8778-4e12-a462-2786e07183a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.828028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5820cd-8778-4e12-a462-2786e07183a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.829636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5820cd-8778-4e12-a462-2786e07183a1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.841160 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4215/8459] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:15.844818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:15.855147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339859ae-707e-4568-830a-cc6069d4e5ab admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:15.860353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:15.860991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.861299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.861567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] PATH_INFO: `/v3/projects/4a7885f442bb4fb492a3a63c11cd776c/users/b8f6870b2ac44ae9bbeea026b0063084/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.876706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7885f442bb4fb492a3a63c11cd776c, user_id=b8f6870b2ac44ae9bbeea026b0063084, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:15.879561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:15.893360 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4245/8460] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:15 2022] PUT /identity/v3/projects/4a7885f442bb4fb492a3a63c11cd776c/users/b8f6870b2ac44ae9bbeea026b0063084/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:15.905250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb2bf-a3b4-488e-8708-7dbe0a6e1f21 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:15.905560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb2bf-a3b4-488e-8708-7dbe0a6e1f21 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:15.905832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb2bf-a3b4-488e-8708-7dbe0a6e1f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:15.927079 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:15.936448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f8fbb2bf-a3b4-488e-8708-7dbe0a6e1f21 None None] MFA Rules not processed for user `b8f6870b2ac44ae9bbeea026b0063084`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:15.937699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f8fbb2bf-a3b4-488e-8708-7dbe0a6e1f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:16.002685 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4216/8461] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:16.012866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:16.014495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:16.073993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0d46b-01a2-4bd7-a13d-f02ec73607fd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:16.077807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf970c-07a0-4563-836c-7c561349369f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:16.078396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf970c-07a0-4563-836c-7c561349369f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:16.078669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf970c-07a0-4563-836c-7c561349369f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:16.078934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf970c-07a0-4563-836c-7c561349369f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:16.087049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf970c-07a0-4563-836c-7c561349369f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:16.088453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf970c-07a0-4563-836c-7c561349369f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:16.097148 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4246/8462] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:20.753702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb2bf-a3b4-488e-8708-7dbe0a6e1f21 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:20.817839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbb2bf-a3b4-488e-8708-7dbe0a6e1f21 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:20.822404 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:20.823031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:20.823312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:20.823585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] PATH_INFO: `/v3/users/b8f6870b2ac44ae9bbeea026b0063084` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:20.824742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f6870b2ac44ae9bbeea026b0063084)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:20.826697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:20.873157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f6870b2ac44ae9bbeea026b0063084'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:20.873749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f6870b2ac44ae9bbeea026b0063084'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:20.874367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f6870b2ac44ae9bbeea026b0063084'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:20.881373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f6870b2ac44ae9bbeea026b0063084'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:20.893932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f6870b2ac44ae9bbeea026b0063084'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:20.908173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4217/8463] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:20 2022] DELETE /identity/v3/users/b8f6870b2ac44ae9bbeea026b0063084 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:20.912686 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:20.913198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:20.913302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:20.934891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:20.936090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:20.995207 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4247/8464] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:21.006175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.007588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:21.030908 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:21.071895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed7485-7575-430b-b816-5e3b434a0da6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.075983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9391a-e9d7-4386-984a-425842bf29cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.076581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9391a-e9d7-4386-984a-425842bf29cd service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.076862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9391a-e9d7-4386-984a-425842bf29cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.077173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9391a-e9d7-4386-984a-425842bf29cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.086151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9391a-e9d7-4386-984a-425842bf29cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.087561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9391a-e9d7-4386-984a-425842bf29cd service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.097777 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4218/8465] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:21.275126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.276767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:21.285747 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:21.289834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591314e2-79cb-4434-afc6-a99da634ae01 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.296520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.297276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.297800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.298388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] PATH_INFO: `/v3/projects/4a7885f442bb4fb492a3a63c11cd776c` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.299704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7885f442bb4fb492a3a63c11cd776c)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.301725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.349698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7885f442bb4fb492a3a63c11cd776c', 'request_id': 'req-8263be05-1efc-4ee1-8868-2f28e9ff5403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:21.355367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7885f442bb4fb492a3a63c11cd776c', 'request_id': 'req-8263be05-1efc-4ee1-8868-2f28e9ff5403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:21.362225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7885f442bb4fb492a3a63c11cd776c', 'request_id': 'req-8263be05-1efc-4ee1-8868-2f28e9ff5403'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:21.374928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] The token cache is being invalidate because project 4a7885f442bb4fb492a3a63c11cd776c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:21.375244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:21.375899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8263be05-1efc-4ee1-8868-2f28e9ff5403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:21.385255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4248/8466] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:21 2022] DELETE /identity/v3/projects/4a7885f442bb4fb492a3a63c11cd776c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:21.387011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5e65-dcc7-4702-8038-ac79f228fee9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.387500 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5e65-dcc7-4702-8038-ac79f228fee9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.387773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5e65-dcc7-4702-8038-ac79f228fee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.407832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ee4c5e65-dcc7-4702-8038-ac79f228fee9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:21.409015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ee4c5e65-dcc7-4702-8038-ac79f228fee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:21.467861 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4219/8467] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:21.475488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8358e0-23d7-4035-91ba-a72adecd02c8 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.475768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8358e0-23d7-4035-91ba-a72adecd02c8 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.476037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8358e0-23d7-4035-91ba-a72adecd02c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.495267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4e8358e0-23d7-4035-91ba-a72adecd02c8 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:21.496970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4e8358e0-23d7-4035-91ba-a72adecd02c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:21.504768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4249/8468] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:21.508847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5e65-dcc7-4702-8038-ac79f228fee9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.521911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5e65-dcc7-4702-8038-ac79f228fee9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.526580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.527185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.527465 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.527779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.529012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:21.529353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.530941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.543082 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4220/8469] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:21.548251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8358e0-23d7-4035-91ba-a72adecd02c8 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.557708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8358e0-23d7-4035-91ba-a72adecd02c8 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.563306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.563905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.564183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.564454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.565127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.567015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.594239 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4250/8470] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:21 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:21.598411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.609595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259926a-f394-4245-a9ae-7ca8052744ab admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.673003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.673645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.673924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.674192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.674827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.676726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.698753 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4221/8471] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:21 2022] POST /identity/v3/users => generated 280 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:21.703986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.714112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0ee45-a488-4063-859e-869c2e9e5ea2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.719172 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.719756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.720058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.720326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.720953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.722552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.732354 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4251/8472] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:21.736243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.746084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea633643-4f3a-4eab-9981-68a68622a61d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.751704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10e65e-6914-4776-93c2-c8244fd9a569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.752289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e65e-6914-4776-93c2-c8244fd9a569 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.752567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e65e-6914-4776-93c2-c8244fd9a569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.752839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e65e-6914-4776-93c2-c8244fd9a569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.753597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10e65e-6914-4776-93c2-c8244fd9a569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.755165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10e65e-6914-4776-93c2-c8244fd9a569 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.767567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4222/8473] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:21.771507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.781558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e9316-556d-4e3c-869c-d530d2036974 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:21.786740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:21.787377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.787652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.787920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] PATH_INFO: `/v3/projects/5101e1b74bca4adabd06d80ed6c1354a/users/f215b8042ed14097a38657f9d2e9c329/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.804774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5101e1b74bca4adabd06d80ed6c1354a, user_id=f215b8042ed14097a38657f9d2e9c329, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:21.807423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:21.821901 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4252/8474] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:21 2022] PUT /identity/v3/projects/5101e1b74bca4adabd06d80ed6c1354a/users/f215b8042ed14097a38657f9d2e9c329/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:21.832520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4d0c-cb73-48d3-b077-5cce24deb90e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:21.832793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4d0c-cb73-48d3-b077-5cce24deb90e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:21.833097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4d0c-cb73-48d3-b077-5cce24deb90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:21.860811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-887c4d0c-cb73-48d3-b077-5cce24deb90e None None] MFA Rules not processed for user `f215b8042ed14097a38657f9d2e9c329`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:21.862007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-887c4d0c-cb73-48d3-b077-5cce24deb90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:21.879193 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:21.928120 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4223/8475] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:21.939202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:21.940982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:21.998546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de6fb-9105-48aa-a073-c59d43b9575b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:22.002171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:22.002762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:22.003035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:22.003300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:22.011620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:22.013014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:22.022301 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4253/8476] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:26.070705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4d0c-cb73-48d3-b077-5cce24deb90e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:26.083452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4d0c-cb73-48d3-b077-5cce24deb90e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:26.087084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:26.087683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:26.087961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:26.088245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:26.089973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:26.103930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:26.105667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:26.118261 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4224/8477] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:26.315459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:26.330584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e8e29-8108-484d-b79e-fee023105a02 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:26.333025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:26.333842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:26.334124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:26.334578 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:26.336655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:26.350444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:26.352151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:26.367350 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4254/8478] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:47:26.689190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:26.701973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a6177-2273-4722-9e12-e4a065f962e8 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:26.706001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d6043-2ecc-4a1f-b911-89b7f1e321ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:26.706594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6043-2ecc-4a1f-b911-89b7f1e321ea service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:26.706868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6043-2ecc-4a1f-b911-89b7f1e321ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:26.707136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6043-2ecc-4a1f-b911-89b7f1e321ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:26.709545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2a0d6043-2ecc-4a1f-b911-89b7f1e321ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:26.791738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d6043-2ecc-4a1f-b911-89b7f1e321ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:26.793216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d6043-2ecc-4a1f-b911-89b7f1e321ea service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:26.823415 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4225/8479] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:29.465749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:29.480251 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:29.540751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aabd2-9e29-4bf7-b142-af95af8cc6b8 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:29.548525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:29.549640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:29.550068 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:29.550524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] PATH_INFO: `/v3/users/f215b8042ed14097a38657f9d2e9c329` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:29.551769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f215b8042ed14097a38657f9d2e9c329)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:29.553729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:29.605463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f215b8042ed14097a38657f9d2e9c329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:29.606125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f215b8042ed14097a38657f9d2e9c329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:29.606737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f215b8042ed14097a38657f9d2e9c329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:29.619231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f215b8042ed14097a38657f9d2e9c329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:29.626918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f215b8042ed14097a38657f9d2e9c329'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:29.640083 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4255/8480] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:29 2022] DELETE /identity/v3/users/f215b8042ed14097a38657f9d2e9c329 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:29.644618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:29.645104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:29.645232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:29.664797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:29.665948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:29.727403 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4226/8481] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:29.737744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:29.739125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:29.797778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a02556-94b3-405a-b83d-206da65d617d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:29.801454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf3a4b-8375-4d11-9725-dc4329dd0e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:29.802045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3a4b-8375-4d11-9725-dc4329dd0e5a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:29.802343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3a4b-8375-4d11-9725-dc4329dd0e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:29.802609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf3a4b-8375-4d11-9725-dc4329dd0e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:29.812946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf3a4b-8375-4d11-9725-dc4329dd0e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:29.814402 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf3a4b-8375-4d11-9725-dc4329dd0e5a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:29.824012 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4256/8482] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:30.032890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.034379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:30.046358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7337b-f53e-4ba0-80f6-1f8bef23b183 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.051017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.058323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.058629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.061420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] PATH_INFO: `/v3/projects/5101e1b74bca4adabd06d80ed6c1354a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.062891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5101e1b74bca4adabd06d80ed6c1354a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.064813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.084737 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:30.118738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5101e1b74bca4adabd06d80ed6c1354a', 'request_id': 'req-f349991e-dba5-4609-8df0-ecb6e844881a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:30.126432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5101e1b74bca4adabd06d80ed6c1354a', 'request_id': 'req-f349991e-dba5-4609-8df0-ecb6e844881a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:30.134261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5101e1b74bca4adabd06d80ed6c1354a', 'request_id': 'req-f349991e-dba5-4609-8df0-ecb6e844881a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:30.145727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] The token cache is being invalidate because project 5101e1b74bca4adabd06d80ed6c1354a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:30.146008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:30.146620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-f349991e-dba5-4609-8df0-ecb6e844881a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:30.148088 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4227/8483] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:30 2022] DELETE /identity/v3/projects/5101e1b74bca4adabd06d80ed6c1354a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:30.152890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a69f08-4d2e-4891-a900-aea8d62754e5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.153267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a69f08-4d2e-4891-a900-aea8d62754e5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.153572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a69f08-4d2e-4891-a900-aea8d62754e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.174638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-47a69f08-4d2e-4891-a900-aea8d62754e5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:30.175756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-47a69f08-4d2e-4891-a900-aea8d62754e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:30.205605 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:30.236444 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4257/8484] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:30.245201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2790bc-9ddd-495b-86a6-ed8781840473 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.245486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2790bc-9ddd-495b-86a6-ed8781840473 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.245796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2790bc-9ddd-495b-86a6-ed8781840473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.266463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4b2790bc-9ddd-495b-86a6-ed8781840473 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:30.267662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4b2790bc-9ddd-495b-86a6-ed8781840473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:30.275505 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4228/8485] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:30.280235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a69f08-4d2e-4891-a900-aea8d62754e5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.290343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a69f08-4d2e-4891-a900-aea8d62754e5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.295252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.295851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.296130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.296413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.297036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:30.297398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.298982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.310590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4258/8486] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:30.314925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2790bc-9ddd-495b-86a6-ed8781840473 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.324471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2790bc-9ddd-495b-86a6-ed8781840473 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.330026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.330611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.330880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.331145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.331771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.333668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.360941 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4229/8487] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:30 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:47:30.365136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.375777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf836d2-c610-42db-bf8d-82fd1b62eb8d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.431565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea961-4485-489d-a345-26853556436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.432092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea961-4485-489d-a345-26853556436c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.432372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea961-4485-489d-a345-26853556436c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.432642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea961-4485-489d-a345-26853556436c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.433307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fea961-4485-489d-a345-26853556436c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.436170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fea961-4485-489d-a345-26853556436c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.458087 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4259/8488] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:30 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:30.461988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.472292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adbd84-c686-4382-b762-d26cbecaef1c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.476891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.477506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.477779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.478044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.478670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.480614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.490472 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4230/8489] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:30.494159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea961-4485-489d-a345-26853556436c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.504956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea961-4485-489d-a345-26853556436c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.509574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08776805-77e8-4f91-b9a2-b3a147814c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.510166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08776805-77e8-4f91-b9a2-b3a147814c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.510444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08776805-77e8-4f91-b9a2-b3a147814c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.510737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08776805-77e8-4f91-b9a2-b3a147814c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.511373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08776805-77e8-4f91-b9a2-b3a147814c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.512976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08776805-77e8-4f91-b9a2-b3a147814c44 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.524897 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4260/8490] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:30.529487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.539850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0a50-67cf-465b-8f4a-351c7d2fae50 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.544618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.545263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.545541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.545811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] PATH_INFO: `/v3/projects/5d659d3935b744adb78e489e841654c0/users/52d4bc8cb7204048bf1beb9a821afec8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.560450 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d659d3935b744adb78e489e841654c0, user_id=52d4bc8cb7204048bf1beb9a821afec8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.563249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.576701 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4231/8491] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:30 2022] PUT /identity/v3/projects/5d659d3935b744adb78e489e841654c0/users/52d4bc8cb7204048bf1beb9a821afec8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:30.587203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5945-ae31-4b6b-a0c0-7ba08aae7a8e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.587484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5945-ae31-4b6b-a0c0-7ba08aae7a8e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.587755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5945-ae31-4b6b-a0c0-7ba08aae7a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.615546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-231e5945-ae31-4b6b-a0c0-7ba08aae7a8e None None] MFA Rules not processed for user `52d4bc8cb7204048bf1beb9a821afec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:30.616737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-231e5945-ae31-4b6b-a0c0-7ba08aae7a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:30.679916 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4261/8492] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:30.690944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:30.692683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:30.752742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69add59-17e0-472e-8446-bfea3eb38d2b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:30.756603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d995f0-c92e-4e03-8c7c-85af85a7f722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:30.757238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d995f0-c92e-4e03-8c7c-85af85a7f722 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:30.757516 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d995f0-c92e-4e03-8c7c-85af85a7f722 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:30.757783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d995f0-c92e-4e03-8c7c-85af85a7f722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:30.766274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d995f0-c92e-4e03-8c7c-85af85a7f722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:30.767663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d995f0-c92e-4e03-8c7c-85af85a7f722 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:30.776408 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4232/8493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:34.660582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5945-ae31-4b6b-a0c0-7ba08aae7a8e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:34.694976 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:34.728054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5945-ae31-4b6b-a0c0-7ba08aae7a8e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:34.732917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:34.733577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:34.733860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:34.734137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] PATH_INFO: `/v3/users/52d4bc8cb7204048bf1beb9a821afec8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:34.735275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d4bc8cb7204048bf1beb9a821afec8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:34.737219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:34.787156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d4bc8cb7204048bf1beb9a821afec8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:34.787869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d4bc8cb7204048bf1beb9a821afec8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:34.788596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d4bc8cb7204048bf1beb9a821afec8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:34.801001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d4bc8cb7204048bf1beb9a821afec8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:34.807772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d4bc8cb7204048bf1beb9a821afec8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:34.821925 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4262/8494] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:34 2022] DELETE /identity/v3/users/52d4bc8cb7204048bf1beb9a821afec8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:34.826811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:34.827317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:34.827430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:34.848981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:34.850144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:34.891783 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:34.912414 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4233/8495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:34.922894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:34.924300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:34.987155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82082f1-9e62-4cba-a9ad-4b1d1644a363 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:34.990897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe717f-92b7-478e-8500-839d73a44b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:34.991536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe717f-92b7-478e-8500-839d73a44b57 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:34.991809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe717f-92b7-478e-8500-839d73a44b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:34.992076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe717f-92b7-478e-8500-839d73a44b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.002201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe717f-92b7-478e-8500-839d73a44b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.003637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe717f-92b7-478e-8500-839d73a44b57 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.014518 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4263/8496] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:35.189957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.191595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:35.206300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0deb08-a20d-489c-8a96-c31301010b5e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.212146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.212146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.212146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.212678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] PATH_INFO: `/v3/projects/5d659d3935b744adb78e489e841654c0` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.213998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d659d3935b744adb78e489e841654c0)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.217158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.271025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d659d3935b744adb78e489e841654c0', 'request_id': 'req-37de96b2-ed46-4d59-833b-227bdf2ecaf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:35.277051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d659d3935b744adb78e489e841654c0', 'request_id': 'req-37de96b2-ed46-4d59-833b-227bdf2ecaf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:35.285222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d659d3935b744adb78e489e841654c0', 'request_id': 'req-37de96b2-ed46-4d59-833b-227bdf2ecaf0'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:35.295241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] The token cache is being invalidate because project 5d659d3935b744adb78e489e841654c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:35.295525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:35.296133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-37de96b2-ed46-4d59-833b-227bdf2ecaf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:35.297642 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4234/8497] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:35 2022] DELETE /identity/v3/projects/5d659d3935b744adb78e489e841654c0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:35.302573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ffb2-525d-4ba5-87b6-c1a75a1ea8fb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.302855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ffb2-525d-4ba5-87b6-c1a75a1ea8fb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.303122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681ffb2-525d-4ba5-87b6-c1a75a1ea8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.322494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9681ffb2-525d-4ba5-87b6-c1a75a1ea8fb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:35.323694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9681ffb2-525d-4ba5-87b6-c1a75a1ea8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:35.370408 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:35.383586 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4264/8498] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:35.392897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bfd86-9996-4e27-838e-55994a6cc5b6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.393212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bfd86-9996-4e27-838e-55994a6cc5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.393484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bfd86-9996-4e27-838e-55994a6cc5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.414009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-654bfd86-9996-4e27-838e-55994a6cc5b6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:35.415216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-654bfd86-9996-4e27-838e-55994a6cc5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:35.423098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4235/8499] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:35.427296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ffb2-525d-4ba5-87b6-c1a75a1ea8fb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.437354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681ffb2-525d-4ba5-87b6-c1a75a1ea8fb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.441920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.442512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.442788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.443055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.443691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:35.443991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.445600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.457540 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4265/8500] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:35.461694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bfd86-9996-4e27-838e-55994a6cc5b6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.471436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bfd86-9996-4e27-838e-55994a6cc5b6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.475995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.476578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.476851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.477156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.477805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.479666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.505920 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4236/8501] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:35 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:35.510015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.521514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a53526-1795-47a9-b30c-1aa0740c4e7c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.579572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.580176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.580456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.580728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.581387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.583322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.605344 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4266/8502] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:35 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:35.609542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.619861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60647938-df8a-42c2-a913-0d732bf7689d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.625120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.625666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.625945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.626216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.626852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.628420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.640195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4237/8503] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:35.642827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.652786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00602-47ec-4d44-a435-dfce89c58efa admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.657749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1794f-7edc-4b94-8d40-0f5d5643ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.658346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1794f-7edc-4b94-8d40-0f5d5643ba04 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.658625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1794f-7edc-4b94-8d40-0f5d5643ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.658900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1794f-7edc-4b94-8d40-0f5d5643ba04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.659528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1794f-7edc-4b94-8d40-0f5d5643ba04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.661162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1794f-7edc-4b94-8d40-0f5d5643ba04 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.671565 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4267/8504] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:35.675548 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.686253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad16c0-92df-4cf1-8d46-4bb2917f99c1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.690832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.691469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.691744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.692011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] PATH_INFO: `/v3/projects/95c748d8055740ca9a8ba1a7f5476457/users/1e9375d54987464bab1341ff39f7b450/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.707279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c748d8055740ca9a8ba1a7f5476457, user_id=1e9375d54987464bab1341ff39f7b450, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.709921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.722802 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4238/8505] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:35 2022] PUT /identity/v3/projects/95c748d8055740ca9a8ba1a7f5476457/users/1e9375d54987464bab1341ff39f7b450/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:35.733599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b404d-e6c4-4580-9fee-31c6bfd8edd3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.733884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b404d-e6c4-4580-9fee-31c6bfd8edd3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.734153 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b404d-e6c4-4580-9fee-31c6bfd8edd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.762804 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4f8b404d-e6c4-4580-9fee-31c6bfd8edd3 None None] MFA Rules not processed for user `1e9375d54987464bab1341ff39f7b450`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:35.765271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4f8b404d-e6c4-4580-9fee-31c6bfd8edd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:35.830214 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4268/8506] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:35.840675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.842527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:35.902533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16a25c-0899-43f7-a357-4ac7dcd3fe65 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:35.906419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d494b-5ddb-45b6-935b-d35a848fdbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:35.907269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d494b-5ddb-45b6-935b-d35a848fdbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:35.907545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d494b-5ddb-45b6-935b-d35a848fdbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:35.907808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d494b-5ddb-45b6-935b-d35a848fdbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:35.916048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d494b-5ddb-45b6-935b-d35a848fdbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:35.917492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d494b-5ddb-45b6-935b-d35a848fdbc5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:35.926417 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4239/8507] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:35.939384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b404d-e6c4-4580-9fee-31c6bfd8edd3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:35.988411 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:36.003842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b404d-e6c4-4580-9fee-31c6bfd8edd3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:36.008407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:36.009028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.009331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.009600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] PATH_INFO: `/v3/users/1e9375d54987464bab1341ff39f7b450` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.010711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9375d54987464bab1341ff39f7b450)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:36.012605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:36.058092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9375d54987464bab1341ff39f7b450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.058743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9375d54987464bab1341ff39f7b450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.059351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9375d54987464bab1341ff39f7b450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.071983 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9375d54987464bab1341ff39f7b450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.079091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9375d54987464bab1341ff39f7b450'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.091509 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4269/8508] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:35 2022] DELETE /identity/v3/users/1e9375d54987464bab1341ff39f7b450 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:36.095987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.096343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.096691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.110216 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:36.116787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:36.118608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:36.176778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4240/8509] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:36.186776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:36.188164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:36.248518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026650e-df60-4c54-9c74-e64f5faaad2e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:36.252051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59412-0098-4bd2-bf7d-8f7d1c318243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:36.252665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59412-0098-4bd2-bf7d-8f7d1c318243 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.252946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59412-0098-4bd2-bf7d-8f7d1c318243 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.253321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59412-0098-4bd2-bf7d-8f7d1c318243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.263777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe59412-0098-4bd2-bf7d-8f7d1c318243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:36.265143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe59412-0098-4bd2-bf7d-8f7d1c318243 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:36.275390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4270/8510] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:36.554599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:36.556059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:36.569722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa474e05-28bc-477f-ae68-8ecf8957868a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:36.574722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:36.575351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.576300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.577156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] PATH_INFO: `/v3/projects/95c748d8055740ca9a8ba1a7f5476457` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.578451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c748d8055740ca9a8ba1a7f5476457)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:36.580292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:36.626860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c748d8055740ca9a8ba1a7f5476457', 'request_id': 'req-c7f70f4b-94e6-4597-a236-8dbd85c91428'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.632880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c748d8055740ca9a8ba1a7f5476457', 'request_id': 'req-c7f70f4b-94e6-4597-a236-8dbd85c91428'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.640972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c748d8055740ca9a8ba1a7f5476457', 'request_id': 'req-c7f70f4b-94e6-4597-a236-8dbd85c91428'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.651205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] The token cache is being invalidate because project 95c748d8055740ca9a8ba1a7f5476457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:36.651488 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.652113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c7f70f4b-94e6-4597-a236-8dbd85c91428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:36.653711 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4241/8511] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:36 2022] DELETE /identity/v3/projects/95c748d8055740ca9a8ba1a7f5476457 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:36.658926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ad90-fd79-40ff-aaf9-cfd9a409348a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.659217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ad90-fd79-40ff-aaf9-cfd9a409348a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.659496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085ad90-fd79-40ff-aaf9-cfd9a409348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.679263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8085ad90-fd79-40ff-aaf9-cfd9a409348a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:36.680390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8085ad90-fd79-40ff-aaf9-cfd9a409348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:36.740671 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4271/8512] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:36.749147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761fdb-913d-477c-805b-8043268930d9 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.749487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761fdb-913d-477c-805b-8043268930d9 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.749768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761fdb-913d-477c-805b-8043268930d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.769451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-41761fdb-913d-477c-805b-8043268930d9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:36.770662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-41761fdb-913d-477c-805b-8043268930d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:36.778618 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4242/8513] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:36.783060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ad90-fd79-40ff-aaf9-cfd9a409348a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:36.792601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085ad90-fd79-40ff-aaf9-cfd9a409348a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:36.797805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:36.798420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.798693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.798960 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.799596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:36.799893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:36.801496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:36.807969 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:36.815557 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4272/8514] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:36.819861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761fdb-913d-477c-805b-8043268930d9 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:36.829374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761fdb-913d-477c-805b-8043268930d9 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:36.834140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:36.834737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.835015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.835287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.835943 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:36.837877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:36.864586 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4243/8515] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:36 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:36.868730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:36.879508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be0289-962c-47c9-9c85-438ab26e42cc admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:36.934727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:36.935795 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.936075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.936342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.936994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:36.938928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:36.959613 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4273/8516] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:36 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:36.963714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:36.974172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4077-70f4-48ab-85ce-66b174f9da0d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:36.978941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:36.979543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:36.979855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:36.980135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:36.980776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:36.983014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:36.992880 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4244/8517] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:36.996674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:37.007221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47560b01-5b7e-487c-8879-a72a9a8fb3ab admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:37.011729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88b252-2be4-4d04-8e6c-93cecb85088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:37.012309 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b252-2be4-4d04-8e6c-93cecb85088a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:37.012586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b252-2be4-4d04-8e6c-93cecb85088a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:37.012854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88b252-2be4-4d04-8e6c-93cecb85088a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:37.013709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88b252-2be4-4d04-8e6c-93cecb85088a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:37.015280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88b252-2be4-4d04-8e6c-93cecb85088a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:37.025879 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4274/8518] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:37.030341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:37.040584 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd3748-821c-4c92-9a70-80680eb00320 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:37.046035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:37.046681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:37.046964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:37.047264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] PATH_INFO: `/v3/projects/099dd40baa9c4febb3f494707d9dec20/users/958fa334c6b04011886e073e9a09b5d0/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:37.062253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099dd40baa9c4febb3f494707d9dec20, user_id=958fa334c6b04011886e073e9a09b5d0, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:37.064913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:37.079031 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4245/8519] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:37 2022] PUT /identity/v3/projects/099dd40baa9c4febb3f494707d9dec20/users/958fa334c6b04011886e073e9a09b5d0/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:37.175618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efdb17-0e2a-44ff-915d-2d8070593fe2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:37.176587 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efdb17-0e2a-44ff-915d-2d8070593fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:37.176936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efdb17-0e2a-44ff-915d-2d8070593fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:37.205985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d1efdb17-0e2a-44ff-915d-2d8070593fe2 None None] MFA Rules not processed for user `958fa334c6b04011886e073e9a09b5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:37.207197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d1efdb17-0e2a-44ff-915d-2d8070593fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:37.270275 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4275/8520] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:37.287902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:37.289638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:37.320700 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:37.353023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a615e4-616e-42a7-a250-504e427b3cb3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:37.356695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fe856-c2a8-46dc-93d9-60b000e40e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:37.358043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe856-c2a8-46dc-93d9-60b000e40e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:37.358329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe856-c2a8-46dc-93d9-60b000e40e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:37.358602 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fe856-c2a8-46dc-93d9-60b000e40e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:37.367070 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fe856-c2a8-46dc-93d9-60b000e40e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:37.368515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fe856-c2a8-46dc-93d9-60b000e40e33 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:37.377678 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4246/8521] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:37.390975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efdb17-0e2a-44ff-915d-2d8070593fe2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:37.453922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efdb17-0e2a-44ff-915d-2d8070593fe2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:37.458594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:37.459295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:37.459570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:37.459839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] PATH_INFO: `/v3/users/958fa334c6b04011886e073e9a09b5d0` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:37.460968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958fa334c6b04011886e073e9a09b5d0)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:37.462897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:37.469128 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:37.521865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958fa334c6b04011886e073e9a09b5d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:37.522563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958fa334c6b04011886e073e9a09b5d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:37.523254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958fa334c6b04011886e073e9a09b5d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:37.537594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958fa334c6b04011886e073e9a09b5d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:37.545222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958fa334c6b04011886e073e9a09b5d0'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:37.558246 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4276/8522] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:37 2022] DELETE /identity/v3/users/958fa334c6b04011886e073e9a09b5d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:37.562995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:37.563497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:37.564090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:37.583744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:37.585006 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:37.650372 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4247/8523] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:37.661434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:37.662828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:37.722729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f2ed-6818-42cb-bed4-61df5ac086f5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:37.726504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168d68e-0ac2-4ce5-9793-2d2a496c7a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:37.727136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168d68e-0ac2-4ce5-9793-2d2a496c7a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:37.727417 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168d68e-0ac2-4ce5-9793-2d2a496c7a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:37.727691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168d68e-0ac2-4ce5-9793-2d2a496c7a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:37.737316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168d68e-0ac2-4ce5-9793-2d2a496c7a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:37.745057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168d68e-0ac2-4ce5-9793-2d2a496c7a65 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:37.755053 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4277/8524] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:38.040282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.041971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:38.054761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb1923-bf2d-4c05-be50-8498e00df873 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.059421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.060614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.060903 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.061378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] PATH_INFO: `/v3/projects/099dd40baa9c4febb3f494707d9dec20` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.062558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=099dd40baa9c4febb3f494707d9dec20)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.064455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.121559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099dd40baa9c4febb3f494707d9dec20', 'request_id': 'req-2befe147-9d3d-4319-b243-db134f8dec31'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:38.129120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099dd40baa9c4febb3f494707d9dec20', 'request_id': 'req-2befe147-9d3d-4319-b243-db134f8dec31'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:38.137479 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099dd40baa9c4febb3f494707d9dec20', 'request_id': 'req-2befe147-9d3d-4319-b243-db134f8dec31'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:38.152055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] The token cache is being invalidate because project 099dd40baa9c4febb3f494707d9dec20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:38.152346 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:38.152974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-2befe147-9d3d-4319-b243-db134f8dec31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:38.154770 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4248/8525] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:38 2022] DELETE /identity/v3/projects/099dd40baa9c4febb3f494707d9dec20 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:38.159860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39264d-8541-46f0-a917-769373c7b37c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.160148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39264d-8541-46f0-a917-769373c7b37c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.160424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39264d-8541-46f0-a917-769373c7b37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.179966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3c39264d-8541-46f0-a917-769373c7b37c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:38.181195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3c39264d-8541-46f0-a917-769373c7b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:38.243438 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4278/8526] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:38.251671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b172-0883-448e-831d-ccdd850d2b5e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.251960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b172-0883-448e-831d-ccdd850d2b5e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.252236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097b172-0883-448e-831d-ccdd850d2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.274475 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4097b172-0883-448e-831d-ccdd850d2b5e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:38.275750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4097b172-0883-448e-831d-ccdd850d2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:38.284923 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4249/8527] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:38.289049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39264d-8541-46f0-a917-769373c7b37c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.300426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39264d-8541-46f0-a917-769373c7b37c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.305051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.305677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.305947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.306216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.306875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:38.307175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.308813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.321265 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4279/8528] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:38.325795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b172-0883-448e-831d-ccdd850d2b5e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.335976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097b172-0883-448e-831d-ccdd850d2b5e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.340942 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.341661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.342033 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.342313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.342953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.344850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.374280 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4250/8529] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:38 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:38.378618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.389649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab8253-17d0-4526-832c-1115615c233f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.402996 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:38.449741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.450344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.451144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.451414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.452047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.454032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.475099 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4280/8530] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:38 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:38.479274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.490467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973f874-acef-4113-bb41-f9cee64657f2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.495169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.495708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.495982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.496251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.496877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.498582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.508305 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4251/8531] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:38.512356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.523261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d117547-c0fd-4ed9-a0c0-8bcdfc2e6621 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.528015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc1327-ac8d-4c9b-a4be-9d36a46d4f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.528649 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1327-ac8d-4c9b-a4be-9d36a46d4f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.529564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1327-ac8d-4c9b-a4be-9d36a46d4f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.529845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc1327-ac8d-4c9b-a4be-9d36a46d4f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.530629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc1327-ac8d-4c9b-a4be-9d36a46d4f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.532406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc1327-ac8d-4c9b-a4be-9d36a46d4f62 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.543554 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4281/8532] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:38.548693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.558681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b048fa-b01f-453c-98ef-35e3327c214d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.564037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.564678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.564951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.565274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] PATH_INFO: `/v3/projects/b764956ebdf0483d988c99102c9e5ad4/users/11af1876b93a4b9fa9b56af5d934b4b7/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.576351 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:38.580986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b764956ebdf0483d988c99102c9e5ad4, user_id=11af1876b93a4b9fa9b56af5d934b4b7, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.583765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.597495 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4252/8533] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:38 2022] PUT /identity/v3/projects/b764956ebdf0483d988c99102c9e5ad4/users/11af1876b93a4b9fa9b56af5d934b4b7/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:38.608924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2837f-50b3-4cbf-b27b-0acbea2906ee None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.609242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2837f-50b3-4cbf-b27b-0acbea2906ee None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.609517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2837f-50b3-4cbf-b27b-0acbea2906ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.639479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-75f2837f-50b3-4cbf-b27b-0acbea2906ee None None] MFA Rules not processed for user `11af1876b93a4b9fa9b56af5d934b4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:38.640724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-75f2837f-50b3-4cbf-b27b-0acbea2906ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:38.709120 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4282/8534] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:38.713515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.780839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144327-aca8-43a1-9b22-f70c8c6364f8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.786098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.786713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.786996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.787620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.788334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.790494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.820083 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4253/8535] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:38 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:38.824230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2837f-50b3-4cbf-b27b-0acbea2906ee None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.836485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2837f-50b3-4cbf-b27b-0acbea2906ee None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.892004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.892607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.892886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.893190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.893813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.895718 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.915921 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4283/8536] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:38 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:38.920633 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.931109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae1797-192b-4356-a19a-fd6570b8c0ed admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.938431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.938431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.938431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.938431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.938880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.940075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:38.951517 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4254/8537] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:38.962742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:38.972736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957a367-c74c-4384-9f1e-5c4adc7c6d94 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:38.977370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:38.978004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:38.978279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:38.978544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] PATH_INFO: `/v3/projects/c784ff6e4d6a4a2393efdd1001b8c355/users/e1d752f9e16f43e0afdf219e88d618bd/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:38.991113 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:38.996333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c784ff6e4d6a4a2393efdd1001b8c355, user_id=e1d752f9e16f43e0afdf219e88d618bd, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:38.999177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:39.012955 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4284/8538] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:38 2022] PUT /identity/v3/projects/c784ff6e4d6a4a2393efdd1001b8c355/users/e1d752f9e16f43e0afdf219e88d618bd/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:39.017127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:39.027255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f512594-9361-4a78-ac84-cb611a8dd093 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:39.084104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4acf4-cc6a-4c6c-b328-e4ab0500d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:39.084808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4acf4-cc6a-4c6c-b328-e4ab0500d123 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:39.084975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4acf4-cc6a-4c6c-b328-e4ab0500d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:39.085277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4acf4-cc6a-4c6c-b328-e4ab0500d123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:39.085913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4acf4-cc6a-4c6c-b328-e4ab0500d123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:39.087559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4acf4-cc6a-4c6c-b328-e4ab0500d123 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:39.097648 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4255/8539] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:39.101807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:39.112704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95882f-0b60-49cf-8138-4cba84db6444 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:39.117346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:39.117986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:39.118259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:39.118526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] PATH_INFO: `/v3/projects/c784ff6e4d6a4a2393efdd1001b8c355/users/e1d752f9e16f43e0afdf219e88d618bd/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:39.120438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c784ff6e4d6a4a2393efdd1001b8c355, user_id=e1d752f9e16f43e0afdf219e88d618bd, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:39.123888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:39.134059 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4285/8540] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:39 2022] PUT /identity/v3/projects/c784ff6e4d6a4a2393efdd1001b8c355/users/e1d752f9e16f43e0afdf219e88d618bd/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:39.145631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963c8f-7139-437b-881f-e40b085c17ed None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:39.145922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963c8f-7139-437b-881f-e40b085c17ed None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:39.146204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963c8f-7139-437b-881f-e40b085c17ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:39.175418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-58963c8f-7139-437b-881f-e40b085c17ed None None] MFA Rules not processed for user `e1d752f9e16f43e0afdf219e88d618bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:39.176628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-58963c8f-7139-437b-881f-e40b085c17ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:39.225208 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:39.248912 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4256/8541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:39.260893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:39.262685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:39.332495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08bc7-4f5a-4f4e-8b0e-ffdd11839c58 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:39.336284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec592-d7fd-411a-be45-e40567f289c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:39.336893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec592-d7fd-411a-be45-e40567f289c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:39.337220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec592-d7fd-411a-be45-e40567f289c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:39.337492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec592-d7fd-411a-be45-e40567f289c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:39.346707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ec592-d7fd-411a-be45-e40567f289c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:39.348126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ec592-d7fd-411a-be45-e40567f289c3 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:39.358175 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4286/8542] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:40.694735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963c8f-7139-437b-881f-e40b085c17ed None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:40.757393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963c8f-7139-437b-881f-e40b085c17ed None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:40.761998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:40.762623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:40.762901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:40.763678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] PATH_INFO: `/v3/users/11af1876b93a4b9fa9b56af5d934b4b7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:40.764962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11af1876b93a4b9fa9b56af5d934b4b7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:40.766894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:40.811929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11af1876b93a4b9fa9b56af5d934b4b7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:40.812654 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11af1876b93a4b9fa9b56af5d934b4b7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:40.813286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11af1876b93a4b9fa9b56af5d934b4b7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:40.820539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11af1876b93a4b9fa9b56af5d934b4b7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:40.832937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11af1876b93a4b9fa9b56af5d934b4b7'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:40.846271 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4257/8543] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:40 2022] DELETE /identity/v3/users/11af1876b93a4b9fa9b56af5d934b4b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:40.851006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59740855-b027-420c-a4ef-662d72264034 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:40.851486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59740855-b027-420c-a4ef-662d72264034 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:40.851604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59740855-b027-420c-a4ef-662d72264034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:40.871105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-59740855-b027-420c-a4ef-662d72264034 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:40.872214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59740855-b027-420c-a4ef-662d72264034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:40.934494 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4287/8544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:40.944194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:40.945611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:41.005471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd7ccd-8723-487a-8345-b66470665388 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:41.009122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:41.009714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:41.010017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:41.010284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:41.020165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:41.021638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:41.033259 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4258/8545] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:41.372491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59740855-b027-420c-a4ef-662d72264034 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:41.374154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-59740855-b027-420c-a4ef-662d72264034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:41.401787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59740855-b027-420c-a4ef-662d72264034 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:41.408563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:41.409269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:41.409547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:41.409814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] PATH_INFO: `/v3/projects/b764956ebdf0483d988c99102c9e5ad4` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:41.410947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b764956ebdf0483d988c99102c9e5ad4)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:41.412853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:41.461792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b764956ebdf0483d988c99102c9e5ad4', 'request_id': 'req-7f8be313-64b9-46bc-96f1-c5203228787b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.467532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b764956ebdf0483d988c99102c9e5ad4', 'request_id': 'req-7f8be313-64b9-46bc-96f1-c5203228787b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.474266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b764956ebdf0483d988c99102c9e5ad4', 'request_id': 'req-7f8be313-64b9-46bc-96f1-c5203228787b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.477046 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:41.489434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] The token cache is being invalidate because project b764956ebdf0483d988c99102c9e5ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:41.489842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.490560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.492483 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4288/8546] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:41 2022] DELETE /identity/v3/projects/b764956ebdf0483d988c99102c9e5ad4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:41.496473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:41.506923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769df355-a49b-4740-ba6e-eadcdd0525ef service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:41.510561 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:41.569667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:41.570301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:41.570698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:41.570977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] PATH_INFO: `/v3/users/e1d752f9e16f43e0afdf219e88d618bd` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:41.572117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d752f9e16f43e0afdf219e88d618bd)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:41.574062 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:41.620248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d752f9e16f43e0afdf219e88d618bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.620901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d752f9e16f43e0afdf219e88d618bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.621545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d752f9e16f43e0afdf219e88d618bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.630178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d752f9e16f43e0afdf219e88d618bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.642276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-10e00751-70a2-45cf-a9d3-be1c2a32be3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d752f9e16f43e0afdf219e88d618bd'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:41.655921 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4259/8547] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:41 2022] DELETE /identity/v3/users/e1d752f9e16f43e0afdf219e88d618bd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:42.115164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.116896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:42.131093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be313-64b9-46bc-96f1-c5203228787b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:42.208663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:42.209859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.210012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.210432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] PATH_INFO: `/v3/projects/c784ff6e4d6a4a2393efdd1001b8c355` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.211752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c784ff6e4d6a4a2393efdd1001b8c355)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:42.214178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:42.281531 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c784ff6e4d6a4a2393efdd1001b8c355', 'request_id': 'req-fd5ed71e-1805-4383-b413-de3e483f5cfa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:42.290344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c784ff6e4d6a4a2393efdd1001b8c355', 'request_id': 'req-fd5ed71e-1805-4383-b413-de3e483f5cfa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:42.299878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c784ff6e4d6a4a2393efdd1001b8c355', 'request_id': 'req-fd5ed71e-1805-4383-b413-de3e483f5cfa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:42.326632 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] The token cache is being invalidate because project c784ff6e4d6a4a2393efdd1001b8c355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:42.327029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:42.327787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-fd5ed71e-1805-4383-b413-de3e483f5cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:42.329765 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4289/8548] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:42 2022] DELETE /identity/v3/projects/c784ff6e4d6a4a2393efdd1001b8c355 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:42.334713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de567-a97f-404b-b6e7-203f77861595 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.335238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de567-a97f-404b-b6e7-203f77861595 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.335356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de567-a97f-404b-b6e7-203f77861595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.362904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2f7de567-a97f-404b-b6e7-203f77861595 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:42.364239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f7de567-a97f-404b-b6e7-203f77861595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:42.436089 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4260/8549] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:42.444448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ddec-b41f-442d-ad68-3bcdb1e55004 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.444765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ddec-b41f-442d-ad68-3bcdb1e55004 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.445001 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ddec-b41f-442d-ad68-3bcdb1e55004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.467148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8ef9ddec-b41f-442d-ad68-3bcdb1e55004 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:42.468460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8ef9ddec-b41f-442d-ad68-3bcdb1e55004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:42.476784 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4290/8550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:42.481231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de567-a97f-404b-b6e7-203f77861595 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.492149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de567-a97f-404b-b6e7-203f77861595 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:42.498007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:42.498655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.498886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.499156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.499803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:42.500098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:42.501729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:42.515085 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4261/8551] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:42.519920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9ddec-b41f-442d-ad68-3bcdb1e55004 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.531063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9ddec-b41f-442d-ad68-3bcdb1e55004 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:42.536532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:42.537312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.537689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.538044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.538748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:42.540729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:42.580818 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4291/8552] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:42 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:47:42.582080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.592697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388705f-da5f-412d-97ad-50b70f3f84d6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:42.602554 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:42.654354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:42.654606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.654843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.655112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.655738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:42.657966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:42.683279 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4262/8553] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:42 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:42.685433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.696217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f5238-34e3-482e-95f2-21636becf5b3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:42.702331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:42.702331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.702600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.702744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.703382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:42.704982 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:42.715191 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4292/8554] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:42.719940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.730021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85496d-34e1-49db-95f2-b37273521a3f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:42.736497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4253e-1c1d-4d17-a878-16d4f8c22124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:42.737154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4253e-1c1d-4d17-a878-16d4f8c22124 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.737439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4253e-1c1d-4d17-a878-16d4f8c22124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.737708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4253e-1c1d-4d17-a878-16d4f8c22124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.738383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4253e-1c1d-4d17-a878-16d4f8c22124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:42.739975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4253e-1c1d-4d17-a878-16d4f8c22124 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:42.752096 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4263/8555] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:42.756090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.766553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af7a5-995b-4cf6-913d-6cef20f5f8ac admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:42.771222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:42.771870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.772149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.772420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] PATH_INFO: `/v3/projects/497d5d96aa0649418b1793a9c49ef1de/users/0bb1903b42554ec8b88271b88bd0d3db/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.787733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=497d5d96aa0649418b1793a9c49ef1de, user_id=0bb1903b42554ec8b88271b88bd0d3db, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:42.790421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:42.804710 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4293/8556] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:42 2022] PUT /identity/v3/projects/497d5d96aa0649418b1793a9c49ef1de/users/0bb1903b42554ec8b88271b88bd0d3db/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:47:42.818438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dac8b-94f3-4308-a55f-89e794ec4ae1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:42.818835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dac8b-94f3-4308-a55f-89e794ec4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:42.819200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dac8b-94f3-4308-a55f-89e794ec4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:42.852118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1c7dac8b-94f3-4308-a55f-89e794ec4ae1 None None] MFA Rules not processed for user `0bb1903b42554ec8b88271b88bd0d3db`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:42.853432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1c7dac8b-94f3-4308-a55f-89e794ec4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:42.930431 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4264/8557] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:42.935745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:42.958984 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:43.005372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cb29e-35c5-49d8-b86d-a7ab5fac4fee admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.010000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.010599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.010876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.011141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.011760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.013943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.043412 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4294/8558] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:42 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:43.047975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dac8b-94f3-4308-a55f-89e794ec4ae1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:43.058729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dac8b-94f3-4308-a55f-89e794ec4ae1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.116316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.116929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.117291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.117553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.118194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.120103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.142735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4265/8559] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:43 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:43.146950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:43.159102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35baba-5ef2-49fd-a300-e1db5ab80487 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.164006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.164643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.164922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.165230 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.165875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.167499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.181577 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4295/8560] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:43.186347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:43.197202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eadd3-7d98-4fde-bf45-160db92e28c7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.202797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.203463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.203740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.204012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] PATH_INFO: `/v3/projects/ebd20b1759704275815eef094768d2c7/users/687e202cad43405395d0e400ebaabbc5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.213094 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:43.222341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd20b1759704275815eef094768d2c7, user_id=687e202cad43405395d0e400ebaabbc5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.225352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.241543 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4266/8561] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:43 2022] PUT /identity/v3/projects/ebd20b1759704275815eef094768d2c7/users/687e202cad43405395d0e400ebaabbc5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:43.247457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:43.257627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be25769-71ee-41f6-b407-d5af7f9c2ac7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.319887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eda58-0927-46e6-bd13-06d2438836cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.320502 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eda58-0927-46e6-bd13-06d2438836cc admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.320781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eda58-0927-46e6-bd13-06d2438836cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.321052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eda58-0927-46e6-bd13-06d2438836cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.321733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eda58-0927-46e6-bd13-06d2438836cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.323390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eda58-0927-46e6-bd13-06d2438836cc admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.333106 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4296/8562] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:43.337375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:43.349308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef96a9-da69-4100-8e80-a7c447208b4b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.354201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.354884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.355164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.355437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] PATH_INFO: `/v3/projects/ebd20b1759704275815eef094768d2c7/users/687e202cad43405395d0e400ebaabbc5/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.358327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd20b1759704275815eef094768d2c7, user_id=687e202cad43405395d0e400ebaabbc5, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.360966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.371254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4267/8563] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:43 2022] PUT /identity/v3/projects/ebd20b1759704275815eef094768d2c7/users/687e202cad43405395d0e400ebaabbc5/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:43.381636 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cafcc-224a-4ba2-8f93-c35f645874c6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.381925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cafcc-224a-4ba2-8f93-c35f645874c6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.382201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cafcc-224a-4ba2-8f93-c35f645874c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.410302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-091cafcc-224a-4ba2-8f93-c35f645874c6 None None] MFA Rules not processed for user `687e202cad43405395d0e400ebaabbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:43.411518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-091cafcc-224a-4ba2-8f93-c35f645874c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:43.482774 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4297/8564] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:43.493586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:43.495413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:43.560505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b189-710a-40d3-91bc-98ec999cfb4b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.564440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.565137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.565551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.565914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.576065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.577536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.588075 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4268/8565] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:43.699392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cafcc-224a-4ba2-8f93-c35f645874c6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:43.712288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cafcc-224a-4ba2-8f93-c35f645874c6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:43.715936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:43.717145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:43.717498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:43.717772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:43.729690 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:43.783057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:43.784405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:43.793953 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4298/8566] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:44.622263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:44.624929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:44.703743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d692-ca33-46f8-9aa8-399df5cb6476 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:44.709405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf1006-7903-4162-a821-c73a173cdb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:44.710021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf1006-7903-4162-a821-c73a173cdb0b service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:44.710298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf1006-7903-4162-a821-c73a173cdb0b service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:44.710568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf1006-7903-4162-a821-c73a173cdb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:44.712311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b7bf1006-7903-4162-a821-c73a173cdb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:44.772629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf1006-7903-4162-a821-c73a173cdb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:44.774260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf1006-7903-4162-a821-c73a173cdb0b service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:44.799321 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4269/8567] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:47.473570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:47.557934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee7f83-67d4-4ff1-850b-8a5227299e60 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:47.563684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:47.564426 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:47.564757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:47.565168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] PATH_INFO: `/v3/users/0bb1903b42554ec8b88271b88bd0d3db` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:47.566897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb1903b42554ec8b88271b88bd0d3db)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:47.569035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:47.631706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb1903b42554ec8b88271b88bd0d3db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:47.632433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb1903b42554ec8b88271b88bd0d3db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:47.633150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb1903b42554ec8b88271b88bd0d3db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:47.656729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb1903b42554ec8b88271b88bd0d3db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:47.665242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb1903b42554ec8b88271b88bd0d3db'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:47.690540 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4299/8568] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:47 2022] DELETE /identity/v3/users/0bb1903b42554ec8b88271b88bd0d3db => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:47.694911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:47.695381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:47.695540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:47.706930 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:47.724265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:47.725583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:47.813490 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4270/8569] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:47.817674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:47.819146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:47.855732 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:47.884341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a058-fabb-439f-bd90-cf71516eee4b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:47.888198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:47.888875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:47.889120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:47.889396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:47.898730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:47.900268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:47.911145 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4300/8570] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:48.276593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:48.278324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:48.304490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0456a6-c5b5-4dad-8ac1-0ce215c3b614 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:48.316411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:48.317718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:48.318219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:48.318857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] PATH_INFO: `/v3/projects/497d5d96aa0649418b1793a9c49ef1de` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:48.320352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=497d5d96aa0649418b1793a9c49ef1de)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:48.323314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:48.433504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497d5d96aa0649418b1793a9c49ef1de', 'request_id': 'req-505f8666-b544-4fb6-a2fd-edc9b14b77a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.443613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497d5d96aa0649418b1793a9c49ef1de', 'request_id': 'req-505f8666-b544-4fb6-a2fd-edc9b14b77a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.455242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497d5d96aa0649418b1793a9c49ef1de', 'request_id': 'req-505f8666-b544-4fb6-a2fd-edc9b14b77a8'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.470444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] The token cache is being invalidate because project 497d5d96aa0649418b1793a9c49ef1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:48.470736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.471466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.472965 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4271/8571] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:48 2022] DELETE /identity/v3/projects/497d5d96aa0649418b1793a9c49ef1de => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:48.476885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:48.487467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0fc25-d1fa-4c83-ba2a-cac0a3a3b25d service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:48.554404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:48.555104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:48.555383 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:48.555655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] PATH_INFO: `/v3/users/687e202cad43405395d0e400ebaabbc5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:48.556801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687e202cad43405395d0e400ebaabbc5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:48.558992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:48.608662 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687e202cad43405395d0e400ebaabbc5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.609382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687e202cad43405395d0e400ebaabbc5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.610014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687e202cad43405395d0e400ebaabbc5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.622092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687e202cad43405395d0e400ebaabbc5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.629575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-45d051e5-4846-43da-b2a9-9fae2bbb39a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687e202cad43405395d0e400ebaabbc5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:48.642185 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4301/8572] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:48 2022] DELETE /identity/v3/users/687e202cad43405395d0e400ebaabbc5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:48.934944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:48.936664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:48.950014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f8666-b544-4fb6-a2fd-edc9b14b77a8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.007941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.008469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.008744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.009011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] PATH_INFO: `/v3/projects/ebd20b1759704275815eef094768d2c7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.010157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd20b1759704275815eef094768d2c7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.012029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.046575 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:49.061570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd20b1759704275815eef094768d2c7', 'request_id': 'req-48e87bdc-3797-4686-961d-f248e3359523'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:49.067673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd20b1759704275815eef094768d2c7', 'request_id': 'req-48e87bdc-3797-4686-961d-f248e3359523'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:49.074961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd20b1759704275815eef094768d2c7', 'request_id': 'req-48e87bdc-3797-4686-961d-f248e3359523'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:49.085894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] The token cache is being invalidate because project ebd20b1759704275815eef094768d2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:49.086183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:49.086809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-48e87bdc-3797-4686-961d-f248e3359523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:49.088313 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4272/8573] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:48 2022] DELETE /identity/v3/projects/ebd20b1759704275815eef094768d2c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:49.094325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b61ced-e4a4-4f45-a6f1-62bec5386f57 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.094639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b61ced-e4a4-4f45-a6f1-62bec5386f57 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.094910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b61ced-e4a4-4f45-a6f1-62bec5386f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.115884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a7b61ced-e4a4-4f45-a6f1-62bec5386f57 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:49.117121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7b61ced-e4a4-4f45-a6f1-62bec5386f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:49.165156 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:49.180302 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4302/8574] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:49.188794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e838-5c8a-461c-bee8-b1e7e941921e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.189135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e838-5c8a-461c-bee8-b1e7e941921e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.189417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e838-5c8a-461c-bee8-b1e7e941921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.209283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d305e838-5c8a-461c-bee8-b1e7e941921e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:49.210497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d305e838-5c8a-461c-bee8-b1e7e941921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:49.218658 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4273/8575] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:49.222762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b61ced-e4a4-4f45-a6f1-62bec5386f57 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.232984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b61ced-e4a4-4f45-a6f1-62bec5386f57 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.237624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.238222 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.238499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.238775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.239410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:47:49.239713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.241332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.253516 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4303/8576] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:47:49.258218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e838-5c8a-461c-bee8-b1e7e941921e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.269027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e838-5c8a-461c-bee8-b1e7e941921e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.273788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.274385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.274667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.274937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.275563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.277572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.304961 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4274/8577] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:49 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:49.309178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.319747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b688e-356b-4466-802f-6d67a592fac5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.375522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.376127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.376436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.376710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.377385 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.379428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.400325 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4304/8578] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:49 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:49.404598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.415396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e5689-2613-4f3f-8fca-2cc89fbdc3af admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.420650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.421287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.421567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.421838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.422471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.424133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.434068 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4275/8579] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:47:49.438199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.448182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63116c-c632-4687-afd4-667cbd1621cf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.453682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb5c93-75f9-49f0-9b14-aa64af199166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.454265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb5c93-75f9-49f0-9b14-aa64af199166 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.454538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb5c93-75f9-49f0-9b14-aa64af199166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.454834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb5c93-75f9-49f0-9b14-aa64af199166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.455466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb5c93-75f9-49f0-9b14-aa64af199166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.457024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb5c93-75f9-49f0-9b14-aa64af199166 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.468204 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4305/8580] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:49.472300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.482487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f42ec-0cc6-4719-ae71-131ff80326d5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.487170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.487817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.488099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.488373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] PATH_INFO: `/v3/projects/e630370e6d0f450aa20ee37e98747e90/users/460b10f2cd99428a816849b1629066d8/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.503043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e630370e6d0f450aa20ee37e98747e90, user_id=460b10f2cd99428a816849b1629066d8, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.505728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.519201 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4276/8581] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:49 2022] PUT /identity/v3/projects/e630370e6d0f450aa20ee37e98747e90/users/460b10f2cd99428a816849b1629066d8/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:49.531052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1af3f1-069e-4c02-a499-09095bfc4a04 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.531568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1af3f1-069e-4c02-a499-09095bfc4a04 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.531568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1af3f1-069e-4c02-a499-09095bfc4a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.561228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-be1af3f1-069e-4c02-a499-09095bfc4a04 None None] MFA Rules not processed for user `460b10f2cd99428a816849b1629066d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:49.562454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-be1af3f1-069e-4c02-a499-09095bfc4a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:49.626320 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4306/8582] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:47:49.630821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.693712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3c23-f87a-4bee-bd53-eba6c193f413 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.698664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.699271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.699541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.699804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.701088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.702984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.729560 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4277/8583] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:47:49 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:49.733791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1af3f1-069e-4c02-a499-09095bfc4a04 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.744488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1af3f1-069e-4c02-a499-09095bfc4a04 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.792782 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:49.804089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.804697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.804973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.805273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.805909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.807848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.831486 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4307/8584] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:47:49 2022] POST /identity/v3/users => generated 310 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:47:49.835738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.846991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e4c4f-838b-4150-97db-b9da4b35e47b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.851749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.852352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.852635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.852909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.853600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.855171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.865873 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4278/8585] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:49.869945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.880396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8becc36-6b97-437a-b5cc-d64244f2ea45 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.885027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.885700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.885975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.886261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] PATH_INFO: `/v3/projects/6624d7bd7568410687e4bbdb683819fb/users/74089f64fc884f6fba20904c784e30e3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.902161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6624d7bd7568410687e4bbdb683819fb, user_id=74089f64fc884f6fba20904c784e30e3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.904927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:49.918031 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4308/8586] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:49 2022] PUT /identity/v3/projects/6624d7bd7568410687e4bbdb683819fb/users/74089f64fc884f6fba20904c784e30e3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:49.922529 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:49.932443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7e61-d27b-4893-86e4-48182a5eab80 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:49.960639 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:49.994505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025dc40-e3dd-4b31-9975-8f591f502c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:49.996036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025dc40-e3dd-4b31-9975-8f591f502c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:49.996320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025dc40-e3dd-4b31-9975-8f591f502c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:49.996590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025dc40-e3dd-4b31-9975-8f591f502c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:49.997262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025dc40-e3dd-4b31-9975-8f591f502c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:49.999567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025dc40-e3dd-4b31-9975-8f591f502c4c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:50.009747 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4279/8587] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:47:50.014123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:50.024726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8836654-70f3-4583-97ca-80a892fe27de admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:50.029600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:50.030260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:50.030541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:50.030816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] PATH_INFO: `/v3/projects/6624d7bd7568410687e4bbdb683819fb/users/74089f64fc884f6fba20904c784e30e3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:50.033050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6624d7bd7568410687e4bbdb683819fb, user_id=74089f64fc884f6fba20904c784e30e3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:50.035760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:50.057234 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4309/8588] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:47:50 2022] PUT /identity/v3/projects/6624d7bd7568410687e4bbdb683819fb/users/74089f64fc884f6fba20904c784e30e3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:50.059032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d322-0245-4691-b41e-a99e11254f66 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:50.059333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d322-0245-4691-b41e-a99e11254f66 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:50.059598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d322-0245-4691-b41e-a99e11254f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:50.089514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c4e4d322-0245-4691-b41e-a99e11254f66 None None] MFA Rules not processed for user `74089f64fc884f6fba20904c784e30e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:50.090731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c4e4d322-0245-4691-b41e-a99e11254f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:50.165399 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4280/8589] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:50 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:50.176757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:50.178521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:50.238878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6d8c-63e2-42b4-87de-6f0b4e02991c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:50.242547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:50.243169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:50.243444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:50.243710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:50.253555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:50.254962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:50.264565 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4310/8590] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:50 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:50.415375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4d322-0245-4691-b41e-a99e11254f66 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:50.429449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4d322-0245-4691-b41e-a99e11254f66 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:50.433018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75b238-5130-451d-a7d4-a872159d9659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:50.433650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b238-5130-451d-a7d4-a872159d9659 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:50.433930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b238-5130-451d-a7d4-a872159d9659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:50.434200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b238-5130-451d-a7d4-a872159d9659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:50.498435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75b238-5130-451d-a7d4-a872159d9659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:50.499912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75b238-5130-451d-a7d4-a872159d9659 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:50.509563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4281/8591] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:50 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:59.121073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:59.184252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff6578-1547-4553-ad67-30f09cb741dc service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:59.188899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:59.189566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:59.189843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:59.190245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] PATH_INFO: `/v3/users/460b10f2cd99428a816849b1629066d8` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:59.191386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] RBAC: Authorizing `identity:delete_user(user_id=460b10f2cd99428a816849b1629066d8)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:59.193407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:59.242570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460b10f2cd99428a816849b1629066d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.243532 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460b10f2cd99428a816849b1629066d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.244143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460b10f2cd99428a816849b1629066d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.245288 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:59.260384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460b10f2cd99428a816849b1629066d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.268539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460b10f2cd99428a816849b1629066d8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.283533 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4311/8592] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:59 2022] DELETE /identity/v3/users/460b10f2cd99428a816849b1629066d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:59.288092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:59.288590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:59.288696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:59.307629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:47:59.308834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:59.355355 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:47:59.373230 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4282/8593] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:47:59.383552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:59.385191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:59.448971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf8e6-6904-4779-baf0-0e30432d194e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:59.453788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:59.454389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:59.454670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:59.454928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:59.464513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:59.466025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:59.476074 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4312/8594] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:47:59.765507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:59.767242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:47:59.781301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56dd19-7766-45f5-8cfd-e6fbd22197f3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:59.791828 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:59.792628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:59.793017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:59.793424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] PATH_INFO: `/v3/projects/e630370e6d0f450aa20ee37e98747e90` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:59.794814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e630370e6d0f450aa20ee37e98747e90)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:59.796866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:47:59.848810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e630370e6d0f450aa20ee37e98747e90', 'request_id': 'req-255e36fe-6be1-456f-82fc-7ac9501bd331'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.855619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e630370e6d0f450aa20ee37e98747e90', 'request_id': 'req-255e36fe-6be1-456f-82fc-7ac9501bd331'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.863659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e630370e6d0f450aa20ee37e98747e90', 'request_id': 'req-255e36fe-6be1-456f-82fc-7ac9501bd331'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.874180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] The token cache is being invalidate because project e630370e6d0f450aa20ee37e98747e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:47:59.874467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.875088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:47:59.876570 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4283/8595] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:47:59 2022] DELETE /identity/v3/projects/e630370e6d0f450aa20ee37e98747e90 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:47:59.880526 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:47:59.891460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010e67d-505e-476d-9e1f-027ab046ff0f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:47:59.947236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:47:59.947861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:47:59.948138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:47:59.948408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] PATH_INFO: `/v3/users/74089f64fc884f6fba20904c784e30e3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:47:59.949554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74089f64fc884f6fba20904c784e30e3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:47:59.951988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.007471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74089f64fc884f6fba20904c784e30e3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.008210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74089f64fc884f6fba20904c784e30e3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.008796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74089f64fc884f6fba20904c784e30e3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.025233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74089f64fc884f6fba20904c784e30e3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.031917 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:00.035581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1608efd4-2a68-43b6-a3ac-cf4d7175f77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74089f64fc884f6fba20904c784e30e3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.053243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4313/8596] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:47:59 2022] DELETE /identity/v3/users/74089f64fc884f6fba20904c784e30e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:00.333580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:00.339457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:00.353740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e36fe-6be1-456f-82fc-7ac9501bd331 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:00.422159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:00.422723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.423010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.423285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] PATH_INFO: `/v3/projects/6624d7bd7568410687e4bbdb683819fb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.424421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6624d7bd7568410687e4bbdb683819fb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:00.426359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.474045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6624d7bd7568410687e4bbdb683819fb', 'request_id': 'req-7ec43630-2360-4076-8c01-3ab0b532a3e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.480293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6624d7bd7568410687e4bbdb683819fb', 'request_id': 'req-7ec43630-2360-4076-8c01-3ab0b532a3e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.487995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6624d7bd7568410687e4bbdb683819fb', 'request_id': 'req-7ec43630-2360-4076-8c01-3ab0b532a3e1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.498456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] The token cache is being invalidate because project 6624d7bd7568410687e4bbdb683819fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:48:00.498748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.499376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7ec43630-2360-4076-8c01-3ab0b532a3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:00.501118 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4284/8597] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:48:00 2022] DELETE /identity/v3/projects/6624d7bd7568410687e4bbdb683819fb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:00.505971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31da11-65e8-477f-9ad9-8b85db973b11 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.506446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31da11-65e8-477f-9ad9-8b85db973b11 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.506635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31da11-65e8-477f-9ad9-8b85db973b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.527009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8f31da11-65e8-477f-9ad9-8b85db973b11 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:00.528208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8f31da11-65e8-477f-9ad9-8b85db973b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:00.587263 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4314/8598] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:00.595801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72033-6e65-4466-b805-ec41d2bcd3ae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.596084 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72033-6e65-4466-b805-ec41d2bcd3ae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.596354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72033-6e65-4466-b805-ec41d2bcd3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.604050 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:00.617904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-27f72033-6e65-4466-b805-ec41d2bcd3ae None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:00.619116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-27f72033-6e65-4466-b805-ec41d2bcd3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:00.627185 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4285/8599] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:00.631393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31da11-65e8-477f-9ad9-8b85db973b11 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:00.642032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31da11-65e8-477f-9ad9-8b85db973b11 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:00.646574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:00.647165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.647466 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.647734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.648363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:48:00.648658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:00.650266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.674154 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4315/8600] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:48:00.678249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72033-6e65-4466-b805-ec41d2bcd3ae None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:00.687709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72033-6e65-4466-b805-ec41d2bcd3ae None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:00.692564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:00.693265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.693546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.693819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.694456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:00.696340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.727785 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4286/8601] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:48:00 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:48:00.730695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:00.740642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1008c5-dfa9-434b-8445-f3716a17ba4b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:00.797443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:00.798044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.798325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.798603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.799232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:00.801168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.823587 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4316/8602] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:48:00 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:48:00.828389 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:00.838889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e90604-b457-4d03-ad57-bd8cfedf65ee admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:00.843550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:00.844141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.844420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.844694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.845382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:00.846952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.856859 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4287/8603] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:00.860858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:00.870870 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5deb-3d06-4d38-bd8c-fabbbf2f10ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:00.875974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7059-80c1-4696-86e2-a60372ac805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:00.876562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7059-80c1-4696-86e2-a60372ac805b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.876840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7059-80c1-4696-86e2-a60372ac805b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.877147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7059-80c1-4696-86e2-a60372ac805b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.877788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7059-80c1-4696-86e2-a60372ac805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:00.879363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7059-80c1-4696-86e2-a60372ac805b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.890432 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4317/8604] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:00.894789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:00.905178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9b25-3e9b-497e-8ff2-14b75d8d16f9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:00.912328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:00.913013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.913321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.913594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] PATH_INFO: `/v3/projects/b0ec09ce99d646058172e02088690f2f/users/798b89eed6954cdfa5acb7e058aed869/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.928644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ec09ce99d646058172e02088690f2f, user_id=798b89eed6954cdfa5acb7e058aed869, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:00.931223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:00.944317 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4288/8605] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:48:00 2022] PUT /identity/v3/projects/b0ec09ce99d646058172e02088690f2f/users/798b89eed6954cdfa5acb7e058aed869/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:48:00.956423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100d46b-965b-4b8a-ad76-b898a24945c5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:00.956706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100d46b-965b-4b8a-ad76-b898a24945c5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:00.956976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100d46b-965b-4b8a-ad76-b898a24945c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:00.984843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2100d46b-965b-4b8a-ad76-b898a24945c5 None None] MFA Rules not processed for user `798b89eed6954cdfa5acb7e058aed869`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:00.986081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2100d46b-965b-4b8a-ad76-b898a24945c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:01.027099 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:01.051686 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4318/8606] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:01.056101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.118018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef923e3-3b5e-4957-8009-02d45edc5af7 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.123431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.124059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.124339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.124614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.125280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.127172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.154208 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4289/8607] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:48:01 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:48:01.158508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100d46b-965b-4b8a-ad76-b898a24945c5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.169856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100d46b-965b-4b8a-ad76-b898a24945c5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.225453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.226061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.226342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.226614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.227248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.229166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.251402 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4319/8608] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:48:01 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:48:01.255411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.266415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931313-6cb1-4c30-8409-7bb32208a237 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.270982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.271574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.271851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.272121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.272755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.274361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.285805 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4290/8609] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:01.289884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.300103 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d72853-ff8b-4fd0-99b1-5f446ca65f2f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.304779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.305523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.305808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.306083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] PATH_INFO: `/v3/projects/bc78446df8a84aafb9a32671c6aadd32/users/db41abcf1df6424dae73fc72e5544ffe/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.320706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc78446df8a84aafb9a32671c6aadd32, user_id=db41abcf1df6424dae73fc72e5544ffe, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.323423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.336741 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4320/8610] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:48:01 2022] PUT /identity/v3/projects/bc78446df8a84aafb9a32671c6aadd32/users/db41abcf1df6424dae73fc72e5544ffe/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:01.340614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.351999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d743f1-0aa9-470a-aeef-f3e282aca348 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.411378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309a310-a190-456d-afd7-9fd6fce24d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.411979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a310-a190-456d-afd7-9fd6fce24d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.412254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a310-a190-456d-afd7-9fd6fce24d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.412524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309a310-a190-456d-afd7-9fd6fce24d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.413184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a310-a190-456d-afd7-9fd6fce24d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.414749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309a310-a190-456d-afd7-9fd6fce24d70 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.425082 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4291/8611] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:01.429368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.440440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120ef4c-d598-4540-82a8-e4c944238da8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.445079 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.445752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.446037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.446308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] PATH_INFO: `/v3/projects/bc78446df8a84aafb9a32671c6aadd32/users/db41abcf1df6424dae73fc72e5544ffe/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.448225 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc78446df8a84aafb9a32671c6aadd32, user_id=db41abcf1df6424dae73fc72e5544ffe, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.455397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.465756 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4321/8612] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:48:01 2022] PUT /identity/v3/projects/bc78446df8a84aafb9a32671c6aadd32/users/db41abcf1df6424dae73fc72e5544ffe/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:01.476320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ac2-e128-4bc4-9f60-1e1a0d1ce42b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.476663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ac2-e128-4bc4-9f60-1e1a0d1ce42b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.476969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ac2-e128-4bc4-9f60-1e1a0d1ce42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.496960 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:01.507915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9f485ac2-e128-4bc4-9f60-1e1a0d1ce42b None None] MFA Rules not processed for user `db41abcf1df6424dae73fc72e5544ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:01.509141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f485ac2-e128-4bc4-9f60-1e1a0d1ce42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:01.576881 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4292/8613] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:01.588184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.589987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:01.650862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec698-7d0d-47bb-8898-6f86da6db2f6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.655198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.656067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.656371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.656640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.666092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.667501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.677428 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4322/8614] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:01.759880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ac2-e128-4bc4-9f60-1e1a0d1ce42b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:01.772241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ac2-e128-4bc4-9f60-1e1a0d1ce42b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:01.775976 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aac39-caa7-4a32-8f0c-c62016343760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:01.776571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aac39-caa7-4a32-8f0c-c62016343760 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:01.776849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aac39-caa7-4a32-8f0c-c62016343760 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:01.777146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aac39-caa7-4a32-8f0c-c62016343760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:01.838629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1aac39-caa7-4a32-8f0c-c62016343760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:01.840074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1aac39-caa7-4a32-8f0c-c62016343760 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:01.850085 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4293/8615] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:07.652306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:07.694251 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:07.717202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19d3ab-dc13-40a2-a954-181398c46738 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:07.721731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:07.722353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:07.722622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:07.722888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] PATH_INFO: `/v3/users/798b89eed6954cdfa5acb7e058aed869` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:07.723996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798b89eed6954cdfa5acb7e058aed869)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:07.725932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:07.773484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798b89eed6954cdfa5acb7e058aed869'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:07.774074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798b89eed6954cdfa5acb7e058aed869'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:07.774738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798b89eed6954cdfa5acb7e058aed869'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:07.787266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798b89eed6954cdfa5acb7e058aed869'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:07.794288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798b89eed6954cdfa5acb7e058aed869'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:07.807362 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4323/8616] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:48:07 2022] DELETE /identity/v3/users/798b89eed6954cdfa5acb7e058aed869 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:07.812060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:07.813382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:07.813557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:07.834532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:07.835752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:07.897196 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4294/8617] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:07.907645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:07.909610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:07.977797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe4aa-3653-4f92-8b2e-5ea19dc9fa49 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:07.981606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:07.982246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:07.982519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:07.982787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:07.993695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:07.995149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:08.005757 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4324/8618] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:08.283461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:08.285437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:08.306750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa7072-0eff-4837-93a4-12aa38e96b11 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:08.311668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:08.312403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:08.312793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:08.313305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] PATH_INFO: `/v3/projects/b0ec09ce99d646058172e02088690f2f` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:08.314570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ec09ce99d646058172e02088690f2f)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:08.316493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:08.353018 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:08.375820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ec09ce99d646058172e02088690f2f', 'request_id': 'req-20a435eb-f75e-4dbc-a823-5e1746ad54a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.382504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ec09ce99d646058172e02088690f2f', 'request_id': 'req-20a435eb-f75e-4dbc-a823-5e1746ad54a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.389886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ec09ce99d646058172e02088690f2f', 'request_id': 'req-20a435eb-f75e-4dbc-a823-5e1746ad54a3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.401331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] The token cache is being invalidate because project b0ec09ce99d646058172e02088690f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:48:08.401624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.402261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.403939 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4295/8619] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:48:08 2022] DELETE /identity/v3/projects/b0ec09ce99d646058172e02088690f2f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:08.409235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:08.425454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9396fac-d5cc-4bec-b58b-0bd597cd1c38 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:08.489070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:08.489722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:08.490000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:08.490271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] PATH_INFO: `/v3/users/db41abcf1df6424dae73fc72e5544ffe` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:08.491407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] RBAC: Authorizing `identity:delete_user(user_id=db41abcf1df6424dae73fc72e5544ffe)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:08.493324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:08.494776 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:08.550156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db41abcf1df6424dae73fc72e5544ffe'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.550913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db41abcf1df6424dae73fc72e5544ffe'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.551519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db41abcf1df6424dae73fc72e5544ffe'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.566143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db41abcf1df6424dae73fc72e5544ffe'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.574060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ffa6e3f0-b696-4a55-82ec-8597760091df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db41abcf1df6424dae73fc72e5544ffe'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:08.589013 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4325/8620] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:48:08 2022] DELETE /identity/v3/users/db41abcf1df6424dae73fc72e5544ffe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:08.885629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:08.887057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:08.901492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a435eb-f75e-4dbc-a823-5e1746ad54a3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:08.959342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:08.959971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:08.960274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:08.960547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] PATH_INFO: `/v3/projects/bc78446df8a84aafb9a32671c6aadd32` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:08.961691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc78446df8a84aafb9a32671c6aadd32)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:08.963612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.008892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc78446df8a84aafb9a32671c6aadd32', 'request_id': 'req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.015236 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc78446df8a84aafb9a32671c6aadd32', 'request_id': 'req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.022975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc78446df8a84aafb9a32671c6aadd32', 'request_id': 'req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.033684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] The token cache is being invalidate because project bc78446df8a84aafb9a32671c6aadd32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:48:09.033969 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.034614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e0f0ea7c-568d-4b7e-9cfa-dc7c1d5b9525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.036089 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4296/8621] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:48:08 2022] DELETE /identity/v3/projects/bc78446df8a84aafb9a32671c6aadd32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:09.040904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1f1b-c76f-40e3-ba5c-fc813c7a1281 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.041407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1f1b-c76f-40e3-ba5c-fc813c7a1281 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.041596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1f1b-c76f-40e3-ba5c-fc813c7a1281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.061260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-919d1f1b-c76f-40e3-ba5c-fc813c7a1281 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:09.062976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-919d1f1b-c76f-40e3-ba5c-fc813c7a1281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:09.121887 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4326/8622] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:09.132100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08b54-7e95-4e0b-ab43-fc8f16fa6ac6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.132321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08b54-7e95-4e0b-ab43-fc8f16fa6ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.132593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08b54-7e95-4e0b-ab43-fc8f16fa6ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.152757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b4e08b54-7e95-4e0b-ab43-fc8f16fa6ac6 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:09.153990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b4e08b54-7e95-4e0b-ab43-fc8f16fa6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:09.162289 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4297/8623] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:09.166189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d1f1b-c76f-40e3-ba5c-fc813c7a1281 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.176069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d1f1b-c76f-40e3-ba5c-fc813c7a1281 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.180892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.181657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.181790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.182056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.182691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:48:09.182968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.184563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.196630 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4327/8624] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:48:09.200997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e08b54-7e95-4e0b-ab43-fc8f16fa6ac6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.211043 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e08b54-7e95-4e0b-ab43-fc8f16fa6ac6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.215693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.216278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.216553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.216818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.217487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.219781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.246244 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4298/8625] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:48:09 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:48:09.250943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.262912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3faede-0722-4a5f-9dbd-23a6f50d0338 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.319664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.320269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.320550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.320825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.321492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.323389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.334665 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:09.349771 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4328/8626] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:48:09 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:48:09.350988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.362179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f00a71-9554-442d-a67f-eae7a8163b6f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.367014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.367612 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.367895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.368192 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.368830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.370463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.381518 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4299/8627] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:09.385043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.394959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06eceb-0af3-4a07-a02f-98bfcb0b09bb admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.399484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d227f-71b5-468c-adf8-ceac53f19870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.400066 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d227f-71b5-468c-adf8-ceac53f19870 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.400348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d227f-71b5-468c-adf8-ceac53f19870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.400616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d227f-71b5-468c-adf8-ceac53f19870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.401276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d227f-71b5-468c-adf8-ceac53f19870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.402837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d227f-71b5-468c-adf8-ceac53f19870 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.414019 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4329/8628] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:09.417919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.428638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c663aa6-e5bf-4353-b92d-6c81f08c47db admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.433283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.433930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.434268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.434549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] PATH_INFO: `/v3/projects/96d5fee9ea0d43adb19718f03de3deaa/users/06276e3183c7404894d921c036a747f1/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.436751 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:09.452051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d5fee9ea0d43adb19718f03de3deaa, user_id=06276e3183c7404894d921c036a747f1, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.455013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.466993 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4300/8629] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:48:09 2022] PUT /identity/v3/projects/96d5fee9ea0d43adb19718f03de3deaa/users/06276e3183c7404894d921c036a747f1/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:09.477268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609c8b-c830-4ffe-8523-34b3520fd87d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.477555 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609c8b-c830-4ffe-8523-34b3520fd87d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.477831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609c8b-c830-4ffe-8523-34b3520fd87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.505830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-18609c8b-c830-4ffe-8523-34b3520fd87d None None] MFA Rules not processed for user `06276e3183c7404894d921c036a747f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:09.507024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-18609c8b-c830-4ffe-8523-34b3520fd87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:09.573506 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4330/8630] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:09.607866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.609636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:09.670962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425b9b5-460a-43d9-a605-bad148708354 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.674778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0941b77-4936-4fa3-88a7-39e07a1b8dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.675377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0941b77-4936-4fa3-88a7-39e07a1b8dcd service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.675652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0941b77-4936-4fa3-88a7-39e07a1b8dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.675921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0941b77-4936-4fa3-88a7-39e07a1b8dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.684159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0941b77-4936-4fa3-88a7-39e07a1b8dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.685609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0941b77-4936-4fa3-88a7-39e07a1b8dcd service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.694348 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4301/8631] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:09.710692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609c8b-c830-4ffe-8523-34b3520fd87d None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.777842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609c8b-c830-4ffe-8523-34b3520fd87d None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:09.782711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:09.783592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.783871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.784144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] PATH_INFO: `/v3/users/06276e3183c7404894d921c036a747f1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.785386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06276e3183c7404894d921c036a747f1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:09.787298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:09.834384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06276e3183c7404894d921c036a747f1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.835041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06276e3183c7404894d921c036a747f1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.835653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06276e3183c7404894d921c036a747f1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.847366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06276e3183c7404894d921c036a747f1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.854123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06276e3183c7404894d921c036a747f1'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:09.856571 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:09.872301 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4331/8632] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:48:09 2022] DELETE /identity/v3/users/06276e3183c7404894d921c036a747f1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:09.877930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:09.878216 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:09.878513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:09.898829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:09.900144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:09.959032 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4302/8633] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:09.969544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:09.970967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:10.031716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46172cde-fdbe-468e-b671-6a5ec4c6290b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.035768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af17d9-f58f-41fb-a58d-292d4bd29f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.036376 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af17d9-f58f-41fb-a58d-292d4bd29f6a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.036656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af17d9-f58f-41fb-a58d-292d4bd29f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.036928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af17d9-f58f-41fb-a58d-292d4bd29f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.046392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af17d9-f58f-41fb-a58d-292d4bd29f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.048455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af17d9-f58f-41fb-a58d-292d4bd29f6a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.058244 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4332/8634] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:10.335098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.336651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:10.349866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5c8b-218a-4c91-91f2-1cd83ea479e4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.354508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.355154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.355435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.355710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] PATH_INFO: `/v3/projects/96d5fee9ea0d43adb19718f03de3deaa` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.356856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d5fee9ea0d43adb19718f03de3deaa)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.358872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.407757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d5fee9ea0d43adb19718f03de3deaa', 'request_id': 'req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:10.414129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d5fee9ea0d43adb19718f03de3deaa', 'request_id': 'req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:10.421292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d5fee9ea0d43adb19718f03de3deaa', 'request_id': 'req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:10.432818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] The token cache is being invalidate because project 96d5fee9ea0d43adb19718f03de3deaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:48:10.433143 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:10.433766 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-0bc00ab0-8bbd-446a-a9af-3d426ac7d2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:48:10.435243 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4303/8635] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:48:10 2022] DELETE /identity/v3/projects/96d5fee9ea0d43adb19718f03de3deaa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:48:10.440759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52761d34-d54f-491b-8b75-f0df33a43a16 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.441115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52761d34-d54f-491b-8b75-f0df33a43a16 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.441387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52761d34-d54f-491b-8b75-f0df33a43a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.461102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-52761d34-d54f-491b-8b75-f0df33a43a16 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:10.462333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-52761d34-d54f-491b-8b75-f0df33a43a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:10.524714 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4333/8636] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:10.533572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b307-3915-4823-893f-f97305af3b09 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.533859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b307-3915-4823-893f-f97305af3b09 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.534130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b307-3915-4823-893f-f97305af3b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.554655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9234b307-3915-4823-893f-f97305af3b09 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:10.555863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9234b307-3915-4823-893f-f97305af3b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:10.564047 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4304/8637] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:10.568226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52761d34-d54f-491b-8b75-f0df33a43a16 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.578052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52761d34-d54f-491b-8b75-f0df33a43a16 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.583168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.583760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.584039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.584312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.584946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:48:10.585284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.586895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.599072 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4334/8638] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:48:10.602970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b307-3915-4823-893f-f97305af3b09 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.607380 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:10.613892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b307-3915-4823-893f-f97305af3b09 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.619511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.620106 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.620385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.620657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.621476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.623383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.650865 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4305/8639] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:48:10 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:48:10.655063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.665821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8a65-3c14-423f-b2b2-748c09c9a567 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.721785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.722312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.722590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.722863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.723494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.725427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.746589 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4335/8640] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:48:10 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:48:10.751203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.761686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa41e0-cd4d-4502-950b-17632f6de9b2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.767265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.767850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.768149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.768419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.769045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.770644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.786201 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4306/8641] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:10.789912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.800204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7aa1-a0c8-4536-8d44-47950aade764 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.804852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b90c7-2b4e-459e-b8a5-b48bccc6f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.805480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b90c7-2b4e-459e-b8a5-b48bccc6f40a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.805758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b90c7-2b4e-459e-b8a5-b48bccc6f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.806029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b90c7-2b4e-459e-b8a5-b48bccc6f40a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.806658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b90c7-2b4e-459e-b8a5-b48bccc6f40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.808337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b90c7-2b4e-459e-b8a5-b48bccc6f40a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.819624 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4336/8642] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:48:10.823736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.834391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a28b1d-5846-4db1-be76-49d62abfa1b5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:10.839049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:10.839685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.839964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.840235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] PATH_INFO: `/v3/projects/b0256ae4130a44bcb5c4c18fcad5529b/users/327dbe0fb72b489fa0e6985f78c89d59/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.854621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0256ae4130a44bcb5c4c18fcad5529b, user_id=327dbe0fb72b489fa0e6985f78c89d59, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:10.857264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:10.870550 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4307/8643] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:48:10 2022] PUT /identity/v3/projects/b0256ae4130a44bcb5c4c18fcad5529b/users/327dbe0fb72b489fa0e6985f78c89d59/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:48:10.876653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b8da-3300-49cf-821a-84e210c5007e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:10.876939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b8da-3300-49cf-821a-84e210c5007e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:10.877253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2b8da-3300-49cf-821a-84e210c5007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:10.884403 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:10.897882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e3c2b8da-3300-49cf-821a-84e210c5007e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:10.899081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e3c2b8da-3300-49cf-821a-84e210c5007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:10.962067 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4337/8644] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:10.971849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:10.973593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:11.034958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b6398-91dd-43b4-a401-21fda9b3669c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:11.038736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:11.039339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:11.039624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:11.039898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:11.049470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:11.050908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:11.060336 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4308/8645] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:11.682557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb4b9-9666-4707-a9e5-44059db24d67 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:11.683090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb4b9-9666-4707-a9e5-44059db24d67 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:11.683090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecb4b9-9666-4707-a9e5-44059db24d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:11.719063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8eecb4b9-9666-4707-a9e5-44059db24d67 None None] MFA Rules not processed for user `327dbe0fb72b489fa0e6985f78c89d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:11.720368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8eecb4b9-9666-4707-a9e5-44059db24d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:11.788881 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4338/8646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:11.800148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:11.801587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:11.871437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc339ef6-0aee-4e8c-8d83-135249dda8e8 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:11.876645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:11.877293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:11.877577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:11.877851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:11.886836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:11.888287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:11.897234 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4309/8647] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:13.265318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffd5bb-ff6e-4ca7-9c25-21e9b32bdd2e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:13.266460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffd5bb-ff6e-4ca7-9c25-21e9b32bdd2e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:13.266845 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffd5bb-ff6e-4ca7-9c25-21e9b32bdd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:13.288251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-84ffd5bb-ff6e-4ca7-9c25-21e9b32bdd2e None None] MFA Rules not processed for user `327dbe0fb72b489fa0e6985f78c89d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:13.289492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84ffd5bb-ff6e-4ca7-9c25-21e9b32bdd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:13.296407 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4339/8648] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:13.534852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:13.546824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba92d-2e1f-4774-a7a0-ac180b5515d7 service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:13.550427 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:13.551010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:13.551282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:13.551577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:13.553333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:13.565918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:13.567328 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:13.577567 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4310/8649] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:23.280128 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=61 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:23.571628 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:30.698090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0baf-c1c6-4b92-a1d2-6b40661f0b75 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:30.698594 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0baf-c1c6-4b92-a1d2-6b40661f0b75 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:30.698701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0baf-c1c6-4b92-a1d2-6b40661f0b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:30.718543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e72e0baf-c1c6-4b92-a1d2-6b40661f0b75 None None] MFA Rules not processed for user `327dbe0fb72b489fa0e6985f78c89d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:30.719890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e72e0baf-c1c6-4b92-a1d2-6b40661f0b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:30.726842 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4340/8650] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:48:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:33.520879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:33.532852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0babe-f20c-4a91-866b-79ba89514a9f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:33.536829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:33.537469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:33.537744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:33.538011 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:33.539727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:33.615524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:33.616967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:33.631426 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4311/8651] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:40.713224 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:43.623127 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=34 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:48:48.593411 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:48.593902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:48.594023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:48.623312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:48:48.624430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:48.690850 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4341/8652] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 01:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:48:48.735965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:48.737461 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:48.830078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434108be-6cd9-4d2b-aa4e-1ca6bdeed559 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:48.835048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda659f3-bc71-4117-864b-15c54592b3a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:48.835652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda659f3-bc71-4117-864b-15c54592b3a6 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:48.835937 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda659f3-bc71-4117-864b-15c54592b3a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:48.836208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda659f3-bc71-4117-864b-15c54592b3a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:48.844169 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda659f3-bc71-4117-864b-15c54592b3a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:48.846338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda659f3-bc71-4117-864b-15c54592b3a6 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:48.854520 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4312/8653] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:48:51.582463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:48:51.584275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:51.604750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55222a5b-99c3-4566-a61e-c19e1551b2f6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:48:51.612360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:48:51.613443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:48:51.613721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:48:51.613992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:48:51.615909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:48:51.703613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:48:51.705295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:48:51.733794 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4342/8654] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:48:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:48:58.851167 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=41 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:49:01.726966 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=67 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:49:06.705673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694f7b-52b6-460b-9b40-3c2f11a33db0 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:06.707220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694f7b-52b6-460b-9b40-3c2f11a33db0 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:06.707684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea694f7b-52b6-460b-9b40-3c2f11a33db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:06.734301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ea694f7b-52b6-460b-9b40-3c2f11a33db0 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:49:06.735967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ea694f7b-52b6-460b-9b40-3c2f11a33db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:06.746635 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4313/8655] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 01:49:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:49:06.762511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:06.779115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a009d-876a-43c6-88fe-3697280dfc79 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:06.786089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:06.786782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:06.787305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:06.787805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:06.797267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:06.799148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:06.809023 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4343/8656] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:49:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:49:09.009382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d8893-2d99-4a34-8d5c-d750cce072a1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:09.010247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d8893-2d99-4a34-8d5c-d750cce072a1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:09.010525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d8893-2d99-4a34-8d5c-d750cce072a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:09.043384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-972d8893-2d99-4a34-8d5c-d750cce072a1 None None] MFA Rules not processed for user `5b62f2cd5736454c8f95c80ab8ecc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:49:09.044862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-972d8893-2d99-4a34-8d5c-d750cce072a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:09.108473 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4314/8657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:49:11.180667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:11.192759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42f4fb-2871-46b5-b03b-cfde91cc5f08 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:11.197827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:11.198601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:11.198884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:11.199357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] PATH_INFO: `/v3/users/327dbe0fb72b489fa0e6985f78c89d59` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:11.200506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=327dbe0fb72b489fa0e6985f78c89d59)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:11.202524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:11.290720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327dbe0fb72b489fa0e6985f78c89d59'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.291757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327dbe0fb72b489fa0e6985f78c89d59'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.293588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327dbe0fb72b489fa0e6985f78c89d59'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.315407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327dbe0fb72b489fa0e6985f78c89d59'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.326194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2d4ed947-1106-4121-9877-2986739af29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327dbe0fb72b489fa0e6985f78c89d59'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.379437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4344/8658] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:49:11 2022] DELETE /identity/v3/users/327dbe0fb72b489fa0e6985f78c89d59 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:49:11.772865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d8893-2d99-4a34-8d5c-d750cce072a1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:11.787101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d8893-2d99-4a34-8d5c-d750cce072a1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:11.876746 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:11.877632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:11.878021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:11.878403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] PATH_INFO: `/v3/projects/b0256ae4130a44bcb5c4c18fcad5529b` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:11.879692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0256ae4130a44bcb5c4c18fcad5529b)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:11.882182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:11.940667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0256ae4130a44bcb5c4c18fcad5529b', 'request_id': 'req-5d614e59-d674-482c-89ad-e8d6cf433b47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.948102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0256ae4130a44bcb5c4c18fcad5529b', 'request_id': 'req-5d614e59-d674-482c-89ad-e8d6cf433b47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.960064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0256ae4130a44bcb5c4c18fcad5529b', 'request_id': 'req-5d614e59-d674-482c-89ad-e8d6cf433b47'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.983175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] The token cache is being invalidate because project b0256ae4130a44bcb5c4c18fcad5529b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:49:11.984032 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.984779 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-5d614e59-d674-482c-89ad-e8d6cf433b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:49:11.991958 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4315/8659] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:49:11 2022] DELETE /identity/v3/projects/b0256ae4130a44bcb5c4c18fcad5529b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:49:11.993942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360413dc-4783-40a7-b363-61a7e696cdf7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:11.994447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360413dc-4783-40a7-b363-61a7e696cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:11.994922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360413dc-4783-40a7-b363-61a7e696cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.034157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-360413dc-4783-40a7-b363-61a7e696cdf7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:49:12.036164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-360413dc-4783-40a7-b363-61a7e696cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:12.137152 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4688406-5fc6-4674-8416-78b33500ef90 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.137442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4688406-5fc6-4674-8416-78b33500ef90 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.137763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4688406-5fc6-4674-8416-78b33500ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.142483 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4345/8660] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:49:12.161553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e4688406-5fc6-4674-8416-78b33500ef90 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:49:12.163128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e4688406-5fc6-4674-8416-78b33500ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:12.173366 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4316/8661] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:49:12.178761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360413dc-4783-40a7-b363-61a7e696cdf7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:12.192979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360413dc-4783-40a7-b363-61a7e696cdf7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:12.212081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:12.213283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.213567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.213904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.214794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:49:12.215098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:12.217586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:12.230826 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4346/8662] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:49:12.235713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4688406-5fc6-4674-8416-78b33500ef90 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:12.246483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4688406-5fc6-4674-8416-78b33500ef90 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:12.252452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:12.253281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.253659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.254029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.254787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:12.257168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:12.284204 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:49:12.291391 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4317/8663] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:49:12 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:49:12.299747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:12.311440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e68666-e730-4706-a6ed-88841b52fd7e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:12.374023 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:49:12.389917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:12.391261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.391723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.392257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.392974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:12.395091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:12.418271 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4347/8664] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:49:12 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:49:12.423238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:12.435998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e88248-79cd-430a-8ffc-5d9de3f241dd admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:12.442048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:12.443016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.444295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.445294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.446203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:12.448397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:12.489464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4318/8665] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:49:12.490730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:12.506736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305b47-1aa8-4d87-bc4b-00108b6a4e6f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:12.533867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95cc5-93af-48a3-a8fe-b8781148a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:12.534938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95cc5-93af-48a3-a8fe-b8781148a2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.535400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95cc5-93af-48a3-a8fe-b8781148a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.535843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95cc5-93af-48a3-a8fe-b8781148a2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.537317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95cc5-93af-48a3-a8fe-b8781148a2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:12.539508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95cc5-93af-48a3-a8fe-b8781148a2e2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:12.561439 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4348/8666] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:49:12.562168 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:12.576512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca11889-d7e7-4471-ab11-98eba542b623 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:12.583370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:12.584286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.584733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.585222 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] PATH_INFO: `/v3/projects/eb817e8a0d424ca9a15c43157e4a9fb5/users/23c9d66385884dcf916f356e457d52b1/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.604524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb817e8a0d424ca9a15c43157e4a9fb5, user_id=23c9d66385884dcf916f356e457d52b1, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:12.608596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:12.629004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4319/8667] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:49:12 2022] PUT /identity/v3/projects/eb817e8a0d424ca9a15c43157e4a9fb5/users/23c9d66385884dcf916f356e457d52b1/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:49:12.641875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.642211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.642430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.693958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] MFA Rules not processed for user `23c9d66385884dcf916f356e457d52b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:49:12.695484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:12.786379 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4349/8668] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:49:12.799802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:12.801694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:12.876504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c25d9-646d-4bc8-8455-81fa1406848a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:12.880673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:12.881321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:12.881606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:12.881886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:12.891263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:12.892894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:12.903046 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4320/8669] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:49:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:49:20.856737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:20.858419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:20.935182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793404a-d8b8-4309-b461-54b9bd8978c3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:20.941900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:20.942565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:20.942832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:20.943108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:20.951428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:20.953045 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:20.961401 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4350/8670] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 01:49:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:49:22.178108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:22.179681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:22.254053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93a00-62b0-4f16-9dca-74df4493b26f service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:22.258453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:22.259341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:22.259810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:22.260083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:22.262200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:22.356607 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:22.358190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:22.374859 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4321/8671] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:49:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:49:25.635640 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:49:25.638184 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:25.660787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee2bd-8262-4742-8841-e4420541be2c service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:49:25.665189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6bb24-d0b3-4b67-a7fd-2b2058e69287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:49:25.666963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6bb24-d0b3-4b67-a7fd-2b2058e69287 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:49:25.667271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6bb24-d0b3-4b67-a7fd-2b2058e69287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:49:25.667542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6bb24-d0b3-4b67-a7fd-2b2058e69287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:49:25.669387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-afe6bb24-d0b3-4b67-a7fd-2b2058e69287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:49:25.693694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6bb24-d0b3-4b67-a7fd-2b2058e69287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:49:25.698086 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6bb24-d0b3-4b67-a7fd-2b2058e69287 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:49:25.755024 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4351/8672] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:49:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:49:32.366829 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:49:35.732078 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:00.135972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:00.199393 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c221c9-73c8-4816-be9a-6a1cfb85b533 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:00.204047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:00.204676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:00.204956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:00.205424 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] PATH_INFO: `/v3/users/23c9d66385884dcf916f356e457d52b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:00.206556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c9d66385884dcf916f356e457d52b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:00.208491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:00.258885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c9d66385884dcf916f356e457d52b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.259561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c9d66385884dcf916f356e457d52b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.260342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c9d66385884dcf916f356e457d52b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.268743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c9d66385884dcf916f356e457d52b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.282335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c9d66385884dcf916f356e457d52b1'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.296127 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4322/8673] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:50:00 2022] DELETE /identity/v3/users/23c9d66385884dcf916f356e457d52b1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:50:00.301389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:00.301887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:00.302101 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:00.322947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:50:00.324147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:00.385938 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4352/8674] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:50:00.396382 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:00.397816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:00.460505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621260-5fb2-41bd-bf6d-d59f156a4626 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:00.464176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:00.464777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:00.465053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:00.465353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:00.475155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:00.476579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:00.487106 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4323/8675] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:50:00.775925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:00.777937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:00.791902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8566f18-89ed-4bc9-850a-56163c64d148 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:00.796911 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:00.798095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:00.798398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:00.798671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] PATH_INFO: `/v3/projects/eb817e8a0d424ca9a15c43157e4a9fb5` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:00.799815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb817e8a0d424ca9a15c43157e4a9fb5)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:00.801771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:00.855617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb817e8a0d424ca9a15c43157e4a9fb5', 'request_id': 'req-871a11dc-1b86-40ec-9046-f740f6bff4f8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.862316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb817e8a0d424ca9a15c43157e4a9fb5', 'request_id': 'req-871a11dc-1b86-40ec-9046-f740f6bff4f8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.869318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb817e8a0d424ca9a15c43157e4a9fb5', 'request_id': 'req-871a11dc-1b86-40ec-9046-f740f6bff4f8'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.885020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] The token cache is being invalidate because project eb817e8a0d424ca9a15c43157e4a9fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:50:00.885339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.885975 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:50:00.887529 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4353/8676] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:50:00 2022] DELETE /identity/v3/projects/eb817e8a0d424ca9a15c43157e4a9fb5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:50:10.482061 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:10.881661 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:28.466740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:28.468170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:28.551492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783bc73-cb9e-4385-948d-8c58d3e3927e service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:28.610756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:28.611757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:28.612272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:28.612550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:28.614289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:28.628917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:28.630564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:28.644003 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4324/8677] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:50:29.964966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:29.966581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:30.036457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a11dc-1b86-40ec-9046-f740f6bff4f8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:30.040240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:30.040842 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:30.041154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:30.041422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:30.043102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:30.057253 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:30.058677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:30.071674 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4354/8678] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:50:38.636459 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=62 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:40.064152 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=26 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:50:48.102963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:48.104420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:48.250232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcdd89-59d1-4a92-a2f7-59368fce9fb6 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:48.257338 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:48.257965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:48.258244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:48.258578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:48.260317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:48.281964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:48.285040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:48.300754 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4325/8679] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:50:49.756194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:49.759497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:49.792978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012438bc-562e-40e9-9d7e-78e69b7c9f47 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:49.798777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131db7c-5b8c-4a4f-84a9-7f8397fdcc33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:49.799893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131db7c-5b8c-4a4f-84a9-7f8397fdcc33 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:49.800170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131db7c-5b8c-4a4f-84a9-7f8397fdcc33 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:49.800444 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131db7c-5b8c-4a4f-84a9-7f8397fdcc33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:49.802263 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0131db7c-5b8c-4a4f-84a9-7f8397fdcc33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:49.818821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131db7c-5b8c-4a4f-84a9-7f8397fdcc33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:49.820406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131db7c-5b8c-4a4f-84a9-7f8397fdcc33 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:49.837153 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4355/8680] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:50:53.405148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:50:53.406687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:53.424793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06112d-5457-4044-a6fa-0702ef479bbb service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:50:53.432127 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:50:53.433054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:53.433525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:53.433902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:53.440574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:53.459359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:50:53.461124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:50:53.492113 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4326/8681] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:50:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:50:59.600140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2badb1-8a93-4cb1-86bd-9267d465ad2a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:50:59.600609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2badb1-8a93-4cb1-86bd-9267d465ad2a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:50:59.600609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2badb1-8a93-4cb1-86bd-9267d465ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:50:59.623863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1a2badb1-8a93-4cb1-86bd-9267d465ad2a None None] MFA Rules not processed for user `5b62f2cd5736454c8f95c80ab8ecc6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:50:59.625910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1a2badb1-8a93-4cb1-86bd-9267d465ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:50:59.711287 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4356/8682] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:50:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:51:00.429121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:51:00.443902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fb172-8aff-4c5d-befb-8f704b755994 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:51:00.450422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:51:00.451041 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:51:00.451550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:51:00.452001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:51:00.454166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:51:00.470331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:51:00.472471 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:51:00.486402 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4327/8683] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:51:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:51:09.119970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2badb1-8a93-4cb1-86bd-9267d465ad2a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:51:09.154017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2badb1-8a93-4cb1-86bd-9267d465ad2a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:51:09.160171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:51:09.160790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:51:09.161096 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:51:09.161370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:51:09.163342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:51:09.192232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:51:09.193860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:51:09.207156 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4357/8684] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:51:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:51:10.479586 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=58 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:51:19.200079 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=53 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:51:34.051996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:51:34.081017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e7dc-d9c6-40f7-a547-7da4db023af0 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:51:34.086789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:51:34.087442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:51:34.087732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:51:34.088004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:51:34.089747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:51:34.117884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:51:34.119482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:51:34.132928 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4328/8685] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:51:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:51:41.131488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:51:41.132889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:51:41.150072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa7a4-e538-4dbc-825d-6825172f3d85 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:51:41.155164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc171f-e56b-445c-ad13-3065c8786ad0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:51:41.155755 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc171f-e56b-445c-ad13-3065c8786ad0 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:51:41.156031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc171f-e56b-445c-ad13-3065c8786ad0 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:51:41.156295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc171f-e56b-445c-ad13-3065c8786ad0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:51:41.157970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-90cc171f-e56b-445c-ad13-3065c8786ad0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:51:41.171859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc171f-e56b-445c-ad13-3065c8786ad0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:51:41.173431 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc171f-e56b-445c-ad13-3065c8786ad0 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:51:41.186318 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4358/8686] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:51:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:51:44.125280 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=17 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:51:51.179702 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:10.022415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:10.047657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561a3c7-aec3-4a0a-93fd-10d8b1d93260 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:10.053893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:10.054467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:10.054750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:10.055019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:10.056720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:10.089734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:10.091329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:10.100603 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4329/8687] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:53:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:53:20.096105 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=18 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:41.957833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:41.958745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:41.959016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:42.028407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:42.030704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:42.038346 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4359/8688] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 01:53:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:53:42.044667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:42.054839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d36d18-80a9-4727-85b9-7f7a7591a532 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:42.058538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7691d5-179d-4f90-9b32-9065bcf167d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:42.059140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7691d5-179d-4f90-9b32-9065bcf167d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:42.059419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7691d5-179d-4f90-9b32-9065bcf167d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:42.059692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7691d5-179d-4f90-9b32-9065bcf167d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:42.061442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ca7691d5-179d-4f90-9b32-9065bcf167d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:42.091733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7691d5-179d-4f90-9b32-9065bcf167d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:42.093200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7691d5-179d-4f90-9b32-9065bcf167d1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:42.107565 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4330/8689] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:53:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:53:49.654032 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:49.655592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:49.743848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537eefa-d62d-4ad6-ab40-da44b7fe1ef2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:49.748452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:49.749081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:49.749380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:49.749652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] PATH_INFO: `/v3/users/5b62f2cd5736454c8f95c80ab8ecc6a2` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:49.750777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b62f2cd5736454c8f95c80ab8ecc6a2)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:49.752666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:49.799687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b62f2cd5736454c8f95c80ab8ecc6a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:49.800815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b62f2cd5736454c8f95c80ab8ecc6a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:49.801450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b62f2cd5736454c8f95c80ab8ecc6a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:49.813404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b62f2cd5736454c8f95c80ab8ecc6a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:49.820967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5a6fea96-ee02-43be-b6a2-80cb3be093c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b62f2cd5736454c8f95c80ab8ecc6a2'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:49.833443 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4360/8690] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:53:49 2022] DELETE /identity/v3/users/5b62f2cd5736454c8f95c80ab8ecc6a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:53:49.838045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07373d3-0db2-4074-b85b-19825ee3aa35 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:49.838577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07373d3-0db2-4074-b85b-19825ee3aa35 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:49.838730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07373d3-0db2-4074-b85b-19825ee3aa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:49.866420 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d07373d3-0db2-4074-b85b-19825ee3aa35 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:49.867554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d07373d3-0db2-4074-b85b-19825ee3aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:49.928588 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4331/8691] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:53:49.938163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:49.938446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:49.938712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:49.959353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:49.960528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:49.973306 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:50.013913 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4361/8692] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 01:53:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:53:50.020505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07373d3-0db2-4074-b85b-19825ee3aa35 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:50.029986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07373d3-0db2-4074-b85b-19825ee3aa35 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:50.033601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:50.034193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:50.035016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:50.035436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:50.044665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:50.046118 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:50.056240 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4332/8693] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:53:50.229099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:50.230533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:50.248798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf72a19-607f-4654-a96b-4d37e5713bab None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:50.260287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:50.260965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:50.261290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:50.261565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] PATH_INFO: `/v3/projects/13aea811223a421885d0b296cad99768` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:50.262719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13aea811223a421885d0b296cad99768)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:50.264646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:50.311950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aea811223a421885d0b296cad99768', 'request_id': 'req-cf545fe5-82d7-43d9-a1d2-0333bf951a97'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.318177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aea811223a421885d0b296cad99768', 'request_id': 'req-cf545fe5-82d7-43d9-a1d2-0333bf951a97'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.324538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aea811223a421885d0b296cad99768', 'request_id': 'req-cf545fe5-82d7-43d9-a1d2-0333bf951a97'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.338366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] The token cache is being invalidate because project 13aea811223a421885d0b296cad99768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:53:50.338658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.339291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.340781 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4362/8694] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:53:50 2022] DELETE /identity/v3/projects/13aea811223a421885d0b296cad99768 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:53:50.344872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:50.355588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df1e55-f954-4bdb-991f-d5827a34a0e4 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:50.411606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:50.412154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:50.412435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:50.412709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] PATH_INFO: `/v3/users/3b8f84836e0a4cf08b2a84b3b9c82356` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:50.426786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8f84836e0a4cf08b2a84b3b9c82356)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:50.428704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:50.475036 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8f84836e0a4cf08b2a84b3b9c82356'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.475695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8f84836e0a4cf08b2a84b3b9c82356'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.476306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8f84836e0a4cf08b2a84b3b9c82356'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.477520 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:50.485814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8f84836e0a4cf08b2a84b3b9c82356'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.498554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9defb0c2-0923-4a70-81dd-a0f8e81b256a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8f84836e0a4cf08b2a84b3b9c82356'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.512370 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4333/8695] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:53:50 2022] DELETE /identity/v3/users/3b8f84836e0a4cf08b2a84b3b9c82356 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:53:50.687062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:50.688647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:50.702971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf545fe5-82d7-43d9-a1d2-0333bf951a97 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:50.764492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:50.765151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:50.765434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:50.765701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] PATH_INFO: `/v3/projects/0a383752fb5d4dd29cc392f439a00634` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:50.776648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a383752fb5d4dd29cc392f439a00634)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:50.778580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:50.822708 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:50.825788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a383752fb5d4dd29cc392f439a00634', 'request_id': 'req-49cf74f8-42d0-4c20-a630-6648d199cbf7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.832734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a383752fb5d4dd29cc392f439a00634', 'request_id': 'req-49cf74f8-42d0-4c20-a630-6648d199cbf7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.839741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a383752fb5d4dd29cc392f439a00634', 'request_id': 'req-49cf74f8-42d0-4c20-a630-6648d199cbf7'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.852565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] The token cache is being invalidate because project 0a383752fb5d4dd29cc392f439a00634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:53:50.852846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.853508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-49cf74f8-42d0-4c20-a630-6648d199cbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:53:50.854978 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4363/8696] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:53:50 2022] DELETE /identity/v3/projects/0a383752fb5d4dd29cc392f439a00634 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:53:50.860086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc01f-3962-4195-9072-fc01944f0268 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:50.860590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc01f-3962-4195-9072-fc01944f0268 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:50.860712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc01f-3962-4195-9072-fc01944f0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:50.901429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-0ddbc01f-3962-4195-9072-fc01944f0268 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:50.902636 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0ddbc01f-3962-4195-9072-fc01944f0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:50.961640 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4334/8697] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:53:50.969912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a771-faac-42ff-8664-21e60c060894 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:50.970189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a771-faac-42ff-8664-21e60c060894 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:50.970454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a771-faac-42ff-8664-21e60c060894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:50.990760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dc39a771-faac-42ff-8664-21e60c060894 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:50.991940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dc39a771-faac-42ff-8664-21e60c060894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:50.999858 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4364/8698] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:53:51.004726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc01f-3962-4195-9072-fc01944f0268 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.014559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc01f-3962-4195-9072-fc01944f0268 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.019791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.020386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.020668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.020941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.021624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:53:51.021929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.023511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.036255 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4335/8699] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:53:51.040639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a771-faac-42ff-8664-21e60c060894 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.050017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a771-faac-42ff-8664-21e60c060894 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.055450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.056041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.056319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.056656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.057340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.059228 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.094783 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4365/8700] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:53:51 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:53:51.099821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.109881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792e60e-b2e1-4ad0-8729-8cf4eb4f4e0b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.165992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.166585 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.166858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.167126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.167751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.169673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.190811 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4336/8701] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:53:51 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:53:51.195487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.206787 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46090-d30a-478b-9856-5c6ef4f64d15 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.211818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.212363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.212676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.212952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.213626 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.215216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.226283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4366/8702] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:53:51.230276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.240551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b13fca-3c92-4b9a-a94e-5a0e549e6b00 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.245220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69425bfe-904b-4f33-82ca-16133a501342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.245809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69425bfe-904b-4f33-82ca-16133a501342 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.246086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69425bfe-904b-4f33-82ca-16133a501342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.246356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69425bfe-904b-4f33-82ca-16133a501342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.246995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69425bfe-904b-4f33-82ca-16133a501342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.248569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69425bfe-904b-4f33-82ca-16133a501342 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.260411 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4337/8703] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:53:51.264569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.275281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b67c-7ab3-446f-9dfc-9f6887b0ecdf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.279908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.280552 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.280833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.281144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] PATH_INFO: `/v3/projects/38007d670f4b4a98b9b6e3a213d31115/users/4281fb8eb2d14a3a962ffcff6f7956ee/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.296576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38007d670f4b4a98b9b6e3a213d31115, user_id=4281fb8eb2d14a3a962ffcff6f7956ee, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.299278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.312603 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4367/8704] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:53:51 2022] PUT /identity/v3/projects/38007d670f4b4a98b9b6e3a213d31115/users/4281fb8eb2d14a3a962ffcff6f7956ee/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:53:51.324214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee62933-e672-4e70-971d-4ea8ead9fde1 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.324527 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee62933-e672-4e70-971d-4ea8ead9fde1 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.324801 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee62933-e672-4e70-971d-4ea8ead9fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.353200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5ee62933-e672-4e70-971d-4ea8ead9fde1 None None] MFA Rules not processed for user `4281fb8eb2d14a3a962ffcff6f7956ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:51.354431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ee62933-e672-4e70-971d-4ea8ead9fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:51.358363 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:51.420707 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4338/8705] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:53:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:53:51.425453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.489861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96949c6-6fa9-4ade-8cb8-02a48475dd34 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.494676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.495279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.495557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.495830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.496586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.498507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.529734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4368/8706] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:53:51 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:53:51.531054 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee62933-e672-4e70-971d-4ea8ead9fde1 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.543790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee62933-e672-4e70-971d-4ea8ead9fde1 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.601745 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.602381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.602660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.602932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.603556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.605502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.627240 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4339/8707] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:53:51 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:53:51.631296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.641835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9ea77-4c42-4176-aad1-940d8259eba9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.646647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.647243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.647520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.647794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.648428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.650031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.662302 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4369/8708] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:53:51.666722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.677160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be94896-fac7-4761-9ef4-d5d07a8f1c15 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.681809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.682446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.682723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.682993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] PATH_INFO: `/v3/projects/2835d24fdb71439c847bb21d8d55e4a7/users/904d160395f040078757e0fdb089c03e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.697782 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2835d24fdb71439c847bb21d8d55e4a7, user_id=904d160395f040078757e0fdb089c03e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.700572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.713134 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4340/8709] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:53:51 2022] PUT /identity/v3/projects/2835d24fdb71439c847bb21d8d55e4a7/users/904d160395f040078757e0fdb089c03e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:53:51.717033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.727944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff3b0-65f5-4e73-9e73-f3424a5ad09b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.760030 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:51.786744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d8c9f-82b8-42eb-a7df-f4989e209642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.787347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d8c9f-82b8-42eb-a7df-f4989e209642 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.787675 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d8c9f-82b8-42eb-a7df-f4989e209642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.787966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d8c9f-82b8-42eb-a7df-f4989e209642 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.788595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d8c9f-82b8-42eb-a7df-f4989e209642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.790512 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d8c9f-82b8-42eb-a7df-f4989e209642 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.800840 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4370/8710] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:53:51.804798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.815341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d1c94-d283-46ba-8690-27913700034c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:51.820092 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:51.820740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.821022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.821319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] PATH_INFO: `/v3/projects/2835d24fdb71439c847bb21d8d55e4a7/users/904d160395f040078757e0fdb089c03e/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.823263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2835d24fdb71439c847bb21d8d55e4a7, user_id=904d160395f040078757e0fdb089c03e, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:51.825982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:51.836470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4341/8711] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:53:51 2022] PUT /identity/v3/projects/2835d24fdb71439c847bb21d8d55e4a7/users/904d160395f040078757e0fdb089c03e/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:53:51.846705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465d162-14a1-480c-bfb5-218767e961c4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:51.847525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465d162-14a1-480c-bfb5-218767e961c4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:51.847794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465d162-14a1-480c-bfb5-218767e961c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:51.875003 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6465d162-14a1-480c-bfb5-218767e961c4 None None] MFA Rules not processed for user `904d160395f040078757e0fdb089c03e`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:51.876200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6465d162-14a1-480c-bfb5-218767e961c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:51.944022 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4371/8712] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:53:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:53:51.955063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:51.956836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:52.013497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115c3a-bb1b-4b0e-8407-f68e5fe90ac3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:52.017029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c21cbc-d5be-4131-b493-ced4189e2449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:52.017691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c21cbc-d5be-4131-b493-ced4189e2449 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:52.017967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c21cbc-d5be-4131-b493-ced4189e2449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:52.018233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c21cbc-d5be-4131-b493-ced4189e2449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:52.027546 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:53:52.075927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c21cbc-d5be-4131-b493-ced4189e2449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:52.077381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c21cbc-d5be-4131-b493-ced4189e2449 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:52.086616 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4342/8713] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:53:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:53:53.821891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465d162-14a1-480c-bfb5-218767e961c4 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:53.831413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465d162-14a1-480c-bfb5-218767e961c4 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:53.835643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:53.836241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:53.836519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:53.836793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:53.846789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:53.849372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:53.859135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4372/8714] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:53:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:53:59.565281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e86a-937f-4953-9b45-eafba9e8b450 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:59.566345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e86a-937f-4953-9b45-eafba9e8b450 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:59.566441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e86a-937f-4953-9b45-eafba9e8b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:59.587361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ebe7e86a-937f-4953-9b45-eafba9e8b450 None None] MFA Rules not processed for user `4281fb8eb2d14a3a962ffcff6f7956ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:53:59.588464 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ebe7e86a-937f-4953-9b45-eafba9e8b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:59.597326 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4343/8715] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:53:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:53:59.955233 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:53:59.957377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:59.968468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bef4c1-f41a-4018-90a7-c4b298496b3d service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:53:59.972248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:53:59.972747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:53:59.973026 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:53:59.973324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:53:59.974974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:53:59.987143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:53:59.988574 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:53:59.998860 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4373/8716] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:53:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:54:00.316047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1633-b166-459e-8385-3d2f8c8b87ba None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:54:00.316412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1633-b166-459e-8385-3d2f8c8b87ba None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:54:00.316698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1633-b166-459e-8385-3d2f8c8b87ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:54:00.359130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-236b1633-b166-459e-8385-3d2f8c8b87ba None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:54:00.360481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-236b1633-b166-459e-8385-3d2f8c8b87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:54:00.424659 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4344/8717] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:54:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:54:00.436869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:54:00.438409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:54:00.456195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d301-164f-44b0-9908-037b7dd72b87 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:54:00.461266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:54:00.461857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:54:00.462137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:54:00.462408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:54:00.470668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:54:00.472220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:54:00.482135 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4374/8718] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:54:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:54:10.416091 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=60 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:54:10.478008 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=65 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:55:24.333103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af566-6a9c-461d-9153-9f5f939e18ae None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:24.333599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af566-6a9c-461d-9153-9f5f939e18ae None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:24.333816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af566-6a9c-461d-9153-9f5f939e18ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:24.353833 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-665af566-6a9c-461d-9153-9f5f939e18ae None None] MFA Rules not processed for user `4281fb8eb2d14a3a962ffcff6f7956ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:55:24.355067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-665af566-6a9c-461d-9153-9f5f939e18ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:24.362065 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4345/8719] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:55:24.693658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:55:24.703475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8afa5-8f41-4851-9aff-d1758e6c4ca6 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:55:24.707138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:55:24.707792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:24.708081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:24.708539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:24.710291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:24.723872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:55:24.725598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:55:24.738999 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4375/8720] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:55:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:55:25.074284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:25.074574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:25.074847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:25.086862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:55:25.098733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43210d28-0762-4088-934a-e6599784c6aa service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:55:25.103935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:55:25.104342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:55:25.105279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:25.105732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:25.105874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:25.106306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:25.108331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:25.117329 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4346/8721] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 01:55:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:55:25.130844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:55:25.134810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:25.160395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470107c9-a4dc-4cab-a7c0-195363311674 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:55:25.170360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:55:25.171157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:25.171542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:25.171918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:25.183093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:55:25.185093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:55:25.202014 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4347/8722] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:55:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:55:25.211651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:55:25.213187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:55:25.228734 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4376/8723] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:55:27.032982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:55:27.044503 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197895-e560-4c30-a43b-ccf23664b937 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:55:27.048591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:55:27.049244 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:27.049526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:27.049854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:27.052274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:27.065806 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:55:27.067304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:55:27.078931 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4348/8724] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:55:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:55:35.219815 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=40 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:55:37.072296 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=18 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:55:40.852063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:55:40.868420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcca3f-0f49-4e4f-abf0-8458ef5822df service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:55:40.874934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:55:40.875806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:55:40.876289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:55:40.877277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:55:40.880885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:55:40.897005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:55:40.898523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:55:40.909348 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4377/8725] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:55:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:55:50.905448 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:56:16.096197 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:56:16.097892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:16.118301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf60f9b-1865-448c-b3be-ed7d53b84d71 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:56:16.125661 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c027bd-650c-4314-b738-b35791cd2b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:56:16.126263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c027bd-650c-4314-b738-b35791cd2b2d service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:56:16.126567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c027bd-650c-4314-b738-b35791cd2b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:56:16.126834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c027bd-650c-4314-b738-b35791cd2b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:56:16.128637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8c027bd-650c-4314-b738-b35791cd2b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:16.145722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c027bd-650c-4314-b738-b35791cd2b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:56:16.147286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c027bd-650c-4314-b738-b35791cd2b2d service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:56:16.160880 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4349/8726] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:56:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:56:18.611980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:56:18.626715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096e52b-57f9-44c6-9263-9fbfe6e5ef83 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:56:18.632271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:56:18.632869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:56:18.633180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:56:18.633454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:56:18.635196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:18.653168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:56:18.654791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:56:18.668692 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4378/8727] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:56:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:56:26.153691 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:56:28.661923 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:56:32.480395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:56:32.480882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:56:32.480999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:56:32.499737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] MFA Rules not processed for user `4281fb8eb2d14a3a962ffcff6f7956ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:56:32.500932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:32.508518 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4350/8728] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:56:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:56:38.031572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:56:38.046189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4cbf7-2dfa-4ae3-8cec-39ff2c9c1f43 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:56:38.052027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:56:38.052613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:56:38.052888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:56:38.053195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:56:38.054887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:38.068991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:56:38.070600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:56:38.083194 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4379/8729] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:56:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:56:41.318627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:56:41.320086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:41.340856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d711-2fe5-420f-a08b-730487b40b56 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:56:41.349651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:56:41.350110 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:56:41.350704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:56:41.350704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:56:41.352589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:41.368780 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:56:41.370400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:56:41.384636 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4351/8730] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:56:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:56:45.640588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:56:45.656774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b50dc-1c4f-43d1-8981-d9188e68095a service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:56:45.662678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:56:45.663285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:56:45.663566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:56:45.663841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:56:45.665613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:45.682394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:56:45.685247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:56:45.704061 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4380/8731] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:56:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:56:47.219926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:56:47.233701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99bed-f6d1-43ef-9c3e-0cded92bdbd2 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:56:47.238605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb713a-8b6b-4398-ac96-70964bfa9d09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:56:47.239194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb713a-8b6b-4398-ac96-70964bfa9d09 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:56:47.239466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb713a-8b6b-4398-ac96-70964bfa9d09 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:56:47.239732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb713a-8b6b-4398-ac96-70964bfa9d09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:56:47.241660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5ecb713a-8b6b-4398-ac96-70964bfa9d09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:56:47.256832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb713a-8b6b-4398-ac96-70964bfa9d09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:56:47.258495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb713a-8b6b-4398-ac96-70964bfa9d09 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:56:47.270933 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4352/8732] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:56:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:56:55.694936 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=12 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:56:57.264109 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=15 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:57:57.298251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:57.371029 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e12f2-743e-4e07-9b0a-58d43fc21b61 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:57.375690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:57.376318 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:57.376604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:57.376897 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] PATH_INFO: `/v3/users/4281fb8eb2d14a3a962ffcff6f7956ee` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:57.378052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4281fb8eb2d14a3a962ffcff6f7956ee)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:57.379952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:57.424791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4281fb8eb2d14a3a962ffcff6f7956ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.425460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4281fb8eb2d14a3a962ffcff6f7956ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.426064 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4281fb8eb2d14a3a962ffcff6f7956ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.439439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4281fb8eb2d14a3a962ffcff6f7956ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.446408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4281fb8eb2d14a3a962ffcff6f7956ee'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.458695 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4381/8733] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:57:57 2022] DELETE /identity/v3/users/4281fb8eb2d14a3a962ffcff6f7956ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:57:57.463549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:57.464066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:57.464151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:57.483550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:57:57.484773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:57.555876 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4353/8734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:57:57.566002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:57.567430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:57.636724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05124ac8-dd5e-420e-99a4-6a7c6141a31a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:57.640435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:57.641037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:57.641345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:57.641618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:57.651252 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:57.652666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:57.662222 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4382/8735] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:57:57.830030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:57.831536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:57.844351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78b8af-16bb-4107-8ec3-5ae933867bfb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:57.849257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:57.849901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:57.850184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:57.850462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] PATH_INFO: `/v3/projects/38007d670f4b4a98b9b6e3a213d31115` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:57.851738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38007d670f4b4a98b9b6e3a213d31115)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:57.854025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:57.904921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38007d670f4b4a98b9b6e3a213d31115', 'request_id': 'req-de3800cf-3844-4284-a36b-612516eb9ff6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.911139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38007d670f4b4a98b9b6e3a213d31115', 'request_id': 'req-de3800cf-3844-4284-a36b-612516eb9ff6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.919252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38007d670f4b4a98b9b6e3a213d31115', 'request_id': 'req-de3800cf-3844-4284-a36b-612516eb9ff6'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.931259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] The token cache is being invalidate because project 38007d670f4b4a98b9b6e3a213d31115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:57:57.931549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.932281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:57.933977 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4354/8736] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:57:57 2022] DELETE /identity/v3/projects/38007d670f4b4a98b9b6e3a213d31115 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:57:57.938143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:57.944140 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:57:57.948492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754807dd-2685-4da6-a6a8-e64a550c2018 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.005182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.005806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.006082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.006351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] PATH_INFO: `/v3/users/904d160395f040078757e0fdb089c03e` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.007460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] RBAC: Authorizing `identity:delete_user(user_id=904d160395f040078757e0fdb089c03e)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.010170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.057835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904d160395f040078757e0fdb089c03e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.058508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904d160395f040078757e0fdb089c03e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.059111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904d160395f040078757e0fdb089c03e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.072022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904d160395f040078757e0fdb089c03e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.081022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b15b7854-fad0-4739-9a21-68a6c626830c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904d160395f040078757e0fdb089c03e'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.094454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4383/8737] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 01:57:57 2022] DELETE /identity/v3/users/904d160395f040078757e0fdb089c03e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:57:58.390696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:58.392359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:58.406824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3800cf-3844-4284-a36b-612516eb9ff6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.473821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.474460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.474720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.474992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] PATH_INFO: `/v3/projects/2835d24fdb71439c847bb21d8d55e4a7` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.476149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2835d24fdb71439c847bb21d8d55e4a7)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.479234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.509884 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:57:58.529309 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2835d24fdb71439c847bb21d8d55e4a7', 'request_id': 'req-613958bc-f5c6-4882-9358-6e0d91601e45'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.535606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2835d24fdb71439c847bb21d8d55e4a7', 'request_id': 'req-613958bc-f5c6-4882-9358-6e0d91601e45'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.543669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2835d24fdb71439c847bb21d8d55e4a7', 'request_id': 'req-613958bc-f5c6-4882-9358-6e0d91601e45'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.554029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] The token cache is being invalidate because project 2835d24fdb71439c847bb21d8d55e4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:57:58.554312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.555313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-613958bc-f5c6-4882-9358-6e0d91601e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:57:58.556801 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4355/8738] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 01:57:58 2022] DELETE /identity/v3/projects/2835d24fdb71439c847bb21d8d55e4a7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:57:58.562002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e43f-03e1-4b7a-9b0f-a027fb2bad97 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.562474 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e43f-03e1-4b7a-9b0f-a027fb2bad97 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.562588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295e43f-03e1-4b7a-9b0f-a027fb2bad97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.581896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4295e43f-03e1-4b7a-9b0f-a027fb2bad97 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:57:58.583080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4295e43f-03e1-4b7a-9b0f-a027fb2bad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:58.641389 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4384/8739] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:57:58.650003 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677122-ef17-4829-aeb7-78ccadc23050 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.650283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677122-ef17-4829-aeb7-78ccadc23050 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.650554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677122-ef17-4829-aeb7-78ccadc23050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.671249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f1677122-ef17-4829-aeb7-78ccadc23050 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:57:58.672451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1677122-ef17-4829-aeb7-78ccadc23050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:58.681653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4356/8740] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:57:58.685875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295e43f-03e1-4b7a-9b0f-a027fb2bad97 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:58.697244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295e43f-03e1-4b7a-9b0f-a027fb2bad97 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.701959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.702568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.702853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.703126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.703765 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 01:57:58.704070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.705731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.717997 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4385/8741] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 01:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 01:57:58.722398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677122-ef17-4829-aeb7-78ccadc23050 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:58.733211 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677122-ef17-4829-aeb7-78ccadc23050 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.737927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.738523 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.738800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.739071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.739705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.741622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.769916 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4357/8742] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:57:58 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:57:58.774599 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:58.784470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c0645-2719-43b1-a6d0-3083d2540a33 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.793281 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:57:58.845951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.846547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.846821 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.847088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.847695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.849627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.872225 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4386/8743] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:57:58 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:57:58.876656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:58.887592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2667f0f-1805-4e68-a629-a8b51cb38dc9 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.892303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.892842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.893156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.893439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.894078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.895649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.906188 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4358/8744] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:57:58.910095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:58.920579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6473d-835b-4bbc-9a63-801879141596 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.925221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251a0a1-2eab-47d1-8325-f60075b3ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.925900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251a0a1-2eab-47d1-8325-f60075b3ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.926332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251a0a1-2eab-47d1-8325-f60075b3ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.926487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251a0a1-2eab-47d1-8325-f60075b3ba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.927122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251a0a1-2eab-47d1-8325-f60075b3ba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.928790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251a0a1-2eab-47d1-8325-f60075b3ba06 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.939831 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4387/8745] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:57:58.944081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:58.954711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635f77d-1e2c-4345-8e70-c3c6feaa0042 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:58.959460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:58.960111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.960411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.960670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] PATH_INFO: `/v3/projects/04e23668d3da413a97355b48731d6476/users/91e4416e81a24d339c0b11c80918c8ce/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:58.977341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e23668d3da413a97355b48731d6476, user_id=91e4416e81a24d339c0b11c80918c8ce, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:58.979988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:58.993344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4359/8746] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:57:58 2022] PUT /identity/v3/projects/04e23668d3da413a97355b48731d6476/users/91e4416e81a24d339c0b11c80918c8ce/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:57:58.998404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932b52-7bd2-4cb5-b82d-9849d74e2a5c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:58.998721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932b52-7bd2-4cb5-b82d-9849d74e2a5c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:58.998991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932b52-7bd2-4cb5-b82d-9849d74e2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:59.018969 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f9932b52-7bd2-4cb5-b82d-9849d74e2a5c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:57:59.020165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f9932b52-7bd2-4cb5-b82d-9849d74e2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:59.080224 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4388/8747] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:57:59.090895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:57:59.092571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:57:59.149900 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe954987-c104-407f-b825-4f6c0e5c49f3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:57:59.153499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:57:59.154104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:57:59.154383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:57:59.154653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:57:59.163601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:57:59.165537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:57:59.175155 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4360/8748] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:58:03.121439 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3c2c8-f9dc-42e2-aa4b-d807d4d19d4b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:03.121962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3c2c8-f9dc-42e2-aa4b-d807d4d19d4b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:03.121962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3c2c8-f9dc-42e2-aa4b-d807d4d19d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:03.154022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f1f3c2c8-f9dc-42e2-aa4b-d807d4d19d4b None None] MFA Rules not processed for user `91e4416e81a24d339c0b11c80918c8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:58:03.155287 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f1f3c2c8-f9dc-42e2-aa4b-d807d4d19d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:03.222142 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4389/8749] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:58:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:58:03.226678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:03.237698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f63c-eaa2-4e56-b753-140eb5d7ceb9 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:03.242316 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:03.243482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:03.243762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:03.244038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:03.244668 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:03.246610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:03.274702 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4361/8750] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 01:58:03 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 01:58:03.278579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3c2c8-f9dc-42e2-aa4b-d807d4d19d4b None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:03.289855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3c2c8-f9dc-42e2-aa4b-d807d4d19d4b None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:03.307494 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:58:03.350745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:03.351412 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:03.351678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:03.352451 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:03.353429 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:03.357658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:03.379069 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4390/8751] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 01:58:03 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 01:58:03.383024 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:03.395352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3d1b-404c-4219-9f45-72d470baee0d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:03.400285 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:03.401123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:03.401408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:03.401681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:03.402332 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:03.403960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:03.416064 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4362/8752] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 01:58:03.420529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:03.431078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925a29f-4eac-4e82-9c38-f2b91885d54b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:03.435802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:03.436461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:03.436739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:03.437012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] PATH_INFO: `/v3/projects/10529eb5eb114826a0c82066d6b728ac/users/f49d51b9178d49ecbfbe27d92d009c44/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:03.453259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10529eb5eb114826a0c82066d6b728ac, user_id=f49d51b9178d49ecbfbe27d92d009c44, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:03.455882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:03.470212 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4391/8753] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:58:03 2022] PUT /identity/v3/projects/10529eb5eb114826a0c82066d6b728ac/users/f49d51b9178d49ecbfbe27d92d009c44/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:58:03.474156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:03.486738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048d0eb-270a-4c50-9994-88b55ce5da2d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:03.506697 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:58:03.592734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c7af-63b8-4f5b-bd40-9b209effe07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:03.593576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c7af-63b8-4f5b-bd40-9b209effe07f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:03.594345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c7af-63b8-4f5b-bd40-9b209effe07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:03.595046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c7af-63b8-4f5b-bd40-9b209effe07f admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:03.595848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c7af-63b8-4f5b-bd40-9b209effe07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:03.597669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c7af-63b8-4f5b-bd40-9b209effe07f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:03.618493 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4363/8754] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 01:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 01:58:03.619807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:03.630724 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa7825-1cdc-4e7c-a0c8-5d3951180ef2 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:03.637620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:03.638300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:03.638576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:03.638849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] PATH_INFO: `/v3/projects/10529eb5eb114826a0c82066d6b728ac/users/f49d51b9178d49ecbfbe27d92d009c44/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:03.641217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10529eb5eb114826a0c82066d6b728ac, user_id=f49d51b9178d49ecbfbe27d92d009c44, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:03.644006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:03.659698 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4392/8755] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 01:58:03 2022] PUT /identity/v3/projects/10529eb5eb114826a0c82066d6b728ac/users/f49d51b9178d49ecbfbe27d92d009c44/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:58:08.173255 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb689c-bf6c-4b85-b388-4f0bdc6cd510 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:08.173723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb689c-bf6c-4b85-b388-4f0bdc6cd510 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:08.173808 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb689c-bf6c-4b85-b388-4f0bdc6cd510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:08.203804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8edb689c-bf6c-4b85-b388-4f0bdc6cd510 None None] MFA Rules not processed for user `f49d51b9178d49ecbfbe27d92d009c44`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:58:08.204981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8edb689c-bf6c-4b85-b388-4f0bdc6cd510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:08.277682 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4364/8756] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:58:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:58:08.296316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:08.298348 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:08.394268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64239886-b7b6-4b8f-995e-704ed1364879 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:08.401569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:08.402226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:08.402500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:08.402772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:08.471894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:08.473642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:08.483985 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:58:08.486437 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4393/8757] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:58:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:58:09.561591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736e2d-59b5-493d-b43b-4d4db9a765c6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:09.562093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736e2d-59b5-493d-b43b-4d4db9a765c6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:09.562204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736e2d-59b5-493d-b43b-4d4db9a765c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:09.584289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7a736e2d-59b5-493d-b43b-4d4db9a765c6 None None] MFA Rules not processed for user `91e4416e81a24d339c0b11c80918c8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:58:09.585546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7a736e2d-59b5-493d-b43b-4d4db9a765c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:09.594050 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4365/8758] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 01:58:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:58:19.580009 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=57 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:58:22.395139 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:22.396563 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:22.454063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c1dc-67f8-4d45-8137-dbda0a67e6fa service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:22.461457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:22.462201 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:22.462484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:22.462841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:22.474342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:22.475759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:22.485911 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4394/8759] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:58:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:58:32.481708 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=26 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:58:40.712439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3bec-9ce7-4425-a731-bc3b2d57bbd8 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:40.713179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3bec-9ce7-4425-a731-bc3b2d57bbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:40.713179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec3bec-9ce7-4425-a731-bc3b2d57bbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:40.733234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f6ec3bec-9ce7-4425-a731-bc3b2d57bbd8 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:58:40.734454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f6ec3bec-9ce7-4425-a731-bc3b2d57bbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:40.796545 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4366/8760] 10.222.0.57 () {58 vars in 1015 bytes} [Sun Sep 11 01:58:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:58:40.810041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:40.811464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:40.828882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2767c3-2990-403a-962a-778e8a53e881 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:40.833879 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732791-4a00-4760-9be2-620ecb637189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:40.834468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732791-4a00-4760-9be2-620ecb637189 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:40.834747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732791-4a00-4760-9be2-620ecb637189 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:40.835017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732791-4a00-4760-9be2-620ecb637189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:40.844445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732791-4a00-4760-9be2-620ecb637189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:40.846035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732791-4a00-4760-9be2-620ecb637189 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:40.856198 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4395/8761] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:58:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:58:48.112771 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d40ba-baa4-4e0f-bf8c-80f8f0c3af52 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:48.113373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d40ba-baa4-4e0f-bf8c-80f8f0c3af52 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:48.113373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d40ba-baa4-4e0f-bf8c-80f8f0c3af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:48.132470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6f0d40ba-baa4-4e0f-bf8c-80f8f0c3af52 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:58:48.133691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6f0d40ba-baa4-4e0f-bf8c-80f8f0c3af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:48.142184 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4367/8762] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 11 01:58:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:58:48.154438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb2d4-9699-49cc-80ee-94673b16d136 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:48.154827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb2d4-9699-49cc-80ee-94673b16d136 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:48.154993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb2d4-9699-49cc-80ee-94673b16d136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:48.176506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ef2eb2d4-9699-49cc-80ee-94673b16d136 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:58:48.177743 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ef2eb2d4-9699-49cc-80ee-94673b16d136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:58:48.186704 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4396/8763] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 01:58:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 01:58:48.192792 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d40ba-baa4-4e0f-bf8c-80f8f0c3af52 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:58:48.203446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d40ba-baa4-4e0f-bf8c-80f8f0c3af52 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:58:48.208646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:58:48.209277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:58:48.209564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:58:48.209834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:58:48.219037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:58:48.220597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:58:48.230991 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4368/8764] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:58:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:58:58.169961 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:58:58.226200 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=38 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:59:29.966530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eb2d4-9699-49cc-80ee-94673b16d136 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:59:29.975807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eb2d4-9699-49cc-80ee-94673b16d136 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:59:29.980070 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853fc2-7ed6-4cfd-8f9d-6bb0b5863165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:59:29.980663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853fc2-7ed6-4cfd-8f9d-6bb0b5863165 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:59:29.980939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853fc2-7ed6-4cfd-8f9d-6bb0b5863165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:59:29.981238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853fc2-7ed6-4cfd-8f9d-6bb0b5863165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:59:29.982948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-df853fc2-7ed6-4cfd-8f9d-6bb0b5863165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:59:29.995678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853fc2-7ed6-4cfd-8f9d-6bb0b5863165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:59:29.997108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853fc2-7ed6-4cfd-8f9d-6bb0b5863165 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:59:30.007466 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4397/8765] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 01:59:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:59:40.001456 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:00:41.731863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:00:41.741103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579913e-400a-4f54-a5c9-242cf13ac138 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:00:41.745010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:00:41.745627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:00:41.745904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:00:41.746171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:00:41.747877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:00:41.760344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:00:41.761898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:00:41.772174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4369/8766] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:00:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:00:51.766214 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:01:41.765087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee31fe-e0cb-41b4-8487-726c70dffb29 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:01:41.765663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee31fe-e0cb-41b4-8487-726c70dffb29 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:01:41.765663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee31fe-e0cb-41b4-8487-726c70dffb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:01:41.804378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-34ee31fe-e0cb-41b4-8487-726c70dffb29 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:01:41.805537 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-34ee31fe-e0cb-41b4-8487-726c70dffb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:01:41.831918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4398/8767] 10.222.0.57 () {58 vars in 1015 bytes} [Sun Sep 11 02:01:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:01:41.844906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:01:41.863371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175e68e-a16f-448a-9a08-af8da7c6658f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:01:41.866977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:01:41.867565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:01:41.867838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:01:41.868103 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:01:41.876031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:01:41.877820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:01:41.887260 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4370/8768] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:01:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:01:51.830192 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=20 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:01:51.882983 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=11 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:34.755927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae448-1d9e-4cc0-beef-9ee51cc62583 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:34.756456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae448-1d9e-4cc0-beef-9ee51cc62583 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:34.756545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae448-1d9e-4cc0-beef-9ee51cc62583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:34.797073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-643ae448-1d9e-4cc0-beef-9ee51cc62583 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:34.798223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-643ae448-1d9e-4cc0-beef-9ee51cc62583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:34.835275 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4399/8769] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 02:03:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:34.842001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:34.854845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b443cb-678f-4a3f-9147-50077a0a19e5 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:34.861646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450d377-aff3-4ba7-b6b4-bbf3ca895939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:34.862245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450d377-aff3-4ba7-b6b4-bbf3ca895939 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:34.862621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450d377-aff3-4ba7-b6b4-bbf3ca895939 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:34.862856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450d377-aff3-4ba7-b6b4-bbf3ca895939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:34.870941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450d377-aff3-4ba7-b6b4-bbf3ca895939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:34.872544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450d377-aff3-4ba7-b6b4-bbf3ca895939 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:34.881232 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4371/8770] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:35.114294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae58d5-b7ad-446c-8346-2881c3a78a28 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:35.114597 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae58d5-b7ad-446c-8346-2881c3a78a28 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:35.114886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae58d5-b7ad-446c-8346-2881c3a78a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:35.134513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-97ae58d5-b7ad-446c-8346-2881c3a78a28 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:35.135727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-97ae58d5-b7ad-446c-8346-2881c3a78a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:35.145728 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4400/8771] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 02:03:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:35.151614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8da4d-9884-47ea-b32a-c253285398f2 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:35.151908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8da4d-9884-47ea-b32a-c253285398f2 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:35.152215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8da4d-9884-47ea-b32a-c253285398f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:35.172265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-31f8da4d-9884-47ea-b32a-c253285398f2 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:35.173498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-31f8da4d-9884-47ea-b32a-c253285398f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:35.182778 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4372/8772] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:03:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:35.194395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae58d5-b7ad-446c-8346-2881c3a78a28 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:35.204227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae58d5-b7ad-446c-8346-2881c3a78a28 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:35.207810 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:35.208425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:35.208700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:35.208966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:35.219121 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:35.220509 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:35.231525 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4401/8773] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:36.431696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a624f99-a164-4d81-badb-447a0b75f649 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:36.432246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a624f99-a164-4d81-badb-447a0b75f649 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:36.432246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a624f99-a164-4d81-badb-447a0b75f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:36.454939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4a624f99-a164-4d81-badb-447a0b75f649 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:36.456299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4a624f99-a164-4d81-badb-447a0b75f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:36.466115 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4373/8774] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:03:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:36.478017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:36.487207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724d8f4-c984-428f-9702-f59abcba416c service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:36.490880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:36.491471 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:36.491739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:36.492008 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:36.503800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:36.505523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:36.525027 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4402/8775] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:36.779313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887ad8-68e6-4739-8f64-86c86f48d412 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:36.779606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887ad8-68e6-4739-8f64-86c86f48d412 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:36.779875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9887ad8-68e6-4739-8f64-86c86f48d412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:36.805029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c9887ad8-68e6-4739-8f64-86c86f48d412 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:36.806295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c9887ad8-68e6-4739-8f64-86c86f48d412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:36.818698 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4374/8776] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:03:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:36.833219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:36.852648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bea06c-a44d-4012-b569-fee729397597 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:36.863359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563d289-1a61-4f2d-8546-1466ab00a672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:36.863979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d289-1a61-4f2d-8546-1466ab00a672 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:36.864259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d289-1a61-4f2d-8546-1466ab00a672 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:36.864580 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563d289-1a61-4f2d-8546-1466ab00a672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:36.875741 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563d289-1a61-4f2d-8546-1466ab00a672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:36.877379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563d289-1a61-4f2d-8546-1466ab00a672 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:36.889914 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4403/8777] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:03:38.628770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9887ad8-68e6-4739-8f64-86c86f48d412 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:38.638372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9887ad8-68e6-4739-8f64-86c86f48d412 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:38.642425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1ab6-637e-4001-956b-447ac71f41e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:38.643019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1ab6-637e-4001-956b-447ac71f41e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:38.643293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1ab6-637e-4001-956b-447ac71f41e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:38.643560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1ab6-637e-4001-956b-447ac71f41e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:38.704524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1ab6-637e-4001-956b-447ac71f41e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:38.705988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1ab6-637e-4001-956b-447ac71f41e4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:38.715649 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4375/8778] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:41.854612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37395a83-b5f0-4e0b-b509-02bf7108a3f1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:41.855108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37395a83-b5f0-4e0b-b509-02bf7108a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:41.855240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37395a83-b5f0-4e0b-b509-02bf7108a3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:41.918984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-37395a83-b5f0-4e0b-b509-02bf7108a3f1 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:41.921039 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-37395a83-b5f0-4e0b-b509-02bf7108a3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:41.960629 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4404/8779] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:03:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:03:41.976312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8e74-b4b2-45e5-8f7e-7743b47084ee None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:41.976790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8e74-b4b2-45e5-8f7e-7743b47084ee None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:41.976898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d8e74-b4b2-45e5-8f7e-7743b47084ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:42.011509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d93d8e74-b4b2-45e5-8f7e-7743b47084ee None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:42.012736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d93d8e74-b4b2-45e5-8f7e-7743b47084ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:42.023237 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4376/8780] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 02:03:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:42.032714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37395a83-b5f0-4e0b-b509-02bf7108a3f1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:42.051529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37395a83-b5f0-4e0b-b509-02bf7108a3f1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:42.056704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:42.057378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:42.057654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:42.057922 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:42.066863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:42.068534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:42.079510 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4405/8781] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:45.208917 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8e74-b4b2-45e5-8f7e-7743b47084ee None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:45.227884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d8e74-b4b2-45e5-8f7e-7743b47084ee None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:45.234568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:45.235187 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:45.235463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:45.235733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] PATH_INFO: `/v3/users/91e4416e81a24d339c0b11c80918c8ce` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:45.236855 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e4416e81a24d339c0b11c80918c8ce)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:45.238844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:45.291085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e4416e81a24d339c0b11c80918c8ce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.291893 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e4416e81a24d339c0b11c80918c8ce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.292598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e4416e81a24d339c0b11c80918c8ce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.300619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e4416e81a24d339c0b11c80918c8ce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.313441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e4416e81a24d339c0b11c80918c8ce'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.326126 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4377/8782] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:03:45 2022] DELETE /identity/v3/users/91e4416e81a24d339c0b11c80918c8ce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:03:45.500893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:45.514681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a356ff-9fa3-4bb5-b3de-64a78835ac3a service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:45.584370 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:45.584998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:45.585306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:45.585575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] PATH_INFO: `/v3/projects/04e23668d3da413a97355b48731d6476` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:45.586692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e23668d3da413a97355b48731d6476)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:45.588571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:45.623427 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:45.637207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e23668d3da413a97355b48731d6476', 'request_id': 'req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.642832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e23668d3da413a97355b48731d6476', 'request_id': 'req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.648967 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e23668d3da413a97355b48731d6476', 'request_id': 'req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.662302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] The token cache is being invalidate because project 04e23668d3da413a97355b48731d6476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:03:45.662590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.663213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.664908 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4406/8783] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:03:45 2022] DELETE /identity/v3/projects/04e23668d3da413a97355b48731d6476 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:03:45.668866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:45.671099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:45.685408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbf136-453b-49bb-bfa0-010a48a75428 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:45.698456 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:45.750384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:45.751052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:45.751327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:45.751601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] PATH_INFO: `/v3/users/f49d51b9178d49ecbfbe27d92d009c44` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:45.752776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49d51b9178d49ecbfbe27d92d009c44)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:45.754890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:45.807295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49d51b9178d49ecbfbe27d92d009c44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.807953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49d51b9178d49ecbfbe27d92d009c44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.808581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49d51b9178d49ecbfbe27d92d009c44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.816308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49d51b9178d49ecbfbe27d92d009c44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.830402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c47d4cde-6cdc-4a5c-90e4-6cd5ac124dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49d51b9178d49ecbfbe27d92d009c44'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:45.848537 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4378/8784] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:03:45 2022] DELETE /identity/v3/users/f49d51b9178d49ecbfbe27d92d009c44 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:03:46.030861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.032878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:46.047182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79bfec-7f45-4cea-9ea7-06fe72195cb5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.111586 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.112216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.112498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.112774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] PATH_INFO: `/v3/projects/10529eb5eb114826a0c82066d6b728ac` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.113941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=10529eb5eb114826a0c82066d6b728ac)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.115847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.162507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10529eb5eb114826a0c82066d6b728ac', 'request_id': 'req-f4acbd17-f970-4491-aea9-bff2994c03aa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:46.167956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10529eb5eb114826a0c82066d6b728ac', 'request_id': 'req-f4acbd17-f970-4491-aea9-bff2994c03aa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:46.175146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10529eb5eb114826a0c82066d6b728ac', 'request_id': 'req-f4acbd17-f970-4491-aea9-bff2994c03aa'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:46.187049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] The token cache is being invalidate because project 10529eb5eb114826a0c82066d6b728ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:03:46.187332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:46.187970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f4acbd17-f970-4491-aea9-bff2994c03aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:03:46.189472 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4407/8785] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:03:46 2022] DELETE /identity/v3/projects/10529eb5eb114826a0c82066d6b728ac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:03:46.194460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a3ba3-9373-415e-9442-68de7e19be54 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.194749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a3ba3-9373-415e-9442-68de7e19be54 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.195018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a3ba3-9373-415e-9442-68de7e19be54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.214839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-186a3ba3-9373-415e-9442-68de7e19be54 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:46.216770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-186a3ba3-9373-415e-9442-68de7e19be54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:46.276128 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4379/8786] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:46.284548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365f294-ef07-4e18-86c5-e6f6a8b2da09 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.284834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365f294-ef07-4e18-86c5-e6f6a8b2da09 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.285141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365f294-ef07-4e18-86c5-e6f6a8b2da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.305809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7365f294-ef07-4e18-86c5-e6f6a8b2da09 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:46.306992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7365f294-ef07-4e18-86c5-e6f6a8b2da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:46.315201 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4408/8787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:46.319468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a3ba3-9373-415e-9442-68de7e19be54 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.329374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a3ba3-9373-415e-9442-68de7e19be54 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.333946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.334544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.334814 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.335082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.335719 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:03:46.336020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.337627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.349945 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4380/8788] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:03:46.354207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365f294-ef07-4e18-86c5-e6f6a8b2da09 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.364115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365f294-ef07-4e18-86c5-e6f6a8b2da09 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.368748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.369362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.369643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.369909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.370518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.372441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.398486 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4409/8789] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:03:46 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:03:46.402563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.413622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b587-3bbf-442b-b1a6-7dbcb8e1db27 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.435519 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:46.473171 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.473781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.474064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.474335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.474973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.476921 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.498258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4381/8790] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:03:46 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:03:46.502374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.512647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf02153-d88b-4dc0-84fe-164fbd84e2be admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.517996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.518607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.518886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.519156 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.519797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.521467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.532756 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4410/8791] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:03:46.536597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.547737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ff0bb-450f-4a06-938a-e1b01e055112 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.552376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404169f-2d1e-4681-97ba-d6db7cea561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.552968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404169f-2d1e-4681-97ba-d6db7cea561e admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.553307 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404169f-2d1e-4681-97ba-d6db7cea561e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.553591 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404169f-2d1e-4681-97ba-d6db7cea561e admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.554239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404169f-2d1e-4681-97ba-d6db7cea561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.555794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404169f-2d1e-4681-97ba-d6db7cea561e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.566696 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4382/8792] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:03:46.570778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.581697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0299a7-befc-47b7-ac9f-9a3217a65fd0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.586355 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.587002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.587276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.587546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] PATH_INFO: `/v3/projects/a07049dcf929431c885a48c25a9aa6a9/users/7229f2312e2541a9b7edb7050ee44346/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.590599 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:46.607422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07049dcf929431c885a48c25a9aa6a9, user_id=7229f2312e2541a9b7edb7050ee44346, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.610071 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.622468 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4411/8793] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:03:46 2022] PUT /identity/v3/projects/a07049dcf929431c885a48c25a9aa6a9/users/7229f2312e2541a9b7edb7050ee44346/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:03:46.627614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.627920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.628195 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.648335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:46.649609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:46.710264 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4383/8794] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:46.720590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:46.722327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:46.790126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471858a-a3da-4df9-9785-2eb893a0017d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:46.793809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7388fb-de08-4f11-a2d6-9224c9d6713e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:46.794440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7388fb-de08-4f11-a2d6-9224c9d6713e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:46.794689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7388fb-de08-4f11-a2d6-9224c9d6713e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:46.794963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7388fb-de08-4f11-a2d6-9224c9d6713e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:46.804246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7388fb-de08-4f11-a2d6-9224c9d6713e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:46.805705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7388fb-de08-4f11-a2d6-9224c9d6713e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:46.815251 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4412/8795] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:48.002587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:48.004107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:48.095303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e874b-7bbb-4e1b-9a78-ea6ad54f1490 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:48.102128 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:48.102841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:48.103196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:48.103539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:48.105617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:48.130712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:48.132391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:48.144699 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4384/8796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:03:51.051935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc32ca-ae84-4ac2-9fd6-b330551ff9a5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:51.052481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc32ca-ae84-4ac2-9fd6-b330551ff9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:51.052481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc32ca-ae84-4ac2-9fd6-b330551ff9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:51.084409 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fafc32ca-ae84-4ac2-9fd6-b330551ff9a5 None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:51.085884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fafc32ca-ae84-4ac2-9fd6-b330551ff9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:51.157785 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4413/8797] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:03:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:51.162124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:51.197813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a0043-89a4-48af-846c-57d6ffd968de service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:51.203282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:51.203955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:51.204229 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:51.204495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:51.205155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:51.207047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:51.246694 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:51.265620 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4385/8798] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:03:51 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 02:03:51.269849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc32ca-ae84-4ac2-9fd6-b330551ff9a5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:51.281968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc32ca-ae84-4ac2-9fd6-b330551ff9a5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:51.346403 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:51.358941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:51.359565 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:51.359847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:51.360120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:51.360926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:51.363027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:51.389177 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4414/8799] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:03:51 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:03:51.390519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:51.401645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65949032-6f42-49ac-bb09-84567d6d3b03 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:51.407115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:51.407739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:51.408022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:51.408294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:51.408940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:51.410598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:51.421581 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4386/8800] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:03:51.426143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:51.437445 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b693f-b867-46d8-96eb-83124c945f54 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:51.442329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:51.443100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:51.443462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:51.443800 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] PATH_INFO: `/v3/projects/4c11e3eea62548f884152dded1e56d55/users/85b0ff08423c43268b64cc379134e64d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:51.460176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c11e3eea62548f884152dded1e56d55, user_id=85b0ff08423c43268b64cc379134e64d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:51.462948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:51.478239 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4415/8801] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:03:51 2022] PUT /identity/v3/projects/4c11e3eea62548f884152dded1e56d55/users/85b0ff08423c43268b64cc379134e64d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:03:51.482655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:51.493670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a640-7a08-421c-a795-c081513287bc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:51.558443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:51.559074 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:51.559359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:51.560208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:51.561047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:51.562690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:51.574598 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4387/8802] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:03:51.579293 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:51.590328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023019b5-bfdb-4188-af70-601c730c80f1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:51.595748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc3d17-eec8-4ad7-b9a2-966617579d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:51.596485 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3d17-eec8-4ad7-b9a2-966617579d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:51.596762 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3d17-eec8-4ad7-b9a2-966617579d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:51.597034 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3d17-eec8-4ad7-b9a2-966617579d59 admin admin] PATH_INFO: `/v3/projects/4c11e3eea62548f884152dded1e56d55/users/85b0ff08423c43268b64cc379134e64d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:51.599275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3d17-eec8-4ad7-b9a2-966617579d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c11e3eea62548f884152dded1e56d55, user_id=85b0ff08423c43268b64cc379134e64d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:51.601959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3d17-eec8-4ad7-b9a2-966617579d59 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:51.637864 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4416/8803] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:03:51 2022] PUT /identity/v3/projects/4c11e3eea62548f884152dded1e56d55/users/85b0ff08423c43268b64cc379134e64d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:03:52.132623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:52.221789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d635ad-41ac-43d2-bf70-17dac0824470 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:52.302085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168b881-a208-4ce3-b257-11084e89ece2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:52.302818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b881-a208-4ce3-b257-11084e89ece2 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:52.303196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b881-a208-4ce3-b257-11084e89ece2 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:52.303540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b881-a208-4ce3-b257-11084e89ece2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:52.305441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3168b881-a208-4ce3-b257-11084e89ece2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:52.318769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168b881-a208-4ce3-b257-11084e89ece2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:52.320593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168b881-a208-4ce3-b257-11084e89ece2 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:52.332021 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4388/8804] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:55.928147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35b02-191d-44a8-912d-eb6c69d3e9eb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:55.928646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35b02-191d-44a8-912d-eb6c69d3e9eb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:55.928646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d35b02-191d-44a8-912d-eb6c69d3e9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:55.956360 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-07d35b02-191d-44a8-912d-eb6c69d3e9eb None None] MFA Rules not processed for user `85b0ff08423c43268b64cc379134e64d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:55.957595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-07d35b02-191d-44a8-912d-eb6c69d3e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:56.035992 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4417/8805] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:03:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:56.048555 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb95c18-35f5-4be8-9f17-a905815a3e30 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:56.049002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb95c18-35f5-4be8-9f17-a905815a3e30 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:56.049182 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb95c18-35f5-4be8-9f17-a905815a3e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:56.078898 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:03:56.116418 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-bfb95c18-35f5-4be8-9f17-a905815a3e30 None None] MFA Rules not processed for user `0492b5b414354bce909e395d44d215c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:56.117966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-bfb95c18-35f5-4be8-9f17-a905815a3e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:56.215265 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4389/8806] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 02:03:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:56.216671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35b02-191d-44a8-912d-eb6c69d3e9eb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:56.230666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d35b02-191d-44a8-912d-eb6c69d3e9eb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:56.234888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f9d1f-8ad5-4438-9c9c-8d8f1b1b6d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:56.235643 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9d1f-8ad5-4438-9c9c-8d8f1b1b6d4e service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:56.236054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9d1f-8ad5-4438-9c9c-8d8f1b1b6d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:56.236425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9d1f-8ad5-4438-9c9c-8d8f1b1b6d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:56.248267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f9d1f-8ad5-4438-9c9c-8d8f1b1b6d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:56.250028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f9d1f-8ad5-4438-9c9c-8d8f1b1b6d4e service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:56.276431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4418/8807] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:03:56.395481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb95c18-35f5-4be8-9f17-a905815a3e30 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:56.406280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb95c18-35f5-4be8-9f17-a905815a3e30 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:56.411281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56c1bd-1cbc-4a28-b74c-425fc773127c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:56.411915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c1bd-1cbc-4a28-b74c-425fc773127c service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:56.412196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c1bd-1cbc-4a28-b74c-425fc773127c service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:56.412466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56c1bd-1cbc-4a28-b74c-425fc773127c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:56.492116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56c1bd-1cbc-4a28-b74c-425fc773127c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:56.493818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56c1bd-1cbc-4a28-b74c-425fc773127c service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:56.504314 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4390/8808] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:57.996920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b302c-9431-4a62-90f7-87d591e45603 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:57.999063 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b302c-9431-4a62-90f7-87d591e45603 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:57.999533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b302c-9431-4a62-90f7-87d591e45603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:58.021461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5e1b302c-9431-4a62-90f7-87d591e45603 None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:58.023579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5e1b302c-9431-4a62-90f7-87d591e45603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:58.031322 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4419/8809] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:03:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:58.325031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f197e-f4d2-42ba-ae71-46c6b805c868 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:58.325572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f197e-f4d2-42ba-ae71-46c6b805c868 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:58.325669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f197e-f4d2-42ba-ae71-46c6b805c868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:58.363384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ed7f197e-f4d2-42ba-ae71-46c6b805c868 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:03:58.364586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ed7f197e-f4d2-42ba-ae71-46c6b805c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:58.417306 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4391/8810] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:03:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:03:58.429685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b302c-9431-4a62-90f7-87d591e45603 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:58.439881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b302c-9431-4a62-90f7-87d591e45603 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:58.443486 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60986-9ba7-4a1f-93a5-76d7446955bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:58.444055 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60986-9ba7-4a1f-93a5-76d7446955bc service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:58.444329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60986-9ba7-4a1f-93a5-76d7446955bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:58.445112 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60986-9ba7-4a1f-93a5-76d7446955bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:58.452098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60986-9ba7-4a1f-93a5-76d7446955bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:58.453573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60986-9ba7-4a1f-93a5-76d7446955bc service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:58.461270 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4420/8811] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:03:58.971865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f197e-f4d2-42ba-ae71-46c6b805c868 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:03:58.986342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f197e-f4d2-42ba-ae71-46c6b805c868 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:03:58.991831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:03:58.992438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:03:58.993203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:03:58.993203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:03:58.994742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:03:59.008028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:03:59.009710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:03:59.020787 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4392/8812] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:03:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:04:00.910747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118d48-3879-4906-af7b-122e070a3ec1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:04:00.911270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118d48-3879-4906-af7b-122e070a3ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:04:00.911378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118d48-3879-4906-af7b-122e070a3ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:04:00.932291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-84118d48-3879-4906-af7b-122e070a3ec1 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:04:00.933539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-84118d48-3879-4906-af7b-122e070a3ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:04:00.943469 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4421/8813] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 11 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:04:00.956202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:04:00.958965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:04:00.976891 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5fc3-e47e-4989-b801-bc6b9f97941d service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:04:00.984809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:04:00.985482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:04:00.985980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:04:00.986443 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:04:00.991641 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:04:00.997899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:04:00.999571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:04:01.009380 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4393/8814] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:04:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:04:10.927090 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=70,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:04:11.005077 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:04:15.544781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa6efe-a639-48b5-9157-446c74cdfaeb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:04:15.545677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa6efe-a639-48b5-9157-446c74cdfaeb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:04:15.545957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa6efe-a639-48b5-9157-446c74cdfaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:04:15.579163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1bfa6efe-a639-48b5-9157-446c74cdfaeb None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:04:15.580374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1bfa6efe-a639-48b5-9157-446c74cdfaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:04:15.651635 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4422/8815] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:04:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:04:15.664848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:04:15.666302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:04:15.683057 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365c4f-20f6-4279-ac41-731cd58a00dc service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:04:15.689537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:04:15.690147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:04:15.690430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:04:15.690711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:04:15.699954 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:04:15.702170 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:04:15.712728 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4394/8816] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:04:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:04:25.641943 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=36 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:04:25.708257 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:04:31.173615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a82d2f-9d40-4a61-8cd4-26fddb2726d1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:04:31.174119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a82d2f-9d40-4a61-8cd4-26fddb2726d1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:04:31.174220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a82d2f-9d40-4a61-8cd4-26fddb2726d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:04:31.194338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-42a82d2f-9d40-4a61-8cd4-26fddb2726d1 None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:04:31.195522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42a82d2f-9d40-4a61-8cd4-26fddb2726d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:04:31.203505 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4423/8817] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:04:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:04:32.154774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:04:32.156933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:04:32.172524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257280ae-d554-488d-b218-a51ab1466c13 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:04:32.177659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d562ee-1f2d-4f72-8d63-fc63047621bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:04:32.178266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d562ee-1f2d-4f72-8d63-fc63047621bf service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:04:32.178545 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d562ee-1f2d-4f72-8d63-fc63047621bf service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:04:32.178816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d562ee-1f2d-4f72-8d63-fc63047621bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:04:32.180511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-27d562ee-1f2d-4f72-8d63-fc63047621bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:04:32.192283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d562ee-1f2d-4f72-8d63-fc63047621bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:04:32.193892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d562ee-1f2d-4f72-8d63-fc63047621bf service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:04:32.208248 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4395/8818] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:04:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:04:41.188071 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:04:42.203465 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:05:19.260952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5e0b-43ed-43b8-aba1-bfc51b48c842 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:05:19.261494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5e0b-43ed-43b8-aba1-bfc51b48c842 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:05:19.261601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe5e0b-43ed-43b8-aba1-bfc51b48c842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:05:19.281203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-89fe5e0b-43ed-43b8-aba1-bfc51b48c842 None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:05:19.282384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-89fe5e0b-43ed-43b8-aba1-bfc51b48c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:05:19.289229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4424/8819] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:05:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:05:29.275816 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:06:17.724004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657c17-f2c4-46a0-9349-0c4f28917123 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:17.724547 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657c17-f2c4-46a0-9349-0c4f28917123 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:17.724658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657c17-f2c4-46a0-9349-0c4f28917123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:17.745578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d9657c17-f2c4-46a0-9349-0c4f28917123 None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:06:17.746758 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d9657c17-f2c4-46a0-9349-0c4f28917123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:06:17.754030 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4396/8820] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:06:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:06:18.004723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d6ae3-6530-4dfc-b276-ad7bc9c80574 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:18.005239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d6ae3-6530-4dfc-b276-ad7bc9c80574 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:18.005339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d6ae3-6530-4dfc-b276-ad7bc9c80574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:18.024477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0e9d6ae3-6530-4dfc-b276-ad7bc9c80574 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:06:18.025712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0e9d6ae3-6530-4dfc-b276-ad7bc9c80574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:06:18.032193 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4425/8821] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:06:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:06:18.043742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9657c17-f2c4-46a0-9349-0c4f28917123 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:06:18.053988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9657c17-f2c4-46a0-9349-0c4f28917123 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:06:18.057495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d9bbc-a573-44ad-bf5d-5e69ffa79fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:06:18.058082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d9bbc-a573-44ad-bf5d-5e69ffa79fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:18.058356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d9bbc-a573-44ad-bf5d-5e69ffa79fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:18.058622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d9bbc-a573-44ad-bf5d-5e69ffa79fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:18.067318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d9bbc-a573-44ad-bf5d-5e69ffa79fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:06:18.068597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d9bbc-a573-44ad-bf5d-5e69ffa79fd4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:06:18.077738 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4397/8822] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:06:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:06:28.019134 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:06:28.073699 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:06:39.404321 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf67855-bc96-4e32-aeb8-2f8da0d94ecd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:39.404854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf67855-bc96-4e32-aeb8-2f8da0d94ecd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:39.405277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf67855-bc96-4e32-aeb8-2f8da0d94ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:39.456990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1cf67855-bc96-4e32-aeb8-2f8da0d94ecd None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:06:39.458250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1cf67855-bc96-4e32-aeb8-2f8da0d94ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:06:39.524767 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4426/8823] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:06:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:06:39.574804 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2884dc-2ca5-4bb2-9b30-6d582a634e84 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:39.575234 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2884dc-2ca5-4bb2-9b30-6d582a634e84 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:39.575342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2884dc-2ca5-4bb2-9b30-6d582a634e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:39.625436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fe2884dc-2ca5-4bb2-9b30-6d582a634e84 None None] MFA Rules not processed for user `3ada7c97c73b43e09c30a603e648bcb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:06:39.626635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fe2884dc-2ca5-4bb2-9b30-6d582a634e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:06:39.697382 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4398/8824] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 11 02:06:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:06:39.704073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf67855-bc96-4e32-aeb8-2f8da0d94ecd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:06:39.716200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf67855-bc96-4e32-aeb8-2f8da0d94ecd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:06:39.722046 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:06:39.722676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:39.722953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:39.723232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:39.731308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:06:39.732923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:06:39.740951 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4427/8825] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:06:41.025467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1c8fb-b071-4260-9e7f-64adcffd6a1b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:41.025985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1c8fb-b071-4260-9e7f-64adcffd6a1b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:41.026080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1c8fb-b071-4260-9e7f-64adcffd6a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:41.044964 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-14d1c8fb-b071-4260-9e7f-64adcffd6a1b None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:06:41.046265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-14d1c8fb-b071-4260-9e7f-64adcffd6a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:06:41.053483 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4399/8826] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:06:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:06:43.756775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:06:43.771682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396b785-94d7-49f7-b42c-74f3d3278251 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:06:43.775926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:06:43.776708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:06:43.777083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:06:43.777543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:06:43.781906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:06:43.795847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:06:43.797721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:06:43.808236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4428/8827] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:06:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:06:51.040673 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=47 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:06:53.804193 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=52 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:07:34.792956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736e34-63b3-41ec-9eaa-0f9dbab6ee0f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:07:34.793554 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736e34-63b3-41ec-9eaa-0f9dbab6ee0f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:07:34.793874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06736e34-63b3-41ec-9eaa-0f9dbab6ee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:07:34.816176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-06736e34-63b3-41ec-9eaa-0f9dbab6ee0f None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:07:34.817610 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-06736e34-63b3-41ec-9eaa-0f9dbab6ee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:07:34.825931 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4400/8828] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 02:07:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:07:34.840082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:07:34.857652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a176ae-87ff-4ba9-89d5-ab17eecf01d0 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:07:34.865991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad217fb-4d32-4e05-8bbd-f6cbf7b974d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:07:34.866530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad217fb-4d32-4e05-8bbd-f6cbf7b974d7 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:07:34.866814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad217fb-4d32-4e05-8bbd-f6cbf7b974d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:07:34.867090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad217fb-4d32-4e05-8bbd-f6cbf7b974d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:07:34.876388 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad217fb-4d32-4e05-8bbd-f6cbf7b974d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:07:34.877999 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad217fb-4d32-4e05-8bbd-f6cbf7b974d7 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:07:34.887030 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4429/8829] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:07:44.810176 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:07:44.882823 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:07:51.550883 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1513d-107c-4a12-b154-4334ff46ab3c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:07:51.551368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1513d-107c-4a12-b154-4334ff46ab3c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:07:51.551476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1513d-107c-4a12-b154-4334ff46ab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:07:51.571224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2af1513d-107c-4a12-b154-4334ff46ab3c None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:07:51.572417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2af1513d-107c-4a12-b154-4334ff46ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:07:51.579336 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4401/8830] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:08:01.565848 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:08:13.991712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30ceb-6a28-4fe2-b143-1457e2a57702 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:08:13.992216 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30ceb-6a28-4fe2-b143-1457e2a57702 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:08:13.992352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30ceb-6a28-4fe2-b143-1457e2a57702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:08:14.013202 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-bcc30ceb-6a28-4fe2-b143-1457e2a57702 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:08:14.014422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bcc30ceb-6a28-4fe2-b143-1457e2a57702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:08:14.033854 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4430/8831] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:08:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:08:14.047731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1513d-107c-4a12-b154-4334ff46ab3c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:08:14.060872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1513d-107c-4a12-b154-4334ff46ab3c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:08:14.066567 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:08:14.067155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:08:14.067551 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:08:14.067832 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:08:14.077619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:08:14.079138 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:08:14.090998 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4402/8832] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:08:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:08:24.030630 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:08:24.085600 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:08:53.024691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30ceb-6a28-4fe2-b143-1457e2a57702 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:08:53.036110 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30ceb-6a28-4fe2-b143-1457e2a57702 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:08:53.041044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:08:53.041677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:08:53.041962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:08:53.042231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:08:53.050991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:08:53.052569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:08:53.062359 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4431/8833] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:08:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:08:55.091558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:08:55.103398 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c802b-ae56-4279-aa75-fa160297874c service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:08:55.108685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:08:55.109331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:08:55.109614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:08:55.109887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:08:55.118988 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:08:55.120558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:08:55.131219 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4403/8834] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:08:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:09:03.058270 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:09:05.126329 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:10:09.094546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:09.096077 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:10:09.112630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d21d-6d63-408a-89b9-30b767df3e6d service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:09.119207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:09.119806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:09.120085 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:09.120358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:09.127953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:09.130689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:09.139586 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4432/8835] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:09.327797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:09.346572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2343d3-e43a-4bfe-9649-276d191a1695 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:09.350368 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:09.350967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:09.351238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:09.351504 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:09.353232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:10:09.368261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:09.369729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:09.382837 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4404/8836] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:10.574974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:10.585539 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e6d4-b1e1-4597-bc92-454d9b7a51b4 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:10.589128 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8b219-a06b-4c52-9717-27c70e0235c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:10.589728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b219-a06b-4c52-9717-27c70e0235c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:10.590006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b219-a06b-4c52-9717-27c70e0235c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:10.590279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b219-a06b-4c52-9717-27c70e0235c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:10.591977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f7f8b219-a06b-4c52-9717-27c70e0235c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:10:10.606938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8b219-a06b-4c52-9717-27c70e0235c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:10.608352 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8b219-a06b-4c52-9717-27c70e0235c7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:10.619706 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4433/8837] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:11.895381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:11.907895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9e1f7-8efa-47cb-987e-b1def6a61c7d service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:11.914347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:11.914953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:11.915414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:11.915685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:11.922562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:10:11.939105 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:11.940947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:11.966452 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4405/8838] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:17.346468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa163942-f539-470d-9993-02dcc9edda54 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:17.346995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa163942-f539-470d-9993-02dcc9edda54 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:17.347089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa163942-f539-470d-9993-02dcc9edda54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:17.366516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fa163942-f539-470d-9993-02dcc9edda54 None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:10:17.367726 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fa163942-f539-470d-9993-02dcc9edda54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:10:17.374705 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4434/8839] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:10:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:10:17.690288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:17.700111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c26c3-2876-4b9e-b97d-bff1f3480afd service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:17.703789 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:17.704381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:17.704660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:17.704934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:17.712559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:17.714007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:17.721869 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4406/8840] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:18.430023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa163942-f539-470d-9993-02dcc9edda54 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:18.443124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa163942-f539-470d-9993-02dcc9edda54 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:18.448274 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:18.448895 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:18.449208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:18.449479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:18.459436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:18.461270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:18.471562 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4435/8841] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:20.276329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:20.285313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb119-a478-4c66-90f4-94ec39c0c7f1 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:20.290747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:20.291644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:20.292109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:20.292385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:20.306669 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:20.308376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:20.318219 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4407/8842] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:28.467156 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=21 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:10:30.313939 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=28 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:10:37.205748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:37.221623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bd80b-4ee4-475b-863c-51e80825af10 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:37.229099 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1e059-aaeb-4d1e-afc5-b68568a4c450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:37.229722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1e059-aaeb-4d1e-afc5-b68568a4c450 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:37.230002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1e059-aaeb-4d1e-afc5-b68568a4c450 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:37.230275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1e059-aaeb-4d1e-afc5-b68568a4c450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:37.252605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1e059-aaeb-4d1e-afc5-b68568a4c450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:37.254259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1e059-aaeb-4d1e-afc5-b68568a4c450 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:37.268659 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4436/8843] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:41.055075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:10:41.063837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5750-0586-409f-abb4-46a670b80d2f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:10:41.067898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:10:41.068486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:10:41.068755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:10:41.069020 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:10:41.077852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:10:41.079232 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:10:41.089344 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4408/8844] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:10:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:10:47.263017 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:10:51.085138 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:12:20.971790 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf633-aa25-4afa-bf6a-87d06a13a1ca None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:12:20.972301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf633-aa25-4afa-bf6a-87d06a13a1ca None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:12:20.972452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf633-aa25-4afa-bf6a-87d06a13a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:12:21.000462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-caaaf633-aa25-4afa-bf6a-87d06a13a1ca None None] MFA Rules not processed for user `7229f2312e2541a9b7edb7050ee44346`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:12:21.001690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-caaaf633-aa25-4afa-bf6a-87d06a13a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:12:21.012031 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4437/8845] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:12:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:12:21.343996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:12:21.362327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c71e42-e111-4b9b-8665-f3a6e137eaea service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:12:21.366878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:12:21.367469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:12:21.367740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:12:21.368007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:12:21.374872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:12:21.376288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:12:21.384973 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4409/8846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:12:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:12:22.831260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaf633-aa25-4afa-bf6a-87d06a13a1ca None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:12:22.843642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaf633-aa25-4afa-bf6a-87d06a13a1ca None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:12:22.848588 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:12:22.849898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:12:22.850231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:12:22.850503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:12:22.858913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:12:22.860468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:12:22.870356 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4438/8847] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:12:27.725451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:12:27.735027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aad09-f552-4308-8a4a-ead003954013 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:12:27.738904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:12:27.739594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:12:27.740522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:12:27.740663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:12:27.749256 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:12:27.750721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:12:27.765331 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4410/8848] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:12:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:12:32.866482 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=15 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:12:37.757199 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=17 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:13:57.197267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:13:57.198820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:13:57.320023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b368-3359-4dd2-9a4e-893e4ac3187a service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:13:57.325130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:13:57.325725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:13:57.326000 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:13:57.326265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:13:57.328058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:13:57.339858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:13:57.341345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:13:57.351433 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4439/8849] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:13:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:13:59.024253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:13:59.037399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e3cd-6d1e-498b-892e-4a1730f8a1e6 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:13:59.042907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:13:59.043452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:13:59.043932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:13:59.045582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:13:59.047901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:13:59.066913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:13:59.068235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:13:59.080025 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4411/8850] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:13:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:14:07.347238 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=54 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:09.074685 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:16.001813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:16.087620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57b612-4657-42b6-b2ea-a9e6650ee640 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:16.093612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:16.094337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:16.095343 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:16.095715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:16.107307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:16.109349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:16.124086 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4440/8851] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:14:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:14:26.117696 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=37 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:41.910230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:41.911920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:41.981505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcb955-7a28-41c3-bacb-aa261b6e4bcd service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:41.985647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f304a-4543-4fef-b3dc-9789e05d620b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:41.986335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f304a-4543-4fef-b3dc-9789e05d620b service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:41.986618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f304a-4543-4fef-b3dc-9789e05d620b service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:41.986895 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f304a-4543-4fef-b3dc-9789e05d620b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:41.988752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-588f304a-4543-4fef-b3dc-9789e05d620b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:42.074428 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f304a-4543-4fef-b3dc-9789e05d620b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:42.075864 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f304a-4543-4fef-b3dc-9789e05d620b service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:42.095670 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4412/8852] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:14:44.972953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:44.986326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6ff3-31d0-4c6a-a4d4-707f2ca63726 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:44.991899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:44.992674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:44.992961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:44.993272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:44.995038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:45.008270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:45.010300 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:45.022680 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4441/8853] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:14:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:14:47.913263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770762-d3e4-4e21-a440-33bf5004a5e7 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:47.913805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770762-d3e4-4e21-a440-33bf5004a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:47.913975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770762-d3e4-4e21-a440-33bf5004a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:47.984379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:47.986275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:48.001403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b7770762-d3e4-4e21-a440-33bf5004a5e7 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:14:48.001569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385e951-a189-410a-a8c3-a2726a9be995 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:48.002858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b7770762-d3e4-4e21-a440-33bf5004a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:48.007135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:48.008161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:48.008447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:48.008942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] PATH_INFO: `/v3/users/7229f2312e2541a9b7edb7050ee44346` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:48.014275 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4413/8854] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:14:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:14:48.025781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7229f2312e2541a9b7edb7050ee44346)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:48.027715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:48.032217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770762-d3e4-4e21-a440-33bf5004a5e7 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:48.044947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770762-d3e4-4e21-a440-33bf5004a5e7 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:48.051907 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:48.052736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:48.053341 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:48.053487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:48.068880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:48.072483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:48.086062 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4414/8855] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:14:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:14:48.090473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7229f2312e2541a9b7edb7050ee44346'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.091197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7229f2312e2541a9b7edb7050ee44346'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.091857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7229f2312e2541a9b7edb7050ee44346'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.112198 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7229f2312e2541a9b7edb7050ee44346'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.128799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7229f2312e2541a9b7edb7050ee44346'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.143474 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4442/8856] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:14:47 2022] DELETE /identity/v3/users/7229f2312e2541a9b7edb7050ee44346 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:14:48.336737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:48.350760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9772d8-afa2-4050-972a-d8a72457f81a service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:48.368535 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:48.408849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:48.409541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:48.409816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:48.410085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] PATH_INFO: `/v3/projects/a07049dcf929431c885a48c25a9aa6a9` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:48.420905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07049dcf929431c885a48c25a9aa6a9)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:48.422904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:48.468018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07049dcf929431c885a48c25a9aa6a9', 'request_id': 'req-64b22674-4d33-40a6-8d4d-af052c151e84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.474716 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07049dcf929431c885a48c25a9aa6a9', 'request_id': 'req-64b22674-4d33-40a6-8d4d-af052c151e84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.481847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07049dcf929431c885a48c25a9aa6a9', 'request_id': 'req-64b22674-4d33-40a6-8d4d-af052c151e84'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.492812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] The token cache is being invalidate because project a07049dcf929431c885a48c25a9aa6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:14:48.493136 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.493790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.495261 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4415/8857] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:14:48 2022] DELETE /identity/v3/projects/a07049dcf929431c885a48c25a9aa6a9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:14:48.499276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:48.500813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:48.514478 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e443-7ea7-4139-8091-559b75bdb8e6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:48.571989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:48.572620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:48.572899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:48.573204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] PATH_INFO: `/v3/users/85b0ff08423c43268b64cc379134e64d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:48.587193 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b0ff08423c43268b64cc379134e64d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:48.589167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:48.629705 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:48.636775 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b0ff08423c43268b64cc379134e64d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.637719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b0ff08423c43268b64cc379134e64d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.638738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b0ff08423c43268b64cc379134e64d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.651390 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b0ff08423c43268b64cc379134e64d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.658638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-5b2e25b7-fc0c-4a24-b900-d52263e2470e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b0ff08423c43268b64cc379134e64d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.670942 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4443/8858] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:14:48 2022] DELETE /identity/v3/users/85b0ff08423c43268b64cc379134e64d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:14:48.847640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:48.849225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:48.864757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22674-4d33-40a6-8d4d-af052c151e84 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:48.923540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:48.924186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:48.924458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:48.924732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] PATH_INFO: `/v3/projects/4c11e3eea62548f884152dded1e56d55` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:48.935405 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c11e3eea62548f884152dded1e56d55)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:48.937353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:48.974371 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:48.986069 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c11e3eea62548f884152dded1e56d55', 'request_id': 'req-072baae8-77ce-4ca1-b484-e2090bae6450'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:48.992623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c11e3eea62548f884152dded1e56d55', 'request_id': 'req-072baae8-77ce-4ca1-b484-e2090bae6450'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:49.000749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c11e3eea62548f884152dded1e56d55', 'request_id': 'req-072baae8-77ce-4ca1-b484-e2090bae6450'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:49.011764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] The token cache is being invalidate because project 4c11e3eea62548f884152dded1e56d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:14:49.012051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:49.012688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-072baae8-77ce-4ca1-b484-e2090bae6450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:14:49.014181 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4416/8859] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:14:48 2022] DELETE /identity/v3/projects/4c11e3eea62548f884152dded1e56d55 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:14:58.561584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4edfb-8a89-4d50-a5ba-feb62b4ac830 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:58.562168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4edfb-8a89-4d50-a5ba-feb62b4ac830 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:58.562168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4edfb-8a89-4d50-a5ba-feb62b4ac830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:58.609734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-52c4edfb-8a89-4d50-a5ba-feb62b4ac830 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:14:58.611013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-52c4edfb-8a89-4d50-a5ba-feb62b4ac830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:58.669669 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4444/8860] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:14:58.679188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e860ba-3ddd-4e35-a252-eb6b17812bfe None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:58.679691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e860ba-3ddd-4e35-a252-eb6b17812bfe None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:58.679793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e860ba-3ddd-4e35-a252-eb6b17812bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:58.700097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b8e860ba-3ddd-4e35-a252-eb6b17812bfe None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:14:58.701318 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b8e860ba-3ddd-4e35-a252-eb6b17812bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:58.709840 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4417/8861] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:14:58.714467 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4edfb-8a89-4d50-a5ba-feb62b4ac830 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:58.724394 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4edfb-8a89-4d50-a5ba-feb62b4ac830 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:58.728977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:58.729668 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:58.729948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:58.730219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:58.730882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:14:58.731183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:58.732763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:58.744639 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4445/8862] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:14:58.756934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e860ba-3ddd-4e35-a252-eb6b17812bfe None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:58.767769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e860ba-3ddd-4e35-a252-eb6b17812bfe None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:58.775452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:58.776080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:58.776355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:58.776622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:58.777286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:58.779180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:58.820495 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4418/8863] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:14:58 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:14:58.822734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:58.834249 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f06f97-4cb8-4b08-948e-530375a1f333 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:58.896150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:58.896673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:58.896951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:58.897250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:58.897873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:58.899791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:58.921243 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4446/8864] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:14:58 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:14:58.925959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:58.936507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a777899-5969-454c-8cd6-4f26951d4513 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:58.942373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:58.943142 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:58.943303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:58.943519 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:58.944155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:58.945790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:58.956851 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4419/8865] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:14:58.960901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:58.971508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37af49-e2cc-491c-9abd-9110eef72bf0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:58.976147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6982693-6982-4ce0-8e1b-e4435d5ab18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:58.976742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982693-6982-4ce0-8e1b-e4435d5ab18b admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:58.977017 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982693-6982-4ce0-8e1b-e4435d5ab18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:58.977338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982693-6982-4ce0-8e1b-e4435d5ab18b admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:58.977973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6982693-6982-4ce0-8e1b-e4435d5ab18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:58.979548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6982693-6982-4ce0-8e1b-e4435d5ab18b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:58.986054 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:58.992837 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4447/8866] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:14:58.997282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.011294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc1c5-0aae-4bc8-9e48-6872984df6b5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:59.016190 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:59.016862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.017186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.017467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] PATH_INFO: `/v3/projects/2c817c8eadca4ce795c9e8cb3f7a0679/users/584786a6e425401da8824e02ac6c796b/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.034667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c817c8eadca4ce795c9e8cb3f7a0679, user_id=584786a6e425401da8824e02ac6c796b, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:59.037536 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:59.053795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4420/8867] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:14:58 2022] PUT /identity/v3/projects/2c817c8eadca4ce795c9e8cb3f7a0679/users/584786a6e425401da8824e02ac6c796b/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:14:59.067387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1a56-0980-4636-8168-7874fc628a3e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.067670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1a56-0980-4636-8168-7874fc628a3e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.067937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1a56-0980-4636-8168-7874fc628a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.099896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fd0e1a56-0980-4636-8168-7874fc628a3e None None] MFA Rules not processed for user `584786a6e425401da8824e02ac6c796b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:14:59.101400 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fd0e1a56-0980-4636-8168-7874fc628a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:59.186994 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4448/8868] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:14:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:14:59.193458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.265176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069687b4-ff7a-4883-ac8b-da041c929f62 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:59.270597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:59.271274 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.271596 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.271929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.272600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:59.274701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:59.309023 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4421/8869] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:14:59 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:14:59.314414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1a56-0980-4636-8168-7874fc628a3e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.328285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1a56-0980-4636-8168-7874fc628a3e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:59.392270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:59.392979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.393323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.393596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.394229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:59.396298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:59.424510 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4449/8870] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:14:59 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 02:14:59.428159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.440880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae3f5-2de4-45ef-8066-8315f28bf2a6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:59.446422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:59.447025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.448078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.448078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.448283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:59.449776 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:59.460877 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4422/8871] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:14:59.466619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.478245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558af5df-7dc1-434a-98b5-32a334a0a021 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:59.483178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:59.483837 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.484122 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.485119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] PATH_INFO: `/v3/projects/35e0f01a78c644b2bfe41bfd72e00147/users/544ac9d83c86434b8f9d9d8776b30b7d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.503644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e0f01a78c644b2bfe41bfd72e00147, user_id=544ac9d83c86434b8f9d9d8776b30b7d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:59.507589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:59.530173 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4450/8872] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:14:59 2022] PUT /identity/v3/projects/35e0f01a78c644b2bfe41bfd72e00147/users/544ac9d83c86434b8f9d9d8776b30b7d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:14:59.533151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.550080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4ddb-2ab5-4299-88f7-3c17d14eb306 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:59.571408 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:59.617705 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b9f65-fa61-445d-8576-7e271a092df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:59.618414 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9f65-fa61-445d-8576-7e271a092df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.618698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9f65-fa61-445d-8576-7e271a092df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.618980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b9f65-fa61-445d-8576-7e271a092df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.619628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b9f65-fa61-445d-8576-7e271a092df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:59.621240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b9f65-fa61-445d-8576-7e271a092df4 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:59.631938 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4423/8873] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:14:59.636774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.649458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161113d-b95a-4fed-bec2-731bab6530ef admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:14:59.655235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ef1b3-4457-4ce5-9509-a40b4cf1feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:14:59.655235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ef1b3-4457-4ce5-9509-a40b4cf1feb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.655235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ef1b3-4457-4ce5-9509-a40b4cf1feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.655593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ef1b3-4457-4ce5-9509-a40b4cf1feb7 admin admin] PATH_INFO: `/v3/projects/35e0f01a78c644b2bfe41bfd72e00147/users/544ac9d83c86434b8f9d9d8776b30b7d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.658785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ef1b3-4457-4ce5-9509-a40b4cf1feb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e0f01a78c644b2bfe41bfd72e00147, user_id=544ac9d83c86434b8f9d9d8776b30b7d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:14:59.661483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ef1b3-4457-4ce5-9509-a40b4cf1feb7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:14:59.675029 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4451/8874] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:14:59 2022] PUT /identity/v3/projects/35e0f01a78c644b2bfe41bfd72e00147/users/544ac9d83c86434b8f9d9d8776b30b7d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:14:59.686485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.687019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.687201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.717985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] MFA Rules not processed for user `544ac9d83c86434b8f9d9d8776b30b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:14:59.720208 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:59.800737 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4424/8875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:14:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:14:59.814040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:14:59.814326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:14:59.814598 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:14:59.833986 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] MFA Rules not processed for user `584786a6e425401da8824e02ac6c796b`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:14:59.835174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:59.874061 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:14:59.891964 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4452/8876] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:14:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:14:59.905877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:14:59.908121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:14:59.995751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5eb7a-652e-49fe-b800-9e9368961e41 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:00.001687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:00.002310 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:00.002592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:00.002863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:00.011415 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:00.012991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:00.023030 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4425/8877] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:14:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:09.884900 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:10.019513 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:11.246084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:11.247492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:11.304734 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa8710-2c95-4d56-83fa-311e3ccc0493 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:11.308235 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:11.308828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:11.309140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:11.309408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:11.311059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:11.324120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:11.325573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:11.336804 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4453/8878] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:12.534928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:12.544196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d00e4-c9df-438e-a9af-50276129205c service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:12.548204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e4158-9ca5-4c12-9589-a0246b1e15ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:12.548783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4158-9ca5-4c12-9589-a0246b1e15ce service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:12.551258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4158-9ca5-4c12-9589-a0246b1e15ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:12.551258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4158-9ca5-4c12-9589-a0246b1e15ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:12.551258 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d95e4158-9ca5-4c12-9589-a0246b1e15ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:12.565831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4158-9ca5-4c12-9589-a0246b1e15ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:12.567269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4158-9ca5-4c12-9589-a0246b1e15ce service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:12.579231 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4426/8879] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:12.716782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:12.728972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9860ec6-e755-4846-90b0-e8e2f1b57a45 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:12.734892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:12.735488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:12.735769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:12.736041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:12.744142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:12.745761 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:12.755390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4454/8880] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:12.770857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b96e4-9941-43d3-bbbe-b36f39a36ccb None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:12.771144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b96e4-9941-43d3-bbbe-b36f39a36ccb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:12.771421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b96e4-9941-43d3-bbbe-b36f39a36ccb None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:12.772804 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4427/8881] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 02:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 02:15:12.777487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 02:15:12.789382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:12.798751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87ba24-91cf-43d7-a7b6-bd432f929e25 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:12.803629 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544ac9d83c86434b8f9d9d8776b30b7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35e0f01a78c644b2bfe41bfd72e00147', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:12.804237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:12.804519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:12.804793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] PATH_INFO: `/v3/projects/35e0f01a78c644b2bfe41bfd72e00147` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:12.805949 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] RBAC: Authorizing `identity:get_project(project_id=35e0f01a78c644b2bfe41bfd72e00147)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:12.807809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:12.809452 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4455/8882] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 02:15:12 2022] GET /identity/v3/projects/35e0f01a78c644b2bfe41bfd72e00147 => generated 391 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:15:13.116600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182f874-e581-4123-8a18-abe599e55abc None None] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:13.116889 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182f874-e581-4123-8a18-abe599e55abc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:13.117199 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182f874-e581-4123-8a18-abe599e55abc None None] PATH_INFO: `/` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:13.118577 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4428/8883] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 11 02:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 02:15:13.123203 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] Authenticating service token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 11 02:15:13.125418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:13.141847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:13.150337 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f72e86-1c46-4710-aaee-dcb2fff220ec tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:13.154838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544ac9d83c86434b8f9d9d8776b30b7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35e0f01a78c644b2bfe41bfd72e00147', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:13.155454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:13.155732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:13.156037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] PATH_INFO: `/v3/projects/35e0f01a78c644b2bfe41bfd72e00147` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:13.157176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] RBAC: Authorizing `identity:get_project(project_id=35e0f01a78c644b2bfe41bfd72e00147)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:13.158931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:13.160526 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4456/8884] 10.222.0.16 () {58 vars in 1443 bytes} [Sun Sep 11 02:15:13 2022] GET /identity/v3/projects/35e0f01a78c644b2bfe41bfd72e00147 => generated 391 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:15:15.565754 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182f874-e581-4123-8a18-abe599e55abc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:15.582247 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182f874-e581-4123-8a18-abe599e55abc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:15.589344 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8e4f-a990-4dce-a3a0-f52a5c81bc6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:15.589966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8e4f-a990-4dce-a3a0-f52a5c81bc6a service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:15.590243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8e4f-a990-4dce-a3a0-f52a5c81bc6a service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:15.590517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8e4f-a990-4dce-a3a0-f52a5c81bc6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:15.592652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fb1e8e4f-a990-4dce-a3a0-f52a5c81bc6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:15.607173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8e4f-a990-4dce-a3a0-f52a5c81bc6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:15.609514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8e4f-a990-4dce-a3a0-f52a5c81bc6a service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:15.625826 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4429/8885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:17.092098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:17.155129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8aab8-d88e-46b3-8608-14832d153900 tempest-ServersAdminNegativeTestJSON-859827231 tempest-ServersAdminNegativeTestJSON-859827231-project-admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:17.160004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:17.160619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:17.160894 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:17.161192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] PATH_INFO: `/v3/users/584786a6e425401da8824e02ac6c796b` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:17.162292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] RBAC: Authorizing `identity:delete_user(user_id=584786a6e425401da8824e02ac6c796b)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:17.164180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:17.211067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584786a6e425401da8824e02ac6c796b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.211710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584786a6e425401da8824e02ac6c796b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.212313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584786a6e425401da8824e02ac6c796b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.224170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584786a6e425401da8824e02ac6c796b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.231747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584786a6e425401da8824e02ac6c796b'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.233594 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:17.245606 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4457/8886] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:15:17 2022] DELETE /identity/v3/users/584786a6e425401da8824e02ac6c796b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:15:17.250188 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:17.250642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:17.250800 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:17.270728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:17.271945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:17.331369 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4430/8887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:17.341251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:17.342658 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:17.402991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ad7a0-65b5-4345-9fe5-8cae511d457b admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:17.407764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:17.408414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:17.408672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:17.408942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:17.418697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:17.420183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:17.431816 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4458/8888] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:17.599860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:17.601396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:17.614736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28932349-67f2-40a7-afc4-428f8b5cd708 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:17.619426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:17.620059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:17.620336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:17.620603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] PATH_INFO: `/v3/projects/2c817c8eadca4ce795c9e8cb3f7a0679` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:17.621734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c817c8eadca4ce795c9e8cb3f7a0679)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:17.623652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:17.670293 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c817c8eadca4ce795c9e8cb3f7a0679', 'request_id': 'req-458f05b5-d683-45a2-9a6f-351b2d53e9d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.677383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c817c8eadca4ce795c9e8cb3f7a0679', 'request_id': 'req-458f05b5-d683-45a2-9a6f-351b2d53e9d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.684579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c817c8eadca4ce795c9e8cb3f7a0679', 'request_id': 'req-458f05b5-d683-45a2-9a6f-351b2d53e9d3'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.695016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] The token cache is being invalidate because project 2c817c8eadca4ce795c9e8cb3f7a0679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:15:17.695303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.695952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.697488 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4431/8889] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:15:17 2022] DELETE /identity/v3/projects/2c817c8eadca4ce795c9e8cb3f7a0679 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:15:17.701487 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:17.711843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96634937-6869-4989-93fd-9b44a3d1a838 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:17.769504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:17.770137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:17.770415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:17.770693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] PATH_INFO: `/v3/users/544ac9d83c86434b8f9d9d8776b30b7d` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:17.771834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544ac9d83c86434b8f9d9d8776b30b7d)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:17.773819 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:17.819489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544ac9d83c86434b8f9d9d8776b30b7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.820127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544ac9d83c86434b8f9d9d8776b30b7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.820720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544ac9d83c86434b8f9d9d8776b30b7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.832721 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544ac9d83c86434b8f9d9d8776b30b7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.839993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-e5dc62fc-2347-429c-8da8-518dd51fe3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544ac9d83c86434b8f9d9d8776b30b7d'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:17.853080 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4459/8890] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:15:17 2022] DELETE /identity/v3/users/544ac9d83c86434b8f9d9d8776b30b7d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:15:18.127922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.129713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:18.145004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f05b5-d683-45a2-9a6f-351b2d53e9d3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.200714 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:18.208112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014be663-0887-477d-871a-e29c06de11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.208785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014be663-0887-477d-871a-e29c06de11be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.209410 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014be663-0887-477d-871a-e29c06de11be admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.209718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014be663-0887-477d-871a-e29c06de11be admin admin] PATH_INFO: `/v3/projects/35e0f01a78c644b2bfe41bfd72e00147` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.210985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014be663-0887-477d-871a-e29c06de11be admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e0f01a78c644b2bfe41bfd72e00147)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.213140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014be663-0887-477d-871a-e29c06de11be admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.269876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-014be663-0887-477d-871a-e29c06de11be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e0f01a78c644b2bfe41bfd72e00147', 'request_id': 'req-014be663-0887-477d-871a-e29c06de11be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:18.276063 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-014be663-0887-477d-871a-e29c06de11be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e0f01a78c644b2bfe41bfd72e00147', 'request_id': 'req-014be663-0887-477d-871a-e29c06de11be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:18.283552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-014be663-0887-477d-871a-e29c06de11be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e0f01a78c644b2bfe41bfd72e00147', 'request_id': 'req-014be663-0887-477d-871a-e29c06de11be'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:18.294279 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-014be663-0887-477d-871a-e29c06de11be admin admin] The token cache is being invalidate because project 35e0f01a78c644b2bfe41bfd72e00147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:15:18.294570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-014be663-0887-477d-871a-e29c06de11be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:18.295212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-014be663-0887-477d-871a-e29c06de11be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:15:18.296926 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4432/8891] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:15:18 2022] DELETE /identity/v3/projects/35e0f01a78c644b2bfe41bfd72e00147 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:15:18.303494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77223ec-992f-47af-8915-9eeabb4e65e7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.303952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77223ec-992f-47af-8915-9eeabb4e65e7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.304108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77223ec-992f-47af-8915-9eeabb4e65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.324245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e77223ec-992f-47af-8915-9eeabb4e65e7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:18.325482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e77223ec-992f-47af-8915-9eeabb4e65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:18.334245 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:18.385418 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4460/8892] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:18.394272 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e17a-1c87-47b3-b0a8-2640617ffb21 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.394561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e17a-1c87-47b3-b0a8-2640617ffb21 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.394838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e17a-1c87-47b3-b0a8-2640617ffb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.414359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f1e3e17a-1c87-47b3-b0a8-2640617ffb21 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:18.415563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f1e3e17a-1c87-47b3-b0a8-2640617ffb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:18.423846 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4433/8893] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:18.428391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77223ec-992f-47af-8915-9eeabb4e65e7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.438472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77223ec-992f-47af-8915-9eeabb4e65e7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.443050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.443644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.443919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.444188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.444823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:15:18.445149 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.446757 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.458848 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4461/8894] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:15:18.463189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e17a-1c87-47b3-b0a8-2640617ffb21 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.472487 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e17a-1c87-47b3-b0a8-2640617ffb21 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.477140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.477734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.478009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.478277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.478902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.480807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.509954 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4434/8895] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:15:18 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:15:18.514380 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.527782 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b176f2-0440-4bc3-a769-737f12fef67d admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.586341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.586942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.587219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.587488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.588108 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.590047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.612198 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4462/8896] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:15:18 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:15:18.616436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.627624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b56a-4675-4ddf-93fa-bbc874761048 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.632320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.632916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.633225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.633502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.634155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.635793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.645724 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4435/8897] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:15:18.649786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.660091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e973e5-9cf3-4ded-9020-8dc4607db2dd admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.665197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c72b80-66a6-4e37-abce-58d1c2423a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.665792 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72b80-66a6-4e37-abce-58d1c2423a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.666076 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72b80-66a6-4e37-abce-58d1c2423a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.666353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72b80-66a6-4e37-abce-58d1c2423a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.666991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c72b80-66a6-4e37-abce-58d1c2423a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.668576 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c72b80-66a6-4e37-abce-58d1c2423a6d admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.681255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4463/8898] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:15:18.685356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.696048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcad424-068d-489b-a181-686f665aed47 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.700730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.701419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.701688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.701971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] PATH_INFO: `/v3/projects/8e833bfcd50745cc9244fcc876fb9886/users/5c02cc49111941e3aa7b648adfa2030f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.716449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e833bfcd50745cc9244fcc876fb9886, user_id=5c02cc49111941e3aa7b648adfa2030f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.719146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.731795 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4436/8899] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:15:18 2022] PUT /identity/v3/projects/8e833bfcd50745cc9244fcc876fb9886/users/5c02cc49111941e3aa7b648adfa2030f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:15:18.737490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93c83b-a569-4270-9a27-2fa7bb7c4851 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.737781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93c83b-a569-4270-9a27-2fa7bb7c4851 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.738059 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93c83b-a569-4270-9a27-2fa7bb7c4851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.757719 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-1f93c83b-a569-4270-9a27-2fa7bb7c4851 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:18.758968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f93c83b-a569-4270-9a27-2fa7bb7c4851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:18.816814 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4464/8900] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:18.826458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:18.828237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:18.895656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d038cd0-a9d5-4e8a-8aad-7e67b54071c5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:18.899327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68eb05-0d70-413f-b9cc-3f808dcb66b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:18.899936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68eb05-0d70-413f-b9cc-3f808dcb66b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:18.900221 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68eb05-0d70-413f-b9cc-3f808dcb66b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:18.900491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68eb05-0d70-413f-b9cc-3f808dcb66b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:18.909994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68eb05-0d70-413f-b9cc-3f808dcb66b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:18.911416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68eb05-0d70-413f-b9cc-3f808dcb66b8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:18.920808 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4437/8901] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:22.632873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:22.633671 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:22.633849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:22.666497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] MFA Rules not processed for user `5c02cc49111941e3aa7b648adfa2030f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:22.667834 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:22.676110 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:22.734483 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4465/8902] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:15:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:22.745958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58523-bdb2-436e-bf96-eec8542d5531 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:22.746521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58523-bdb2-436e-bf96-eec8542d5531 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:22.746616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58523-bdb2-436e-bf96-eec8542d5531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:22.769149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1cd58523-bdb2-436e-bf96-eec8542d5531 None None] MFA Rules not processed for user `5c02cc49111941e3aa7b648adfa2030f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:22.769764 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1cd58523-bdb2-436e-bf96-eec8542d5531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:22.776763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4438/8903] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:15:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:22.789824 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:22.791308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:22.875484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0978-77b2-41d7-bd5c-313ef955aef6 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:22.881330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:22.882113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:22.882517 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:22.882881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:22.892601 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:22.894344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:22.904043 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4466/8904] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:15:23.186433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58523-bdb2-436e-bf96-eec8542d5531 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:23.196617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58523-bdb2-436e-bf96-eec8542d5531 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:23.200361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4fd9-0628-48ce-ab23-9d05e46a6ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:23.200962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4fd9-0628-48ce-ab23-9d05e46a6ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:23.201265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4fd9-0628-48ce-ab23-9d05e46a6ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:23.201587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4fd9-0628-48ce-ab23-9d05e46a6ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:23.204281 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7b0e4fd9-0628-48ce-ab23-9d05e46a6ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:23.214777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e4fd9-0628-48ce-ab23-9d05e46a6ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:23.216226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e4fd9-0628-48ce-ab23-9d05e46a6ff9 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:23.226060 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4439/8905] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:25.543901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:25.546214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:25.563496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcf3bd-a993-456e-915c-0eb9c94fe071 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:25.567413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:25.568035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:25.568313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:25.568584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:25.570441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:25.581768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:25.583301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:25.598142 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4467/8906] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:15:33.222259 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:35.590497 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=63 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:35.966294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d18c8-2d2b-4507-a36d-9b99c42a4826 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:35.966885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d18c8-2d2b-4507-a36d-9b99c42a4826 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:35.967146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d18c8-2d2b-4507-a36d-9b99c42a4826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:36.012076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-841d18c8-2d2b-4507-a36d-9b99c42a4826 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:36.013335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-841d18c8-2d2b-4507-a36d-9b99c42a4826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:36.020094 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4440/8907] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:15:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:15:36.031484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:36.040257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41f24c-aaaa-4535-9497-f0d8e26ee748 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:36.043862 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:36.044452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:36.044727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:36.044991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:36.053254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:36.054931 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:36.064255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4468/8908] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:36.151560 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55842a-9758-4c61-92b4-d9cea682b34f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:36.151854 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55842a-9758-4c61-92b4-d9cea682b34f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:36.152134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55842a-9758-4c61-92b4-d9cea682b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:36.174026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ff55842a-9758-4c61-92b4-d9cea682b34f None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:36.175231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ff55842a-9758-4c61-92b4-d9cea682b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:36.238833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4441/8909] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:15:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:36.250634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:36.252012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:36.267369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d44a6-e874-40ff-87e5-68a586f59691 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:36.272387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:36.272978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:36.273305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:36.273577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:36.282353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:36.283902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:36.293431 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4469/8910] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:36.543440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e7da-b7fc-4fde-9edf-1c4e45322416 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:36.543727 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e7da-b7fc-4fde-9edf-1c4e45322416 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:36.543999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e7da-b7fc-4fde-9edf-1c4e45322416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:36.582401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b612e7da-b7fc-4fde-9edf-1c4e45322416 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:15:36.584201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b612e7da-b7fc-4fde-9edf-1c4e45322416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:36.598470 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4442/8911] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:15:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:15:36.610081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:36.619323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9217-8bee-4c07-a262-a952e3c2aae4 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:36.622807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:36.623392 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:36.623667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:36.623938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:36.634957 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:36.636357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:36.647232 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4470/8912] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:36.708308 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e7da-b7fc-4fde-9edf-1c4e45322416 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:15:36.719686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e7da-b7fc-4fde-9edf-1c4e45322416 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:15:36.724611 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:15:36.725237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:15:36.725514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:15:36.725785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:15:36.727470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:15:36.739241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:15:36.740784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:15:36.751033 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4443/8913] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:15:46.642577 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=18 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:15:46.746287 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=53 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:16:17.477805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:17.493397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a415c6-da5d-45b5-a830-af17feebc03f service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:17.498246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:17.499415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:17.499690 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:17.499959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] PATH_INFO: `/v3/users/5c02cc49111941e3aa7b648adfa2030f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:17.501102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c02cc49111941e3aa7b648adfa2030f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:17.503166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:17.554141 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c02cc49111941e3aa7b648adfa2030f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.556427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c02cc49111941e3aa7b648adfa2030f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.556427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c02cc49111941e3aa7b648adfa2030f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.569653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c02cc49111941e3aa7b648adfa2030f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.577529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-32630564-3a4d-45ff-b1ff-8f857bd19c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c02cc49111941e3aa7b648adfa2030f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.590918 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4471/8914] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:16:17 2022] DELETE /identity/v3/users/5c02cc49111941e3aa7b648adfa2030f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:16:17.766476 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:17.777014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb0fc-8910-4bc0-91dd-d35930c18dc7 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:17.837817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:17.838449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:17.838730 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:17.839010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] PATH_INFO: `/v3/projects/8e833bfcd50745cc9244fcc876fb9886` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:17.840137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e833bfcd50745cc9244fcc876fb9886)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:17.842119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:17.888629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e833bfcd50745cc9244fcc876fb9886', 'request_id': 'req-8e6c5592-9a7e-467b-8eac-835094c2c489'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.895694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e833bfcd50745cc9244fcc876fb9886', 'request_id': 'req-8e6c5592-9a7e-467b-8eac-835094c2c489'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.903175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e833bfcd50745cc9244fcc876fb9886', 'request_id': 'req-8e6c5592-9a7e-467b-8eac-835094c2c489'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.914378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] The token cache is being invalidate because project 8e833bfcd50745cc9244fcc876fb9886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:16:17.914688 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.915326 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8e6c5592-9a7e-467b-8eac-835094c2c489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:16:17.916829 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4444/8915] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:16:17 2022] DELETE /identity/v3/projects/8e833bfcd50745cc9244fcc876fb9886 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:16:17.922178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c2ed-cd17-44ed-a2ca-b7d5caeec3bb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:17.922460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c2ed-cd17-44ed-a2ca-b7d5caeec3bb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:17.922729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7c2ed-cd17-44ed-a2ca-b7d5caeec3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:17.942543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e1e7c2ed-cd17-44ed-a2ca-b7d5caeec3bb None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:16:17.943659 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e1e7c2ed-cd17-44ed-a2ca-b7d5caeec3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:18.003591 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4472/8916] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:16:18.012296 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d4dc-0104-47df-afeb-5ad8af04536a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.012578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d4dc-0104-47df-afeb-5ad8af04536a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.012878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d4dc-0104-47df-afeb-5ad8af04536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.034506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5fb0d4dc-0104-47df-afeb-5ad8af04536a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:16:18.035696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5fb0d4dc-0104-47df-afeb-5ad8af04536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:18.043547 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4445/8917] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:16:18.048229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7c2ed-cd17-44ed-a2ca-b7d5caeec3bb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:18.058615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7c2ed-cd17-44ed-a2ca-b7d5caeec3bb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:18.063480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:18.064090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.064368 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.064638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.065319 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:16:18.065621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:18.067206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:18.080229 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4473/8918] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 02:16:18.084702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0d4dc-0104-47df-afeb-5ad8af04536a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:18.095740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0d4dc-0104-47df-afeb-5ad8af04536a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:18.100553 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:18.101292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.101572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.101924 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.102666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:18.104720 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:18.137257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4446/8919] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:16:18 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 02:16:18.140794 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:18.151285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578eed-4d58-47b2-930c-dacbda5293f1 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:18.215346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:18.215817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.216093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.216364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.216988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:18.219083 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:18.227105 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:16:18.241559 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4474/8920] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:16:18 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 02:16:18.245702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:18.256486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2537-7df6-4264-89cd-1ddc254a8643 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:18.261116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:18.261707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.261981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.262250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.262885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:18.265353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:18.275396 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4447/8921] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:16:18.279398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:18.290031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be72c-c764-40f0-bcff-5622a82fdcb7 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:18.294705 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309047ba-817f-467a-a552-2c75cc1b3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:18.295294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309047ba-817f-467a-a552-2c75cc1b3cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.295992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309047ba-817f-467a-a552-2c75cc1b3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.296279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309047ba-817f-467a-a552-2c75cc1b3cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.296914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309047ba-817f-467a-a552-2c75cc1b3cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:18.298562 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309047ba-817f-467a-a552-2c75cc1b3cb1 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:18.309405 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4475/8922] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:16:18.314497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:18.324562 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477567-1e01-48af-9587-5856569e1b1c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:18.330046 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:18.330684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.330961 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.331231 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] PATH_INFO: `/v3/projects/c8d5171fb0ae4f43a8ffe3b8556e12f8/users/689703d248bc4e81a306c71ee5b3831f/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.345712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d5171fb0ae4f43a8ffe3b8556e12f8, user_id=689703d248bc4e81a306c71ee5b3831f, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:18.348329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:18.361639 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4448/8923] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:16:18 2022] PUT /identity/v3/projects/c8d5171fb0ae4f43a8ffe3b8556e12f8/users/689703d248bc4e81a306c71ee5b3831f/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:16:18.366814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33518451-b91d-4bec-bbac-d710d2d0607e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.367106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33518451-b91d-4bec-bbac-d710d2d0607e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.367382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33518451-b91d-4bec-bbac-d710d2d0607e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.386699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-33518451-b91d-4bec-bbac-d710d2d0607e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:16:18.387888 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-33518451-b91d-4bec-bbac-d710d2d0607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:18.449432 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4476/8924] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:16:18.460409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:18.462161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:18.492604 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:16:18.521628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b81e14-9298-49e9-bdc1-78b9d287e2e3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:18.525356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663424b-9fa2-488d-ac35-e0914391b9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:18.525970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663424b-9fa2-488d-ac35-e0914391b9af service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:18.526254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663424b-9fa2-488d-ac35-e0914391b9af service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:18.526526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663424b-9fa2-488d-ac35-e0914391b9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:18.535906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663424b-9fa2-488d-ac35-e0914391b9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:18.537360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663424b-9fa2-488d-ac35-e0914391b9af service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:18.547521 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4449/8925] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:16:22.699871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:22.700398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:22.700638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:22.735830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] MFA Rules not processed for user `689703d248bc4e81a306c71ee5b3831f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:16:22.737179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:22.809531 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4477/8926] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:16:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:16:22.820068 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:22.820570 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:22.820666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:22.845083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] MFA Rules not processed for user `689703d248bc4e81a306c71ee5b3831f`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:16:22.846374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:22.853532 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4450/8927] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:16:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:16:22.866727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:22.868340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:22.942120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173fb5-b9a0-4d87-9243-e2657160b3a1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:22.947773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e64632-067f-46e1-b396-d46d4892233d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:22.948482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64632-067f-46e1-b396-d46d4892233d service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:22.948786 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64632-067f-46e1-b396-d46d4892233d service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:22.949136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64632-067f-46e1-b396-d46d4892233d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:22.955061 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:16:22.959841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e64632-067f-46e1-b396-d46d4892233d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:22.961920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e64632-067f-46e1-b396-d46d4892233d service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:22.971879 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4478/8928] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:16:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:16:32.837864 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=17 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:16:32.966891 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:16:34.294271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:16:34.297438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:34.317481 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a349a-0f6c-4cc8-8448-68ef4d3e5944 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:16:34.323245 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:16:34.323844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:16:34.324119 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:16:34.324872 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:16:34.326137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:16:34.340859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:16:34.342282 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:16:34.354146 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4451/8929] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:16:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:16:44.349469 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:17:16.583947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9c39-8ac9-4837-ab5e-6b9798c9bc00 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:17:16.584518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9c39-8ac9-4837-ab5e-6b9798c9bc00 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:17:16.584518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9c39-8ac9-4837-ab5e-6b9798c9bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:17:16.604192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-884b9c39-8ac9-4837-ab5e-6b9798c9bc00 None None] MFA Rules not processed for user `689703d248bc4e81a306c71ee5b3831f`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:17:16.605407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-884b9c39-8ac9-4837-ab5e-6b9798c9bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:17:16.612237 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4479/8930] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:17:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:17:26.599315 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:17:58.162081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:17:58.163592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:17:58.174805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c55a30-28a8-4eb1-8373-c83f3eedddca service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:17:58.178634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:17:58.179219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:17:58.179493 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:17:58.179760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:17:58.181449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:17:58.190977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:17:58.192370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:17:58.200693 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4452/8931] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:17:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:18:08.196690 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:18:13.248645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9c39-8ac9-4837-ab5e-6b9798c9bc00 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:13.259436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9c39-8ac9-4837-ab5e-6b9798c9bc00 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:13.264212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:13.264838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:13.265157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:13.265452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] PATH_INFO: `/v3/users/689703d248bc4e81a306c71ee5b3831f` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:13.266570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=689703d248bc4e81a306c71ee5b3831f)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:13.268503 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:13.317484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689703d248bc4e81a306c71ee5b3831f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.318190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689703d248bc4e81a306c71ee5b3831f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.318805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689703d248bc4e81a306c71ee5b3831f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.331814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689703d248bc4e81a306c71ee5b3831f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.341023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-8b907694-2bff-417e-beee-f47717a6b618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689703d248bc4e81a306c71ee5b3831f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.356340 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4480/8932] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:18:13 2022] DELETE /identity/v3/users/689703d248bc4e81a306c71ee5b3831f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:18:13.533460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:13.546704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afab63c-d049-4931-9862-4da65ab7bbf8 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:13.604875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:13.605528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:13.605848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:13.606122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] PATH_INFO: `/v3/projects/c8d5171fb0ae4f43a8ffe3b8556e12f8` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:13.607253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d5171fb0ae4f43a8ffe3b8556e12f8)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:13.609154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:13.658947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d5171fb0ae4f43a8ffe3b8556e12f8', 'request_id': 'req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.664998 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d5171fb0ae4f43a8ffe3b8556e12f8', 'request_id': 'req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.672047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d5171fb0ae4f43a8ffe3b8556e12f8', 'request_id': 'req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.682324 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] The token cache is being invalidate because project c8d5171fb0ae4f43a8ffe3b8556e12f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:18:13.682609 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.683223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-e7df14e8-ea0c-49fa-840d-f013ef87d8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:18:13.685398 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4453/8933] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:18:13 2022] DELETE /identity/v3/projects/c8d5171fb0ae4f43a8ffe3b8556e12f8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:18:13.690361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e20c3-35d9-4659-99fd-1fa199d713fa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:13.690650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e20c3-35d9-4659-99fd-1fa199d713fa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:13.690925 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e20c3-35d9-4659-99fd-1fa199d713fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:13.711482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-623e20c3-35d9-4659-99fd-1fa199d713fa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:18:13.712694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-623e20c3-35d9-4659-99fd-1fa199d713fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:13.771544 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4481/8934] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:18:13.780564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e7cd6-1c2c-4ce3-bc37-2891af0e436b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:13.780778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e7cd6-1c2c-4ce3-bc37-2891af0e436b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:13.781048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e7cd6-1c2c-4ce3-bc37-2891af0e436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:13.801053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e71e7cd6-1c2c-4ce3-bc37-2891af0e436b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:18:13.802297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e71e7cd6-1c2c-4ce3-bc37-2891af0e436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:13.811313 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4454/8935] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:18:13.815704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e20c3-35d9-4659-99fd-1fa199d713fa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:13.826215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e20c3-35d9-4659-99fd-1fa199d713fa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:13.830799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:13.831391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:13.831669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:13.831937 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:13.832637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:18:13.832924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:13.834549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:13.845948 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4482/8936] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:18:13.850278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e7cd6-1c2c-4ce3-bc37-2891af0e436b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:13.859946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e7cd6-1c2c-4ce3-bc37-2891af0e436b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:13.864753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:13.865380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:13.865665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:13.865944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:13.866597 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:13.868592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:13.896388 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4455/8937] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:18:13 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:18:13.900691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:13.910985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ceb77-dd52-4429-b4bc-a3071532d238 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:13.969004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:13.969637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:13.969917 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:13.970188 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:13.970806 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:13.972711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:13.980582 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:18:13.995423 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4483/8938] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:18:13 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:18:14.000673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:14.011072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643b5f-5436-4058-b1f1-2a6fb268073a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:14.015757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:14.016349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:14.016666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:14.017014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:14.017737 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:14.019345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:14.029501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4456/8939] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:18:14.033465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:14.044204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ec18-b4c2-4ac1-8786-b46f9c35e437 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:14.048995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5de304-d219-47c5-8c55-3f7f6451270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:14.049655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5de304-d219-47c5-8c55-3f7f6451270f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:14.049933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5de304-d219-47c5-8c55-3f7f6451270f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:14.050206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5de304-d219-47c5-8c55-3f7f6451270f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:14.050848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5de304-d219-47c5-8c55-3f7f6451270f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:14.052454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5de304-d219-47c5-8c55-3f7f6451270f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:14.063521 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4484/8940] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:18:14.067502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:14.078016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf5ba6-a738-4207-9612-553aebf3ccc8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:14.082715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:14.083363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:14.083642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:14.083913 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] PATH_INFO: `/v3/projects/b9a37cb9cbab4270b05a8c1cefd24d35/users/c56a0807f1f9425ca3a5c36b8a0d8543/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:14.098955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a37cb9cbab4270b05a8c1cefd24d35, user_id=c56a0807f1f9425ca3a5c36b8a0d8543, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:14.101622 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:14.114211 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4457/8941] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:18:14 2022] PUT /identity/v3/projects/b9a37cb9cbab4270b05a8c1cefd24d35/users/c56a0807f1f9425ca3a5c36b8a0d8543/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:18:14.119600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023656f-e438-42bc-bbbc-98a7f88bf571 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:14.119891 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023656f-e438-42bc-bbbc-98a7f88bf571 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:14.120167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023656f-e438-42bc-bbbc-98a7f88bf571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:14.139694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6023656f-e438-42bc-bbbc-98a7f88bf571 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:18:14.141847 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6023656f-e438-42bc-bbbc-98a7f88bf571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:14.204844 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4485/8942] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:18:14.214653 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:14.216953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:14.247454 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:18:14.279108 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790cd5b-b29c-4e23-8c37-738032ea625e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:14.282975 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:14.283635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:14.283865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:14.284141 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:14.294589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:14.296113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:14.306521 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4458/8943] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:18:18.408362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcc4b0-8086-4479-8c1e-c43aeee2b1e3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:18.409357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcc4b0-8086-4479-8c1e-c43aeee2b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:18.409841 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcc4b0-8086-4479-8c1e-c43aeee2b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:18.442265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b5dcc4b0-8086-4479-8c1e-c43aeee2b1e3 None None] MFA Rules not processed for user `c56a0807f1f9425ca3a5c36b8a0d8543`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:18:18.443495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b5dcc4b0-8086-4479-8c1e-c43aeee2b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:18.527467 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4486/8944] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:18:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:18:18.542416 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:18.544373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:18.636437 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a3774-559d-4d31-b664-465a84c63374 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:18.643009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:18.643637 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:18.643911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:18.644179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:18.653477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:18.655266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:18.665316 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4459/8945] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:18:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:18:20.000281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8461-8d36-416d-8248-3c4989e8f4c1 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:20.000828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8461-8d36-416d-8248-3c4989e8f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:20.000828 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8461-8d36-416d-8248-3c4989e8f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:20.025968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e71b8461-8d36-416d-8248-3c4989e8f4c1 None None] MFA Rules not processed for user `c56a0807f1f9425ca3a5c36b8a0d8543`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:18:20.027231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e71b8461-8d36-416d-8248-3c4989e8f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:20.035139 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4487/8946] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:18:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:18:20.734568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:18:20.737862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:20.821879 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd9c9e-eb62-4112-8361-12601741e5dd service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:18:20.827501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:18:20.828295 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:18:20.828572 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:18:20.828839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:18:20.830565 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:18:20.843375 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:18:20.844993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:18:20.855323 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4460/8947] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:18:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:18:30.015012 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:18:30.851078 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=84 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:19:04.012730 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b8461-8d36-416d-8248-3c4989e8f4c1 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:19:04.024257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b8461-8d36-416d-8248-3c4989e8f4c1 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:19:04.029677 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:19:04.030269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:19:04.030543 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:19:04.030816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:19:04.032488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:19:04.044124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:19:04.045776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:19:04.055662 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4488/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:19:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:19:05.129904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:19:05.141173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616f2b-895a-4b68-96b7-7ff5d536e168 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:19:05.146277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bfa90-47ab-4ee3-9a21-1fa10909ee18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:19:05.146869 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bfa90-47ab-4ee3-9a21-1fa10909ee18 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:19:05.147151 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bfa90-47ab-4ee3-9a21-1fa10909ee18 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:19:05.147425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bfa90-47ab-4ee3-9a21-1fa10909ee18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:19:05.149268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cd4bfa90-47ab-4ee3-9a21-1fa10909ee18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:19:05.161317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bfa90-47ab-4ee3-9a21-1fa10909ee18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:19:05.162912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bfa90-47ab-4ee3-9a21-1fa10909ee18 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:19:05.173255 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4461/8949] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:19:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:19:14.051354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:19:15.168667 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:19:52.678614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:19:52.680689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:19:52.701513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286f46-745c-4362-97e4-07da82c3137a service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:19:52.707993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:19:52.708604 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:19:52.708886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:19:52.709191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:19:52.710935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:19:52.724180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:19:52.725784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:19:52.736264 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4489/8950] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:19:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:20:02.731849 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:20:04.395967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0b22-8786-46c6-bd40-55af89930f50 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:20:04.396456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0b22-8786-46c6-bd40-55af89930f50 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:20:04.396456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0b22-8786-46c6-bd40-55af89930f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:20:04.416066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c70a0b22-8786-46c6-bd40-55af89930f50 None None] MFA Rules not processed for user `c56a0807f1f9425ca3a5c36b8a0d8543`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:20:04.417303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c70a0b22-8786-46c6-bd40-55af89930f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:20:04.424599 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4462/8951] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:20:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:20:12.125436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:20:12.126913 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:20:12.147936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e89b-5b9b-4b67-98eb-1ca5c8e8e3cd service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:20:12.151665 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:20:12.152283 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:20:12.152558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:20:12.152825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:20:12.154554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:20:12.167559 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:20:12.168956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:20:12.180269 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4490/8952] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:20:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:20:13.363721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a0b22-8786-46c6-bd40-55af89930f50 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:20:13.373614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a0b22-8786-46c6-bd40-55af89930f50 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:20:13.377794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:20:13.378396 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:20:13.378678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:20:13.378953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:20:13.380662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:20:13.394120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:20:13.395541 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:20:13.406447 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4463/8953] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:20:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:20:22.175047 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=10 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:20:23.401558 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:21:47.042205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:21:47.051798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52d3a-e206-46a2-89ae-15dea3a996f5 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:21:47.055751 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:21:47.056459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:21:47.056740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:21:47.057011 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:21:47.059138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:21:47.070092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:21:47.072088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:21:47.080464 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4491/8954] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:21:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:21:47.179373 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:21:47.190958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16321d-2b36-44a0-8113-b8038d3990ff service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:21:47.196974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:21:47.197642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:21:47.197923 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:21:47.198196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:21:47.199974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:21:47.211981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:21:47.213587 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:21:47.223582 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4464/8955] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:21:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:21:48.420211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:21:48.428928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56785062-396b-404d-8c60-feb4640d1fb2 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:21:48.433438 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:21:48.434028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:21:48.434299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:21:48.434566 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:21:48.436270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:21:48.449940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:21:48.451333 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:21:48.461950 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4492/8956] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:21:48.521987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:21:48.533017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b917a96-47f3-4a71-b861-21ca35054116 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:21:48.538071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:21:48.538686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:21:48.538962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:21:48.539803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:21:48.541722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:21:48.552982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:21:48.554583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:21:48.565938 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4465/8957] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:21:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:21:55.191827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:21:55.200489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b11168-1de4-4de3-b4bf-51c89b5e93c6 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:21:55.204146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:21:55.204744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:21:55.205022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:21:55.205325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:21:55.207060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:21:55.217014 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:21:55.218459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:21:55.226364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4493/8958] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:21:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:21:55.647530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:21:55.661588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3442b8-6c3b-48d5-9cca-3b15dc96cf57 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:21:55.667767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608eee-5db5-48bf-a753-492eca589a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:21:55.668372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608eee-5db5-48bf-a753-492eca589a93 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:21:55.668644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608eee-5db5-48bf-a753-492eca589a93 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:21:55.668910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608eee-5db5-48bf-a753-492eca589a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:21:55.670752 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9f608eee-5db5-48bf-a753-492eca589a93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:21:55.683233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608eee-5db5-48bf-a753-492eca589a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:21:55.684791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608eee-5db5-48bf-a753-492eca589a93 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:21:55.695494 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4466/8959] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:22:02.292704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:22:02.306630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3797-1d56-4d48-ac4f-c4a0c06c0e29 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:22:02.313171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:22:02.313772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:22:02.314051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:22:02.314322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:22:02.316155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:22:02.329694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:22:02.331278 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:22:02.342801 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4494/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:22:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:22:05.691024 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=18 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:22:09.421569 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424a8b-3a63-4f08-8320-ebbb4e4de9fd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:22:09.422230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424a8b-3a63-4f08-8320-ebbb4e4de9fd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:22:09.422230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424a8b-3a63-4f08-8320-ebbb4e4de9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:22:09.447417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-fc424a8b-3a63-4f08-8320-ebbb4e4de9fd None None] MFA Rules not processed for user `c56a0807f1f9425ca3a5c36b8a0d8543`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:22:09.448606 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fc424a8b-3a63-4f08-8320-ebbb4e4de9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:22:09.455783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4467/8961] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:22:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:22:09.761942 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:22:09.772137 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374e55-87b4-4688-a1bf-8504837823d3 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:22:09.775676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:22:09.776259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:22:09.776529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:22:09.776793 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:22:09.779044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:22:09.788065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:22:09.789499 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:22:09.797139 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4495/8962] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:22:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:22:19.442353 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:22:19.793781 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=30 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:23:25.812513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424a8b-3a63-4f08-8320-ebbb4e4de9fd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:23:25.835794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424a8b-3a63-4f08-8320-ebbb4e4de9fd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:23:25.841304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65c085-8a61-430d-a156-a308135330fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:23:25.841908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c085-8a61-430d-a156-a308135330fd service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:23:25.842184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c085-8a61-430d-a156-a308135330fd service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:23:25.842455 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c085-8a61-430d-a156-a308135330fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:23:25.851104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65c085-8a61-430d-a156-a308135330fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:23:25.852689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65c085-8a61-430d-a156-a308135330fd service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:23:25.862445 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4468/8963] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:23:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:23:35.857483 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=11 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:23:40.014995 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:23:40.042702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d7ad-98a1-4616-bf3b-4cd59c8064b7 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:23:40.046472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:23:40.047069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:23:40.047345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:23:40.047614 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:23:40.049706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:23:40.069764 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:23:40.071180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:23:40.079283 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4496/8964] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:23:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:23:50.075680 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=15 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:23:58.417460 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a8e6-f989-426d-93f5-7c37d16fa32c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:23:58.417979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a8e6-f989-426d-93f5-7c37d16fa32c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:23:58.418091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a8e6-f989-426d-93f5-7c37d16fa32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:23:58.437945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-b6e4a8e6-f989-426d-93f5-7c37d16fa32c None None] MFA Rules not processed for user `c56a0807f1f9425ca3a5c36b8a0d8543`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:23:58.439139 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b6e4a8e6-f989-426d-93f5-7c37d16fa32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:23:58.459476 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4469/8965] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:23:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:23:59.103740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:23:59.105262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:23:59.162362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ead9f8-431e-4540-b96e-c5f2924f6549 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:23:59.167508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:23:59.168094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:23:59.168373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:23:59.168644 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:23:59.177854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:23:59.179423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:23:59.189618 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4497/8966] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:23:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:24:08.453745 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:24:08.976336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4a8e6-f989-426d-93f5-7c37d16fa32c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:24:08.988965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4a8e6-f989-426d-93f5-7c37d16fa32c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:24:08.994007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:24:08.994651 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:24:08.994955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:24:08.995852 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:24:09.004876 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:24:09.006490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:24:09.016806 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4470/8967] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:24:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:24:09.185226 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=22 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:24:10.058007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:24:10.071419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376cf35-912f-496f-97e5-c91a913fbb98 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:24:10.076789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843bf93-8116-4b18-9164-562fc607197a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:24:10.077457 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843bf93-8116-4b18-9164-562fc607197a service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:24:10.077740 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843bf93-8116-4b18-9164-562fc607197a service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:24:10.078019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843bf93-8116-4b18-9164-562fc607197a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:24:10.089013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843bf93-8116-4b18-9164-562fc607197a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:24:10.090657 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843bf93-8116-4b18-9164-562fc607197a service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:24:10.105597 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4498/8968] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:24:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:24:19.012222 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:24:20.102052 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:25:23.151632 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:25:23.160888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4d06-bcfa-4f69-9808-865f9ec616ee service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:25:23.165002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:25:23.165628 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:25:23.165910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:25:23.166185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:25:23.183689 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:25:23.185145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:25:23.196318 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4471/8969] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:25:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:25:23.387092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1015206-6ff8-4568-8730-bf70df773ff5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:25:23.387551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1015206-6ff8-4568-8730-bf70df773ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:25:23.387660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1015206-6ff8-4568-8730-bf70df773ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:25:23.455256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f1015206-6ff8-4568-8730-bf70df773ff5 None None] MFA Rules not processed for user `0492b5b414354bce909e395d44d215c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:25:23.456436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f1015206-6ff8-4568-8730-bf70df773ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:25:23.515709 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4499/8970] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 11 02:25:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:25:23.521703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:25:23.531421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186474-8498-4e02-986a-4201f4326c36 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:25:23.534992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:25:23.535581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:25:23.535856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:25:23.536124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:25:23.546957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:25:23.548351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:25:23.559183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4472/8971] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:25:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:25:33.512646 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=46 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:25:33.554326 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=15 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:26:17.601916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1015206-6ff8-4568-8730-bf70df773ff5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:17.619106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1015206-6ff8-4568-8730-bf70df773ff5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:17.625707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:17.626361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:17.626645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:17.626916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:17.636514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:17.639533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:17.652497 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4500/8972] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:26:27.646519 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:26:45.052796 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:45.062213 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc5e77-ca78-4441-a20a-c45c09b567af service cinder] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:45.066094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:45.066687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:45.066967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:45.067242 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:45.076091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:45.077540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:45.106761 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4473/8973] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:26:48.284900 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:48.297091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380812-a5c7-47ff-9d8c-e457c58fecf9 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:48.302100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:48.302729 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:48.303004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:48.303275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:48.304959 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:48.317752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:48.319289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:48.330323 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4501/8974] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:26:48.356524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:48.375042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cc582-f428-4b3a-89a7-2f0bdb404fd6 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:48.379853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:48.380477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:48.380751 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:48.381017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] PATH_INFO: `/v3/users/c56a0807f1f9425ca3a5c36b8a0d8543` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:48.382177 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56a0807f1f9425ca3a5c36b8a0d8543)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:48.384117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:48.433918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56a0807f1f9425ca3a5c36b8a0d8543'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.434580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56a0807f1f9425ca3a5c36b8a0d8543'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.435193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56a0807f1f9425ca3a5c36b8a0d8543'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.443755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56a0807f1f9425ca3a5c36b8a0d8543'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.456505 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-a2773073-4610-4e6b-a4e8-2a045f5a5bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56a0807f1f9425ca3a5c36b8a0d8543'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.471059 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4474/8975] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:26:48 2022] DELETE /identity/v3/users/c56a0807f1f9425ca3a5c36b8a0d8543 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:26:48.652144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:48.663533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4826d0-3488-4019-99cf-6c9b8da4a7ac service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:48.720687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:48.721461 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:48.721712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:48.721987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] PATH_INFO: `/v3/projects/b9a37cb9cbab4270b05a8c1cefd24d35` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:48.723132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a37cb9cbab4270b05a8c1cefd24d35)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:48.725084 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:48.772575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a37cb9cbab4270b05a8c1cefd24d35', 'request_id': 'req-994c3b2f-e70b-4675-b1ac-8781457cd785'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.777994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a37cb9cbab4270b05a8c1cefd24d35', 'request_id': 'req-994c3b2f-e70b-4675-b1ac-8781457cd785'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.784062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a37cb9cbab4270b05a8c1cefd24d35', 'request_id': 'req-994c3b2f-e70b-4675-b1ac-8781457cd785'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.807886 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] The token cache is being invalidate because project b9a37cb9cbab4270b05a8c1cefd24d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:26:48.808170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.808778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-994c3b2f-e70b-4675-b1ac-8781457cd785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:26:48.810252 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4502/8976] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:26:48 2022] DELETE /identity/v3/projects/b9a37cb9cbab4270b05a8c1cefd24d35 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:26:48.815978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18638450-7e7e-4443-ba5f-f34741132715 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:48.816264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18638450-7e7e-4443-ba5f-f34741132715 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:48.816539 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18638450-7e7e-4443-ba5f-f34741132715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:48.863837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-18638450-7e7e-4443-ba5f-f34741132715 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:26:48.865086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-18638450-7e7e-4443-ba5f-f34741132715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:48.922693 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4475/8977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:26:48.930489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7044ac1-6594-4513-866d-09e766b3fefa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:48.930773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7044ac1-6594-4513-866d-09e766b3fefa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:48.931065 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7044ac1-6594-4513-866d-09e766b3fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:48.950482 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f7044ac1-6594-4513-866d-09e766b3fefa None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:26:48.952266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f7044ac1-6594-4513-866d-09e766b3fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:48.960569 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4503/8978] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:26:48.964655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18638450-7e7e-4443-ba5f-f34741132715 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:48.975196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18638450-7e7e-4443-ba5f-f34741132715 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:48.979842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:48.980440 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:48.980723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:48.980997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:48.981673 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:26:48.982007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:48.983837 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:48.995307 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4476/8979] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:26:48.999952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7044ac1-6594-4513-866d-09e766b3fefa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:49.009353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7044ac1-6594-4513-866d-09e766b3fefa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:49.014507 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:49.015091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:49.015371 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:49.015634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:49.016258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:49.018174 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:49.055323 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4504/8980] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:26:48 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 02:26:49.059715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:49.070571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d70-d9ef-4d79-8dc2-9692cad8703b admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:49.075190 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:26:49.130246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:49.130842 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:49.131121 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:49.131392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:49.132015 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:49.133951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:49.156212 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4477/8981] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:26:49 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:26:49.160298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:49.170722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ded0-e252-4a1a-983a-a69ef64dddf8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:49.175408 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:49.176006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:49.176286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:49.176560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:49.177285 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:49.178896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:49.188878 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4505/8982] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:26:49.193202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:49.204009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bebec-4b9a-44ae-89b0-38f662b3438a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:49.208670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d9d1-34df-4381-97f1-c480c3d4d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:49.209300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d9d1-34df-4381-97f1-c480c3d4d592 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:49.209580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d9d1-34df-4381-97f1-c480c3d4d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:49.209860 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d9d1-34df-4381-97f1-c480c3d4d592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:49.210522 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d9d1-34df-4381-97f1-c480c3d4d592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:49.212096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d9d1-34df-4381-97f1-c480c3d4d592 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:49.223553 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4478/8983] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:26:49.227972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:49.238731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c045-92fa-4de7-8e0c-749afe23259f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:49.243760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:49.244498 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:49.244832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:49.245191 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] PATH_INFO: `/v3/projects/6da96cb0fe6649cba2473ad604b16386/users/abc49aee341041018466dec1b7cb5dab/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:49.260805 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da96cb0fe6649cba2473ad604b16386, user_id=abc49aee341041018466dec1b7cb5dab, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:49.264689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:49.266894 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:26:49.279112 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4506/8984] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:26:49 2022] PUT /identity/v3/projects/6da96cb0fe6649cba2473ad604b16386/users/abc49aee341041018466dec1b7cb5dab/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:26:49.284411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e844-b423-4e24-8987-0bf068c00359 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:49.284704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e844-b423-4e24-8987-0bf068c00359 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:49.284995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39e844-b423-4e24-8987-0bf068c00359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:49.303728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-6c39e844-b423-4e24-8987-0bf068c00359 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:26:49.304928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6c39e844-b423-4e24-8987-0bf068c00359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:49.366648 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4479/8985] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:26:49.377359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:49.379189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:49.447492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee69e4-d79a-4db2-a8aa-42f4d724e9b5 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:49.451815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330beb4a-167b-44d1-b934-981534fbbe64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:49.452416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330beb4a-167b-44d1-b934-981534fbbe64 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:49.452699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330beb4a-167b-44d1-b934-981534fbbe64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:49.452977 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330beb4a-167b-44d1-b934-981534fbbe64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:49.469349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330beb4a-167b-44d1-b934-981534fbbe64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:49.471178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330beb4a-167b-44d1-b934-981534fbbe64 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:49.481512 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4507/8986] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:26:53.314123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:53.314599 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:53.314946 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:53.349430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] MFA Rules not processed for user `abc49aee341041018466dec1b7cb5dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:26:53.350693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:53.433117 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4480/8987] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:26:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:26:53.440256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37d4e2-d348-484a-a684-bb6a8d1c7d85 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:53.440256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37d4e2-d348-484a-a684-bb6a8d1c7d85 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:53.440742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37d4e2-d348-484a-a684-bb6a8d1c7d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:53.461078 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4b37d4e2-d348-484a-a684-bb6a8d1c7d85 None None] MFA Rules not processed for user `abc49aee341041018466dec1b7cb5dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:26:53.462306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4b37d4e2-d348-484a-a684-bb6a8d1c7d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:53.469930 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4508/8988] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:26:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:26:53.481573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:53.482997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:53.507285 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:26:53.576694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f5f5c-4aa3-488d-b684-aed862181f1f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:53.583974 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:53.584712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:53.585082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:53.585459 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:53.596214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:53.597929 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:53.607820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4481/8989] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:26:53.885681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37d4e2-d348-484a-a684-bb6a8d1c7d85 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:53.896669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37d4e2-d348-484a-a684-bb6a8d1c7d85 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:53.900332 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:53.900924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:53.901238 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:53.901504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:53.903212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:53.912432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:53.913871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:53.921774 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4509/8990] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:26:57.515644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:57.517521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:57.531901 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69750c3b-fa24-4ccf-9327-f9aa6c5b39e0 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:57.536401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:57.537039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:57.537349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:57.537619 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:57.539395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:57.551788 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:57.553249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:57.562340 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4482/8991] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:26:58.217994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:26:58.232186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc221519-1dd9-401f-853e-4a5850f24830 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:26:58.238865 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459102a-6b13-41ca-a8ba-9f543211c433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:26:58.239455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459102a-6b13-41ca-a8ba-9f543211c433 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:26:58.239735 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459102a-6b13-41ca-a8ba-9f543211c433 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:26:58.240005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459102a-6b13-41ca-a8ba-9f543211c433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:26:58.241747 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d459102a-6b13-41ca-a8ba-9f543211c433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:26:58.255518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459102a-6b13-41ca-a8ba-9f543211c433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:26:58.257207 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459102a-6b13-41ca-a8ba-9f543211c433 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:26:58.269762 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4510/8992] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:26:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:05.784093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:05.798706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363d0f2-3cd9-4ff2-afd7-694f5eed4a18 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:05.804578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:05.805250 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:05.805537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:05.805816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:05.807742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:05.823811 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:05.825435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:05.852909 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4483/8993] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:08.263722 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:INSERT=1,keystone:SELECT=48 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:08.308009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72e72-5469-4f56-b4ad-95b839601388 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:08.308299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72e72-5469-4f56-b4ad-95b839601388 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:08.308571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72e72-5469-4f56-b4ad-95b839601388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:08.329035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-efc72e72-5469-4f56-b4ad-95b839601388 None None] MFA Rules not processed for user `abc49aee341041018466dec1b7cb5dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:08.330289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-efc72e72-5469-4f56-b4ad-95b839601388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:08.337042 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4511/8994] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:08.914047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:08.915512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:08.994319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92946a3e-e342-46da-b294-cfa95e9ecb3f service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:09.000442 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:09.001090 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:09.001360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:09.001629 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:09.003358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:09.015313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:09.016922 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:09.027183 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4484/8995] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:18.323618 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:19.022827 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=75 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:31.268737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc72e72-5469-4f56-b4ad-95b839601388 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:31.282732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc72e72-5469-4f56-b4ad-95b839601388 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:31.289180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:31.289883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:31.290240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:31.290609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:31.292905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:31.306327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:31.308209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:31.322710 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4512/8996] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:31.330538 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:31.341283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dafed-a6dd-4be8-9b27-7ba43a001152 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:31.347061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:31.347616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:31.347963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:31.348422 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] PATH_INFO: `/v3/users/abc49aee341041018466dec1b7cb5dab` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:31.350400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc49aee341041018466dec1b7cb5dab)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:31.353302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:31.408994 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc49aee341041018466dec1b7cb5dab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.409670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc49aee341041018466dec1b7cb5dab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.410262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc49aee341041018466dec1b7cb5dab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.417412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc49aee341041018466dec1b7cb5dab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.429306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-942b641c-720f-41ca-941c-94def9a0be8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc49aee341041018466dec1b7cb5dab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.443172 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4485/8997] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:27:31 2022] DELETE /identity/v3/users/abc49aee341041018466dec1b7cb5dab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:31.618727 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:31.630269 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c0368-2235-4c95-9912-111fdf9ee062 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:31.688179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:31.688815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:31.689123 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:31.689396 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] PATH_INFO: `/v3/projects/6da96cb0fe6649cba2473ad604b16386` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:31.690781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da96cb0fe6649cba2473ad604b16386)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:31.692669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:31.740151 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da96cb0fe6649cba2473ad604b16386', 'request_id': 'req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.745685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da96cb0fe6649cba2473ad604b16386', 'request_id': 'req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.752570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da96cb0fe6649cba2473ad604b16386', 'request_id': 'req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.766209 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] The token cache is being invalidate because project 6da96cb0fe6649cba2473ad604b16386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:27:31.766491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.767104 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-b0a0eb7b-9f3d-47b0-913e-d389d2ca1a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:31.768653 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4513/8998] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:27:31 2022] DELETE /identity/v3/projects/6da96cb0fe6649cba2473ad604b16386 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:31.774111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a16d6-9136-4249-8bce-f5bf0b461bef None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:31.774394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a16d6-9136-4249-8bce-f5bf0b461bef None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:31.774664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a16d6-9136-4249-8bce-f5bf0b461bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:31.794358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-708a16d6-9136-4249-8bce-f5bf0b461bef None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:31.795485 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-708a16d6-9136-4249-8bce-f5bf0b461bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:31.852820 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4486/8999] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:31.862007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8176494-4cbb-4787-9b94-c59f6be20835 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:31.862347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8176494-4cbb-4787-9b94-c59f6be20835 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:31.862625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8176494-4cbb-4787-9b94-c59f6be20835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:31.882861 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f8176494-4cbb-4787-9b94-c59f6be20835 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:31.884048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f8176494-4cbb-4787-9b94-c59f6be20835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:31.892026 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4514/9000] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:31.896446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a16d6-9136-4249-8bce-f5bf0b461bef None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:31.906741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a16d6-9136-4249-8bce-f5bf0b461bef None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:31.911383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:31.911978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:31.912252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:31.912543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:31.913196 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:27:31.913497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:31.915065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:31.927195 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4487/9001] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:27:31.931638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8176494-4cbb-4787-9b94-c59f6be20835 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:31.950873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8176494-4cbb-4787-9b94-c59f6be20835 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:31.955716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:31.956359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:31.956589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:31.956869 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:31.957533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:31.959423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:31.987678 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4515/9002] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:27:31 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:31.991712 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:32.002423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a8b61-ad56-4084-83bc-486927a434d6 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:32.061526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:32.062048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:32.062350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:32.062767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:32.063510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:32.065717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:32.073602 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:32.091585 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4488/9003] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:27:31 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:32.092760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:32.103773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365af82-bf44-4e4f-8140-4bf61667939c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:32.108374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:32.108968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:32.109851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:32.110353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:32.110965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:32.112551 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:32.122426 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4516/9004] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:27:32.126819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:32.136848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cfb55-485d-48a7-a0b3-af0488cff9b0 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:32.142159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f462b3-9b82-4f57-bf4e-da59008cb11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:32.142753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f462b3-9b82-4f57-bf4e-da59008cb11d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:32.143035 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f462b3-9b82-4f57-bf4e-da59008cb11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:32.143311 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f462b3-9b82-4f57-bf4e-da59008cb11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:32.143947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f462b3-9b82-4f57-bf4e-da59008cb11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:32.145558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f462b3-9b82-4f57-bf4e-da59008cb11d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:32.156760 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4489/9005] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:27:32.161015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:32.171028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd776d4-cbb9-4c3c-9290-9e72f3ce67f9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:32.176653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:32.177329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:32.177606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:32.177873 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] PATH_INFO: `/v3/projects/93138c893117499e8f5da7b79d228e04/users/d3e9473acd414d52b21c2bee4f5b3ce4/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:32.192918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93138c893117499e8f5da7b79d228e04, user_id=d3e9473acd414d52b21c2bee4f5b3ce4, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:32.195571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:32.213217 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4517/9006] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:27:32 2022] PUT /identity/v3/projects/93138c893117499e8f5da7b79d228e04/users/d3e9473acd414d52b21c2bee4f5b3ce4/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:32.224589 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd91d-32ae-41c5-852b-26728eafccd5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:32.224875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd91d-32ae-41c5-852b-26728eafccd5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:32.225204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd91d-32ae-41c5-852b-26728eafccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:32.255123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-79dfd91d-32ae-41c5-852b-26728eafccd5 None None] MFA Rules not processed for user `d3e9473acd414d52b21c2bee4f5b3ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:32.256351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-79dfd91d-32ae-41c5-852b-26728eafccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:32.320980 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4490/9007] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:32.331674 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:32.333536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:32.349213 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:32.394661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf484a-da93-46e4-8bb7-542208d461b0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:32.398407 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080274b2-eede-4bff-bc79-1ca90500d1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:32.399012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080274b2-eede-4bff-bc79-1ca90500d1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:32.399295 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080274b2-eede-4bff-bc79-1ca90500d1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:32.399568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080274b2-eede-4bff-bc79-1ca90500d1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:32.408090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080274b2-eede-4bff-bc79-1ca90500d1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:32.409973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080274b2-eede-4bff-bc79-1ca90500d1f6 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:32.420406 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4518/9008] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:42.317943 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:42.415686 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=20 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:43.340535 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfd91d-32ae-41c5-852b-26728eafccd5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:43.404158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfd91d-32ae-41c5-852b-26728eafccd5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:43.409807 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:43.410469 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:43.410767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:43.411023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] PATH_INFO: `/v3/users/d3e9473acd414d52b21c2bee4f5b3ce4` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:43.412158 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e9473acd414d52b21c2bee4f5b3ce4)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:43.414097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:43.460252 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e9473acd414d52b21c2bee4f5b3ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.460909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e9473acd414d52b21c2bee4f5b3ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.461549 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e9473acd414d52b21c2bee4f5b3ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.468345 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e9473acd414d52b21c2bee4f5b3ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.485446 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e9473acd414d52b21c2bee4f5b3ce4'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.499089 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4491/9009] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:27:43 2022] DELETE /identity/v3/users/d3e9473acd414d52b21c2bee4f5b3ce4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:43.504033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:43.504534 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:43.504672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:43.524936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:43.526124 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:43.587255 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4519/9010] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:43.598002 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:43.599431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:43.656958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81c323-cc87-401b-b3f1-16a881fc0957 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:43.660670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00243-d6af-4520-8e07-99343b62ef68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:43.661298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00243-d6af-4520-8e07-99343b62ef68 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:43.661579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00243-d6af-4520-8e07-99343b62ef68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:43.661851 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00243-d6af-4520-8e07-99343b62ef68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:43.670818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00243-d6af-4520-8e07-99343b62ef68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:43.672885 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00243-d6af-4520-8e07-99343b62ef68 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:43.682387 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4492/9011] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:43.852346 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:43.853945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:43.867569 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c160-441b-4924-b25c-e5ff59d8bdd9 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:43.872641 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:43.873314 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:43.873596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:43.873871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] PATH_INFO: `/v3/projects/93138c893117499e8f5da7b79d228e04` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:43.875639 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93138c893117499e8f5da7b79d228e04)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:43.877788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:43.924464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93138c893117499e8f5da7b79d228e04', 'request_id': 'req-2409331f-db98-4b28-8271-e8b0b8b4ff4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.930022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93138c893117499e8f5da7b79d228e04', 'request_id': 'req-2409331f-db98-4b28-8271-e8b0b8b4ff4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.936215 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93138c893117499e8f5da7b79d228e04', 'request_id': 'req-2409331f-db98-4b28-8271-e8b0b8b4ff4f'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.949275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] The token cache is being invalidate because project 93138c893117499e8f5da7b79d228e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:27:43.949561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.950169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-2409331f-db98-4b28-8271-e8b0b8b4ff4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:43.951689 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4520/9012] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:27:43 2022] DELETE /identity/v3/projects/93138c893117499e8f5da7b79d228e04 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:43.957741 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91fbca-60e1-45e1-8625-eb3254cfd27f None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:43.958130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91fbca-60e1-45e1-8625-eb3254cfd27f None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:43.958498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91fbca-60e1-45e1-8625-eb3254cfd27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:43.979167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5a91fbca-60e1-45e1-8625-eb3254cfd27f None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:43.980359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5a91fbca-60e1-45e1-8625-eb3254cfd27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:43.998083 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:44.043783 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4493/9013] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:27:44.051577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd762c68-1218-4012-8bd0-04b168a81044 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.051858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd762c68-1218-4012-8bd0-04b168a81044 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.052134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd762c68-1218-4012-8bd0-04b168a81044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.072589 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fd762c68-1218-4012-8bd0-04b168a81044 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:44.073823 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fd762c68-1218-4012-8bd0-04b168a81044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:44.082011 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4521/9014] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:44.086235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91fbca-60e1-45e1-8625-eb3254cfd27f None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:44.096540 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91fbca-60e1-45e1-8625-eb3254cfd27f None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:44.101044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:44.101658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.101933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.102200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.102835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:27:44.103148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:44.104694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:44.116852 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4494/9015] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:27:44.121326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd762c68-1218-4012-8bd0-04b168a81044 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:44.130944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd762c68-1218-4012-8bd0-04b168a81044 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:44.135603 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:44.136197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.136475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.136744 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.137415 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:44.139291 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:44.166573 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4522/9016] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:27:44 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:44.170734 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:44.181490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa779a1-bec3-47c6-a382-cb4aee1347a3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:44.240439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:44.241040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.241352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.241627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.242246 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:44.244145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:44.269108 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4495/9017] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:27:44 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:44.272978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:44.284232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebe3b9-210c-44e5-a613-27b401379c75 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:44.289244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:44.289843 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.290120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.290391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.291027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:44.292606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:44.303599 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4523/9018] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:27:44.307558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:44.318012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583b164-14bc-472e-9454-9cb8edff2fa8 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:44.322711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19282437-445e-4973-b169-c38640d1ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:44.323301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19282437-445e-4973-b169-c38640d1ab49 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.323579 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19282437-445e-4973-b169-c38640d1ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.323849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19282437-445e-4973-b169-c38640d1ab49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.324480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19282437-445e-4973-b169-c38640d1ab49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:44.326088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19282437-445e-4973-b169-c38640d1ab49 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:44.337165 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4496/9019] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:27:44.341481 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:44.352140 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6bac0-d1d1-4be7-9b2b-fca6eebe7192 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:44.356808 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:44.357497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.357758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.358025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] PATH_INFO: `/v3/projects/3f2d8b6645ad478fb2a4a3d0f40e1a03/users/f9b64632ff054fab8a6464d8080c1d27/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.374338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2d8b6645ad478fb2a4a3d0f40e1a03, user_id=f9b64632ff054fab8a6464d8080c1d27, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:44.376985 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:44.392098 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4524/9020] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:27:44 2022] PUT /identity/v3/projects/3f2d8b6645ad478fb2a4a3d0f40e1a03/users/f9b64632ff054fab8a6464d8080c1d27/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:27:44.401972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803df72-ac2c-40fa-b9b9-6c9af7b0a93a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.402438 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803df72-ac2c-40fa-b9b9-6c9af7b0a93a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.402556 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803df72-ac2c-40fa-b9b9-6c9af7b0a93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.432528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-3803df72-ac2c-40fa-b9b9-6c9af7b0a93a None None] MFA Rules not processed for user `f9b64632ff054fab8a6464d8080c1d27`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:44.433906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3803df72-ac2c-40fa-b9b9-6c9af7b0a93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:44.503387 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4497/9021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:44.513223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:44.514915 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:44.537810 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:44.575025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84a61e-ec95-4e7f-a505-d3fbab702088 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:44.578772 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d488a-ec23-4d4d-b4e7-36bbb6f43552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:44.579382 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d488a-ec23-4d4d-b4e7-36bbb6f43552 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:44.579660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d488a-ec23-4d4d-b4e7-36bbb6f43552 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:44.579932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d488a-ec23-4d4d-b4e7-36bbb6f43552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:44.588240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d488a-ec23-4d4d-b4e7-36bbb6f43552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:44.589710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d488a-ec23-4d4d-b4e7-36bbb6f43552 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:44.598741 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4525/9022] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:48.862444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803df72-ac2c-40fa-b9b9-6c9af7b0a93a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:48.881393 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:48.926936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803df72-ac2c-40fa-b9b9-6c9af7b0a93a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:48.931498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:48.932125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:48.932408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:48.932683 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] PATH_INFO: `/v3/users/f9b64632ff054fab8a6464d8080c1d27` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:48.933850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b64632ff054fab8a6464d8080c1d27)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:48.935770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:48.981635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b64632ff054fab8a6464d8080c1d27'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:48.982403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b64632ff054fab8a6464d8080c1d27'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:48.983012 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b64632ff054fab8a6464d8080c1d27'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:48.990337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b64632ff054fab8a6464d8080c1d27'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:49.002397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b64632ff054fab8a6464d8080c1d27'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:49.016081 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4498/9023] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:27:48 2022] DELETE /identity/v3/users/f9b64632ff054fab8a6464d8080c1d27 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:49.020663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.021152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.021250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.040733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:49.041966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:49.101508 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4526/9024] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:49.111815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.113421 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:49.171951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fe3a3-7a35-4539-ad6d-9a0a2348888f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.175731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f7684-8cc4-4eec-8e04-63f2f967c926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.176334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f7684-8cc4-4eec-8e04-63f2f967c926 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.176620 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f7684-8cc4-4eec-8e04-63f2f967c926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.176898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f7684-8cc4-4eec-8e04-63f2f967c926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.186091 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f7684-8cc4-4eec-8e04-63f2f967c926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.188030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f7684-8cc4-4eec-8e04-63f2f967c926 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.197864 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4499/9025] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:49.367404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.368972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:49.382840 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e46b52-9fcb-4a29-8b54-70b0a9c3c0b7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.387440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.388069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.388345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.388613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] PATH_INFO: `/v3/projects/3f2d8b6645ad478fb2a4a3d0f40e1a03` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.390484 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2d8b6645ad478fb2a4a3d0f40e1a03)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.392435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.441329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2d8b6645ad478fb2a4a3d0f40e1a03', 'request_id': 'req-7c088c4a-9080-46af-9195-8fd09224bf31'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:49.446885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2d8b6645ad478fb2a4a3d0f40e1a03', 'request_id': 'req-7c088c4a-9080-46af-9195-8fd09224bf31'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:49.453145 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2d8b6645ad478fb2a4a3d0f40e1a03', 'request_id': 'req-7c088c4a-9080-46af-9195-8fd09224bf31'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:49.466591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] The token cache is being invalidate because project 3f2d8b6645ad478fb2a4a3d0f40e1a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:27:49.466923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:49.467554 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-7c088c4a-9080-46af-9195-8fd09224bf31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:27:49.470477 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4527/9026] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:27:49 2022] DELETE /identity/v3/projects/3f2d8b6645ad478fb2a4a3d0f40e1a03 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:49.475557 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51e24-323a-4c0b-bab7-66034bb2069a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.475846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51e24-323a-4c0b-bab7-66034bb2069a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.476150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51e24-323a-4c0b-bab7-66034bb2069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.496273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-88e51e24-323a-4c0b-bab7-66034bb2069a None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:49.497524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-88e51e24-323a-4c0b-bab7-66034bb2069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:49.532963 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:49.561304 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4500/9027] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:49.570774 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e102e76-565f-4c02-b243-d52a653ad9e2 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.571060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e102e76-565f-4c02-b243-d52a653ad9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.571341 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e102e76-565f-4c02-b243-d52a653ad9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.591708 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2e102e76-565f-4c02-b243-d52a653ad9e2 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:49.592918 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2e102e76-565f-4c02-b243-d52a653ad9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:49.601586 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4528/9028] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:49.605847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51e24-323a-4c0b-bab7-66034bb2069a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.615870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51e24-323a-4c0b-bab7-66034bb2069a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.620507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.621132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.621419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.621695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.622336 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:27:49.622642 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.624220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.635771 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4501/9029] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:27:49.640082 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e102e76-565f-4c02-b243-d52a653ad9e2 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.650138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e102e76-565f-4c02-b243-d52a653ad9e2 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.654769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.655356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.655630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.655902 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.657159 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.659043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.686654 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4529/9030] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:27:49 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:49.691374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.701383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b09bd-5bb5-440a-b24d-b0b5f77fe205 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.756581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.757243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.757526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.757827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.758458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.760399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.785322 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4502/9031] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:27:49 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:49.786518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.797158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e990-697a-4399-8484-528f5b17250e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.801812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.802405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.802679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.802945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.803621 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.805236 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.815366 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4530/9032] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:27:49.819543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.830065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1af6c1-b4bd-4fc8-a822-c96176030db1 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.834701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2af8e4-f1fc-42ce-8284-94e30906c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.835286 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af8e4-f1fc-42ce-8284-94e30906c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.835566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af8e4-f1fc-42ce-8284-94e30906c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.835838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af8e4-f1fc-42ce-8284-94e30906c6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.836467 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2af8e4-f1fc-42ce-8284-94e30906c6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.838086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2af8e4-f1fc-42ce-8284-94e30906c6e6 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.849305 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4503/9033] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:27:49.853180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:49.863244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8a71-4ecf-498c-a707-0867b7d5b464 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:49.867863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:49.868440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.868715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.869004 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] PATH_INFO: `/v3/projects/907fa158858642a782540a6779cf5698/users/898bf521c1fa4bbdb5be4a0d3b35577a/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.871244 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:49.886622 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907fa158858642a782540a6779cf5698, user_id=898bf521c1fa4bbdb5be4a0d3b35577a, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:49.889289 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:49.902813 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4531/9034] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:27:49 2022] PUT /identity/v3/projects/907fa158858642a782540a6779cf5698/users/898bf521c1fa4bbdb5be4a0d3b35577a/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:49.908371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ccc2-7ae7-43b8-b8c5-642e1e32523e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:49.908843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ccc2-7ae7-43b8-b8c5-642e1e32523e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:49.908959 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557ccc2-7ae7-43b8-b8c5-642e1e32523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:49.927983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c557ccc2-7ae7-43b8-b8c5-642e1e32523e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:49.929215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c557ccc2-7ae7-43b8-b8c5-642e1e32523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:49.990422 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4504/9035] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:50.000447 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:50.002157 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:50.062054 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349b154-f719-4f6c-b574-db064937cb60 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:50.066607 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:50.067205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:50.067511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:50.067784 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:50.076981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:50.079135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:50.088749 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4532/9036] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:53.865333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a2c2c-cbc9-42e8-ab7e-6c75ba211922 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:53.865813 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a2c2c-cbc9-42e8-ab7e-6c75ba211922 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:53.866021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a2c2c-cbc9-42e8-ab7e-6c75ba211922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:53.908075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f41a2c2c-cbc9-42e8-ab7e-6c75ba211922 None None] MFA Rules not processed for user `898bf521c1fa4bbdb5be4a0d3b35577a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:53.909457 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f41a2c2c-cbc9-42e8-ab7e-6c75ba211922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:53.944648 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:53.977205 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4505/9037] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:53.981780 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:53.992120 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2aa5b-07e6-4dee-b079-ba2844d329ea service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:53.997035 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:53.997777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:53.998062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:53.998338 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:53.999180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:54.001345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:54.033839 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4533/9038] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:27:53 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:54.034983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a2c2c-cbc9-42e8-ab7e-6c75ba211922 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:54.046364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a2c2c-cbc9-42e8-ab7e-6c75ba211922 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:54.105497 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:54.106144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:54.106546 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:54.106824 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:54.107490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:54.109576 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:54.131942 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4506/9039] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:27:54 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:27:54.135972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:54.146878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989e34-5ab4-4398-a9bf-4f6ad0d1d1db admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:54.151756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:54.152375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:54.152655 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:54.152927 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:54.153613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:54.155205 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:54.171590 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4534/9040] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:27:54.176340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:54.187093 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e5eb4-15c5-483e-8d0f-f67eea113533 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:54.192320 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:54.193099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:54.193517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:54.193884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] PATH_INFO: `/v3/projects/ca9a56579cb94193980a52af643b29ae/users/29ebe7fc3a5a43bd82c2d0f9550944cb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:54.210910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a56579cb94193980a52af643b29ae, user_id=29ebe7fc3a5a43bd82c2d0f9550944cb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:54.213774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:54.228027 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4507/9041] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:27:54 2022] PUT /identity/v3/projects/ca9a56579cb94193980a52af643b29ae/users/29ebe7fc3a5a43bd82c2d0f9550944cb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:54.232223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:54.243742 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fc944-9aa9-4a9a-a8d6-a3338acdef5e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:54.304827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12c27f-9b81-42e2-a3cf-652cec2435ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:54.305479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c27f-9b81-42e2-a3cf-652cec2435ed admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:54.305759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c27f-9b81-42e2-a3cf-652cec2435ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:54.306031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c27f-9b81-42e2-a3cf-652cec2435ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:54.306666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12c27f-9b81-42e2-a3cf-652cec2435ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:54.308257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12c27f-9b81-42e2-a3cf-652cec2435ed admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:54.319798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4535/9042] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:27:54.334574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:54.356376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc341-853a-4fca-b7e7-eb53d4e36a72 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:54.361713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:54.362376 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:54.362657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:54.362930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] PATH_INFO: `/v3/projects/ca9a56579cb94193980a52af643b29ae/users/29ebe7fc3a5a43bd82c2d0f9550944cb/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:54.364956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a56579cb94193980a52af643b29ae, user_id=29ebe7fc3a5a43bd82c2d0f9550944cb, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:54.367670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:54.381110 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4508/9043] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:27:54 2022] PUT /identity/v3/projects/ca9a56579cb94193980a52af643b29ae/users/29ebe7fc3a5a43bd82c2d0f9550944cb/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:27:59.220369 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ab29-035a-43d6-9243-bb50c98d886d None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:59.222928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ab29-035a-43d6-9243-bb50c98d886d None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:59.225545 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ab29-035a-43d6-9243-bb50c98d886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:59.260374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-8805ab29-035a-43d6-9243-bb50c98d886d None None] MFA Rules not processed for user `29ebe7fc3a5a43bd82c2d0f9550944cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:59.261723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8805ab29-035a-43d6-9243-bb50c98d886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:59.311335 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:59.355522 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4536/9044] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:59.371233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:59.373626 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:59.475697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45dc5-b160-4bcc-801c-50942966edd3 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:27:59.482641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:27:59.484489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:59.484826 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:59.485201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:59.517163 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:27:59.556297 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:27:59.557927 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:27:59.568653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4509/9045] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:27:59.642961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6401-623f-466d-86ca-58437d535538 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:27:59.643334 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6401-623f-466d-86ca-58437d535538 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:27:59.643710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6401-623f-466d-86ca-58437d535538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:27:59.664816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-62be6401-623f-466d-86ca-58437d535538 None None] MFA Rules not processed for user `898bf521c1fa4bbdb5be4a0d3b35577a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:27:59.666114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-62be6401-623f-466d-86ca-58437d535538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:27:59.676975 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4537/9046] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:27:59.945319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:27:59.946715 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:28:00.002991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901bb5-78fa-47f5-a3ad-614417de9eb9 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:28:00.006881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7750998-5cfe-4b50-a636-60f618a5f064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:28:00.007484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7750998-5cfe-4b50-a636-60f618a5f064 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:28:00.007767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7750998-5cfe-4b50-a636-60f618a5f064 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:28:00.008048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7750998-5cfe-4b50-a636-60f618a5f064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:28:00.009773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7750998-5cfe-4b50-a636-60f618a5f064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:28:00.019778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7750998-5cfe-4b50-a636-60f618a5f064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:28:00.021251 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7750998-5cfe-4b50-a636-60f618a5f064 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:28:00.029310 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4510/9047] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:27:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:28:09.658921 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=15 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:28:10.025754 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=42 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:28:12.357536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be6401-623f-466d-86ca-58437d535538 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:28:12.359024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-62be6401-623f-466d-86ca-58437d535538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:28:12.416871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be6401-623f-466d-86ca-58437d535538 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:28:12.420853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0492b5b414354bce909e395d44d215c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:28:12.422027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:28:12.422359 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:28:12.422625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:28:12.433260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:28:12.434693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:28:12.445701 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4538/9048] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:28:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:28:22.440936 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=26 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:28:37.731838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6018-376c-4742-9bb3-5a0827b0b353 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:28:37.732385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6018-376c-4742-9bb3-5a0827b0b353 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:28:37.732385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6018-376c-4742-9bb3-5a0827b0b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:28:37.752122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-648b6018-376c-4742-9bb3-5a0827b0b353 None None] MFA Rules not processed for user `898bf521c1fa4bbdb5be4a0d3b35577a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:28:37.753353 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-648b6018-376c-4742-9bb3-5a0827b0b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:28:37.760264 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4511/9049] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:28:47.746576 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:29:12.084656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:12.086152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:12.180896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708d7f9-9349-4652-a328-c0ea58bcf124 service cinder] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:12.186294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:12.186914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:12.187386 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:12.187928 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:12.189773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:12.202651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:12.204245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:12.215072 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4539/9050] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:29:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:29:15.842381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ebe54-53c2-4028-9728-4753111fb1e4 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:15.842897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ebe54-53c2-4028-9728-4753111fb1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:15.843048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ebe54-53c2-4028-9728-4753111fb1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:15.863123 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c04ebe54-53c2-4028-9728-4753111fb1e4 None None] MFA Rules not processed for user `898bf521c1fa4bbdb5be4a0d3b35577a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:29:15.864317 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c04ebe54-53c2-4028-9728-4753111fb1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:15.871281 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4512/9051] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:29:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:29:16.438342 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:16.451162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663c15-6108-43fb-aa62-db81b1da784e service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:16.457425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:16.458033 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:16.458320 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:16.458593 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:16.460524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:16.474204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:16.475781 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:16.488498 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4540/9052] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:29:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:29:18.003573 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ebe54-53c2-4028-9728-4753111fb1e4 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:18.016150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ebe54-53c2-4028-9728-4753111fb1e4 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:18.022037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:18.022736 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:18.023018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:18.023291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:18.025100 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:18.037352 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:18.038925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:18.049003 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4513/9053] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:29:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:29:26.481792 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=38 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:29:28.044751 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:29:58.592901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:58.672331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8b88d-5f46-44bf-8f73-bdac6b4b15b5 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:58.677829 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:58.678423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:58.678679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:58.678947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] PATH_INFO: `/v3/users/898bf521c1fa4bbdb5be4a0d3b35577a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:58.680258 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898bf521c1fa4bbdb5be4a0d3b35577a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:58.682161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:58.734748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898bf521c1fa4bbdb5be4a0d3b35577a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:58.735389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898bf521c1fa4bbdb5be4a0d3b35577a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:58.735992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898bf521c1fa4bbdb5be4a0d3b35577a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:58.748519 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898bf521c1fa4bbdb5be4a0d3b35577a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:58.756050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898bf521c1fa4bbdb5be4a0d3b35577a'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:58.768454 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4541/9054] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:29:58 2022] DELETE /identity/v3/users/898bf521c1fa4bbdb5be4a0d3b35577a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:29:58.945480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:58.957335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94292d7c-232d-4fc5-ba71-06a68084cddf service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.013201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.013835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.014113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.014387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] PATH_INFO: `/v3/projects/907fa158858642a782540a6779cf5698` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.015525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907fa158858642a782540a6779cf5698)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.018013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.069444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907fa158858642a782540a6779cf5698', 'request_id': 'req-8d3d181f-2455-471c-81e3-872dc06d3c40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.075571 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907fa158858642a782540a6779cf5698', 'request_id': 'req-8d3d181f-2455-471c-81e3-872dc06d3c40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.083726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907fa158858642a782540a6779cf5698', 'request_id': 'req-8d3d181f-2455-471c-81e3-872dc06d3c40'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.094014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] The token cache is being invalidate because project 907fa158858642a782540a6779cf5698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:29:59.094298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.094919 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.096572 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4514/9055] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:29:58 2022] DELETE /identity/v3/projects/907fa158858642a782540a6779cf5698 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:29:59.100779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.102206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:59.115177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77e1ab-f3bf-4b41-82d2-d9b61d4bdb00 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.171854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97554-2484-4051-800e-027f8436074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.172479 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97554-2484-4051-800e-027f8436074e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.172752 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97554-2484-4051-800e-027f8436074e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.173019 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97554-2484-4051-800e-027f8436074e admin admin] PATH_INFO: `/v3/users/29ebe7fc3a5a43bd82c2d0f9550944cb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.174227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97554-2484-4051-800e-027f8436074e admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ebe7fc3a5a43bd82c2d0f9550944cb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.176116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97554-2484-4051-800e-027f8436074e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.198209 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:29:59.222907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-85b97554-2484-4051-800e-027f8436074e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ebe7fc3a5a43bd82c2d0f9550944cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.223579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-85b97554-2484-4051-800e-027f8436074e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ebe7fc3a5a43bd82c2d0f9550944cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.224194 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-85b97554-2484-4051-800e-027f8436074e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ebe7fc3a5a43bd82c2d0f9550944cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.236533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-85b97554-2484-4051-800e-027f8436074e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ebe7fc3a5a43bd82c2d0f9550944cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.243672 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-85b97554-2484-4051-800e-027f8436074e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ebe7fc3a5a43bd82c2d0f9550944cb'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.255866 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4542/9056] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:29:59 2022] DELETE /identity/v3/users/29ebe7fc3a5a43bd82c2d0f9550944cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:29:59.432449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.434023 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:59.448305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d181f-2455-471c-81e3-872dc06d3c40 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.510458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.511098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.511383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.511662 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] PATH_INFO: `/v3/projects/ca9a56579cb94193980a52af643b29ae` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.512815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9a56579cb94193980a52af643b29ae)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.514787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.550768 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:29:59.565042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9a56579cb94193980a52af643b29ae', 'request_id': 'req-ab12525d-df12-4912-865c-fcfdf63d5222'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.571598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9a56579cb94193980a52af643b29ae', 'request_id': 'req-ab12525d-df12-4912-865c-fcfdf63d5222'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.579206 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9a56579cb94193980a52af643b29ae', 'request_id': 'req-ab12525d-df12-4912-865c-fcfdf63d5222'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.589984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] The token cache is being invalidate because project ca9a56579cb94193980a52af643b29ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:29:59.590269 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.590888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-ab12525d-df12-4912-865c-fcfdf63d5222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:29:59.592400 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4515/9057] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:29:59 2022] DELETE /identity/v3/projects/ca9a56579cb94193980a52af643b29ae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:29:59.598134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601c078-4d11-4c1a-bd1a-35015ea26425 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.598638 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601c078-4d11-4c1a-bd1a-35015ea26425 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.598738 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601c078-4d11-4c1a-bd1a-35015ea26425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.620047 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d601c078-4d11-4c1a-bd1a-35015ea26425 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:29:59.621212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d601c078-4d11-4c1a-bd1a-35015ea26425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:59.680639 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4543/9058] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:29:59.688682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fb97-e88c-4bb3-adfe-51211d550494 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.688989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fb97-e88c-4bb3-adfe-51211d550494 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.689292 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fb97-e88c-4bb3-adfe-51211d550494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.709638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-5f57fb97-e88c-4bb3-adfe-51211d550494 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:29:59.710932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5f57fb97-e88c-4bb3-adfe-51211d550494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:29:59.718888 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4516/9059] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:29:59.723617 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601c078-4d11-4c1a-bd1a-35015ea26425 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.733591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601c078-4d11-4c1a-bd1a-35015ea26425 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.738864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.739464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.739750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.740024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.740661 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:29:59.740965 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.742625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.754061 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4544/9060] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:29:59.758439 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57fb97-e88c-4bb3-adfe-51211d550494 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.769666 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57fb97-e88c-4bb3-adfe-51211d550494 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.774289 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.774884 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.775162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.775433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.776071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.777999 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.807388 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4517/9061] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:29:59 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:29:59.811514 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.822609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10560516-5855-4514-abde-f1f6fa134a91 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.880993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.881570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.881874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.882148 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.882771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.884673 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.908521 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4545/9062] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:29:59 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:29:59.909249 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.919686 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e518a-e3b8-4536-bf5b-808d2eb1ef96 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.925025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.925648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.925930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.926205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.926845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.928426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.938500 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4518/9063] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:29:59.943251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.953255 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756aeb-f336-4484-adea-e9797f031fd9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.958584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbe1d6-8889-4f00-9bc2-294f79d47ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.959164 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbe1d6-8889-4f00-9bc2-294f79d47ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.959440 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbe1d6-8889-4f00-9bc2-294f79d47ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.959707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbe1d6-8889-4f00-9bc2-294f79d47ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:29:59.960329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbe1d6-8889-4f00-9bc2-294f79d47ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:29:59.961936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbe1d6-8889-4f00-9bc2-294f79d47ac2 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:29:59.972777 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4546/9064] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:29:59.976918 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:29:59.987721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c402-ceb9-4de9-8476-02ed45749d8a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:29:59.992319 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:29:59.992957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:29:59.993283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:29:59.993550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] PATH_INFO: `/v3/projects/e59a3bf65543416faaa4dbdf444e2704/users/2871e8974ca14105b540a8f65d9b26cf/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:00.008354 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59a3bf65543416faaa4dbdf444e2704, user_id=2871e8974ca14105b540a8f65d9b26cf, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:00.011001 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:00.023549 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4519/9065] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:29:59 2022] PUT /identity/v3/projects/e59a3bf65543416faaa4dbdf444e2704/users/2871e8974ca14105b540a8f65d9b26cf/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:30:00.028577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eff4-3be1-4d5f-be4a-c23c7ebb3226 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:00.028863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eff4-3be1-4d5f-be4a-c23c7ebb3226 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:00.029163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eff4-3be1-4d5f-be4a-c23c7ebb3226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:00.037525 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:30:00.050226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-0dc1eff4-3be1-4d5f-be4a-c23c7ebb3226 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:30:00.051454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-0dc1eff4-3be1-4d5f-be4a-c23c7ebb3226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:00.109395 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4547/9066] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:30:00.120021 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:00.121722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:00.178544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc9045-d1a7-4ffe-8a14-a1f63e08a7ec admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:00.182082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:00.182678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:00.182952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:00.183219 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:00.192709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:00.194435 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:00.203711 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4520/9067] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:30:04.269126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05fa8d-5752-4f47-b0ab-b7506009f5fc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:04.269633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05fa8d-5752-4f47-b0ab-b7506009f5fc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:04.269633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05fa8d-5752-4f47-b0ab-b7506009f5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:04.299987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6d05fa8d-5752-4f47-b0ab-b7506009f5fc None None] MFA Rules not processed for user `2871e8974ca14105b540a8f65d9b26cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:30:04.301620 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6d05fa8d-5752-4f47-b0ab-b7506009f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:04.370130 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4548/9068] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:30:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:30:04.374648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:04.385340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc57a4-bdb7-4050-b367-0167bc0d9014 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:04.389962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:04.390624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:04.390985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:04.391259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:04.391892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:04.393888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:04.423004 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4521/9069] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:30:04 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 02:30:04.427522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05fa8d-5752-4f47-b0ab-b7506009f5fc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:04.439271 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05fa8d-5752-4f47-b0ab-b7506009f5fc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:04.506422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:04.508351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:04.508351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:04.508855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:04.509645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:04.511695 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:04.547388 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4549/9070] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:30:04 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:30:04.551928 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:04.563931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacffcb-ca34-49ab-9bae-aafc5b080f25 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:04.570133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:04.570761 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:04.571030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:04.571301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:04.571989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:04.573639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:04.589320 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4522/9071] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:30:04.593660 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:04.605162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47cdc3-d172-42a1-88ab-d48f98d0eac8 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:04.612521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:04.613378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:04.613494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:04.613777 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] PATH_INFO: `/v3/projects/a9dbd0a2c639467d9e2effdc4b115abf/users/4d61f9226d8b4d63af9d7530e2ac56c3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:04.631666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9dbd0a2c639467d9e2effdc4b115abf, user_id=4d61f9226d8b4d63af9d7530e2ac56c3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:04.634356 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:04.644971 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:30:04.652982 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4550/9072] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:30:04 2022] PUT /identity/v3/projects/a9dbd0a2c639467d9e2effdc4b115abf/users/4d61f9226d8b4d63af9d7530e2ac56c3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:30:04.657214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:04.668793 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94075711-dd15-4852-9cb7-b3ecf5c72b62 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:04.698865 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:30:04.753261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db354a17-0056-40d8-911c-94a69901e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:04.753261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354a17-0056-40d8-911c-94a69901e2af admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:04.753261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354a17-0056-40d8-911c-94a69901e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:04.753261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db354a17-0056-40d8-911c-94a69901e2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:04.753859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db354a17-0056-40d8-911c-94a69901e2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:04.753859 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db354a17-0056-40d8-911c-94a69901e2af admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:04.775066 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4523/9073] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:30:04.779276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:04.790575 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eaaa3-99b2-4688-845c-ea9cd73fd46e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:04.795307 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11e7d-506d-4e75-b290-17d1c5648258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:04.795951 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11e7d-506d-4e75-b290-17d1c5648258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:04.796223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11e7d-506d-4e75-b290-17d1c5648258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:04.796490 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11e7d-506d-4e75-b290-17d1c5648258 admin admin] PATH_INFO: `/v3/projects/a9dbd0a2c639467d9e2effdc4b115abf/users/4d61f9226d8b4d63af9d7530e2ac56c3/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:04.798424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11e7d-506d-4e75-b290-17d1c5648258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9dbd0a2c639467d9e2effdc4b115abf, user_id=4d61f9226d8b4d63af9d7530e2ac56c3, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:04.801176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11e7d-506d-4e75-b290-17d1c5648258 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:04.812094 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4551/9074] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:30:04 2022] PUT /identity/v3/projects/a9dbd0a2c639467d9e2effdc4b115abf/users/4d61f9226d8b4d63af9d7530e2ac56c3/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:30:09.286711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59d2a-25a4-4130-a02c-3cf5759857ec None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:09.287841 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59d2a-25a4-4130-a02c-3cf5759857ec None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:09.288126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59d2a-25a4-4130-a02c-3cf5759857ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:09.322732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8ce59d2a-25a4-4130-a02c-3cf5759857ec None None] MFA Rules not processed for user `4d61f9226d8b4d63af9d7530e2ac56c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:30:09.325367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8ce59d2a-25a4-4130-a02c-3cf5759857ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:09.412026 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4524/9075] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:30:09.451472 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a2f5-9e48-4497-a105-cbd10a7abf0b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:09.452425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a2f5-9e48-4497-a105-cbd10a7abf0b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:09.452987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a2f5-9e48-4497-a105-cbd10a7abf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:09.550789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2fb5a2f5-9e48-4497-a105-cbd10a7abf0b None None] MFA Rules not processed for user `d7306de1f2fb4ebfb4177d9acfb25fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:30:09.552340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2fb5a2f5-9e48-4497-a105-cbd10a7abf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:09.625493 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4552/9076] 10.222.0.16 () {58 vars in 1063 bytes} [Sun Sep 11 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:30:09.632524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59d2a-25a4-4130-a02c-3cf5759857ec None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:09.642126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59d2a-25a4-4130-a02c-3cf5759857ec None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:09.647167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:09.647941 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:09.648294 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:09.648680 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:09.740980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:09.745104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:09.760593 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4525/9077] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:30:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:30:09.914513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41e21f-4efb-4f20-99e6-209fe3d3858a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:09.914868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41e21f-4efb-4f20-99e6-209fe3d3858a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:09.915206 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41e21f-4efb-4f20-99e6-209fe3d3858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:09.971050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff41e21f-4efb-4f20-99e6-209fe3d3858a None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:30:09.972522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff41e21f-4efb-4f20-99e6-209fe3d3858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:10.046967 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4553/9078] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:30:10.095060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:10.097693 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:10.154301 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=100 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:30:10.192203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b25d06-298c-4182-acc3-1eb22ddd542a service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:10.197528 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f6c5-fa7e-4a5b-9bff-cceb9bd5f62f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:10.198124 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f6c5-fa7e-4a5b-9bff-cceb9bd5f62f service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:10.198397 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f6c5-fa7e-4a5b-9bff-cceb9bd5f62f service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:10.198667 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f6c5-fa7e-4a5b-9bff-cceb9bd5f62f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:10.207209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f6c5-fa7e-4a5b-9bff-cceb9bd5f62f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:10.208773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f6c5-fa7e-4a5b-9bff-cceb9bd5f62f service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:10.216932 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4526/9079] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:30:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 02:30:19.216689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e0a15-fa3a-4521-bd3b-b381be798dbd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:19.217270 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e0a15-fa3a-4521-bd3b-b381be798dbd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:19.217397 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e0a15-fa3a-4521-bd3b-b381be798dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:19.237163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ef7e0a15-fa3a-4521-bd3b-b381be798dbd None None] MFA Rules not processed for user `2871e8974ca14105b540a8f65d9b26cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:30:19.238362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ef7e0a15-fa3a-4521-bd3b-b381be798dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:19.245170 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4554/9080] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:30:20.213691 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=20 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:30:21.103016 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27022cd6-1fec-4019-a19b-9b0ba32c62bb None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:21.103361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27022cd6-1fec-4019-a19b-9b0ba32c62bb None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:21.103660 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27022cd6-1fec-4019-a19b-9b0ba32c62bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:21.125150 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-27022cd6-1fec-4019-a19b-9b0ba32c62bb None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:30:21.126387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-27022cd6-1fec-4019-a19b-9b0ba32c62bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:21.135098 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4527/9081] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:30:21.148625 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e0a15-fa3a-4521-bd3b-b381be798dbd None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:21.160737 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e0a15-fa3a-4521-bd3b-b381be798dbd None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:21.165818 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:21.166455 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:21.166749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:21.167100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:21.176072 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:21.177936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:21.187104 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4555/9082] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:30:22.059663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27022cd6-1fec-4019-a19b-9b0ba32c62bb None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:22.138868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27022cd6-1fec-4019-a19b-9b0ba32c62bb None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:22.142724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:22.144180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:22.144468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:22.144765 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:22.146858 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:22.245886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:22.247323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:22.272149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4528/9083] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:30:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:30:23.467280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:23.477679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc2389-932a-456f-91d3-76d81be36a5c service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:23.481391 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:23.482028 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:23.482310 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:23.482581 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:23.484301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:23.498613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:23.500060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:23.516182 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4556/9084] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:30:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:30:32.268354 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=65 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:30:33.506994 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:30:58.051029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:30:58.053025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:30:58.063617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467d2d-fb43-4db6-8342-70fa93877ca5 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:30:58.067301 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:30:58.068544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:30:58.069099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:30:58.069386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:30:58.078223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:30:58.079703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:30:58.089312 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4529/9085] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:30:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:31:08.085297 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:32:11.955801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:32:11.964497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e57284-c933-4bc3-b6ba-eb83c359a340 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:32:11.968074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:32:11.968664 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:32:11.968938 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:32:11.969259 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:32:11.970920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:32:11.980998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:32:11.982443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:32:11.990844 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4557/9086] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:32:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:32:21.986886 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:34:19.074186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:34:19.075598 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:34:19.217863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014fa9e-84c2-40a5-83d8-3d49cdffdaf7 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:34:19.223014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:34:19.223618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:34:19.223899 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:34:19.224174 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:34:19.225916 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:34:19.237926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:34:19.239490 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:34:19.249464 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4530/9087] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:34:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:34:22.998491 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:34:23.000007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:34:23.044200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582a007-b696-4185-9ef9-757d455d26e5 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:34:23.049292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:34:23.049890 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:34:23.050165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:34:23.050434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:34:23.052105 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:34:23.063292 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:34:23.064849 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:34:23.075419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4558/9088] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:34:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:34:29.245277 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=63 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:34:33.070512 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=19 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:34:57.510985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:34:57.512763 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:34:57.533489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22ad2-8218-4ac3-9877-3a2dc9d23189 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:34:57.538524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:34:57.539144 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:34:57.539419 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:34:57.539690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:34:57.541495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:34:57.554821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:34:57.556592 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:34:57.580008 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4531/9089] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:34:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:07.563029 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:35:09.462966 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:09.473430 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d386-a698-4245-9ae2-6307779e4498 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:09.476992 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338671b0-6d61-4a5d-993f-36b13ed64926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:09.477613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338671b0-6d61-4a5d-993f-36b13ed64926 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:09.477893 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338671b0-6d61-4a5d-993f-36b13ed64926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:09.478165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338671b0-6d61-4a5d-993f-36b13ed64926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:09.487501 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338671b0-6d61-4a5d-993f-36b13ed64926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:09.488939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338671b0-6d61-4a5d-993f-36b13ed64926 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:09.499467 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4559/9090] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:09.965757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:09.967936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:09.983056 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34d24f-467a-404f-a9e5-673b0b0c7d4d service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:09.990521 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:09.991322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:09.991613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:09.991880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:09.993670 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:10.007302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:10.009085 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:10.021876 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4532/9091] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:11.202756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df121-c7cd-478e-bc42-459b6fdb176b None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:11.203254 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df121-c7cd-478e-bc42-459b6fdb176b None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:11.203358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df121-c7cd-478e-bc42-459b6fdb176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:11.222533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-a85df121-c7cd-478e-bc42-459b6fdb176b None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:35:11.223700 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a85df121-c7cd-478e-bc42-459b6fdb176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:11.231261 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4560/9092] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 02:35:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:35:11.272263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:11.283980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43523-a4b3-445d-97d5-a740bbf3ea00 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:11.288967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:11.289650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:11.289930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:11.290204 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:11.299067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:11.300616 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:11.309256 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4533/9093] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:35:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:35:11.794395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b994-0db9-4e3c-a854-b7d645f10505 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:11.794682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b994-0db9-4e3c-a854-b7d645f10505 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:11.794962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b994-0db9-4e3c-a854-b7d645f10505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:11.814830 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4219b994-0db9-4e3c-a854-b7d645f10505 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:35:11.816012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4219b994-0db9-4e3c-a854-b7d645f10505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:11.824139 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4561/9094] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:35:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:35:11.836189 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:11.847175 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef23075-e6da-4939-b348-5810f96080ec service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:11.852702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:11.853367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:11.853648 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:11.853920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:11.862834 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:11.864392 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:11.873206 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4534/9095] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:35:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 02:35:20.451785 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fec45-6a57-461d-b6a3-ef4a7521ddcb None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:20.452324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fec45-6a57-461d-b6a3-ef4a7521ddcb None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:20.452536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fec45-6a57-461d-b6a3-ef4a7521ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:20.471713 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3e3fec45-6a57-461d-b6a3-ef4a7521ddcb None None] MFA Rules not processed for user `2871e8974ca14105b540a8f65d9b26cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:35:20.472906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3e3fec45-6a57-461d-b6a3-ef4a7521ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:20.480364 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4562/9096] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:35:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:35:20.735013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:20.745714 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54a67-a4c4-4532-8ad0-4358571706aa service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:20.749706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:20.750412 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:20.750721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:20.750989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:20.752713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:20.763383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:20.764812 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:20.773053 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4535/9097] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:21.095715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fec45-6a57-461d-b6a3-ef4a7521ddcb None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:21.110042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fec45-6a57-461d-b6a3-ef4a7521ddcb None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:21.115475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059882-faed-4ef6-ac22-3b85de664fc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:21.116119 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059882-faed-4ef6-ac22-3b85de664fc1 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:21.116494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059882-faed-4ef6-ac22-3b85de664fc1 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:21.116771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059882-faed-4ef6-ac22-3b85de664fc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:21.118538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-20059882-faed-4ef6-ac22-3b85de664fc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:21.131803 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059882-faed-4ef6-ac22-3b85de664fc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:21.133970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059882-faed-4ef6-ac22-3b85de664fc1 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:21.144140 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4563/9098] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:22.228696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:22.238580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edc54c-fdb5-4c3f-9488-6aecc71ab1e3 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:22.242550 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:22.243635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:22.244707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:22.244991 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:22.257431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:22.258866 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:22.274071 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4536/9099] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:35:22.433469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca43d-6c8d-4687-91dc-e071d680ae7a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:22.434007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca43d-6c8d-4687-91dc-e071d680ae7a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:22.434007 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca43d-6c8d-4687-91dc-e071d680ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:22.455051 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c84ca43d-6c8d-4687-91dc-e071d680ae7a None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:35:22.456262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c84ca43d-6c8d-4687-91dc-e071d680ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:22.464655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4564/9100] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:35:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:35:22.478617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:22.490710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4afc05-681c-4e26-a614-b69fdb1e2c62 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:22.496767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:22.497430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:22.497729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:22.497996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:22.507109 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:22.508690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:22.522010 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4537/9101] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:35:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:35:23.469984 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca43d-6c8d-4687-91dc-e071d680ae7a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:23.482013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca43d-6c8d-4687-91dc-e071d680ae7a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:23.496127 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:23.497089 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:23.497702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:23.498005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:23.526859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:23.528286 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:23.552562 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4565/9102] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:31.700334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:31.709770 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990910d6-e18d-4564-b05c-0880991d56d4 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:31.714045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573158-adde-4a1d-9379-5f976b979f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:31.714634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573158-adde-4a1d-9379-5f976b979f40 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:31.714911 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573158-adde-4a1d-9379-5f976b979f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:31.715178 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573158-adde-4a1d-9379-5f976b979f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:31.716936 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-58573158-adde-4a1d-9379-5f976b979f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:31.726348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573158-adde-4a1d-9379-5f976b979f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:31.727696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573158-adde-4a1d-9379-5f976b979f40 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:31.735833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4538/9103] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:33.535508 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=33 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:35:39.930635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:35:39.942375 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2084a9-330a-46d1-9025-3683781a9f0e service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:35:39.948699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:35:39.949422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:35:39.949699 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:35:39.949964 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:35:39.951680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:35:39.964470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:35:39.966060 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:35:39.977468 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4566/9104] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:35:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:35:41.732219 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=42 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:35:49.972542 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:19.302241 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc5cf-c32e-4fe0-90b1-79f16c8b105a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:19.302729 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc5cf-c32e-4fe0-90b1-79f16c8b105a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:19.302850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc5cf-c32e-4fe0-90b1-79f16c8b105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:19.337915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e3bdc5cf-c32e-4fe0-90b1-79f16c8b105a None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:38:19.339125 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e3bdc5cf-c32e-4fe0-90b1-79f16c8b105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:19.346378 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4539/9105] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 02:38:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:38:19.386701 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:19.398038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afb343-9f6f-4519-9038-39904c888fb7 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:19.403038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:19.403628 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:19.403907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:19.404180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:19.412111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:19.414196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:19.422282 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4567/9106] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:38:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:38:19.791466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdc5cf-c32e-4fe0-90b1-79f16c8b105a None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:19.801122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdc5cf-c32e-4fe0-90b1-79f16c8b105a None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:19.805898 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:19.806506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:19.806781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:19.807048 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:19.879223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:19.880652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:19.901211 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4540/9107] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:38:23.102943 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:23.115561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379bae-bea5-4a70-ace2-53c7b79a4ce2 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:23.126544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:23.127463 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:23.127749 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:23.128219 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:23.130947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:23.164131 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:23.166257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:23.182592 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4568/9108] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:38:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:38:26.017364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:26.029957 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab0cf6-fd03-4eb3-b6a1-4c341d9fad3b service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:26.035166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:26.035835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:26.036185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:26.036458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:26.038996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:26.050706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:26.052273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:26.069223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4541/9109] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:38:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:38:26.101955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:26.114854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4feac7-2dd5-4970-803a-db2e3a1bccdf service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:26.120416 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:26.121192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:26.121538 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:26.121877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] PATH_INFO: `/v3/users/2871e8974ca14105b540a8f65d9b26cf` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:26.123114 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2871e8974ca14105b540a8f65d9b26cf)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:26.125250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:26.175866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2871e8974ca14105b540a8f65d9b26cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.176817 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2871e8974ca14105b540a8f65d9b26cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.177454 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2871e8974ca14105b540a8f65d9b26cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.195567 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2871e8974ca14105b540a8f65d9b26cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.202654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2871e8974ca14105b540a8f65d9b26cf'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.226963 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4569/9110] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:38:26 2022] DELETE /identity/v3/users/2871e8974ca14105b540a8f65d9b26cf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:38:26.401155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:26.413280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8063085-a369-424a-963b-4f08c38b84bc service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:26.472652 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:26.473305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:26.473581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:26.473848 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] PATH_INFO: `/v3/projects/e59a3bf65543416faaa4dbdf444e2704` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:26.474956 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59a3bf65543416faaa4dbdf444e2704)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:26.477510 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:26.523525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59a3bf65543416faaa4dbdf444e2704', 'request_id': 'req-69b4e5cd-3223-407d-b291-868d5ab35845'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.524670 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:26.531028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59a3bf65543416faaa4dbdf444e2704', 'request_id': 'req-69b4e5cd-3223-407d-b291-868d5ab35845'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.539905 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59a3bf65543416faaa4dbdf444e2704', 'request_id': 'req-69b4e5cd-3223-407d-b291-868d5ab35845'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.562783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] The token cache is being invalidate because project e59a3bf65543416faaa4dbdf444e2704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:38:26.563071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.563691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.565218 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4542/9111] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:38:26 2022] DELETE /identity/v3/projects/e59a3bf65543416faaa4dbdf444e2704 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:38:26.569387 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:26.570768 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:26.583973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d627-c282-4634-8554-b707781ab299 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:26.641523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:26.642177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:26.642452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:26.642739 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] PATH_INFO: `/v3/users/4d61f9226d8b4d63af9d7530e2ac56c3` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:26.643883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d61f9226d8b4d63af9d7530e2ac56c3)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:26.645827 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:26.696377 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d61f9226d8b4d63af9d7530e2ac56c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.697025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d61f9226d8b4d63af9d7530e2ac56c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.697681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d61f9226d8b4d63af9d7530e2ac56c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.698781 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:26.713102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d61f9226d8b4d63af9d7530e2ac56c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.719857 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-f29196d9-f9fb-4832-b78e-461ebe171c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d61f9226d8b4d63af9d7530e2ac56c3'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:26.732418 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4570/9112] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:38:26 2022] DELETE /identity/v3/users/4d61f9226d8b4d63af9d7530e2ac56c3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:38:26.911383 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:26.913491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:26.927022 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e5cd-3223-407d-b291-868d5ab35845 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:26.992185 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:26.992762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:26.993045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:26.993360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] PATH_INFO: `/v3/projects/a9dbd0a2c639467d9e2effdc4b115abf` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:26.994534 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9dbd0a2c639467d9e2effdc4b115abf)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:26.996517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.047083 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9dbd0a2c639467d9e2effdc4b115abf', 'request_id': 'req-c2728ae1-e5ea-4927-9551-941cad472841'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:27.053378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9dbd0a2c639467d9e2effdc4b115abf', 'request_id': 'req-c2728ae1-e5ea-4927-9551-941cad472841'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:27.061886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9dbd0a2c639467d9e2effdc4b115abf', 'request_id': 'req-c2728ae1-e5ea-4927-9551-941cad472841'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:27.073406 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] The token cache is being invalidate because project a9dbd0a2c639467d9e2effdc4b115abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:38:27.073781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:27.074429 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-c2728ae1-e5ea-4927-9551-941cad472841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:38:27.076167 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4543/9113] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:38:26 2022] DELETE /identity/v3/projects/a9dbd0a2c639467d9e2effdc4b115abf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:38:27.081226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87b520-bd23-4da1-84ce-a673a4ea4d7c None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.081515 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87b520-bd23-4da1-84ce-a673a4ea4d7c None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.081791 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87b520-bd23-4da1-84ce-a673a4ea4d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.141682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ee87b520-bd23-4da1-84ce-a673a4ea4d7c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:38:27.142887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ee87b520-bd23-4da1-84ce-a673a4ea4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:27.201520 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4571/9114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:38:27.209939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659960c-8c13-4b86-abcc-e53234cef555 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.210520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659960c-8c13-4b86-abcc-e53234cef555 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.210816 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659960c-8c13-4b86-abcc-e53234cef555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.231008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f659960c-8c13-4b86-abcc-e53234cef555 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:38:27.232201 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f659960c-8c13-4b86-abcc-e53234cef555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:27.240039 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4544/9115] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:38:27.244428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87b520-bd23-4da1-84ce-a673a4ea4d7c None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.254246 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87b520-bd23-4da1-84ce-a673a4ea4d7c None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.259027 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.259627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.259907 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.260179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.260816 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81859) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:38:27.261150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.262801 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.275035 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4572/9116] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 02:38:27.279061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659960c-8c13-4b86-abcc-e53234cef555 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.288979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659960c-8c13-4b86-abcc-e53234cef555 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.293847 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.294432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.294706 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.294970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.295588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.297513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.335258 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4545/9117] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:38:27 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:38:27.343570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.354030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e9174-f3a2-480a-a2c6-b2f1e4b84c67 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.410347 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.410961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.411248 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.411520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.412155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.414357 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.436192 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4573/9118] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:38:27 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:38:27.440215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.451452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c843b0-8fa4-42a5-a563-e5bd1c4ce4a5 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.456334 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.456960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.457271 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.457543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.458179 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.460264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.470285 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4546/9119] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:38:27.474080 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.485023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d43a-527c-49ee-b048-28ebfe2f9660 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.489712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526c19-6f47-41da-bb81-84a33b16240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.490299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526c19-6f47-41da-bb81-84a33b16240a admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.490577 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526c19-6f47-41da-bb81-84a33b16240a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.491920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526c19-6f47-41da-bb81-84a33b16240a admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.492556 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526c19-6f47-41da-bb81-84a33b16240a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.494176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526c19-6f47-41da-bb81-84a33b16240a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.499386 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:27.505768 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4574/9120] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:38:27.509874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.520009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b89-fec1-4d7b-820a-ede54308684d admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.525167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.525825 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.526099 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.526372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] PATH_INFO: `/v3/projects/6529b267fbaa4b7fa5cb7bfc95ef4c65/users/016d3067cc81472d8ac33d9faab9c9ab/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.530260 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:27.544757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6529b267fbaa4b7fa5cb7bfc95ef4c65, user_id=016d3067cc81472d8ac33d9faab9c9ab, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.547470 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.561149 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4547/9121] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:38:27 2022] PUT /identity/v3/projects/6529b267fbaa4b7fa5cb7bfc95ef4c65/users/016d3067cc81472d8ac33d9faab9c9ab/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:38:27.571421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263670c-73fe-4e3a-8828-71258b4d3db3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.571707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263670c-73fe-4e3a-8828-71258b4d3db3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.571981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263670c-73fe-4e3a-8828-71258b4d3db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.599939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9263670c-73fe-4e3a-8828-71258b4d3db3 None None] MFA Rules not processed for user `016d3067cc81472d8ac33d9faab9c9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:38:27.602111 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9263670c-73fe-4e3a-8828-71258b4d3db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:27.666387 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4575/9122] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:38:27.670845 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.733432 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723260-72cc-494f-af55-35994af7a445 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.738230 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.738835 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.739115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.739386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.740029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.743058 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.770294 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4548/9123] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:38:27 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:38:27.774758 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263670c-73fe-4e3a-8828-71258b4d3db3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.785469 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263670c-73fe-4e3a-8828-71258b4d3db3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.842963 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.843568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.843844 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.844115 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] PATH_INFO: `/v3/users` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.844746 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.846706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.867494 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4576/9124] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:38:27 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:38:27.871453 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.881726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85971-c218-4f8b-83bd-146001fd42fe admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.886364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.886953 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.887224 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.887491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.888156 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.889781 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.900894 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4549/9125] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:38:27.905165 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.916272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5aad9-a8a8-492d-b0b4-9b451fa26f7c admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:27.921168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:27.921839 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:27.922116 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:27.922403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] PATH_INFO: `/v3/projects/e184aaa0a9474adb913fb1abff06171a/users/1924ddbb17a24b37842fc5bda229c175/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:27.937684 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e184aaa0a9474adb913fb1abff06171a, user_id=1924ddbb17a24b37842fc5bda229c175, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:27.940557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:27.953474 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4577/9126] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:38:27 2022] PUT /identity/v3/projects/e184aaa0a9474adb913fb1abff06171a/users/1924ddbb17a24b37842fc5bda229c175/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 02:38:27.957400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:27.968449 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b24638-3753-45bb-963d-f5b02d73ea1c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:28.025492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443be759-8967-4838-a01b-7dad84275209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:28.026019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443be759-8967-4838-a01b-7dad84275209 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:28.026298 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443be759-8967-4838-a01b-7dad84275209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:28.026575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443be759-8967-4838-a01b-7dad84275209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:28.027209 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443be759-8967-4838-a01b-7dad84275209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:28.028786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443be759-8967-4838-a01b-7dad84275209 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:28.039773 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4550/9127] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:38:28.044152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:28.054570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268da9-1e99-46f1-bd20-2ac4ce069908 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:28.060016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:28.060682 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:28.060956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:28.061256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] PATH_INFO: `/v3/projects/e184aaa0a9474adb913fb1abff06171a/users/1924ddbb17a24b37842fc5bda229c175/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:28.063161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e184aaa0a9474adb913fb1abff06171a, user_id=1924ddbb17a24b37842fc5bda229c175, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:28.065812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:28.076595 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4578/9128] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:38:28 2022] PUT /identity/v3/projects/e184aaa0a9474adb913fb1abff06171a/users/1924ddbb17a24b37842fc5bda229c175/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:38:28.088750 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:28.089273 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:28.089391 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:28.117254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] MFA Rules not processed for user `1924ddbb17a24b37842fc5bda229c175`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:38:28.118458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:28.163287 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:28.188645 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4551/9129] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:38:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:38:28.203147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:28.205002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:28.257675 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:28.300637 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b964a9-a235-403c-a84a-d74cd177ffea admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:28.306245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e34253-31a6-49c9-af8b-66ed58333b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:28.306852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34253-31a6-49c9-af8b-66ed58333b40 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:28.307126 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34253-31a6-49c9-af8b-66ed58333b40 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:28.307395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34253-31a6-49c9-af8b-66ed58333b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:28.364504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e34253-31a6-49c9-af8b-66ed58333b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:28.366146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e34253-31a6-49c9-af8b-66ed58333b40 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:28.375194 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4579/9130] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:38:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:38:32.396018 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:32.397700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:32.469698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d4e3-aff6-460f-88aa-ff8186d043e3 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:32.473815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:32.474445 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:32.474717 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:32.475052 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:32.488797 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:32.491358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:32.503068 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4552/9131] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:38:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:38:35.426062 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d53b6-9ba8-4582-8da7-55e695511a1a None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:35.426595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d53b6-9ba8-4582-8da7-55e695511a1a None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:35.426595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d53b6-9ba8-4582-8da7-55e695511a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:35.450023 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-3c5d53b6-9ba8-4582-8da7-55e695511a1a None None] MFA Rules not processed for user `016d3067cc81472d8ac33d9faab9c9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:38:35.451247 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3c5d53b6-9ba8-4582-8da7-55e695511a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:35.458907 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4580/9132] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:38:37.170343 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:37.171995 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:37.259803 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28290135-b699-4a42-a98a-d78a552542da service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:37.265029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:37.265675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:37.266071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:37.266339 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:37.268030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:37.280530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:37.282055 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:37.292251 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4553/9133] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:38:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:38:39.275458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d53b6-9ba8-4582-8da7-55e695511a1a None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:38:39.285533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d53b6-9ba8-4582-8da7-55e695511a1a None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:38:39.289916 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:38:39.290529 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:38:39.290802 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:38:39.291069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:38:39.292766 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:38:39.303867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:38:39.305510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:38:39.315575 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4581/9134] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:38:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:38:47.288398 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=72 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:38:49.311347 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=51 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:39:26.081146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:39:26.092030 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070561ef-762e-444e-a3b0-33f88a8bf36b service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:39:26.097146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:39:26.097738 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:39:26.098013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:39:26.098283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:39:26.099980 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:39:26.112203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:39:26.113819 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:39:26.124380 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4554/9135] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:39:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:39:26.974475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:39:26.975924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:39:26.991450 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f2dfe-dd6a-4b6c-823e-8bd3a1c17167 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:39:26.996536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a87a71-dac2-4627-8937-1c57e8aa3be9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:39:26.997147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a87a71-dac2-4627-8937-1c57e8aa3be9 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:39:26.997422 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a87a71-dac2-4627-8937-1c57e8aa3be9 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:39:26.997691 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a87a71-dac2-4627-8937-1c57e8aa3be9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:39:26.999323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-32a87a71-dac2-4627-8937-1c57e8aa3be9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:39:27.010754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a87a71-dac2-4627-8937-1c57e8aa3be9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:39:27.012284 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a87a71-dac2-4627-8937-1c57e8aa3be9 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:39:27.021955 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4582/9136] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:39:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:39:36.119461 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:39:37.017870 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:39:59.065381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:39:59.081299 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0534-a510-4716-b933-dfeb806024ee service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:39:59.087227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:39:59.087887 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:39:59.088237 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:39:59.088949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:39:59.091582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:39:59.106154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:39:59.107735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:39:59.119311 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4555/9137] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:39:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:40:09.114807 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:40:11.393615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a514-3b8c-4b4e-bb0e-0c3437dea584 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:40:11.394213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a514-3b8c-4b4e-bb0e-0c3437dea584 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:40:11.394213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a514-3b8c-4b4e-bb0e-0c3437dea584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:40:11.415037 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-6a53a514-3b8c-4b4e-bb0e-0c3437dea584 None None] MFA Rules not processed for user `016d3067cc81472d8ac33d9faab9c9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:40:11.416707 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6a53a514-3b8c-4b4e-bb0e-0c3437dea584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:40:11.425006 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4583/9138] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:40:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:40:11.809448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:40:11.811005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:40:11.823514 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6d6f8-0109-48c0-adb3-67eda4fd5878 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:40:11.829468 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:40:11.830115 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:40:11.830425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:40:11.830700 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:40:11.832631 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:40:11.843499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:40:11.845102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:40:11.854284 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4556/9139] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:40:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:40:21.410031 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:40:21.850946 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:40:23.920883 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53a514-3b8c-4b4e-bb0e-0c3437dea584 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:40:23.940687 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53a514-3b8c-4b4e-bb0e-0c3437dea584 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:40:23.944308 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:40:23.944930 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:40:23.945257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:40:23.945530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:40:23.947213 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:40:23.961769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:40:23.963178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:40:23.984892 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4584/9140] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:40:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:40:25.176132 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:40:25.194972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebfb2-e0ab-4374-83a0-2a1ab978dfe8 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:40:25.199212 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:40:25.199843 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:40:25.200094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:40:25.200367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:40:25.202379 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:40:25.217507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:40:25.218986 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:40:25.230583 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4557/9141] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:40:33.981968 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=14 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:40:35.225459 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=10 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:41:26.743850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:41:26.753627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cb00e-1487-43e2-9f65-1b8f0963f33b service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:41:26.757324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a9393-49be-491a-984b-ba9e432d764e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:41:26.757926 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9393-49be-491a-984b-ba9e432d764e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:41:26.758208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9393-49be-491a-984b-ba9e432d764e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:41:26.758480 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9393-49be-491a-984b-ba9e432d764e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:41:26.760197 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-6f7a9393-49be-491a-984b-ba9e432d764e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:41:26.770056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9393-49be-491a-984b-ba9e432d764e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:41:26.771475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9393-49be-491a-984b-ba9e432d764e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:41:26.779447 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4585/9142] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:41:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:41:36.775935 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:42:42.466014 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:42:42.467603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:42:42.483164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0a8ce-58fe-4c3e-9286-658c703cf7a4 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:42:42.490458 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:42:42.491302 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:42:42.491820 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:42:42.492329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:42:42.494361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:42:42.508756 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:42:42.510394 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:42:42.522501 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4558/9143] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:42:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:42:52.517663 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:42:52.668976 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c867020-6e8a-4d86-a8d4-e3f5e125d259 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:42:52.669528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c867020-6e8a-4d86-a8d4-e3f5e125d259 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:42:52.669736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c867020-6e8a-4d86-a8d4-e3f5e125d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:42:52.690779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-2c867020-6e8a-4d86-a8d4-e3f5e125d259 None None] MFA Rules not processed for user `016d3067cc81472d8ac33d9faab9c9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:42:52.692212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2c867020-6e8a-4d86-a8d4-e3f5e125d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:42:52.699730 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4586/9144] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:42:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:43:02.118254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:43:02.133735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aee700-8b79-4d81-b6a9-18534facd631 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:43:02.140337 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ec514-f2e2-44c3-aae0-031fe51d310a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:43:02.141386 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ec514-f2e2-44c3-aae0-031fe51d310a service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:43:02.141838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ec514-f2e2-44c3-aae0-031fe51d310a service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:43:02.142261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ec514-f2e2-44c3-aae0-031fe51d310a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:43:02.156983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d84ec514-f2e2-44c3-aae0-031fe51d310a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:43:02.173025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ec514-f2e2-44c3-aae0-031fe51d310a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:43:02.174639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ec514-f2e2-44c3-aae0-031fe51d310a service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:43:02.185561 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4559/9145] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:43:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:43:02.684569 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:43:12.181614 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:43:39.832067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c867020-6e8a-4d86-a8d4-e3f5e125d259 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:43:39.845557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c867020-6e8a-4d86-a8d4-e3f5e125d259 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:43:39.851006 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:43:39.851609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:43:39.851889 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:43:39.852161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:43:39.859912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:43:39.861523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:43:39.870328 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4587/9146] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:43:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:43:49.866405 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:44:10.576380 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83107fc0-488a-45df-b6ec-caa1dca46f1d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:10.576978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83107fc0-488a-45df-b6ec-caa1dca46f1d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:10.577176 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83107fc0-488a-45df-b6ec-caa1dca46f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:10.618635 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-83107fc0-488a-45df-b6ec-caa1dca46f1d None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:44:10.619967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-83107fc0-488a-45df-b6ec-caa1dca46f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:44:10.626810 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4560/9147] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:44:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:44:10.639933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:44:10.649809 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc09075-4e41-4f38-b894-a96490fce765 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:44:10.653693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:44:10.654303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:10.654583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:10.654885 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:10.662733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:44:10.664150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:44:10.672746 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4588/9148] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:44:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:44:10.753426 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3da79-e45c-4296-8135-33247e8e811a None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:10.753718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3da79-e45c-4296-8135-33247e8e811a None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:10.753996 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3da79-e45c-4296-8135-33247e8e811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:10.792944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d5f3da79-e45c-4296-8135-33247e8e811a None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:44:10.794193 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d5f3da79-e45c-4296-8135-33247e8e811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:44:10.803335 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4561/9149] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:44:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:44:10.815132 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:44:10.827166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03effb9-6c33-4c88-b5a4-1fb8f47f32cd service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:44:10.833401 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:44:10.833993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:10.834275 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:10.834571 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:10.843052 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:44:10.845807 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:44:10.855601 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4589/9150] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:44:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:44:11.025364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d3d6-84a7-4ec1-809b-973713784ecc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:11.025650 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d3d6-84a7-4ec1-809b-973713784ecc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:11.025925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d3d6-84a7-4ec1-809b-973713784ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:11.063552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-f757d3d6-84a7-4ec1-809b-973713784ecc None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:44:11.064881 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-f757d3d6-84a7-4ec1-809b-973713784ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:44:11.079851 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4562/9151] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:44:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:44:11.090994 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:44:11.101118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5471fd-18bf-443e-a860-a320f9d85abb service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:44:11.104716 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:44:11.105353 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:11.105652 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:11.105924 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:11.116404 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:44:11.117835 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:44:11.129390 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4590/9152] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:44:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:44:11.193873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d3d6-84a7-4ec1-809b-973713784ecc None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:44:11.205952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d3d6-84a7-4ec1-809b-973713784ecc None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:44:11.210983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:44:11.211577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:11.211853 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:11.212122 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:11.213827 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:44:11.225167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:44:11.226724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:44:11.236413 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4563/9153] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:44:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:44:12.174991 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:44:12.183679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4f3c-6fce-4b1f-bb70-984ba7349c42 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:44:12.187362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:44:12.188725 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:12.189042 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:12.189351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:12.196459 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:44:12.197906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:44:12.206393 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4591/9154] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:44:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:44:21.232250 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=33 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:44:22.202356 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=24 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:44:31.148356 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:44:31.155190 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:44:31.212532 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616175f-0ad8-4bd1-ac98-baeb0ee326c4 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:44:31.217731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8fdcc-82ea-46d2-85a0-081453c1faf2 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:44:31.218157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:44:31.218769 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:31.219053 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:31.219325 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:31.223592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:44:31.224217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:44:31.224475 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:44:31.224745 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:44:31.228480 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:44:31.230098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:44:31.233398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:44:31.234948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:44:31.239969 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4564/9155] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:44:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:44:31.244987 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4592/9156] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:44:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:44:41.235789 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=27 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:44:41.240517 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=24 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:45:21.521200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:45:21.534329 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5673345-0189-4ee9-bacb-67740acc42dd service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:45:21.540078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:45:21.540684 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:21.540960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:21.541265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:21.550647 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:45:21.552749 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:45:21.563382 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4565/9157] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:45:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:45:25.742492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:45:25.759465 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb8a23-ddf2-48f5-8e6a-1ff231d878fc service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:45:25.769303 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156377-5ec2-4d10-88dc-53ce30929e3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:45:25.770635 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156377-5ec2-4d10-88dc-53ce30929e3f service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:25.771317 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156377-5ec2-4d10-88dc-53ce30929e3f service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:25.772005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156377-5ec2-4d10-88dc-53ce30929e3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:25.775170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-73156377-5ec2-4d10-88dc-53ce30929e3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:45:25.826688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156377-5ec2-4d10-88dc-53ce30929e3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:45:25.830241 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73156377-5ec2-4d10-88dc-53ce30929e3f service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:45:25.853326 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4593/9158] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:45:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:45:29.866748 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:45:29.876233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d1e0-055d-4a5d-91e4-4fae740ea2b9 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:45:29.880104 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:45:29.880794 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:29.881173 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:29.881448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:29.891135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:45:29.892726 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:45:29.904227 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4566/9159] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:45:32.472211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029422a-48dc-48e5-8cc7-dfe1cf08c2d7 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:32.473427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029422a-48dc-48e5-8cc7-dfe1cf08c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:32.473427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029422a-48dc-48e5-8cc7-dfe1cf08c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:32.507050 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-4029422a-48dc-48e5-8cc7-dfe1cf08c2d7 None None] MFA Rules not processed for user `016d3067cc81472d8ac33d9faab9c9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:45:32.508418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-4029422a-48dc-48e5-8cc7-dfe1cf08c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:45:32.521685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4594/9160] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:45:32.578072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:45:32.579972 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:45:32.673787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc11b23-9348-43b9-8103-35a921eaa810 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:45:32.678710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:45:32.679327 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:32.679608 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:32.679877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:32.698878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:45:32.700314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:45:32.717197 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4567/9161] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:45:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:45:33.117953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029422a-48dc-48e5-8cc7-dfe1cf08c2d7 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:45:33.132981 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029422a-48dc-48e5-8cc7-dfe1cf08c2d7 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:45:33.142510 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:45:33.143324 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:33.143706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:33.144058 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:33.153958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:45:33.155497 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:45:33.165535 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4595/9162] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:45:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:45:33.516537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:45:33.527600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9283c-d161-4e41-923d-a8d386262879 service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:45:33.532509 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:45:33.533441 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:33.533909 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:33.534180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:33.545512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:45:33.546932 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:45:33.558855 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4568/9163] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:45:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:45:34.523349 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:45:34.537613 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1d74c-e16e-4d7f-a652-7dfeab2e3605 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:45:34.542850 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:45:34.543611 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:45:34.543896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:45:34.544166 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:45:34.554633 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:45:34.556210 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:45:34.568537 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4596/9164] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:45:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:45:43.554374 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=56 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:45:44.562335 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=30 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:48:10.562707 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:48:10.576896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f88609-3a6c-4ad3-9501-ec1815b7519e service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:48:10.584059 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb6912-c723-4f41-ae90-2617ecdea08c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:48:10.584747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6912-c723-4f41-ae90-2617ecdea08c service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:48:10.585031 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6912-c723-4f41-ae90-2617ecdea08c service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:48:10.585347 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6912-c723-4f41-ae90-2617ecdea08c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:48:10.595533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb6912-c723-4f41-ae90-2617ecdea08c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:48:10.597137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb6912-c723-4f41-ae90-2617ecdea08c service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:48:10.607728 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4569/9165] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:48:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:48:14.989750 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:48:15.007616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c04d4d-438f-45c8-853c-28f1620a85a9 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:48:15.016831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:48:15.017670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:48:15.018056 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:48:15.018433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:48:15.020364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:48:15.038044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:48:15.040361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:48:15.052601 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4597/9166] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:48:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:48:20.603285 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:48:21.761089 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d50d95-35c3-466d-a6f9-f58acc1191a6 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:48:21.762145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d50d95-35c3-466d-a6f9-f58acc1191a6 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:48:21.762586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d50d95-35c3-466d-a6f9-f58acc1191a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:48:21.783790 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-34d50d95-35c3-466d-a6f9-f58acc1191a6 None None] MFA Rules not processed for user `016d3067cc81472d8ac33d9faab9c9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:48:21.785038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-34d50d95-35c3-466d-a6f9-f58acc1191a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:48:21.792966 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4570/9167] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:48:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:48:25.047974 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:48:25.915373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:48:25.925814 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3599-d978-4f47-8488-1c2bc073c3a5 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:48:25.929582 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:48:25.930224 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:48:25.930504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:48:25.930776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:48:25.939549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:48:25.941036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:48:25.950445 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4598/9168] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:48:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:48:31.777654 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:48:33.452687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d50d95-35c3-466d-a6f9-f58acc1191a6 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:48:33.542218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d50d95-35c3-466d-a6f9-f58acc1191a6 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:48:33.547762 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:48:33.548371 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:48:33.548645 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:48:33.548914 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:48:33.557787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:48:33.559348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:48:33.573180 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4571/9169] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:48:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:48:35.945899 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:48:39.819572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:48:39.821199 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:48:39.892088 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935247b0-290c-4c08-9729-3211cbaa4a4a service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:48:39.895703 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:48:39.896302 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:48:39.896579 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:48:39.896851 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:48:39.898680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:48:39.979473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:48:39.980896 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:48:40.002203 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4599/9170] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:48:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:48:43.568356 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=34 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:48:49.998371 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=66 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:49:36.020322 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:36.021939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:36.089181 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b880-d855-4b0c-9d21-633b0d91f247 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:36.094358 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:36.094952 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:36.095227 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:36.095496 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:36.097331 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:36.108778 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:36.110369 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:36.120037 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4572/9171] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:49:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:49:39.036403 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:39.038005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:39.053155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ee55-fb32-4843-a50d-248115c83716 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:39.058173 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c871dc1-5ee8-4379-99d2-6ab7830cbebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:39.058769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c871dc1-5ee8-4379-99d2-6ab7830cbebf service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:39.059049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c871dc1-5ee8-4379-99d2-6ab7830cbebf service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:39.059322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c871dc1-5ee8-4379-99d2-6ab7830cbebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:39.061358 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-2c871dc1-5ee8-4379-99d2-6ab7830cbebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:39.072993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c871dc1-5ee8-4379-99d2-6ab7830cbebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:39.075245 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c871dc1-5ee8-4379-99d2-6ab7830cbebf service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:39.085823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4600/9172] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:49:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:49:46.115993 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=32 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:49:49.080888 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:49:55.532979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:55.534594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:55.640951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9024743-1114-44eb-868b-756d22f5c277 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:55.645697 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:55.646321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:55.646595 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:55.646863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] PATH_INFO: `/v3/users/016d3067cc81472d8ac33d9faab9c9ab` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:55.647970 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=016d3067cc81472d8ac33d9faab9c9ab)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:55.649926 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:55.696277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016d3067cc81472d8ac33d9faab9c9ab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:55.696912 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016d3067cc81472d8ac33d9faab9c9ab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:55.697542 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016d3067cc81472d8ac33d9faab9c9ab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:55.705430 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016d3067cc81472d8ac33d9faab9c9ab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:55.718160 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016d3067cc81472d8ac33d9faab9c9ab'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:55.746947 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4573/9173] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:49:55 2022] DELETE /identity/v3/users/016d3067cc81472d8ac33d9faab9c9ab => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:49:55.752276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:55.753339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:55.753590 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:55.787549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:49:55.788759 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:55.849498 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4601/9174] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:49:55.859275 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:55.860681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:55.918064 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e8ea-06ce-4d7a-a4f9-e5c99096b13e admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:55.921823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:55.922425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:55.922704 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:55.923009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:55.928873 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:49:55.933931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:55.936047 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:55.947003 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4574/9175] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:49:56.118541 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:56.119974 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:56.135268 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727a87-ec62-4f3a-8fad-26fa20a3a0df None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:56.141410 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:56.142057 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:56.142362 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:56.142631 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] PATH_INFO: `/v3/projects/6529b267fbaa4b7fa5cb7bfc95ef4c65` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:56.143904 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6529b267fbaa4b7fa5cb7bfc95ef4c65)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:56.145860 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:56.193022 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6529b267fbaa4b7fa5cb7bfc95ef4c65', 'request_id': 'req-739368f0-6d64-4823-8ce8-81f8cbfd4532'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.198591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6529b267fbaa4b7fa5cb7bfc95ef4c65', 'request_id': 'req-739368f0-6d64-4823-8ce8-81f8cbfd4532'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.204692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6529b267fbaa4b7fa5cb7bfc95ef4c65', 'request_id': 'req-739368f0-6d64-4823-8ce8-81f8cbfd4532'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.217831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] The token cache is being invalidate because project 6529b267fbaa4b7fa5cb7bfc95ef4c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:49:56.218298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.219427 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.220461 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4602/9176] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:49:56 2022] DELETE /identity/v3/projects/6529b267fbaa4b7fa5cb7bfc95ef4c65 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:49:56.224466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:56.234951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8f14e-a8db-486d-bb6a-9b2555ea75d6 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:56.290656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:56.291280 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:56.291561 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:56.291829 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] PATH_INFO: `/v3/users/1924ddbb17a24b37842fc5bda229c175` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:56.306049 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1924ddbb17a24b37842fc5bda229c175)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:56.307951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:56.358582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1924ddbb17a24b37842fc5bda229c175'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.359238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1924ddbb17a24b37842fc5bda229c175'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.359906 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1924ddbb17a24b37842fc5bda229c175'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.367004 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1924ddbb17a24b37842fc5bda229c175'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.379388 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-78b0424c-ffe1-462c-9af2-a53b84689082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1924ddbb17a24b37842fc5bda229c175'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.393173 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4575/9177] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 02:49:56 2022] DELETE /identity/v3/users/1924ddbb17a24b37842fc5bda229c175 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:49:56.658182 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:56.659616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:56.677298 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739368f0-6d64-4823-8ce8-81f8cbfd4532 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:56.741179 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:56.741815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:56.742093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:56.742365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] PATH_INFO: `/v3/projects/e184aaa0a9474adb913fb1abff06171a` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:56.753997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e184aaa0a9474adb913fb1abff06171a)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:56.755906 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:56.766553 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:49:56.803720 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e184aaa0a9474adb913fb1abff06171a', 'request_id': 'req-9729520a-42a0-4f56-b949-d0196feed340'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.809323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e184aaa0a9474adb913fb1abff06171a', 'request_id': 'req-9729520a-42a0-4f56-b949-d0196feed340'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.816867 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e184aaa0a9474adb913fb1abff06171a', 'request_id': 'req-9729520a-42a0-4f56-b949-d0196feed340'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.830242 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] The token cache is being invalidate because project e184aaa0a9474adb913fb1abff06171a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 02:49:56.830546 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.831171 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-9729520a-42a0-4f56-b949-d0196feed340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 02:49:56.832930 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4603/9178] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 02:49:56 2022] DELETE /identity/v3/projects/e184aaa0a9474adb913fb1abff06171a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:49:56.838162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456375-0966-45d4-b8aa-a9ecd1fc7a3c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:56.838624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456375-0966-45d4-b8aa-a9ecd1fc7a3c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:56.838747 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456375-0966-45d4-b8aa-a9ecd1fc7a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:56.885896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-67456375-0966-45d4-b8aa-a9ecd1fc7a3c None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:49:56.887088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-67456375-0966-45d4-b8aa-a9ecd1fc7a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:56.919800 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:49:56.948617 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4576/9179] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:49:56.957882 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48662-cf90-4091-8002-96ab3d2f8fa5 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:56.958162 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48662-cf90-4091-8002-96ab3d2f8fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:56.958432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48662-cf90-4091-8002-96ab3d2f8fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:56.977789 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e2e48662-cf90-4091-8002-96ab3d2f8fa5 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:49:56.978970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e2e48662-cf90-4091-8002-96ab3d2f8fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:56.986747 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4604/9180] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:49:56.990857 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456375-0966-45d4-b8aa-a9ecd1fc7a3c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:57.001028 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456375-0966-45d4-b8aa-a9ecd1fc7a3c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:57.005588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:57.006180 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.006456 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.006725 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.007357 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 02:49:57.007656 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:57.009303 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:57.020769 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4577/9181] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 02:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 02:49:57.024932 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e48662-cf90-4091-8002-96ab3d2f8fa5 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:57.034748 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e48662-cf90-4091-8002-96ab3d2f8fa5 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:57.039367 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:57.039952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.040227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.040494 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.041136 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:57.043012 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:57.080105 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4605/9182] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:49:57 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:49:57.084888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:57.095908 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42a66-e95b-43eb-8326-5a71488b1f8f admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:57.155101 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:57.155795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.156076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.156348 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.156981 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:57.158963 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:57.180583 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4578/9183] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:49:57 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:49:57.185299 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:57.195880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e241-60a2-4224-a22d-7e335fef2c2a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:57.200756 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:57.201389 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.201670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.201945 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.202616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:57.204239 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:57.214692 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4606/9184] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:49:57.219202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:57.229223 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccf8f4-5721-4d4a-b378-f304de472e46 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:57.234915 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd26ed-36e8-413e-9b02-0e1d79524429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:57.235639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd26ed-36e8-413e-9b02-0e1d79524429 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.235960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd26ed-36e8-413e-9b02-0e1d79524429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.236265 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd26ed-36e8-413e-9b02-0e1d79524429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.236896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd26ed-36e8-413e-9b02-0e1d79524429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:57.238507 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd26ed-36e8-413e-9b02-0e1d79524429 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:57.250591 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4579/9185] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 02:49:57.254666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:57.264854 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb3fc-6c71-469e-b189-1f7e512a4ed3 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:57.269435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:57.270074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.270351 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.270623 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] PATH_INFO: `/v3/projects/d63b3a7f31a843868a76139665c43ebb/users/2492488b7dd241359040b0a0a7e7779d/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.285340 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63b3a7f31a843868a76139665c43ebb, user_id=2492488b7dd241359040b0a0a7e7779d, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:57.287956 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:57.301520 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4607/9186] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:49:57 2022] PUT /identity/v3/projects/d63b3a7f31a843868a76139665c43ebb/users/2492488b7dd241359040b0a0a7e7779d/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:49:57.306583 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc960-5d16-4e75-9ce0-a4776bf93b73 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.306948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc960-5d16-4e75-9ce0-a4776bf93b73 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.307291 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc960-5d16-4e75-9ce0-a4776bf93b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.327638 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-e6ffc960-5d16-4e75-9ce0-a4776bf93b73 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:49:57.328839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-e6ffc960-5d16-4e75-9ce0-a4776bf93b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:57.389554 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4580/9187] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:49:57.399227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:49:57.400941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:49:57.458694 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff783817-2aff-41b5-8927-184fc12cf869 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:49:57.462277 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:49:57.462875 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:49:57.463152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:49:57.463423 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:49:57.472833 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:49:57.474290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:49:57.484656 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4608/9188] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:50:01.587145 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56603-82a1-46a9-95ea-739ac1359097 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:01.587664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56603-82a1-46a9-95ea-739ac1359097 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:01.587664 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56603-82a1-46a9-95ea-739ac1359097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:01.622823 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-ede56603-82a1-46a9-95ea-739ac1359097 None None] MFA Rules not processed for user `2492488b7dd241359040b0a0a7e7779d`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:50:01.624370 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-ede56603-82a1-46a9-95ea-739ac1359097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:50:01.661600 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:50:01.698105 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4581/9189] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:50:01.702958 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:01.713754 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474882a-83c3-488b-8e20-b6021a4ca0dd service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:01.719073 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:01.719715 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:01.719990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:01.720257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:01.720887 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:01.722831 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:01.755716 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4609/9190] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 02:50:01 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:50:01.756935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede56603-82a1-46a9-95ea-739ac1359097 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:01.768982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede56603-82a1-46a9-95ea-739ac1359097 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:01.830407 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:01.830951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:01.831235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:01.831515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:01.832411 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:01.834374 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:01.857757 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4582/9191] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 02:50:01 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 02:50:01.861881 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:01.872989 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f193a-a3cf-4b1c-87fc-736172b4d97a admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:01.877723 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:01.878513 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:01.878773 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:01.879044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:01.879683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:01.881436 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:01.882936 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:50:01.897910 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4610/9192] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:50:01.899283 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:01.910566 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ec6df-72b0-411b-987e-9ee738f14448 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:01.915372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:01.916045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:01.916306 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:01.916581 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] PATH_INFO: `/v3/projects/efc4c76fa2c747f7a1f50cf85f3685cd/users/2e50c72d5f944ea4bffc92372232122d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:01.933202 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc4c76fa2c747f7a1f50cf85f3685cd, user_id=2e50c72d5f944ea4bffc92372232122d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:01.937205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:01.951794 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4583/9193] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:50:01 2022] PUT /identity/v3/projects/efc4c76fa2c747f7a1f50cf85f3685cd/users/2e50c72d5f944ea4bffc92372232122d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:50:01.955944 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:01.967044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37cff-d30e-4c71-9e02-12b8a0a1cbd0 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:02.029261 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6315ef-f4ab-47e4-8c42-68f6437cc1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:02.029876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6315ef-f4ab-47e4-8c42-68f6437cc1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:02.030496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6315ef-f4ab-47e4-8c42-68f6437cc1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:02.030496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6315ef-f4ab-47e4-8c42-68f6437cc1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:02.031154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6315ef-f4ab-47e4-8c42-68f6437cc1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:02.032778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6315ef-f4ab-47e4-8c42-68f6437cc1c8 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:02.043155 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4611/9194] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 02:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 02:50:02.047590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:02.059017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddf005-acec-4f83-9bdf-fc0564be7663 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:02.064743 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:02.065454 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:02.065735 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:02.066008 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] PATH_INFO: `/v3/projects/efc4c76fa2c747f7a1f50cf85f3685cd/users/2e50c72d5f944ea4bffc92372232122d/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:02.067997 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc4c76fa2c747f7a1f50cf85f3685cd, user_id=2e50c72d5f944ea4bffc92372232122d, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:02.070671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:02.083905 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4584/9195] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 02:50:02 2022] PUT /identity/v3/projects/efc4c76fa2c747f7a1f50cf85f3685cd/users/2e50c72d5f944ea4bffc92372232122d/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 02:50:06.744244 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedeeb-b3b5-4ccf-8af4-06492f517cf3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:06.744776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedeeb-b3b5-4ccf-8af4-06492f517cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:06.744776 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedeeb-b3b5-4ccf-8af4-06492f517cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:06.780799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-5cbedeeb-b3b5-4ccf-8af4-06492f517cf3 None None] MFA Rules not processed for user `2e50c72d5f944ea4bffc92372232122d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:50:06.782081 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5cbedeeb-b3b5-4ccf-8af4-06492f517cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:50:06.894447 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4612/9196] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:50:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:50:06.911759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:06.914066 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:50:07.008590 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e32db3-b225-4fb3-a3b5-1a2665ec26cc admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:07.018034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:07.018663 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:07.018945 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:07.019218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:07.030511 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:50:07.089259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:07.091159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:07.102131 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4585/9197] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:50:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:50:08.155815 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:08.156364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:08.156364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:08.175492 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] MFA Rules not processed for user `2492488b7dd241359040b0a0a7e7779d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:50:08.176676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:50:08.183789 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4613/9198] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:50:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:50:10.817431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:10.878690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ac9d-b476-4b1c-bdce-c71e05db49d8 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:10.882492 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:10.883097 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:10.883372 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:10.883640 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:10.885513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:50:10.895992 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:10.897466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:10.906725 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4586/9199] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:50:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:50:18.170434 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=68 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:50:20.835864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:20.837365 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:50:20.849428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd1610-f596-4f98-8a1e-f72c03b3dc94 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:20.852923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:20.853557 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:20.853836 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:20.854107 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:20.862920 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:20.864326 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:20.874236 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4614/9200] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:50:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:50:20.902551 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=48 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:50:22.768867 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:50:22.783335 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de3a0f-2800-4cf2-8880-d08f47d1db9a service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:50:22.789966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18360d5c-9ae7-4ae7-94de-57c697f0a388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:50:22.790582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360d5c-9ae7-4ae7-94de-57c697f0a388 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:50:22.790861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360d5c-9ae7-4ae7-94de-57c697f0a388 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:50:22.791134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360d5c-9ae7-4ae7-94de-57c697f0a388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:50:22.792897 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-18360d5c-9ae7-4ae7-94de-57c697f0a388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:50:22.806077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18360d5c-9ae7-4ae7-94de-57c697f0a388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:50:22.807678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18360d5c-9ae7-4ae7-94de-57c697f0a388 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:50:22.819602 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4587/9201] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:50:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 02:50:30.869502 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:50:32.814851 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:52:48.975470 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:52:48.976878 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:52:49.032970 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d394a9-99b8-4218-902e-1f8cdec05c91 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:52:49.036697 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:52:49.037344 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:52:49.037618 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:52:49.038002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:52:49.039692 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:52:49.053511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:52:49.054919 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:52:49.075202 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4615/9202] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:52:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:52:49.269436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1256e-f939-4d94-8566-f5abf6b836dc None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:52:49.270019 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1256e-f939-4d94-8566-f5abf6b836dc None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:52:49.270137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1256e-f939-4d94-8566-f5abf6b836dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:52:49.299949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cdb1256e-f939-4d94-8566-f5abf6b836dc None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:52:49.301722 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cdb1256e-f939-4d94-8566-f5abf6b836dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:52:49.319257 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4588/9203] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:52:49.325325 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:52:49.335328 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af47ac-f782-40bb-b487-2369d3e7af26 service glance] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:52:49.338934 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:52:49.339528 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:52:49.339813 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:52:49.340113 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:52:49.341820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:52:49.355152 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:52:49.356609 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:52:49.369150 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4616/9204] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:52:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:52:59.315142 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=11 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:52:59.363538 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=36 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:53:06.693892 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2c763-b519-49c6-a500-0dec3d04ab34 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:06.694401 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2c763-b519-49c6-a500-0dec3d04ab34 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:06.694530 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2c763-b519-49c6-a500-0dec3d04ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:06.745027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-dff2c763-b519-49c6-a500-0dec3d04ab34 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:53:06.746266 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dff2c763-b519-49c6-a500-0dec3d04ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:06.810798 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4589/9205] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:53:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:53:06.857200 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:06.858600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:06.945568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823a6e-81f3-4a61-9174-33fd7eddcd59 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:06.950448 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71d6f9-0e31-4e9c-bb2f-82604a2709fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:06.951043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71d6f9-0e31-4e9c-bb2f-82604a2709fd service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:06.951316 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71d6f9-0e31-4e9c-bb2f-82604a2709fd service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:06.951583 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71d6f9-0e31-4e9c-bb2f-82604a2709fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:06.959868 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71d6f9-0e31-4e9c-bb2f-82604a2709fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:06.961460 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71d6f9-0e31-4e9c-bb2f-82604a2709fd service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:06.969396 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4617/9206] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:53:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:53:16.807841 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=40 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:53:16.966165 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=41 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:53:20.478759 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2c763-b519-49c6-a500-0dec3d04ab34 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:20.490017 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2c763-b519-49c6-a500-0dec3d04ab34 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:20.493644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:20.494239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:20.494520 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:20.494791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:20.496526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:20.506575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:20.507934 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:20.516594 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4590/9207] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:20.627306 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3bf26-d0e0-4819-bd35-ea4fbdde6ecd None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:20.627826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3bf26-d0e0-4819-bd35-ea4fbdde6ecd None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:20.627939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3bf26-d0e0-4819-bd35-ea4fbdde6ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:20.649315 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d2c3bf26-d0e0-4819-bd35-ea4fbdde6ecd None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:53:20.650606 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d2c3bf26-d0e0-4819-bd35-ea4fbdde6ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:20.660150 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4618/9208] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:53:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:53:20.672126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:20.682377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec68cd5-40c9-4f7c-a4c4-02f50f4b2925 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:20.686172 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:20.686774 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:20.687075 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:20.687349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:20.699702 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:20.701157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:20.712960 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4591/9209] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:20.782783 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47f63-decc-49cd-94e1-4c4e735143fc None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:20.783311 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47f63-decc-49cd-94e1-4c4e735143fc None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:20.783666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47f63-decc-49cd-94e1-4c4e735143fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:20.803769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-e0f47f63-decc-49cd-94e1-4c4e735143fc None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:53:20.804952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e0f47f63-decc-49cd-94e1-4c4e735143fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:20.811423 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4619/9210] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 11 02:53:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:53:20.817194 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:20.827364 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7d1c-3c2a-4368-a070-a52b7ff9c8dc service glance] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:20.831235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:20.831861 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:20.832164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:20.832433 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:20.834646 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:20.844005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:20.845436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:20.853129 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4592/9211] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:20.931996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f47f63-decc-49cd-94e1-4c4e735143fc None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:20.940232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f47f63-decc-49cd-94e1-4c4e735143fc None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:20.944313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:20.944905 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:20.945220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:20.945489 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:20.947175 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:20.961040 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:20.962511 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:20.973187 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4620/9212] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:21.034094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:21.035544 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:21.112731 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ab16-353d-4db0-9ba6-2f41112c162f service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:21.118818 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cb340-7b35-4fcf-adbf-ef1fe7f4dc02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:21.119423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb340-7b35-4fcf-adbf-ef1fe7f4dc02 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:21.119703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb340-7b35-4fcf-adbf-ef1fe7f4dc02 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:21.119973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb340-7b35-4fcf-adbf-ef1fe7f4dc02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:21.121708 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3c5cb340-7b35-4fcf-adbf-ef1fe7f4dc02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:21.133288 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cb340-7b35-4fcf-adbf-ef1fe7f4dc02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:21.134880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cb340-7b35-4fcf-adbf-ef1fe7f4dc02 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:21.144607 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4593/9213] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:23.189421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:23.190846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:23.210548 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7c13d-cca5-4709-a533-c6f5a00e8985 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:23.217280 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:23.217936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:23.218218 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:23.218488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:23.220237 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:23.234769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:23.236656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:23.249052 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4621/9214] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:23.884342 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc49971-0088-4d4a-af6d-c35601944055 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:23.884865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc49971-0088-4d4a-af6d-c35601944055 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:23.885029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc49971-0088-4d4a-af6d-c35601944055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:23.905723 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-2cc49971-0088-4d4a-af6d-c35601944055 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:53:23.906935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2cc49971-0088-4d4a-af6d-c35601944055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:23.914405 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4594/9215] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 02:53:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 02:53:23.926330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:23.937732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6966974-72e5-4c9b-8ec2-b4b6ff37cebe service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:23.944379 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:23.945100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:23.945446 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:23.945685 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:23.954458 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:23.956043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:23.965185 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4622/9216] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:53:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:53:33.899895 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=53 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:53:33.962235 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=24 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:53:35.444993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc49971-0088-4d4a-af6d-c35601944055 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:35.455910 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc49971-0088-4d4a-af6d-c35601944055 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:35.460849 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2e5f-50fb-4d79-bf2d-5a65fa8aa8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:35.461543 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2e5f-50fb-4d79-bf2d-5a65fa8aa8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:35.461805 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2e5f-50fb-4d79-bf2d-5a65fa8aa8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:35.462072 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2e5f-50fb-4d79-bf2d-5a65fa8aa8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:35.464102 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7d5a2e5f-50fb-4d79-bf2d-5a65fa8aa8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:35.474027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2e5f-50fb-4d79-bf2d-5a65fa8aa8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:35.476268 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2e5f-50fb-4d79-bf2d-5a65fa8aa8d8 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:35.484730 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4595/9217] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:42.948651 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:42.962251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5dabe-5271-4ef9-9c93-d658767e2cb9 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:42.968036 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:42.968645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:42.968923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:42.969227 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:42.970980 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:42.983722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:42.985327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:42.996560 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4623/9218] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:53:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:53:44.593166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:44.593675 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:44.593791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:44.612985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:53:44.614186 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:53:44.622130 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4596/9219] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 02:53:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:53:44.634220 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:53:44.645553 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228f5fb-ae5b-4ae8-8c5c-fcc2f3caedf5 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:53:44.650591 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:53:44.651170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:53:44.651443 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:53:44.651709 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:53:44.659573 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:53:44.661155 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:53:44.669502 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4624/9220] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 02:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 02:53:54.607711 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:53:54.665847 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=12 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:54:41.009140 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:54:41.010563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:54:41.075624 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a075397-108c-495e-9575-26e48eb95f21 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:54:41.081783 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:54:41.082384 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:54:41.082665 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:54:41.083214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:54:41.084930 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:54:41.096494 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:54:41.098087 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:54:41.108163 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4597/9221] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:54:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:54:42.032335 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:54:42.074279 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354a58-7e04-4a05-8f29-88af4b34a3e1 service swift] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:54:42.079863 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfa381-1001-4099-868c-71cc2cc5d0e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:54:42.080453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfa381-1001-4099-868c-71cc2cc5d0e5 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:54:42.080728 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfa381-1001-4099-868c-71cc2cc5d0e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:54:42.080996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfa381-1001-4099-868c-71cc2cc5d0e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:54:42.082680 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5bcfa381-1001-4099-868c-71cc2cc5d0e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:54:42.094231 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfa381-1001-4099-868c-71cc2cc5d0e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:54:42.095771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfa381-1001-4099-868c-71cc2cc5d0e5 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:54:42.105336 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4625/9222] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:54:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:54:51.103615 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=28 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:54:52.101352 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=20 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:55:21.411164 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:55:21.420830 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb644495-6ba5-4100-a921-a99e404d882e service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:55:21.424710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775919ba-be42-4ae2-88b7-6541fedf1cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:55:21.425340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775919ba-be42-4ae2-88b7-6541fedf1cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:55:21.425621 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775919ba-be42-4ae2-88b7-6541fedf1cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:55:21.425894 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775919ba-be42-4ae2-88b7-6541fedf1cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:55:21.434010 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775919ba-be42-4ae2-88b7-6541fedf1cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:55:21.435409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775919ba-be42-4ae2-88b7-6541fedf1cc7 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:55:21.445114 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4598/9223] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:55:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:55:27.145266 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c7eda-4216-49ec-89c5-e65c402fceb3 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:55:27.145832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c7eda-4216-49ec-89c5-e65c402fceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:55:27.145832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c7eda-4216-49ec-89c5-e65c402fceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:55:27.175161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-9d5c7eda-4216-49ec-89c5-e65c402fceb3 None None] MFA Rules not processed for user `2492488b7dd241359040b0a0a7e7779d`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:55:27.176354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9d5c7eda-4216-49ec-89c5-e65c402fceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:55:27.183238 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4626/9224] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 02:55:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:55:31.441091 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:55:37.170311 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=7 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:55:43.192973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc1acc-5332-4081-80d2-969e0a31fa31 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:55:43.193511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc1acc-5332-4081-80d2-969e0a31fa31 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:55:43.193627 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc1acc-5332-4081-80d2-969e0a31fa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:55:43.249699 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4cbc1acc-5332-4081-80d2-969e0a31fa31 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:55:43.251076 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4cbc1acc-5332-4081-80d2-969e0a31fa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:55:43.260229 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4599/9225] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:55:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:55:43.273091 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c7eda-4216-49ec-89c5-e65c402fceb3 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:55:43.285722 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c7eda-4216-49ec-89c5-e65c402fceb3 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:55:43.291419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:55:43.292013 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:55:43.292294 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:55:43.292564 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:55:43.301846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:55:43.303406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:55:43.313424 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4627/9226] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:55:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:55:45.090856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc1acc-5332-4081-80d2-969e0a31fa31 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:55:45.101839 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc1acc-5332-4081-80d2-969e0a31fa31 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:55:45.106578 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:55:45.107203 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:55:45.107483 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:55:45.107760 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:55:45.118253 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:55:45.119709 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:55:45.131147 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4600/9227] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:55:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:55:53.309142 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:55:55.125686 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=20 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:56:04.986572 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:56:04.995877 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63fef6-1f3b-47b7-886c-8591bb54b4b9 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:56:04.999558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b636c2-fe36-4249-b94a-8a86c12a2e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:56:05.000858 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b636c2-fe36-4249-b94a-8a86c12a2e89 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:56:05.001163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b636c2-fe36-4249-b94a-8a86c12a2e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:56:05.001433 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b636c2-fe36-4249-b94a-8a86c12a2e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:56:05.010226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b636c2-fe36-4249-b94a-8a86c12a2e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:56:05.011630 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b636c2-fe36-4249-b94a-8a86c12a2e89 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:56:05.021495 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4628/9228] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:56:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:56:06.600009 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:56:06.621950 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc22fb-f2ac-4669-a6dc-446d28591c35 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:56:06.628284 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:56:06.628896 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:56:06.629220 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:56:06.629498 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:56:06.638868 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:56:06.641005 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:56:06.651735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4601/9229] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:56:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:56:15.017409 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:56:16.647212 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:56:43.967372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837b3cd-7747-46f3-92b6-ae0784860a73 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:56:43.968020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837b3cd-7747-46f3-92b6-ae0784860a73 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:56:43.968020 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837b3cd-7747-46f3-92b6-ae0784860a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:56:43.987648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-7837b3cd-7747-46f3-92b6-ae0784860a73 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:56:43.988864 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-7837b3cd-7747-46f3-92b6-ae0784860a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:56:43.997685 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4629/9230] 10.222.0.57 () {58 vars in 1015 bytes} [Sun Sep 11 02:56:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:56:44.010888 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:56:44.022029 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10de4f-2a8e-4a66-b5a1-6d14fc6d82a7 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:56:44.027564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9893c4-728f-477f-b151-5f5fdeab5a0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:56:44.028147 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9893c4-728f-477f-b151-5f5fdeab5a0a service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:56:44.028423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9893c4-728f-477f-b151-5f5fdeab5a0a service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:56:44.028690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9893c4-728f-477f-b151-5f5fdeab5a0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:56:44.036882 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9893c4-728f-477f-b151-5f5fdeab5a0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:56:44.038495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9893c4-728f-477f-b151-5f5fdeab5a0a service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:56:44.047991 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4602/9231] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:56:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:56:53.982802 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=3 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:56:54.043966 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:57:46.016075 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35127-9624-4798-b451-4c187d1cec75 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:57:46.016714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35127-9624-4798-b451-4c187d1cec75 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:57:46.016714 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35127-9624-4798-b451-4c187d1cec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:57:46.036061 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c1d35127-9624-4798-b451-4c187d1cec75 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:57:46.037281 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c1d35127-9624-4798-b451-4c187d1cec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:57:46.046242 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4630/9232] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 11 02:57:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:57:46.058351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0a6e-edec-4d7b-8409-4c53a78f780b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:57:46.058795 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0a6e-edec-4d7b-8409-4c53a78f780b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:57:46.059071 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e0a6e-edec-4d7b-8409-4c53a78f780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:57:46.078658 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-d61e0a6e-edec-4d7b-8409-4c53a78f780b None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:57:46.079838 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d61e0a6e-edec-4d7b-8409-4c53a78f780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:57:46.089525 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4603/9233] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 02:57:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:57:46.095508 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35127-9624-4798-b451-4c187d1cec75 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:57:46.106522 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35127-9624-4798-b451-4c187d1cec75 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:57:46.111797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:57:46.112393 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:57:46.112689 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:57:46.112955 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:57:46.122074 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:57:46.123627 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:57:46.133235 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4631/9234] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:57:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:57:56.073755 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:57:56.129202 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=9 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:58:02.390162 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e0a6e-edec-4d7b-8409-4c53a78f780b None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:58:02.399831 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e0a6e-edec-4d7b-8409-4c53a78f780b None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:58:02.403524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f22f3-2e00-4935-8e5f-139443bce1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:58:02.404129 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f22f3-2e00-4935-8e5f-139443bce1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:58:02.404413 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f22f3-2e00-4935-8e5f-139443bce1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:58:02.404682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f22f3-2e00-4935-8e5f-139443bce1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:58:02.415065 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f22f3-2e00-4935-8e5f-139443bce1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:58:02.416537 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f22f3-2e00-4935-8e5f-139443bce1e1 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:58:02.428255 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4604/9235] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:58:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:58:03.625323 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:58:03.634452 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa2aa2-abc4-4b04-b184-3622a24917b8 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:58:03.638331 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:58:03.638914 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:58:03.639189 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:58:03.639456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:58:03.649374 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:58:03.650770 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:58:03.662257 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4632/9236] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:58:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:58:12.423424 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:58:13.657622 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:58:17.038870 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec731c-9304-4e1b-b00f-7dfcaba7f6bd None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:58:17.039395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec731c-9304-4e1b-b00f-7dfcaba7f6bd None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:58:17.039395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec731c-9304-4e1b-b00f-7dfcaba7f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:58:17.059873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-7dec731c-9304-4e1b-b00f-7dfcaba7f6bd None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:58:17.061130 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7dec731c-9304-4e1b-b00f-7dfcaba7f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:58:17.070196 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4605/9237] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 02:58:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:58:17.082272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:58:17.094584 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2bc1d-13be-4e61-b485-01cd7915b942 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:58:17.099561 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:58:17.100147 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:58:17.100425 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:58:17.100696 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:58:17.110041 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:58:17.111600 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:58:17.121307 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4633/9238] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:58:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:58:23.616577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec731c-9304-4e1b-b00f-7dfcaba7f6bd None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:58:23.634304 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec731c-9304-4e1b-b00f-7dfcaba7f6bd None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:58:23.641491 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645e567-6359-41fd-9f79-9c1dac82ba67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:58:23.642111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e567-6359-41fd-9f79-9c1dac82ba67 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:58:23.642387 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e567-6359-41fd-9f79-9c1dac82ba67 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:58:23.642657 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e567-6359-41fd-9f79-9c1dac82ba67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:58:23.652452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645e567-6359-41fd-9f79-9c1dac82ba67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:58:23.654044 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645e567-6359-41fd-9f79-9c1dac82ba67 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:58:23.665918 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4606/9239] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:58:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:58:27.117268 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:58:33.661108 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:58:36.511550 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:58:36.521043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f033b-0e8a-4054-be26-d57392f48d61 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:58:36.524634 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:58:36.525273 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:58:36.525549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:58:36.525820 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:58:36.533853 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:58:36.535272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:58:36.543467 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4634/9240] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:58:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:58:46.539842 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:59:43.712113 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ce32-376e-4eb1-936d-c48dd938943c None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:59:43.712732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ce32-376e-4eb1-936d-c48dd938943c None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:59:43.712732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8ce32-376e-4eb1-936d-c48dd938943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:59:43.762323 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-48c8ce32-376e-4eb1-936d-c48dd938943c None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 02:59:43.763525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-48c8ce32-376e-4eb1-936d-c48dd938943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 02:59:43.770582 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4607/9241] 10.222.0.57 () {58 vars in 1015 bytes} [Sun Sep 11 02:59:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 02:59:43.782939 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 02:59:43.791929 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f782e-d946-48d1-a5e7-de107ade3b52 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 02:59:43.795935 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 02:59:43.796568 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 02:59:43.796871 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 02:59:43.797170 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 02:59:43.804998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 02:59:43.806441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 02:59:43.814289 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4635/9242] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 02:59:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 02:59:53.759745 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=14 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 02:59:53.810948 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:03.299696 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8ce32-376e-4eb1-936d-c48dd938943c None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:03.309126 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8ce32-376e-4eb1-936d-c48dd938943c None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:03.312925 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:03.313564 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:03.313846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:03.314116 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:03.316499 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:03.405862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:03.407452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:03.426690 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4608/9243] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:00:06.379322 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:06.391361 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e307d-b6ed-4132-a5d1-415ddc18c290 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:06.397100 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:06.397712 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:06.397993 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:06.398267 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:06.399978 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:06.413031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:06.414683 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:06.440935 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4636/9244] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:00:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:00:09.716977 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:09.720243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:09.734417 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b182-2280-4bef-99ab-3eb3e18e275b service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:09.743262 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:09.744148 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:09.744436 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:09.744846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] PATH_INFO: `/v3/users/2492488b7dd241359040b0a0a7e7779d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:09.762740 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2492488b7dd241359040b0a0a7e7779d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:09.766810 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:09.823399 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2492488b7dd241359040b0a0a7e7779d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:09.824067 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2492488b7dd241359040b0a0a7e7779d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:09.824674 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2492488b7dd241359040b0a0a7e7779d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:09.832692 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2492488b7dd241359040b0a0a7e7779d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:09.851040 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2492488b7dd241359040b0a0a7e7779d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:09.884833 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4609/9245] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 03:00:09 2022] DELETE /identity/v3/users/2492488b7dd241359040b0a0a7e7779d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:00:10.058262 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:10.070971 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7524e3-f37a-4cb9-bb95-3d095ce14f04 service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:10.127874 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:10.128495 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:10.128771 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:10.129038 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] PATH_INFO: `/v3/projects/d63b3a7f31a843868a76139665c43ebb` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:10.140962 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63b3a7f31a843868a76139665c43ebb)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:10.143645 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:10.188483 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63b3a7f31a843868a76139665c43ebb', 'request_id': 'req-1f8b3a96-1000-48df-82ea-4ad94a25a791'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.194524 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63b3a7f31a843868a76139665c43ebb', 'request_id': 'req-1f8b3a96-1000-48df-82ea-4ad94a25a791'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.200544 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63b3a7f31a843868a76139665c43ebb', 'request_id': 'req-1f8b3a96-1000-48df-82ea-4ad94a25a791'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.213702 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] The token cache is being invalidate because project d63b3a7f31a843868a76139665c43ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 03:00:10.213990 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.214612 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.216118 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4637/9246] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 03:00:10 2022] DELETE /identity/v3/projects/d63b3a7f31a843868a76139665c43ebb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 03:00:10.220235 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:10.221713 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:10.234744 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c2e53-98ab-4e1c-80e3-dc4adafccce2 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:10.259469 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:10.292958 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:10.293613 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:10.293890 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:10.294161 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] PATH_INFO: `/v3/users/2e50c72d5f944ea4bffc92372232122d` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:10.307785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e50c72d5f944ea4bffc92372232122d)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:10.309724 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:10.354233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e50c72d5f944ea4bffc92372232122d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.354878 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e50c72d5f944ea4bffc92372232122d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.355482 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e50c72d5f944ea4bffc92372232122d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.363300 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e50c72d5f944ea4bffc92372232122d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.374955 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-224f1e71-c9e7-4e82-9d28-55d9a39946a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e50c72d5f944ea4bffc92372232122d'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.388231 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4610/9247] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 03:00:10 2022] DELETE /identity/v3/users/2e50c72d5f944ea4bffc92372232122d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 03:00:10.568093 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:10.569592 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:10.585676 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b3a96-1000-48df-82ea-4ad94a25a791 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:10.643087 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:10.643711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:10.643987 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:10.644257 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] PATH_INFO: `/v3/projects/efc4c76fa2c747f7a1f50cf85f3685cd` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:10.654441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc4c76fa2c747f7a1f50cf85f3685cd)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:10.656329 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:10.657736 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:10.705364 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc4c76fa2c747f7a1f50cf85f3685cd', 'request_id': 'req-d89aa752-59c3-46b1-8215-2993cbeb0bfd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.711525 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc4c76fa2c747f7a1f50cf85f3685cd', 'request_id': 'req-d89aa752-59c3-46b1-8215-2993cbeb0bfd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.718533 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc4c76fa2c747f7a1f50cf85f3685cd', 'request_id': 'req-d89aa752-59c3-46b1-8215-2993cbeb0bfd'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.731373 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] The token cache is being invalidate because project efc4c76fa2c747f7a1f50cf85f3685cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81859) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 03:00:10.731653 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.732256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-d89aa752-59c3-46b1-8215-2993cbeb0bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:00:10.733769 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4638/9248] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 03:00:10 2022] DELETE /identity/v3/projects/efc4c76fa2c747f7a1f50cf85f3685cd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:00:10.738874 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cfc11-e5bf-4f02-815b-837c10b99d66 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:10.739408 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cfc11-e5bf-4f02-815b-837c10b99d66 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:10.739525 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cfc11-e5bf-4f02-815b-837c10b99d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:10.797787 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-176cfc11-e5bf-4f02-815b-837c10b99d66 None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:00:10.799007 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-176cfc11-e5bf-4f02-815b-837c10b99d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:10.858015 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4611/9249] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 03:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:00:10.867226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a7e1-40e5-4f50-b134-7a3cc549b71e None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:10.867493 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a7e1-40e5-4f50-b134-7a3cc549b71e None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:10.867769 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a7e1-40e5-4f50-b134-7a3cc549b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:10.888648 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-fdf6a7e1-40e5-4f50-b134-7a3cc549b71e None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:00:10.889876 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-fdf6a7e1-40e5-4f50-b134-7a3cc549b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:10.898929 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4639/9250] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 03:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:00:10.903060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cfc11-e5bf-4f02-815b-837c10b99d66 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:10.909421 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:10.914215 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cfc11-e5bf-4f02-815b-837c10b99d66 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:10.920340 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:10.921165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:10.921511 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:10.921933 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:10.922634 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81860) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 03:00:10.923098 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:10.924718 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:10.936415 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4612/9251] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 11 03:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 03:00:10.942009 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a7e1-40e5-4f50-b134-7a3cc549b71e None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:10.951208 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a7e1-40e5-4f50-b134-7a3cc549b71e None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:10.957288 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:10.957826 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:10.958102 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:10.958372 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:10.958988 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:10.960872 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:10.997392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4640/9252] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 03:00:10 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 03:00:11.002094 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:11.012531 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d661f-8ff3-4d55-bd20-560af45dc9ee admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:11.071639 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:11.072243 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:11.072524 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:11.072798 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:11.073466 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:11.075360 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:11.099223 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4613/9253] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 03:00:11 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 03:00:11.100669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:11.110979 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dd70d-26e0-48fc-9e96-6255fa92b3bf admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:11.116204 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:11.116798 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:11.117118 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:11.117378 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:11.118015 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:11.119595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:11.130655 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4641/9254] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 03:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 03:00:11.134711 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:11.144979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da89d0-f3c4-460f-b6d1-5a86c8590654 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:11.149350 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f865278-8174-4a7f-a183-3c0a66c8f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:11.149939 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865278-8174-4a7f-a183-3c0a66c8f0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:11.150217 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865278-8174-4a7f-a183-3c0a66c8f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:11.150484 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865278-8174-4a7f-a183-3c0a66c8f0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:11.151120 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f865278-8174-4a7f-a183-3c0a66c8f0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:11.152676 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f865278-8174-4a7f-a183-3c0a66c8f0e5 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:11.163395 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4614/9255] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 03:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 03:00:11.167363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:11.178688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309754ef-8bd0-4c6e-9e1e-5bfed516ae0e admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:11.183477 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:11.184125 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] REQUEST_METHOD: `PUT` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:11.184405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:11.184681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] PATH_INFO: `/v3/projects/38c2be22471443148fc101c4652332cb/users/bcbe9a80df574bbb88fd983cf3345fef/roles/275ac2aaf11e4619be3ad7f3890fb7b1` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:11.199506 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c2be22471443148fc101c4652332cb, user_id=bcbe9a80df574bbb88fd983cf3345fef, role_id=275ac2aaf11e4619be3ad7f3890fb7b1)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:11.202163 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:11.215802 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4642/9256] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 03:00:11 2022] PUT /identity/v3/projects/38c2be22471443148fc101c4652332cb/users/bcbe9a80df574bbb88fd983cf3345fef/roles/275ac2aaf11e4619be3ad7f3890fb7b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:00:11.220821 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f165-193a-40c3-b071-a1d7e9d9413b None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:11.221214 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f165-193a-40c3-b071-a1d7e9d9413b None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:11.221409 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f165-193a-40c3-b071-a1d7e9d9413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:11.241287 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-8909f165-193a-40c3-b071-a1d7e9d9413b None None] MFA Rules not processed for user `f315e7427b614b24bed4c1fa5addb708`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:00:11.242477 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-8909f165-193a-40c3-b071-a1d7e9d9413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:11.300272 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4615/9257] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 03:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:00:11.310214 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:11.311884 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:11.369366 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828b1e-aefc-40d9-81f2-0ab56025897f admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:11.373031 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:11.373666 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:11.373947 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:11.374221 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:11.383650 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:11.385142 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:11.395085 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4643/9258] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:00:15.511134 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b2df-9115-42b9-8b4b-1d882541532e None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:15.512167 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b2df-9115-42b9-8b4b-1d882541532e None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:15.512614 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b2df-9115-42b9-8b4b-1d882541532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:15.553508 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-4f38b2df-9115-42b9-8b4b-1d882541532e None None] MFA Rules not processed for user `bcbe9a80df574bbb88fd983cf3345fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:00:15.554732 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-4f38b2df-9115-42b9-8b4b-1d882541532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:15.641469 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:15.649563 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4616/9259] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 03:00:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:00:15.650646 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:15.662763 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee64a37-d1ce-4bdd-96c0-94d30cd39c3e service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:15.668044 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:15.668912 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:15.669226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:15.669496 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:15.670330 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:15.672473 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:15.701775 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:15.707657 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4644/9260] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 11 03:00:15 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 03:00:15.711694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38b2df-9115-42b9-8b4b-1d882541532e None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:15.728149 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38b2df-9115-42b9-8b4b-1d882541532e None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:15.795777 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:15.796687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:15.797183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:15.797641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] PATH_INFO: `/v3/users` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:15.798594 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:15.801263 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:15.827745 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4617/9261] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 11 03:00:15 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 03:00:15.832178 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:15.844211 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382c49-7da4-4651-8a35-85511f5414c9 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:15.849706 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:15.850549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:15.850950 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:15.851441 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:15.852272 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:15.854418 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:15.866823 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4645/9262] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 03:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 03:00:15.871088 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:15.884623 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db99179-2802-4a49-ab13-0c192a190a72 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:15.893000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:15.893739 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:15.894013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:15.894434 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] PATH_INFO: `/v3/projects/cd9aa69a610e4de598a210ae4f03c10a/users/0ab822c889274ed296376fdbd2959b00/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:15.912987 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9aa69a610e4de598a210ae4f03c10a, user_id=0ab822c889274ed296376fdbd2959b00, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:15.915703 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:15.928964 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4618/9263] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 03:00:15 2022] PUT /identity/v3/projects/cd9aa69a610e4de598a210ae4f03c10a/users/0ab822c889274ed296376fdbd2959b00/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:00:15.933021 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:15.944150 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec035-c11a-40d0-b4ae-e6a3cfc31982 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:16.011030 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7ee4-6d6f-4325-a001-8ba3b8d73ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:16.011656 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7ee4-6d6f-4325-a001-8ba3b8d73ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:16.011940 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7ee4-6d6f-4325-a001-8ba3b8d73ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:16.012196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7ee4-6d6f-4325-a001-8ba3b8d73ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:16.012859 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7ee4-6d6f-4325-a001-8ba3b8d73ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:16.014530 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7ee4-6d6f-4325-a001-8ba3b8d73ea9 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:16.027775 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4646/9264] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 11 03:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 03:00:16.032081 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:16.044617 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf951699-1ac9-4bd9-b487-0cebaa7a4b6c admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:16.049577 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:16.050240 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:16.050586 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:16.051349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] PATH_INFO: `/v3/projects/cd9aa69a610e4de598a210ae4f03c10a/users/0ab822c889274ed296376fdbd2959b00/roles/26647ebe21344cfbb8086d4b36b11321` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:16.054039 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9aa69a610e4de598a210ae4f03c10a, user_id=0ab822c889274ed296376fdbd2959b00, role_id=26647ebe21344cfbb8086d4b36b11321)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:16.056671 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:16.068854 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4619/9265] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 11 03:00:16 2022] PUT /identity/v3/projects/cd9aa69a610e4de598a210ae4f03c10a/users/0ab822c889274ed296376fdbd2959b00/roles/26647ebe21344cfbb8086d4b36b11321 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:00:20.644848 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83f7b-5125-4b99-a725-3c08a2d86f50 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:20.645428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83f7b-5125-4b99-a725-3c08a2d86f50 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:20.645428 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c83f7b-5125-4b99-a725-3c08a2d86f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:20.683129 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-56c83f7b-5125-4b99-a725-3c08a2d86f50 None None] MFA Rules not processed for user `0ab822c889274ed296376fdbd2959b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:00:20.685558 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-56c83f7b-5125-4b99-a725-3c08a2d86f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:20.779210 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4647/9266] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 03:00:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:00:20.788061 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:20.790574 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:20.881314 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2271603-969a-4cd5-b355-6aaa203c5111 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:20.887096 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:20.887710 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:20.887989 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:20.888260 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:20.930374 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:20.951425 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:20.953027 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:20.966319 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4620/9267] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:00:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 03:00:21.990265 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:21.991138 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:21.991414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:22.013180 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] MFA Rules not processed for user `bcbe9a80df574bbb88fd983cf3345fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:00:22.014413 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:22.021589 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4648/9268] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 03:00:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:00:22.357863 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:22.359270 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:22.419261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e871-a68a-4e8e-82eb-502095161660 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:22.422966 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:22.423568 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:22.423846 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:22.424117 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:22.426395 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:22.436183 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:22.437659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:22.447060 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4621/9269] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:00:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:00:31.192838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:31.194398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:31.211880 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d088fd-9465-4b5e-b3e3-7d332e052c06 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:31.217610 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:31.218305 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:31.218663 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:31.218941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:31.220733 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:00:31.235434 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:31.237043 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:31.249432 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4649/9270] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:00:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:00:32.442703 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=36 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:33.632313 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:00:33.640971 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a6f22-a281-4fd3-a25c-80ce81743d28 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:00:33.644618 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2d158-4a4f-47b8-b489-acb1831fb879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:00:33.645239 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d158-4a4f-47b8-b489-acb1831fb879 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:00:33.645515 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d158-4a4f-47b8-b489-acb1831fb879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:00:33.646448 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2d158-4a4f-47b8-b489-acb1831fb879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:00:33.654967 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2d158-4a4f-47b8-b489-acb1831fb879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:00:33.656363 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2d158-4a4f-47b8-b489-acb1831fb879 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:00:33.666236 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4622/9271] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:00:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:00:41.244526 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=78 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:00:43.661514 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:01:45.703256 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:01:45.713405 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158aa1b-7ea8-4163-b6e5-cc8cbc8f404f service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:01:45.716998 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:01:45.717619 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:01:45.717898 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:01:45.718169 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:01:45.719856 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:01:45.729095 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:01:45.730500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:01:45.738492 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4650/9272] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:01:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:01:50.963233 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7cb6e-03f9-4991-bb0e-2a8153b888fa None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:01:50.963690 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7cb6e-03f9-4991-bb0e-2a8153b888fa None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:01:50.963815 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7cb6e-03f9-4991-bb0e-2a8153b888fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:01:50.984361 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-c9d7cb6e-03f9-4991-bb0e-2a8153b888fa None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:01:50.985603 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-c9d7cb6e-03f9-4991-bb0e-2a8153b888fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:01:51.049049 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4623/9273] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 11 03:01:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:01:51.055345 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:01:51.067435 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104eb6-a80e-47b2-a1ab-e1db4b8d5440 service neutron] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:01:51.073596 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:01:51.074186 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:01:51.074462 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:01:51.074731 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:01:51.076453 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:01:51.089143 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:01:51.090704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:01:51.100583 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4651/9274] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:01:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:02:01.040584 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=29 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:02:01.096456 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=12 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:02:45.738321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:02:45.738968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:02:45.738968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:02:45.758238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:02:45.759575 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:02:45.766016 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4624/9275] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Sep 11 03:02:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:02:45.778846 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:02:45.788094 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7bc6-b2b4-43eb-88ca-5688de2ee47e service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:02:45.792899 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dd119-8377-4787-b6db-af8d8de1ba0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:02:45.793523 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dd119-8377-4787-b6db-af8d8de1ba0e service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:02:45.793799 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dd119-8377-4787-b6db-af8d8de1ba0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:02:45.794069 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dd119-8377-4787-b6db-af8d8de1ba0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:02:45.800972 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dd119-8377-4787-b6db-af8d8de1ba0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:02:45.802414 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dd119-8377-4787-b6db-af8d8de1ba0e service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:02:45.810671 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4652/9276] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:02:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:02:54.996107 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:02:54.997559 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:02:55.012944 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d86b4-e012-473b-816e-a3a6696a7b5d None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:02:55.018045 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96595873-eda6-421b-be84-80fce7da8467 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:02:55.018649 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96595873-eda6-421b-be84-80fce7da8467 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:02:55.018931 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96595873-eda6-421b-be84-80fce7da8467 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:02:55.019205 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96595873-eda6-421b-be84-80fce7da8467 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:02:55.020880 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-96595873-eda6-421b-be84-80fce7da8467 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:02:55.032051 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96595873-eda6-421b-be84-80fce7da8467 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:02:55.033655 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96595873-eda6-421b-be84-80fce7da8467 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:02:55.047699 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4625/9277] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:02:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:02:55.807354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:03:05.039319 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=9 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:03:12.600521 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:12.601168 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:12.601312 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:12.649005 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:12.650243 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:12.669170 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4653/9278] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 03:03:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:12.674993 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3020-2eb3-494a-b788-e5c85615e269 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:12.675431 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3020-2eb3-494a-b788-e5c85615e269 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:12.675558 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3020-2eb3-494a-b788-e5c85615e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:12.697512 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-1e4c3020-2eb3-494a-b788-e5c85615e269 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:12.698733 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-1e4c3020-2eb3-494a-b788-e5c85615e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:12.708406 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4626/9279] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 03:03:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:12.720654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:12.722167 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:12.799909 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d3eb8-6951-48d4-b775-ea86f5270195 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:12.803698 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ffa18-fb53-44a2-a257-368e461c2b89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7306de1f2fb4ebfb4177d9acfb25fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:12.804941 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ffa18-fb53-44a2-a257-368e461c2b89 service glance] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:12.805251 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ffa18-fb53-44a2-a257-368e461c2b89 service glance] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:12.805520 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ffa18-fb53-44a2-a257-368e461c2b89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:12.815647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ffa18-fb53-44a2-a257-368e461c2b89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:12.817090 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ffa18-fb53-44a2-a257-368e461c2b89 service glance] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:12.828516 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4654/9280] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:03:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:03:19.979518 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1647c-bb2b-4899-9f1d-88830f481166 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:19.980077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1647c-bb2b-4899-9f1d-88830f481166 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:19.980077 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1647c-bb2b-4899-9f1d-88830f481166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:19.999886 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-54a1647c-bb2b-4899-9f1d-88830f481166 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:20.001146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-54a1647c-bb2b-4899-9f1d-88830f481166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:20.010856 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4627/9281] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 03:03:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:20.040952 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b04b3-abbe-4eb6-883e-53f0917371e6 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:20.041542 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b04b3-abbe-4eb6-883e-53f0917371e6 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:20.041669 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b04b3-abbe-4eb6-883e-53f0917371e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:20.062419 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-330b04b3-abbe-4eb6-883e-53f0917371e6 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:20.063654 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-330b04b3-abbe-4eb6-883e-53f0917371e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:20.073724 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4655/9282] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 11 03:03:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:20.080526 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1647c-bb2b-4899-9f1d-88830f481166 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:20.092678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1647c-bb2b-4899-9f1d-88830f481166 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:20.098378 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:20.098978 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:20.099259 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:20.099533 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:20.108261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:20.109856 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:20.120767 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4628/9283] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:03:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:03:22.228667 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee6e16-bd1e-41bd-a31c-81714acdf855 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:22.229642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee6e16-bd1e-41bd-a31c-81714acdf855 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:22.229933 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee6e16-bd1e-41bd-a31c-81714acdf855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:22.280048 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-61ee6e16-bd1e-41bd-a31c-81714acdf855 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:22.281296 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-61ee6e16-bd1e-41bd-a31c-81714acdf855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:22.346798 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4656/9284] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 03:03:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:22.393786 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:22.395184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:22.486685 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0835c-8549-4235-920f-660be92cf484 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:22.491809 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7562fb-a929-478f-b39b-68c4ff14ae1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:22.492403 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7562fb-a929-478f-b39b-68c4ff14ae1a service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:22.492681 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7562fb-a929-478f-b39b-68c4ff14ae1a service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:22.492949 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7562fb-a929-478f-b39b-68c4ff14ae1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:22.501305 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7562fb-a929-478f-b39b-68c4ff14ae1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:22.502902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7562fb-a929-478f-b39b-68c4ff14ae1a service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:22.511254 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4629/9285] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 03:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 03:03:32.343840 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=95 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:03:32.507733 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=53 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:03:32.648421 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf126-eeb4-4e5c-9f75-0ec1e10e27fa None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:32.648732 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf126-eeb4-4e5c-9f75-0ec1e10e27fa None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:32.649002 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf126-eeb4-4e5c-9f75-0ec1e10e27fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:32.668996 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f2edf126-eeb4-4e5c-9f75-0ec1e10e27fa None None] MFA Rules not processed for user `bcbe9a80df574bbb88fd983cf3345fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:32.670234 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f2edf126-eeb4-4e5c-9f75-0ec1e10e27fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:32.677461 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4657/9286] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 11 03:03:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:33.003349 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae404ac-8729-4c4e-a475-1770cdad2878 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:33.003630 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae404ac-8729-4c4e-a475-1770cdad2878 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:33.003902 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae404ac-8729-4c4e-a475-1770cdad2878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:33.024385 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-9ae404ac-8729-4c4e-a475-1770cdad2878 None None] MFA Rules not processed for user `47323e4e757c49eea3e6695a68fc267a`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:33.025641 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-9ae404ac-8729-4c4e-a475-1770cdad2878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:33.045735 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4630/9287] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 03:03:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:33.057693 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edf126-eeb4-4e5c-9f75-0ec1e10e27fa None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:33.067290 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edf126-eeb4-4e5c-9f75-0ec1e10e27fa None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:33.071301 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c6c98-38d2-4855-90b1-ca2decd5470c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:33.071910 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c6c98-38d2-4855-90b1-ca2decd5470c service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:33.072223 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c6c98-38d2-4855-90b1-ca2decd5470c service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:33.072536 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c6c98-38d2-4855-90b1-ca2decd5470c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:33.080067 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c6c98-38d2-4855-90b1-ca2decd5470c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:33.081788 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c6c98-38d2-4855-90b1-ca2decd5470c service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:33.090419 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4658/9288] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:03:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:03:33.424588 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae404ac-8729-4c4e-a475-1770cdad2878 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:33.436962 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae404ac-8729-4c4e-a475-1770cdad2878 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:33.441990 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:33.442593 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:33.443013 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:33.443276 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:33.444968 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:33.449796 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aead2-9621-4096-9224-9cf46fcfbeb4 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:33.450304 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aead2-9621-4096-9224-9cf46fcfbeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:33.450424 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aead2-9621-4096-9224-9cf46fcfbeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:33.457904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:33.459473 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:33.470953 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4631/9289] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:03:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:03:33.473948 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-c18aead2-9621-4096-9224-9cf46fcfbeb4 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:33.476024 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-c18aead2-9621-4096-9224-9cf46fcfbeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:33.487578 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4659/9290] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 03:03:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 03:03:33.498600 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:33.507755 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab4c3-c9d4-4b50-b5c0-05d7d026ce83 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:33.511979 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:33.512580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:33.512862 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:33.513184 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:33.523877 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:33.525333 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:33.537814 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4632/9291] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:03:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:03:34.866679 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ae45f-1364-4909-be03-e9c20db2c293 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:34.867154 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ae45f-1364-4909-be03-e9c20db2c293 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:34.867260 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ae45f-1364-4909-be03-e9c20db2c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:34.887936 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d20ae45f-1364-4909-be03-e9c20db2c293 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:34.889232 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d20ae45f-1364-4909-be03-e9c20db2c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:34.897015 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4660/9292] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 03:03:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:34.911060 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:34.923757 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f893767-cc8e-4049-a05e-4ee7032103a2 service neutron] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:34.929200 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:34.930351 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:34.930687 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:34.931037 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:34.940844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:34.942462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:34.952153 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4633/9293] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 03:03:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 03:03:44.830616 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af0dd4-25d4-4adf-980b-5174dfcc0223 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:44.831176 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af0dd4-25d4-4adf-980b-5174dfcc0223 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:44.831901 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af0dd4-25d4-4adf-980b-5174dfcc0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:44.858395 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-25af0dd4-25d4-4adf-980b-5174dfcc0223 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:03:44.859711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-25af0dd4-25d4-4adf-980b-5174dfcc0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:44.870385 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4661/9294] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 03:03:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:03:44.889965 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:44.904034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb048-0a81-4258-83e0-263a8f9df751 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:44.911513 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:44.912137 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:44.912423 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:44.912691 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:44.923198 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:44.924785 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:44.936847 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4634/9295] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:03:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:03:54.775711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af0dd4-25d4-4adf-980b-5174dfcc0223 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:03:54.787678 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af0dd4-25d4-4adf-980b-5174dfcc0223 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:03:54.794339 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:03:54.794997 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:03:54.795276 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:03:54.795549 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:03:54.797354 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:03:54.810158 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:03:54.811767 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:03:54.822673 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4662/9296] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:03:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:03:54.931102 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=31 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:04:04.818184 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=24 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:04:43.661836 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:04:43.681402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966db92-f76f-4524-a983-4779138d68d3 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:04:43.685038 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec44ca-2bd8-4baa-8454-f3cc01e4595f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:04:43.685698 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec44ca-2bd8-4baa-8454-f3cc01e4595f service neutron] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:04:43.685982 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec44ca-2bd8-4baa-8454-f3cc01e4595f service neutron] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:04:43.686254 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec44ca-2bd8-4baa-8454-f3cc01e4595f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:04:43.687983 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-d9ec44ca-2bd8-4baa-8454-f3cc01e4595f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:04:43.707462 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec44ca-2bd8-4baa-8454-f3cc01e4595f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:04:43.708875 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec44ca-2bd8-4baa-8454-f3cc01e4595f service neutron] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:04:43.716653 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4635/9297] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:04:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:04:53.713279 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=15 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:05:53.798615 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:05:53.839226 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e021f2-db33-4e5e-8a3d-9ec84f830929 service nova] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:05:53.845711 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded80701-5d06-44b4-a7f2-4b39b215cdcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:05:53.846297 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80701-5d06-44b4-a7f2-4b39b215cdcf service nova] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:05:53.846570 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80701-5d06-44b4-a7f2-4b39b215cdcf service nova] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:05:53.846838 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded80701-5d06-44b4-a7f2-4b39b215cdcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:05:53.854464 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80701-5d06-44b4-a7f2-4b39b215cdcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:05:53.856025 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded80701-5d06-44b4-a7f2-4b39b215cdcf service nova] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:05:53.864794 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4663/9298] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:05:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:06:01.888261 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe066f-acd6-42d6-baab-83317031cdc5 None None] REQUEST_METHOD: `POST` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:01.888753 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe066f-acd6-42d6-baab-83317031cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:01.888865 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe066f-acd6-42d6-baab-83317031cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:01.918133 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.auth.core [None req-dffe066f-acd6-42d6-baab-83317031cdc5 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81860) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:06:01.919321 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-dffe066f-acd6-42d6-baab-83317031cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:01.926474 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4636/9299] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 11 03:06:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:06:01.965961 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d4cb9-2033-4bad-88ab-2b39d6ebe334 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:01.966432 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d4cb9-2033-4bad-88ab-2b39d6ebe334 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:01.966547 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d4cb9-2033-4bad-88ab-2b39d6ebe334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:02.005681 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-942d4cb9-2033-4bad-88ab-2b39d6ebe334 None None] MFA Rules not processed for user `3ada7c97c73b43e09c30a603e648bcb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:06:02.006866 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-942d4cb9-2033-4bad-88ab-2b39d6ebe334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:02.015443 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4664/9300] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 11 03:06:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:06:02.021701 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe066f-acd6-42d6-baab-83317031cdc5 None None] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:02.033695 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe066f-acd6-42d6-baab-83317031cdc5 None None] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:02.038694 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:02.039225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:02.039502 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:02.039768 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:02.048225 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:02.049822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:02.057723 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4637/9301] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 03:06:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 03:06:11.610953 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1cae-502e-4acd-8b79-560a4c205691 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:11.611516 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1cae-502e-4acd-8b79-560a4c205691 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:11.611647 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1cae-502e-4acd-8b79-560a4c205691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:11.630946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-dd3c1cae-502e-4acd-8b79-560a4c205691 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:06:11.632146 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-dd3c1cae-502e-4acd-8b79-560a4c205691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:11.646109 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4665/9302] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 03:06:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:06:11.660257 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:11.671773 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf792d-f2e9-46bd-80d3-f2cf5e756123 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:11.676844 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:11.677486 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:11.677767 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:11.678042 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:11.686155 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:11.687721 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:11.695763 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4638/9303] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 03:06:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 03:06:15.203049 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d411-e4b3-4307-a3c0-46c4abd37f97 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:15.203595 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d411-e4b3-4307-a3c0-46c4abd37f97 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:15.203778 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d411-e4b3-4307-a3c0-46c4abd37f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:15.212927 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=36 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:06:15.227195 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-f860d411-e4b3-4307-a3c0-46c4abd37f97 None None] MFA Rules not processed for user `22f4d77320794bb39b2dda5daa402a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:06:15.228476 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-f860d411-e4b3-4307-a3c0-46c4abd37f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:15.240169 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4666/9304] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 03:06:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:06:15.255112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:15.269111 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3975a2-9bb3-4628-8c01-f3adac918cc8 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:15.274904 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f4d77320794bb39b2dda5daa402a16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:15.275678 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:15.275960 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:15.276355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:15.286948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:15.288552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:15.299876 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4639/9305] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:06:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 03:06:16.530855 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fdbc3-3edb-4d9f-862e-d9831b7ab111 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:16.531504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fdbc3-3edb-4d9f-862e-d9831b7ab111 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:16.531504 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fdbc3-3edb-4d9f-862e-d9831b7ab111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:16.551240 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-d50fdbc3-3edb-4d9f-862e-d9831b7ab111 None None] MFA Rules not processed for user `8ed929b0279d4e9f8910576741158c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:06:16.552420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-d50fdbc3-3edb-4d9f-862e-d9831b7ab111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:16.559541 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4667/9306] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 11 03:06:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:06:16.572312 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:16.583871 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b41c48-8fcf-41ba-89ba-f61baf8082c6 service nova] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:16.588817 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ada7c97c73b43e09c30a603e648bcb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:16.589444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:16.589728 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:16.590000 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:16.598802 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:16.600355 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:16.608298 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4640/9307] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 11 03:06:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 03:06:21.989016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fdbc3-3edb-4d9f-862e-d9831b7ab111 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:21.998250 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fdbc3-3edb-4d9f-862e-d9831b7ab111 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:22.002605 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b30da-58f5-4268-99e6-3daff6d77340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47323e4e757c49eea3e6695a68fc267a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:22.003196 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b30da-58f5-4268-99e6-3daff6d77340 service neutron] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:22.003468 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b30da-58f5-4268-99e6-3daff6d77340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:22.003736 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b30da-58f5-4268-99e6-3daff6d77340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:22.063398 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b30da-58f5-4268-99e6-3daff6d77340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:22.064832 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b30da-58f5-4268-99e6-3daff6d77340 service neutron] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:22.074392 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4668/9308] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:06:25.248157 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:25.254284 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=32 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:06:25.275082 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bae218-6f73-4213-9625-2336e16fb4f2 service swift] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:25.280605 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:25.281850 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:25.282135 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:25.282402 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:25.284452 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:25.321948 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:25.323552 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:25.335011 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4641/9309] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:06:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:06:28.129946 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384b62-6f40-4fa8-9ba9-43e096ba5c94 None None] REQUEST_METHOD: `POST` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:28.130797 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384b62-6f40-4fa8-9ba9-43e096ba5c94 None None] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:28.131144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384b62-6f40-4fa8-9ba9-43e096ba5c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:28.176106 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.auth.core [None req-ff384b62-6f40-4fa8-9ba9-43e096ba5c94 None None] MFA Rules not processed for user `639fb5545d5a475b9c8bd973c3af520a`. Rule list: `[]` (Enabled: `True`). {{(pid=81859) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 03:06:28.177363 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-ff384b62-6f40-4fa8-9ba9-43e096ba5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:28.186631 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4669/9310] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 11 03:06:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 03:06:28.200506 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:28.217134 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384b62-6f40-4fa8-9ba9-43e096ba5c94 None None] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:28.218377 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efd9ce-b89e-4728-8d0c-5f7fa581ddf2 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:28.224985 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:28.226451 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:28.226920 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:28.227359 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:28.232760 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384b62-6f40-4fa8-9ba9-43e096ba5c94 None None] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:28.237580 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:28.239218 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:28.241161 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:28.241825 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:28.242109 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:28.242500 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] PATH_INFO: `/v3/users/bcbe9a80df574bbb88fd983cf3345fef` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:28.243688 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbe9a80df574bbb88fd983cf3345fef)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:28.246892 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:28.252740 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4642/9311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:06:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:06:28.306144 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbe9a80df574bbb88fd983cf3345fef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.306812 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbe9a80df574bbb88fd983cf3345fef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.307420 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbe9a80df574bbb88fd983cf3345fef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.320229 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbe9a80df574bbb88fd983cf3345fef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.327212 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbe9a80df574bbb88fd983cf3345fef'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.349184 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4670/9312] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 03:06:28 2022] DELETE /identity/v3/users/bcbe9a80df574bbb88fd983cf3345fef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 03:06:28.534026 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:28.547146 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b63b1-6534-43f5-9dca-c702a3189700 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:28.604165 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:28.604791 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:28.605086 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:28.605390 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] PATH_INFO: `/v3/projects/38c2be22471443148fc101c4652332cb` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:28.606501 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c2be22471443148fc101c4652332cb)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:28.608381 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:28.653822 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c2be22471443148fc101c4652332cb', 'request_id': 'req-625495e9-47e7-49de-8166-6dbe2bb9973a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.659951 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c2be22471443148fc101c4652332cb', 'request_id': 'req-625495e9-47e7-49de-8166-6dbe2bb9973a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.667080 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c2be22471443148fc101c4652332cb', 'request_id': 'req-625495e9-47e7-49de-8166-6dbe2bb9973a'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.677278 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] The token cache is being invalidate because project 38c2be22471443148fc101c4652332cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 03:06:28.677563 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.678682 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.680174 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4643/9313] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 03:06:28 2022] DELETE /identity/v3/projects/38c2be22471443148fc101c4652332cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:06:28.684130 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:28.685642 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:28.699973 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42939a70-a93d-48ae-a250-2bbc8c8874e6 admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:28.734179 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:06:28.761217 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:28.761852 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:28.762135 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:28.762406 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] PATH_INFO: `/v3/users/0ab822c889274ed296376fdbd2959b00` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:28.763540 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab822c889274ed296376fdbd2959b00)` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:28.765560 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:28.813018 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab822c889274ed296376fdbd2959b00'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.813704 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab822c889274ed296376fdbd2959b00'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.814313 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab822c889274ed296376fdbd2959b00'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.826177 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab822c889274ed296376fdbd2959b00'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.833670 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.notifications [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab822c889274ed296376fdbd2959b00'} {{(pid=81859) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:28.846763 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4671/9314] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 11 03:06:28 2022] DELETE /identity/v3/users/0ab822c889274ed296376fdbd2959b00 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:06:29.022248 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:29.023973 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:29.038495 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625495e9-47e7-49de-8166-6dbe2bb9973a admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:29.083398 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:06:29.099025 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f315e7427b614b24bed4c1fa5addb708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677f08d32cea40f083b85bb0df613dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:29.099659 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:29.099935 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:29.100226 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] PATH_INFO: `/v3/projects/cd9aa69a610e4de598a210ae4f03c10a` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:29.101367 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9aa69a610e4de598a210ae4f03c10a)` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:29.103277 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:29.149784 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9aa69a610e4de598a210ae4f03c10a', 'request_id': 'req-951f0609-6633-45cc-b135-35a49aeb6121'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:29.156166 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9aa69a610e4de598a210ae4f03c10a', 'request_id': 'req-951f0609-6633-45cc-b135-35a49aeb6121'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:29.163444 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9aa69a610e4de598a210ae4f03c10a', 'request_id': 'req-951f0609-6633-45cc-b135-35a49aeb6121'} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:29.174159 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] The token cache is being invalidate because project cd9aa69a610e4de598a210ae4f03c10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81860) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 03:06:29.174463 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:29.175078 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.notifications [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81860) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 03:06:29.176589 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4644/9315] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 11 03:06:29 2022] DELETE /identity/v3/projects/cd9aa69a610e4de598a210ae4f03c10a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 03:06:38.842811 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:06:39.170691 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:06:53.937183 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:06:53.939488 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:54.009968 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2c1a-37d3-4a3b-964a-d66cc0a85fca admin admin] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:06:54.071092 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:06:54.071624 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:06:54.071908 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:06:54.072187 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:06:54.073923 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.fernet_utils [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81859) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:06:54.085456 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:06:54.087016 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:06:54.096950 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4672/9316] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:06:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:07:04.092782 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=58 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:07:58.992742 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:07:58.994582 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:07:59.009154 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f0609-6633-45cc-b135-35a49aeb6121 admin admin] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:07:59.014264 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:07:59.014984 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:07:59.015131 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:07:59.015400 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:07:59.017112 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.fernet_utils [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81860) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 03:07:59.029873 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:07:59.031489 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:07:59.042426 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4645/9317] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:07:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:08:09.038133 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:12:00.919384 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] Authenticating user token {{(pid=81859) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:12:00.929710 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa99bc1-1b8a-4d69-aa0b-6a6207744c3d service placement] Validating token access rules against request {{(pid=81859) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:12:00.935192 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f99a20-677c-4412-8dd6-077e3a6bf258 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81859) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:12:00.935779 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99a20-677c-4412-8dd6-077e3a6bf258 service placement] REQUEST_METHOD: `GET` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:12:00.936053 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99a20-677c-4412-8dd6-077e3a6bf258 service placement] SCRIPT_NAME: `/identity` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:12:00.936327 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99a20-677c-4412-8dd6-077e3a6bf258 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81859) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:12:00.944518 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f99a20-677c-4412-8dd6-077e3a6bf258 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:12:00.946098 n-d-master-1 devstack@keystone.service[81859]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f99a20-677c-4412-8dd6-077e3a6bf258 service placement] RBAC: Authorization granted {{(pid=81859) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:12:00.956271 n-d-master-1 devstack@keystone.service[81859]: [pid: 81859|app: 0|req: 4673/9318] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:12:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:12:10.952354 n-d-master-1 devstack@keystone.service[81859]: DEBUG dbcounter [-] [81859] Writing DB stats keystone:SELECT=6 {{(pid=81859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 03:13:01.939601 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] Authenticating user token {{(pid=81860) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 03:13:01.949940 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dceb6eb-c6f5-4058-807e-97de5d891542 service placement] Validating token access rules against request {{(pid=81860) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 03:13:01.955644 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490fd75-0c19-43b3-b833-e8a8c33bd034 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639fb5545d5a475b9c8bd973c3af520a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ae874a8b86641ac95888a289db15c54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81860) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 03:13:01.956238 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fd75-0c19-43b3-b833-e8a8c33bd034 service placement] REQUEST_METHOD: `GET` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 03:13:01.956517 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fd75-0c19-43b3-b833-e8a8c33bd034 service placement] SCRIPT_NAME: `/identity` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 03:13:01.957034 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490fd75-0c19-43b3-b833-e8a8c33bd034 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81860) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 03:13:01.965947 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490fd75-0c19-43b3-b833-e8a8c33bd034 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 03:13:01.967679 n-d-master-1 devstack@keystone.service[81860]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490fd75-0c19-43b3-b833-e8a8c33bd034 service placement] RBAC: Authorization granted {{(pid=81860) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 03:13:01.977980 n-d-master-1 devstack@keystone.service[81860]: [pid: 81860|app: 0|req: 4646/9319] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 11 03:13:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 03:13:11.973662 n-d-master-1 devstack@keystone.service[81860]: DEBUG dbcounter [-] [81860] Writing DB stats keystone:SELECT=6 {{(pid=81860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}